2024-04-26T12:36:13.914 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T12:36:13.915 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} --archive /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722 --name cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi --verbose --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/orig.config.yaml 2024-04-26T12:36:13.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:36:14.030 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722 branch: wip-cbodley2-testing description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7674722' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cbodley2-testing ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley2-testing sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 8596 sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley2-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFd7BgzkXxaFdK4DXaIi4yrqqT2S58K9cpVvtNan3lMwFLAks3Etc2cjtXGDmoznkDftMroLUN3PIPgyEmfZ6mA= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCCzL6QvzSYr6TMP2b/PS44MCRAWQe4wUTwSSPUm6m1TfWtECOVM9PZkvlt7I+pZFsmJVyUkLKPzIjtY0mI6Mao= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_12:10:35 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T12:36:14.030 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa; will attempt to use it 2024-04-26T12:36:14.031 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa/tasks 2024-04-26T12:36:14.031 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T12:36:14.033 INFO:teuthology.task.internal:Checking packages... 2024-04-26T12:36:14.060 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0' 2024-04-26T12:36:14.060 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T12:36:14.060 INFO:teuthology.packaging:ref: None 2024-04-26T12:36:14.060 INFO:teuthology.packaging:tag: None 2024-04-26T12:36:14.060 INFO:teuthology.packaging:branch: wip-cbodley2-testing 2024-04-26T12:36:14.060 INFO:teuthology.packaging:sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:36:14.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cbodley2-testing 2024-04-26T12:36:14.225 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:36:14.227 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T12:36:14.234 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T12:36:14.234 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T12:36:14.241 INFO:teuthology.task.internal:Saving configuration 2024-04-26T12:36:14.253 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T12:36:14.259 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T12:36:14.282 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:29:29.204211', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICtTMKY9c9uICFs3lzrFVxwqsj5nNoWcvbi7bFgyd7uD'} 2024-04-26T12:36:14.302 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:29:29.205846', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMK4QUgOed2ObJTgvjJhSTy68G0R5CSs2LWeZ+GGZr2V'} 2024-04-26T12:36:14.302 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T12:36:14.308 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-26T12:36:14.308 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-26T12:36:14.308 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T12:36:14.381 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9736543280>, signals=[15]) 2024-04-26T12:36:14.382 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T12:36:14.388 INFO:teuthology.task.internal:Opening connections... 2024-04-26T12:36:14.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T12:36:14.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:36:14.473 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:36:14.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:36:14.557 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T12:36:14.564 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-26T12:36:14.570 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-26T12:36:14.570 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04" 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T12:36:14.617 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T12:36:14.618 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T12:36:14.618 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T12:36:14.618 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy 2024-04-26T12:36:14.618 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-26T12:36:14.644 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-04-26T12:36:14.649 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-04-26T12:36:14.650 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-26T12:36:14.695 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T12:36:14.695 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2024-04-26T12:36:14.695 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T12:36:14.696 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2024-04-26T12:36:14.696 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-26T12:36:14.728 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T12:36:14.737 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T12:36:14.748 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T12:36:14.748 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:36:14.751 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:36:14.755 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T12:36:14.761 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T12:36:14.761 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:36:14.798 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:36:14.812 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T12:36:14.868 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T12:36:14.886 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-26T12:36:14.886 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-26T12:36:14.886 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:36:14.887 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:36:14.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:36:14.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:36:14.892 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-26T12:36:14.892 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-26T12:36:14.939 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-56-generic 2024-04-26T12:36:14.940 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.15.0-56-generic 2024-04-26T12:36:14.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-04-26T12:36:14.942 INFO:teuthology.orchestra.run.smithi029.stdout:5.15.0-56-generic 2024-04-26T12:36:14.942 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.15.0-56-generic 2024-04-26T12:36:14.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2024-04-26T12:36:15.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-26T12:36:15.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-26T12:36:15.235 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T12:36:15.246 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:36:15.247 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T12:36:15.247 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T12:36:15.329 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T12:36:15.335 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:36:15.412 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T12:36:15.496 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T12:36:15.509 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T12:36:15.591 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-26T12:36:15.613 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T12:36:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T12:36:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T12:36:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T12:36:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T12:36:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T12:36:15.655 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T12:36:15.660 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T12:36:15.666 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T12:36:15.666 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T12:36:15.667 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T12:36:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T12:36:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:36:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T12:36:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T12:36:15.691 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T12:36:15.692 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T12:36:15.694 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T12:36:15.695 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T12:36:15.695 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T12:36:15.702 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T12:36:15.706 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:36:15.707 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T12:36:15.717 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T12:36:15.718 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T12:36:15.724 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T12:36:15.730 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T12:36:15.775 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T12:36:15.778 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T12:36:15.778 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T12:36:15.781 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T12:36:15.781 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T12:36:15.781 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T12:36:15.781 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T12:36:15.781 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T12:36:15.781 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T12:36:15.815 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T12:36:15.820 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:36:15.820 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T12:36:15.829 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T12:36:15.841 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T12:36:15.843 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T12:36:15.844 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T12:36:15.844 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T12:36:15.845 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T12:36:15.845 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T12:36:15.862 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T12:36:15.862 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T12:36:15.863 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T12:36:15.882 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T12:36:15.882 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T12:36:15.882 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T12:36:15.883 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T12:36:15.883 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T12:36:15.914 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-26T12:36:16.114 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T12:36:16.264 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T12:36:16.279 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T12:36:16.279 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T12:36:16.281 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T12:36:16.343 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T12:36:16.350 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:36:16.513 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T12:36:17.094 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T12:36:17.204 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T12:36:17.224 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T12:36:17.225 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T12:36:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T12:36:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T12:36:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T12:36:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T12:36:17.235 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T12:36:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T12:36:17.406 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T12:36:17.493 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T12:36:17.608 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T12:36:17.659 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T12:36:17.691 INFO:teuthology.orchestra.run.smithi029.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T12:36:21.558 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 13.2 MB in 2s (6,831 kB/s) 2024-04-26T12:36:22.802 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 13.2 MB in 3s (5,184 kB/s) 2024-04-26T12:36:23.841 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T12:36:23.858 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:36:23.924 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T12:36:24.125 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-26T12:36:24.125 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-26T12:36:24.300 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:36:24.301 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:36:24.301 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:36:24.301 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:36:24.301 INFO:teuthology.orchestra.run.smithi072.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T12:36:24.301 INFO:teuthology.orchestra.run.smithi072.stdout: python2.7-minimal 2024-04-26T12:36:24.301 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:36:24.302 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-04-26T12:36:24.302 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:36:24.303 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T12:36:24.303 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T12:36:24.304 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-26T12:36:24.305 INFO:teuthology.orchestra.run.smithi072.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T12:36:24.305 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-04-26T12:36:24.305 INFO:teuthology.orchestra.run.smithi072.stdout: thermald 2024-04-26T12:36:24.363 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-26T12:36:24.363 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:36:24.363 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T12:36:24.363 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T12:36:24.364 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-04-26T12:36:24.365 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T12:36:24.544 INFO:teuthology.orchestra.run.smithi072.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:36:24.544 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 113 MB of archives. 2024-04-26T12:36:24.544 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T12:36:24.544 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T12:36:25.109 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T12:36:25.128 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:36:25.191 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T12:36:25.378 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-26T12:36:25.379 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-26T12:36:25.539 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:36:25.539 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:36:25.539 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:36:25.540 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:36:25.540 INFO:teuthology.orchestra.run.smithi029.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T12:36:25.540 INFO:teuthology.orchestra.run.smithi029.stdout: python2.7-minimal 2024-04-26T12:36:25.540 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:36:25.541 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-04-26T12:36:25.541 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:36:25.541 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T12:36:25.541 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T12:36:25.542 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-26T12:36:25.542 INFO:teuthology.orchestra.run.smithi029.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T12:36:25.542 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2024-04-26T12:36:25.542 INFO:teuthology.orchestra.run.smithi029.stdout: thermald 2024-04-26T12:36:25.591 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-26T12:36:25.591 INFO:teuthology.orchestra.run.smithi029.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:36:25.591 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T12:36:25.592 INFO:teuthology.orchestra.run.smithi029.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T12:36:25.593 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages will be upgraded: 2024-04-26T12:36:25.593 INFO:teuthology.orchestra.run.smithi029.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T12:36:25.652 INFO:teuthology.orchestra.run.smithi029.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:36:25.653 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 113 MB of archives. 2024-04-26T12:36:25.653 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T12:36:25.653 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T12:36:25.968 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T12:36:26.195 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T12:36:26.318 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T12:36:26.334 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T12:36:27.682 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T12:36:27.682 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T12:36:27.683 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T12:36:28.075 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T12:36:28.134 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T12:36:28.574 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 113 MB in 3s (44.7 MB/s) 2024-04-26T12:36:28.793 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T12:36:28.793 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T12:36:28.793 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T12:36:28.824 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T12:36:29.778 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T12:36:29.874 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T12:36:30.263 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 113 MB in 6s (20.6 MB/s) 2024-04-26T12:36:30.450 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T12:36:31.872 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T12:36:31.879 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:31.958 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:33.408 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T12:36:33.413 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:33.632 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:35.097 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T12:36:35.119 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:35.218 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:35.818 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T12:36:35.839 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:35.878 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:36.222 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T12:36:36.243 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:36.336 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:36.887 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T12:36:36.908 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:36.954 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:44.087 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:36:44.214 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:36:44.576 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:36:44.696 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:36:44.897 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:36:45.014 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:36:45.349 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:36:45.387 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T12:36:45.410 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T12:36:45.461 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:36:45.464 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:36:45.768 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T12:36:45.780 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T12:36:45.819 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:36:53.077 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T12:36:53.114 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:53.343 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T12:36:53.369 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:36:53.409 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:55.843 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:36:55.965 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:36:56.155 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:36:56.282 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:36:56.337 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:36:56.484 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:56.644 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:36:56.654 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T12:36:56.758 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:56.783 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:56.886 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T12:36:57.411 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:58.532 INFO:teuthology.orchestra.run.smithi029.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:36:58.532 INFO:teuthology.orchestra.run.smithi029.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T12:36:58.532 INFO:teuthology.orchestra.run.smithi029.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:36:58.532 INFO:teuthology.orchestra.run.smithi029.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T12:36:58.784 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:36:59.810 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:36:59.811 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T12:36:59.811 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:36:59.811 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T12:36:59.983 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:37:00.263 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:37:01.396 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:37:01.706 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T12:37:01.835 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T12:37:01.945 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:37:02.054 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T12:37:02.054 INFO:teuthology.orchestra.run.smithi029.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:37:02.798 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T12:37:02.925 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T12:37:03.045 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:37:03.108 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T12:37:03.108 INFO:teuthology.orchestra.run.smithi072.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:37:19.693 INFO:teuthology.orchestra.run.smithi029.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T12:37:19.694 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub' 2024-04-26T12:37:19.716 INFO:teuthology.orchestra.run.smithi029.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:37:19.739 INFO:teuthology.orchestra.run.smithi029.stdout:Generating grub configuration file ... 2024-04-26T12:37:20.084 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:37:20.130 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:37:20.279 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T12:37:20.279 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub' 2024-04-26T12:37:20.303 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:37:20.325 INFO:teuthology.orchestra.run.smithi072.stdout:Generating grub configuration file ... 2024-04-26T12:37:20.469 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:37:20.475 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:37:20.562 INFO:teuthology.orchestra.run.smithi029.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:37:20.568 INFO:teuthology.orchestra.run.smithi029.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:37:20.638 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:37:20.692 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:37:20.886 INFO:teuthology.orchestra.run.smithi029.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:37:20.886 INFO:teuthology.orchestra.run.smithi029.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:37:20.887 INFO:teuthology.orchestra.run.smithi029.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:37:20.988 INFO:teuthology.orchestra.run.smithi029.stdout:done 2024-04-26T12:37:20.988 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:37:20.994 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:37:21.079 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:37:21.085 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:37:21.381 INFO:teuthology.orchestra.run.smithi072.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:37:21.382 INFO:teuthology.orchestra.run.smithi072.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:37:21.382 INFO:teuthology.orchestra.run.smithi072.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:37:21.466 INFO:teuthology.orchestra.run.smithi072.stdout:done 2024-04-26T12:37:21.622 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2024-04-26T12:37:21.643 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 21 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.15.0.105.102 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:37:21.644 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2024-04-26T12:37:21.645 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T12:37:21.646 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:37:21.646 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:37:21.646 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T12:37:21.646 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:37:21.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get clean 2024-04-26T12:37:21.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-26T12:37:21.985 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:37:21.987 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T12:37:22.001 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-04-26T12:37:22.008 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T12:37:22.030 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-04-26T12:37:22.030 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-04-26T12:37:22.030 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-04-26T12:37:22.030 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-04-26T12:37:22.030 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-04-26T12:37:22.030 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:37:22.030 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.105.102 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:37:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-04-26T12:37:22.031 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T12:37:22.031 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:37:22.032 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:37:22.032 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-04-26T12:37:22.032 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:37:22.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-04-26T12:37:22.123 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T12:37:22.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-26T12:37:22.348 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:37:22.359 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T12:37:22.379 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T12:37:22.465 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T12:37:23.443 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T12:37:23.463 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:37:23.528 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T12:37:23.739 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-26T12:37:23.740 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T12:37:23.740 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-26T12:37:23.758 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:37:23.808 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T12:37:23.928 INFO:teuthology.orchestra.run.smithi029.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T12:37:23.928 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:37:23.928 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:37:23.928 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:37:23.928 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:37:23.929 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:37:23.929 INFO:teuthology.orchestra.run.smithi029.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:37:23.929 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:37:23.973 INFO:teuthology.orchestra.run.smithi029.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:37:23.975 DEBUG:teuthology.orchestra.run.smithi029:> dpkg -s linux-image-generic 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Package: linux-image-generic 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Status: install ok installed 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Priority: optional 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Section: kernel 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Installed-Size: 21 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: amd64 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Source: linux-meta 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Version: 5.15.0.105.102 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:37:23.991 INFO:teuthology.orchestra.run.smithi029.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:37:23.992 INFO:teuthology.orchestra.run.smithi029.stdout:Recommends: thermald 2024-04-26T12:37:23.992 INFO:teuthology.orchestra.run.smithi029.stdout:Description: Generic Linux kernel image 2024-04-26T12:37:23.992 INFO:teuthology.orchestra.run.smithi029.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:37:23.992 INFO:teuthology.orchestra.run.smithi029.stdout: available. 2024-04-26T12:37:23.992 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T12:37:23.993 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-26T12:37:23.993 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-26T12:37:24.036 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.jJiMdPX4n0 2024-04-26T12:37:24.037 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jJiMdPX4n0 2024-04-26T12:37:24.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.jJiMdPX4n0 2024-04-26T12:37:24.151 INFO:teuthology.orchestra.run.smithi072.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T12:37:24.152 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:37:24.152 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:37:24.152 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:37:24.152 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:37:24.152 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:37:24.152 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:37:24.153 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:37:24.191 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:37:24.193 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-04-26T12:37:24.216 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.jJiMdPX4n0 is 10KB 2024-04-26T12:37:24.229 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.jJiMdPX4n0 2024-04-26T12:37:24.234 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T12:37:24.249 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-04-26T12:37:24.249 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-04-26T12:37:24.249 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-04-26T12:37:24.249 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-04-26T12:37:24.249 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-04-26T12:37:24.249 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.105.102 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:37:24.250 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-04-26T12:37:24.251 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-26T12:37:24.287 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:37:24.287 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T12:37:24.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T12:37:24.294 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.ZhUh4MxCTe 2024-04-26T12:37:24.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZhUh4MxCTe 2024-04-26T12:37:24.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.ZhUh4MxCTe 2024-04-26T12:37:24.372 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T12:37:24.373 DEBUG:teuthology.orchestra.run.smithi029:> sudo update-grub 2024-04-26T12:37:24.480 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.ZhUh4MxCTe is 10KB 2024-04-26T12:37:24.493 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.ZhUh4MxCTe 2024-04-26T12:37:24.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T12:37:24.550 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:37:24.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T12:37:24.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T12:37:24.652 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T12:37:24.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo update-grub 2024-04-26T12:37:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub' 2024-04-26T12:37:26.724 INFO:teuthology.orchestra.run.smithi029.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:37:26.746 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-04-26T12:37:26.830 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub' 2024-04-26T12:37:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:37:26.859 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-04-26T12:37:26.950 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:37:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:37:27.070 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:37:27.076 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:37:27.197 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:37:27.202 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:37:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:37:27.248 INFO:teuthology.orchestra.run.smithi029.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:37:27.316 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:37:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:37:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:37:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:37:27.356 INFO:teuthology.orchestra.run.smithi029.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:37:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:37:27.365 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:37:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-04-26T12:37:27.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-04-26T12:37:27.484 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:37:27.485 INFO:teuthology.orchestra.run.smithi072.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:37:27.485 INFO:teuthology.orchestra.run.smithi072.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:37:27.523 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-04-26T12:37:27.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-04-26T12:37:57.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T12:37:57.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T12:37:57.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:37:57.527 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-04-26T12:37:57.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T12:37:57.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:38:32.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-26T12:38:41.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T12:38:41.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:38:57.455 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T12:38:59.618 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-26T12:39:06.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T12:39:06.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:39:11.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T12:39:11.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:39:11.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-26T12:39:21.891 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-26T12:39:26.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T12:39:26.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:39:26.860 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T12:39:27.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T12:39:27.529 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-105-generic"... 2024-04-26T12:39:27.529 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-26T12:39:27.576 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-105-generic 2024-04-26T12:39:27.576 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T12:39:27.576 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:39:27.577 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T12:39:28.577 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-26T12:39:28.578 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:39:28.709 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-04-26T12:39:28.731 DEBUG:teuthology.parallel:result is None 2024-04-26T12:39:33.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T12:39:33.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:39:34.223 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-26T12:39:35.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T12:39:35.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-26T12:39:35.050 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-26T12:39:35.097 INFO:teuthology.orchestra.run.smithi029.stdout:5.15.0-105-generic 2024-04-26T12:39:35.097 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T12:39:35.097 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:39:35.097 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T12:39:36.098 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T12:39:36.099 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:39:36.199 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-04-26T12:39:36.218 DEBUG:teuthology.parallel:result is None 2024-04-26T12:39:36.218 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T12:39:36.225 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T12:39:36.226 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:39:36.228 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:39:36.234 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T12:39:36.241 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T12:39:36.249 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T12:39:36.250 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:39:36.274 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:39:36.292 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T12:39:36.299 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T12:39:36.299 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:39:36.330 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:39:36.349 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:39:36.352 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:39:36.358 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:39:36.360 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:39:36.362 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T12:39:36.369 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T12:39:36.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:39:36.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:39:36.416 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T12:39:36.425 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T12:39:36.425 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:39:36.458 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:39:36.464 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:39:36.509 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:39:36.557 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:39:36.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:39:36.615 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:39:36.621 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:39:36.669 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:39:36.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:39:36.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-04-26T12:39:36.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-04-26T12:39:36.823 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T12:39:36.831 INFO:teuthology.task.internal:Starting timer... 2024-04-26T12:39:36.831 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T12:39:36.843 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T12:39:36.851 DEBUG:teuthology.task.selinux:Excluding smithi029: OS 'ubuntu' does not support SELinux 2024-04-26T12:39:36.852 DEBUG:teuthology.task.selinux:Excluding smithi072: OS 'ubuntu' does not support SELinux 2024-04-26T12:39:36.852 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T12:39:36.852 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T12:39:36.852 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T12:39:36.852 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T12:39:36.861 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T12:39:36.866 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T12:39:36.993 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T12:39:37.010 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T12:39:37.011 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi072.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:46:58.467 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com')] 2024-04-26T12:46:58.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T12:46:58.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:46:58.554 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-26T12:46:58.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T12:46:58.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T12:46:58.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:46:58.716 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T12:46:58.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T12:46:58.791 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:46:58.802 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:46:58.802 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:46:58.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:46:58.805 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:46:58.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:46:58.834 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T12:46:58.834 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Command line: ntpd -gq 2024-04-26T12:46:58.835 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: ---------------------------------------------------- 2024-04-26T12:46:58.835 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T12:46:58.835 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T12:46:58.835 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: corporation. Support and training for ntp-4 are 2024-04-26T12:46:58.835 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: available at https://www.nwtime.org/support 2024-04-26T12:46:58.835 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: ---------------------------------------------------- 2024-04-26T12:46:58.836 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: proto: precision = 0.045 usec (-24) 2024-04-26T12:46:58.836 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: basedate set to 2022-02-04 2024-04-26T12:46:58.836 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: gps base set to 2022-02-06 (week 2196) 2024-04-26T12:46:58.836 INFO:teuthology.orchestra.run.smithi029.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:46:58.837 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:46:58.837 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:46:58.837 INFO:teuthology.orchestra.run.smithi029.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:46:58.838 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T12:46:58.838 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T12:46:58.838 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T12:46:58.838 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Listen normally on 3 ens1f0 172.21.15.29:123 2024-04-26T12:46:58.838 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Listen normally on 4 lo [::1]:123 2024-04-26T12:46:58.838 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:125a%4]:123 2024-04-26T12:46:58.838 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:46:58 ntpd[17140]: Listening on routing socket on fd #22 for interface updates 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Command line: ntpd -gq 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: ---------------------------------------------------- 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: corporation. Support and training for ntp-4 are 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: available at https://www.nwtime.org/support 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: ---------------------------------------------------- 2024-04-26T12:46:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: proto: precision = 0.057 usec (-24) 2024-04-26T12:46:58.862 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: basedate set to 2022-02-04 2024-04-26T12:46:58.862 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: gps base set to 2022-02-06 (week 2196) 2024-04-26T12:46:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:46:58.863 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:46:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:46:58.864 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:46:58.864 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T12:46:58.864 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T12:46:58.864 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T12:46:58.864 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Listen normally on 3 enp3s0f1 172.21.15.72:123 2024-04-26T12:46:58.865 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Listen normally on 4 lo [::1]:123 2024-04-26T12:46:58.865 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:b765%5]:123 2024-04-26T12:46:58.865 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:46:58 ntpd[17259]: Listening on routing socket on fd #22 for interface updates 2024-04-26T12:46:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:46:59.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:46:59 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:46:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:46:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:46:59 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:01 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:01.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:01.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:01.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:01.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:01.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:01.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:01 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:02 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:02.835 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:02 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:02 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:02 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:02 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:02.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:02 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:03.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:03.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:03 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:03.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:03 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:04.835 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:04 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:04.835 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:04 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:04.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:04 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:04.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:04 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:04.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:04 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:04.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:04 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:05.835 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stdout:26 Apr 12:47:05 ntpd[17140]: ntpd: time slew -0.000226 s 2024-04-26T12:47:05.836 INFO:teuthology.orchestra.run.smithi029.stdout:ntpd: time slew -0.000226s 2024-04-26T12:47:05.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T12:47:05.837 INFO:teuthology.orchestra.run.smithi029.stderr:26 Apr 12:47:05 ntpd[17140]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T12:47:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stdout:26 Apr 12:47:05 ntpd[17259]: ntpd: time slew -0.000006 s 2024-04-26T12:47:05.863 INFO:teuthology.orchestra.run.smithi072.stdout:ntpd: time slew -0.000006s 2024-04-26T12:47:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T12:47:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:26 Apr 12:47:05 ntpd[17259]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T12:47:05.893 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:47:05.893 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-04-26T12:47:05.893 INFO:teuthology.orchestra.run.smithi029.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.893 INFO:teuthology.orchestra.run.smithi029.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.893 INFO:teuthology.orchestra.run.smithi029.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.893 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.910 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:47:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-04-26T12:47:05.910 INFO:teuthology.orchestra.run.smithi072.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.910 INFO:teuthology.orchestra.run.smithi072.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.910 INFO:teuthology.orchestra.run.smithi072.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.910 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:47:05.911 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:47:05.922 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:47:05.922 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}} 2024-04-26T12:47:05.922 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'} 2024-04-26T12:47:05.922 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:47:05.928 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:47:05.928 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:47:05.929 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-key list | grep Ceph 2024-04-26T12:47:05.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-key list | grep Ceph 2024-04-26T12:47:05.996 INFO:teuthology.orchestra.run.smithi029.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T12:47:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T12:47:06.028 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T12:47:06.028 INFO:teuthology.orchestra.run.smithi029.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T12:47:06.029 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T12:47:06.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:47:06.035 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T12:47:06.035 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T12:47:06.036 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T12:47:06.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:47:06.281 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default/ 2024-04-26T12:47:06.281 INFO:teuthology.task.install.deb:Package version is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:47:06.298 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default/ 2024-04-26T12:47:06.298 INFO:teuthology.task.install.deb:Package version is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:47:06.410 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:47:06.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T12:47:06.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-04-26T12:47:06.465 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:47:06.465 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T12:47:06.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo apt-get update 2024-04-26T12:47:06.597 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:47:06.597 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T12:47:06.609 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T12:47:06.629 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T12:47:06.644 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T12:47:06.655 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:47:06.655 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T12:47:06.665 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T12:47:06.667 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T12:47:06.687 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T12:47:06.690 INFO:teuthology.orchestra.run.smithi029.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T12:47:06.702 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T12:47:06.708 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-26T12:47:06.721 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T12:47:06.735 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T12:47:06.743 INFO:teuthology.orchestra.run.smithi029.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T12:47:06.764 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T12:47:06.791 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-26T12:47:06.950 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 29.0 kB in 0s (83.3 kB/s) 2024-04-26T12:47:07.029 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 29.0 kB in 0s (77.9 kB/s) 2024-04-26T12:47:07.933 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T12:47:07.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2451-g7fad7ff2-1jammy cephadm=19.0.0-2451-g7fad7ff2-1jammy ceph-mds=19.0.0-2451-g7fad7ff2-1jammy ceph-mgr=19.0.0-2451-g7fad7ff2-1jammy ceph-common=19.0.0-2451-g7fad7ff2-1jammy ceph-fuse=19.0.0-2451-g7fad7ff2-1jammy ceph-test=19.0.0-2451-g7fad7ff2-1jammy ceph-volume=19.0.0-2451-g7fad7ff2-1jammy radosgw=19.0.0-2451-g7fad7ff2-1jammy python3-rados=19.0.0-2451-g7fad7ff2-1jammy python3-rgw=19.0.0-2451-g7fad7ff2-1jammy python3-cephfs=19.0.0-2451-g7fad7ff2-1jammy python3-rbd=19.0.0-2451-g7fad7ff2-1jammy libcephfs2=19.0.0-2451-g7fad7ff2-1jammy libcephfs-dev=19.0.0-2451-g7fad7ff2-1jammy librados2=19.0.0-2451-g7fad7ff2-1jammy librbd1=19.0.0-2451-g7fad7ff2-1jammy rbd-fuse=19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:47:07.998 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-04-26T12:47:08.008 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T12:47:08.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2451-g7fad7ff2-1jammy cephadm=19.0.0-2451-g7fad7ff2-1jammy ceph-mds=19.0.0-2451-g7fad7ff2-1jammy ceph-mgr=19.0.0-2451-g7fad7ff2-1jammy ceph-common=19.0.0-2451-g7fad7ff2-1jammy ceph-fuse=19.0.0-2451-g7fad7ff2-1jammy ceph-test=19.0.0-2451-g7fad7ff2-1jammy ceph-volume=19.0.0-2451-g7fad7ff2-1jammy radosgw=19.0.0-2451-g7fad7ff2-1jammy python3-rados=19.0.0-2451-g7fad7ff2-1jammy python3-rgw=19.0.0-2451-g7fad7ff2-1jammy python3-cephfs=19.0.0-2451-g7fad7ff2-1jammy python3-rbd=19.0.0-2451-g7fad7ff2-1jammy libcephfs2=19.0.0-2451-g7fad7ff2-1jammy libcephfs-dev=19.0.0-2451-g7fad7ff2-1jammy librados2=19.0.0-2451-g7fad7ff2-1jammy librbd1=19.0.0-2451-g7fad7ff2-1jammy rbd-fuse=19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:47:08.076 INFO:teuthology.orchestra.run.smithi029.stdout:Reading package lists... 2024-04-26T12:47:08.174 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-04-26T12:47:08.174 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-04-26T12:47:08.257 INFO:teuthology.orchestra.run.smithi029.stdout:Building dependency tree... 2024-04-26T12:47:08.257 INFO:teuthology.orchestra.run.smithi029.stdout:Reading state information... 2024-04-26T12:47:08.347 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:47:08.347 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:47:08.347 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:47:08.347 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:47:08.347 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:47:08.347 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:47:08.347 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T12:47:08.351 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T12:47:08.352 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet zip 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-04-26T12:47:08.353 INFO:teuthology.orchestra.run.smithi072.stdout: btrfs-tools 2024-04-26T12:47:08.437 INFO:teuthology.orchestra.run.smithi029.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:47:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:47:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:47:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:47:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:47:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:47:08.438 INFO:teuthology.orchestra.run.smithi029.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:47:08.439 INFO:teuthology.orchestra.run.smithi029.stdout:The following additional packages will be installed: 2024-04-26T12:47:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T12:47:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T12:47:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:47:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet zip 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout:Suggested packages: 2024-04-26T12:47:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout:Recommended packages: 2024-04-26T12:47:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: btrfs-tools 2024-04-26T12:47:08.449 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-04-26T12:47:08.450 INFO:teuthology.orchestra.run.smithi072.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T12:47:08.450 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T12:47:08.450 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T12:47:08.450 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T12:47:08.450 INFO:teuthology.orchestra.run.smithi072.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T12:47:08.450 INFO:teuthology.orchestra.run.smithi072.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:47:08.452 INFO:teuthology.orchestra.run.smithi072.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T12:47:08.453 INFO:teuthology.orchestra.run.smithi072.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T12:47:08.542 INFO:teuthology.orchestra.run.smithi029.stdout:The following NEW packages will be installed: 2024-04-26T12:47:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T12:47:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T12:47:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T12:47:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T12:47:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T12:47:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T12:47:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T12:47:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T12:47:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T12:47:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T12:47:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T12:47:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T12:47:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T12:47:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T12:47:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T12:47:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T12:47:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T12:47:08.591 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T12:47:08.591 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 180 MB of archives. 2024-04-26T12:47:08.591 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T12:47:08.591 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,547 kB] 2024-04-26T12:47:08.638 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T12:47:08.733 INFO:teuthology.orchestra.run.smithi029.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T12:47:08.733 INFO:teuthology.orchestra.run.smithi029.stdout:Need to get 180 MB of archives. 2024-04-26T12:47:08.733 INFO:teuthology.orchestra.run.smithi029.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T12:47:08.734 INFO:teuthology.orchestra.run.smithi029.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T12:47:08.767 INFO:teuthology.orchestra.run.smithi029.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,547 kB] 2024-04-26T12:47:08.807 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,216 kB] 2024-04-26T12:47:08.914 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2451-g7fad7ff2-1jammy [711 kB] 2024-04-26T12:47:08.944 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2451-g7fad7ff2-1jammy [357 kB] 2024-04-26T12:47:08.955 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2451-g7fad7ff2-1jammy [32.8 kB] 2024-04-26T12:47:08.956 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2451-g7fad7ff2-1jammy [180 kB] 2024-04-26T12:47:08.963 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2451-g7fad7ff2-1jammy [65.7 kB] 2024-04-26T12:47:08.967 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2451-g7fad7ff2-1jammy [330 kB] 2024-04-26T12:47:08.982 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2451-g7fad7ff2-1jammy [6,778 kB] 2024-04-26T12:47:09.057 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T12:47:09.069 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T12:47:09.150 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T12:47:09.155 INFO:teuthology.orchestra.run.smithi029.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T12:47:09.167 INFO:teuthology.orchestra.run.smithi029.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T12:47:09.243 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2451-g7fad7ff2-1jammy [112 kB] 2024-04-26T12:47:09.246 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2451-g7fad7ff2-1jammy [466 kB] 2024-04-26T12:47:09.249 INFO:teuthology.orchestra.run.smithi029.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T12:47:09.262 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2451-g7fad7ff2-1jammy [25.6 MB] 2024-04-26T12:47:09.379 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T12:47:09.391 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T12:47:09.421 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T12:47:09.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T12:47:09.431 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T12:47:09.433 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T12:47:09.451 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T12:47:09.480 INFO:teuthology.orchestra.run.smithi029.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T12:47:09.491 INFO:teuthology.orchestra.run.smithi029.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T12:47:09.522 INFO:teuthology.orchestra.run.smithi029.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T12:47:09.531 INFO:teuthology.orchestra.run.smithi029.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T12:47:09.532 INFO:teuthology.orchestra.run.smithi029.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T12:47:09.533 INFO:teuthology.orchestra.run.smithi029.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T12:47:09.552 INFO:teuthology.orchestra.run.smithi029.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T12:47:09.619 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T12:47:09.684 INFO:teuthology.orchestra.run.smithi029.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,216 kB] 2024-04-26T12:47:09.720 INFO:teuthology.orchestra.run.smithi029.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T12:47:10.024 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T12:47:10.058 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T12:47:10.060 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T12:47:10.130 INFO:teuthology.orchestra.run.smithi029.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T12:47:10.140 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T12:47:10.164 INFO:teuthology.orchestra.run.smithi029.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T12:47:10.167 INFO:teuthology.orchestra.run.smithi029.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T12:47:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T12:47:10.213 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T12:47:10.219 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T12:47:10.220 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T12:47:10.232 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T12:47:10.233 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T12:47:10.244 INFO:teuthology.orchestra.run.smithi029.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2451-g7fad7ff2-1jammy [711 kB] 2024-04-26T12:47:10.246 INFO:teuthology.orchestra.run.smithi029.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T12:47:10.298 INFO:teuthology.orchestra.run.smithi029.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T12:47:10.320 INFO:teuthology.orchestra.run.smithi029.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T12:47:10.326 INFO:teuthology.orchestra.run.smithi029.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T12:47:10.327 INFO:teuthology.orchestra.run.smithi029.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T12:47:10.339 INFO:teuthology.orchestra.run.smithi029.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T12:47:10.340 INFO:teuthology.orchestra.run.smithi029.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T12:47:10.359 INFO:teuthology.orchestra.run.smithi029.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2451-g7fad7ff2-1jammy [357 kB] 2024-04-26T12:47:10.360 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2451-g7fad7ff2-1jammy [5,084 kB] 2024-04-26T12:47:10.399 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T12:47:10.419 INFO:teuthology.orchestra.run.smithi029.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2451-g7fad7ff2-1jammy [32.8 kB] 2024-04-26T12:47:10.424 INFO:teuthology.orchestra.run.smithi029.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2451-g7fad7ff2-1jammy [180 kB] 2024-04-26T12:47:10.455 INFO:teuthology.orchestra.run.smithi029.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2451-g7fad7ff2-1jammy [65.7 kB] 2024-04-26T12:47:10.478 INFO:teuthology.orchestra.run.smithi029.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2451-g7fad7ff2-1jammy [330 kB] 2024-04-26T12:47:10.482 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T12:47:10.505 INFO:teuthology.orchestra.run.smithi029.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T12:47:10.534 INFO:teuthology.orchestra.run.smithi029.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2451-g7fad7ff2-1jammy [6,778 kB] 2024-04-26T12:47:10.544 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T12:47:10.545 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2451-g7fad7ff2-1jammy [244 kB] 2024-04-26T12:47:10.545 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T12:47:10.550 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [124 kB] 2024-04-26T12:47:10.552 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2451-g7fad7ff2-1jammy [1,527 kB] 2024-04-26T12:47:10.572 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T12:47:10.582 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2451-g7fad7ff2-1jammy [6,245 kB] 2024-04-26T12:47:10.588 INFO:teuthology.orchestra.run.smithi029.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T12:47:10.617 INFO:teuthology.orchestra.run.smithi029.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T12:47:10.634 INFO:teuthology.orchestra.run.smithi029.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T12:47:10.679 INFO:teuthology.orchestra.run.smithi029.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T12:47:10.792 INFO:teuthology.orchestra.run.smithi072.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T12:47:10.798 INFO:teuthology.orchestra.run.smithi072.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2451-g7fad7ff2-1jammy [22.7 MB] 2024-04-26T12:47:10.807 INFO:teuthology.orchestra.run.smithi072.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T12:47:10.813 INFO:teuthology.orchestra.run.smithi072.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T12:47:10.819 INFO:teuthology.orchestra.run.smithi072.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T12:47:10.840 INFO:teuthology.orchestra.run.smithi072.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T12:47:10.843 INFO:teuthology.orchestra.run.smithi072.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T12:47:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T12:47:10.908 INFO:teuthology.orchestra.run.smithi029.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T12:47:10.915 INFO:teuthology.orchestra.run.smithi029.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T12:47:10.920 INFO:teuthology.orchestra.run.smithi029.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T12:47:10.942 INFO:teuthology.orchestra.run.smithi029.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T12:47:10.946 INFO:teuthology.orchestra.run.smithi029.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T12:47:11.010 INFO:teuthology.orchestra.run.smithi072.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T12:47:11.111 INFO:teuthology.orchestra.run.smithi029.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T12:47:11.327 INFO:teuthology.orchestra.run.smithi072.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T12:47:11.366 INFO:teuthology.orchestra.run.smithi072.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T12:47:11.377 INFO:teuthology.orchestra.run.smithi072.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T12:47:11.442 INFO:teuthology.orchestra.run.smithi029.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T12:47:11.481 INFO:teuthology.orchestra.run.smithi029.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T12:47:11.494 INFO:teuthology.orchestra.run.smithi029.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T12:47:11.583 INFO:teuthology.orchestra.run.smithi072.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T12:47:11.584 INFO:teuthology.orchestra.run.smithi072.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T12:47:11.590 INFO:teuthology.orchestra.run.smithi072.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T12:47:11.595 INFO:teuthology.orchestra.run.smithi072.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T12:47:11.611 INFO:teuthology.orchestra.run.smithi072.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T12:47:11.632 INFO:teuthology.orchestra.run.smithi072.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T12:47:11.638 INFO:teuthology.orchestra.run.smithi072.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T12:47:11.701 INFO:teuthology.orchestra.run.smithi029.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T12:47:11.702 INFO:teuthology.orchestra.run.smithi029.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T12:47:11.708 INFO:teuthology.orchestra.run.smithi029.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T12:47:11.714 INFO:teuthology.orchestra.run.smithi029.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T12:47:11.728 INFO:teuthology.orchestra.run.smithi029.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T12:47:11.749 INFO:teuthology.orchestra.run.smithi029.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T12:47:11.755 INFO:teuthology.orchestra.run.smithi029.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T12:47:11.772 INFO:teuthology.orchestra.run.smithi029.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2451-g7fad7ff2-1jammy [112 kB] 2024-04-26T12:47:11.781 INFO:teuthology.orchestra.run.smithi029.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2451-g7fad7ff2-1jammy [466 kB] 2024-04-26T12:47:11.802 INFO:teuthology.orchestra.run.smithi072.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [14.0 kB] 2024-04-26T12:47:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [869 kB] 2024-04-26T12:47:11.813 INFO:teuthology.orchestra.run.smithi072.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T12:47:11.820 INFO:teuthology.orchestra.run.smithi072.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2451-g7fad7ff2-1jammy [2,437 kB] 2024-04-26T12:47:11.846 INFO:teuthology.orchestra.run.smithi029.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2451-g7fad7ff2-1jammy [25.6 MB] 2024-04-26T12:47:11.861 INFO:teuthology.orchestra.run.smithi072.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2451-g7fad7ff2-1jammy [791 kB] 2024-04-26T12:47:11.872 INFO:teuthology.orchestra.run.smithi072.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2451-g7fad7ff2-1jammy [147 kB] 2024-04-26T12:47:11.880 INFO:teuthology.orchestra.run.smithi072.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2451-g7fad7ff2-1jammy [2,293 kB] 2024-04-26T12:47:11.931 INFO:teuthology.orchestra.run.smithi029.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T12:47:11.970 INFO:teuthology.orchestra.run.smithi072.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2451-g7fad7ff2-1jammy [8,625 kB] 2024-04-26T12:47:12.077 INFO:teuthology.orchestra.run.smithi072.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T12:47:12.194 INFO:teuthology.orchestra.run.smithi029.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T12:47:12.255 INFO:teuthology.orchestra.run.smithi072.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T12:47:12.268 INFO:teuthology.orchestra.run.smithi072.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T12:47:12.288 INFO:teuthology.orchestra.run.smithi072.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T12:47:12.315 INFO:teuthology.orchestra.run.smithi072.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2451-g7fad7ff2-1jammy [14.2 kB] 2024-04-26T12:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2451-g7fad7ff2-1jammy [50.7 MB] 2024-04-26T12:47:12.364 INFO:teuthology.orchestra.run.smithi072.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T12:47:12.371 INFO:teuthology.orchestra.run.smithi029.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T12:47:12.385 INFO:teuthology.orchestra.run.smithi029.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T12:47:12.405 INFO:teuthology.orchestra.run.smithi029.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T12:47:12.469 INFO:teuthology.orchestra.run.smithi029.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T12:47:12.642 INFO:teuthology.orchestra.run.smithi072.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T12:47:12.644 INFO:teuthology.orchestra.run.smithi072.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T12:47:12.646 INFO:teuthology.orchestra.run.smithi072.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T12:47:12.647 INFO:teuthology.orchestra.run.smithi072.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T12:47:12.649 INFO:teuthology.orchestra.run.smithi072.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T12:47:12.757 INFO:teuthology.orchestra.run.smithi029.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T12:47:12.760 INFO:teuthology.orchestra.run.smithi029.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T12:47:12.762 INFO:teuthology.orchestra.run.smithi029.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T12:47:12.762 INFO:teuthology.orchestra.run.smithi029.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T12:47:12.764 INFO:teuthology.orchestra.run.smithi029.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T12:47:12.878 INFO:teuthology.orchestra.run.smithi072.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T12:47:12.993 INFO:teuthology.orchestra.run.smithi029.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T12:47:13.314 INFO:teuthology.orchestra.run.smithi072.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T12:47:13.322 INFO:teuthology.orchestra.run.smithi072.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T12:47:13.429 INFO:teuthology.orchestra.run.smithi029.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T12:47:13.436 INFO:teuthology.orchestra.run.smithi029.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T12:47:13.610 INFO:teuthology.orchestra.run.smithi072.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T12:47:13.611 INFO:teuthology.orchestra.run.smithi072.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T12:47:13.613 INFO:teuthology.orchestra.run.smithi072.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T12:47:13.615 INFO:teuthology.orchestra.run.smithi072.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T12:47:13.617 INFO:teuthology.orchestra.run.smithi072.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T12:47:13.619 INFO:teuthology.orchestra.run.smithi072.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T12:47:13.620 INFO:teuthology.orchestra.run.smithi072.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T12:47:13.622 INFO:teuthology.orchestra.run.smithi072.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T12:47:13.726 INFO:teuthology.orchestra.run.smithi029.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T12:47:13.730 INFO:teuthology.orchestra.run.smithi029.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T12:47:13.730 INFO:teuthology.orchestra.run.smithi029.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T12:47:13.730 INFO:teuthology.orchestra.run.smithi029.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T12:47:13.732 INFO:teuthology.orchestra.run.smithi029.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T12:47:13.734 INFO:teuthology.orchestra.run.smithi029.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T12:47:13.735 INFO:teuthology.orchestra.run.smithi029.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T12:47:13.737 INFO:teuthology.orchestra.run.smithi029.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T12:47:13.803 INFO:teuthology.orchestra.run.smithi072.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T12:47:13.918 INFO:teuthology.orchestra.run.smithi029.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T12:47:14.210 INFO:teuthology.orchestra.run.smithi072.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T12:47:14.256 INFO:teuthology.orchestra.run.smithi072.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T12:47:14.291 INFO:teuthology.orchestra.run.smithi072.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T12:47:14.324 INFO:teuthology.orchestra.run.smithi029.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T12:47:14.370 INFO:teuthology.orchestra.run.smithi029.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T12:47:14.390 INFO:teuthology.orchestra.run.smithi029.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T12:47:14.422 INFO:teuthology.orchestra.run.smithi072.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T12:47:14.502 INFO:teuthology.orchestra.run.smithi029.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T12:47:14.543 INFO:teuthology.orchestra.run.smithi029.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T12:47:14.554 INFO:teuthology.orchestra.run.smithi029.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T12:47:14.558 INFO:teuthology.orchestra.run.smithi029.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T12:47:14.606 INFO:teuthology.orchestra.run.smithi029.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T12:47:14.609 INFO:teuthology.orchestra.run.smithi029.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T12:47:14.631 INFO:teuthology.orchestra.run.smithi029.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T12:47:14.648 INFO:teuthology.orchestra.run.smithi072.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T12:47:14.652 INFO:teuthology.orchestra.run.smithi072.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T12:47:14.794 INFO:teuthology.orchestra.run.smithi029.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T12:47:14.832 INFO:teuthology.orchestra.run.smithi072.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T12:47:14.833 INFO:teuthology.orchestra.run.smithi072.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2451-g7fad7ff2-1jammy [121 kB] 2024-04-26T12:47:14.837 INFO:teuthology.orchestra.run.smithi072.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2451-g7fad7ff2-1jammy [38.9 kB] 2024-04-26T12:47:14.838 INFO:teuthology.orchestra.run.smithi072.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2451-g7fad7ff2-1jammy [13.4 MB] 2024-04-26T12:47:14.851 INFO:teuthology.orchestra.run.smithi072.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T12:47:14.854 INFO:teuthology.orchestra.run.smithi072.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T12:47:14.864 INFO:teuthology.orchestra.run.smithi072.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T12:47:15.029 INFO:teuthology.orchestra.run.smithi072.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T12:47:15.068 INFO:teuthology.orchestra.run.smithi029.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T12:47:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T12:47:15.236 INFO:teuthology.orchestra.run.smithi072.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [91.6 kB] 2024-04-26T12:47:15.239 INFO:teuthology.orchestra.run.smithi029.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T12:47:15.268 INFO:teuthology.orchestra.run.smithi029.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T12:47:15.294 INFO:teuthology.orchestra.run.smithi072.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T12:47:15.312 INFO:teuthology.orchestra.run.smithi072.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T12:47:15.425 INFO:teuthology.orchestra.run.smithi029.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T12:47:15.428 INFO:teuthology.orchestra.run.smithi029.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T12:47:15.430 INFO:teuthology.orchestra.run.smithi029.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T12:47:15.452 INFO:teuthology.orchestra.run.smithi029.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T12:47:15.457 INFO:teuthology.orchestra.run.smithi029.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T12:47:15.465 INFO:teuthology.orchestra.run.smithi072.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T12:47:15.494 INFO:teuthology.orchestra.run.smithi072.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T12:47:15.651 INFO:teuthology.orchestra.run.smithi072.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T12:47:15.654 INFO:teuthology.orchestra.run.smithi072.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T12:47:15.655 INFO:teuthology.orchestra.run.smithi072.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T12:47:15.678 INFO:teuthology.orchestra.run.smithi072.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T12:47:15.682 INFO:teuthology.orchestra.run.smithi072.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T12:47:15.851 INFO:teuthology.orchestra.run.smithi029.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2451-g7fad7ff2-1jammy [5,084 kB] 2024-04-26T12:47:16.130 INFO:teuthology.orchestra.run.smithi029.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2451-g7fad7ff2-1jammy [244 kB] 2024-04-26T12:47:16.135 INFO:teuthology.orchestra.run.smithi029.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [124 kB] 2024-04-26T12:47:16.162 INFO:teuthology.orchestra.run.smithi029.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2451-g7fad7ff2-1jammy [1,527 kB] 2024-04-26T12:47:16.275 INFO:teuthology.orchestra.run.smithi029.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2451-g7fad7ff2-1jammy [6,245 kB] 2024-04-26T12:47:16.349 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 180 MB in 7s (24.5 MB/s) 2024-04-26T12:47:16.515 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T12:47:16.615 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T12:47:16.620 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T12:47:16.689 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:47:16.776 INFO:teuthology.orchestra.run.smithi029.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2451-g7fad7ff2-1jammy [22.7 MB] 2024-04-26T12:47:17.038 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T12:47:17.064 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T12:47:17.105 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:47:17.428 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T12:47:17.454 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T12:47:17.495 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:47:17.936 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T12:47:17.962 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:47:18.011 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:47:18.450 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T12:47:18.476 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:47:18.517 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:47:18.686 INFO:teuthology.orchestra.run.smithi029.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [14.0 kB] 2024-04-26T12:47:18.687 INFO:teuthology.orchestra.run.smithi029.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [869 kB] 2024-04-26T12:47:18.704 INFO:teuthology.orchestra.run.smithi029.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2451-g7fad7ff2-1jammy [2,437 kB] 2024-04-26T12:47:18.849 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T12:47:18.875 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:47:18.904 INFO:teuthology.orchestra.run.smithi029.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2451-g7fad7ff2-1jammy [791 kB] 2024-04-26T12:47:18.916 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:47:18.950 INFO:teuthology.orchestra.run.smithi029.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2451-g7fad7ff2-1jammy [147 kB] 2024-04-26T12:47:18.979 INFO:teuthology.orchestra.run.smithi029.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2451-g7fad7ff2-1jammy [2,293 kB] 2024-04-26T12:47:19.158 INFO:teuthology.orchestra.run.smithi029.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2451-g7fad7ff2-1jammy [8,625 kB] 2024-04-26T12:47:19.248 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T12:47:19.274 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T12:47:19.340 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:47:19.662 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librados2. 2024-04-26T12:47:19.688 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../007-librados2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:19.728 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:19.827 INFO:teuthology.orchestra.run.smithi029.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2451-g7fad7ff2-1jammy [14.2 kB] 2024-04-26T12:47:19.827 INFO:teuthology.orchestra.run.smithi029.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2451-g7fad7ff2-1jammy [50.7 MB] 2024-04-26T12:47:20.235 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librbd1. 2024-04-26T12:47:20.261 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../008-librbd1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:20.302 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:20.792 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T12:47:20.818 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:20.858 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:21.138 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rados. 2024-04-26T12:47:21.153 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:21.196 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:21.486 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T12:47:21.512 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:21.553 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:21.782 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T12:47:21.808 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:21.849 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:22.147 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T12:47:22.173 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:22.214 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:22.536 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T12:47:22.562 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T12:47:22.604 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:47:22.926 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T12:47:22.952 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T12:47:22.993 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T12:47:23.257 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T12:47:23.283 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:23.324 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:23.646 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T12:47:23.672 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T12:47:23.690 INFO:teuthology.orchestra.run.smithi029.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2451-g7fad7ff2-1jammy [121 kB] 2024-04-26T12:47:23.692 INFO:teuthology.orchestra.run.smithi029.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2451-g7fad7ff2-1jammy [38.9 kB] 2024-04-26T12:47:23.694 INFO:teuthology.orchestra.run.smithi029.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2451-g7fad7ff2-1jammy [13.4 MB] 2024-04-26T12:47:23.712 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:47:24.002 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T12:47:24.028 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T12:47:24.069 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:47:24.224 INFO:teuthology.orchestra.run.smithi029.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [91.6 kB] 2024-04-26T12:47:24.376 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T12:47:24.390 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T12:47:24.434 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:47:24.790 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua5.1. 2024-04-26T12:47:24.808 INFO:teuthology.orchestra.run.smithi029.stdout:Fetched 180 MB in 16s (11.5 MB/s) 2024-04-26T12:47:24.816 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T12:47:24.857 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:47:24.975 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T12:47:25.078 INFO:teuthology.orchestra.run.smithi029.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T12:47:25.084 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T12:47:25.167 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:47:25.489 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-any. 2024-04-26T12:47:25.506 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T12:47:25.532 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T12:47:25.548 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T12:47:25.558 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T12:47:25.607 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:47:25.804 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package zip. 2024-04-26T12:47:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T12:47:25.863 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T12:47:25.937 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T12:47:25.964 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T12:47:26.004 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:47:26.160 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package unzip. 2024-04-26T12:47:26.186 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T12:47:26.226 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:47:26.479 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T12:47:26.505 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:47:26.554 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:47:26.618 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package luarocks. 2024-04-26T12:47:26.644 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T12:47:26.685 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:47:27.028 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T12:47:27.052 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librgw2. 2024-04-26T12:47:27.054 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:47:27.078 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../025-librgw2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:27.095 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:47:27.118 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:27.718 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T12:47:27.745 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:47:27.781 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T12:47:27.785 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:47:27.796 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:27.840 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:28.138 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T12:47:28.164 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T12:47:28.205 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:47:28.216 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T12:47:28.243 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T12:47:28.283 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:47:28.512 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T12:47:28.538 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:28.578 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:28.639 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librados2. 2024-04-26T12:47:28.666 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../007-librados2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:28.706 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:29.009 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-common. 2024-04-26T12:47:29.036 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:29.076 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:29.254 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librbd1. 2024-04-26T12:47:29.281 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../008-librbd1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:29.330 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:29.843 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T12:47:29.869 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:30.216 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rados. 2024-04-26T12:47:30.242 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:30.283 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:30.629 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T12:47:30.656 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:30.696 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:30.722 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-base. 2024-04-26T12:47:30.749 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:30.798 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:30.960 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T12:47:30.976 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:31.019 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:31.365 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T12:47:31.392 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:31.442 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:31.464 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T12:47:31.490 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T12:47:31.532 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:47:31.789 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T12:47:31.816 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T12:47:31.828 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T12:47:31.855 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T12:47:31.856 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:47:31.895 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:47:32.188 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T12:47:32.214 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T12:47:32.219 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T12:47:32.246 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T12:47:32.254 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T12:47:32.286 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:47:32.558 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T12:47:32.584 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T12:47:32.624 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:47:32.693 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T12:47:32.719 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:32.759 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:32.922 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T12:47:32.949 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T12:47:32.989 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:47:33.133 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T12:47:33.159 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T12:47:33.200 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:47:33.279 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T12:47:33.305 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T12:47:33.346 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T12:47:33.497 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T12:47:33.524 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T12:47:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:47:33.643 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-portend. 2024-04-26T12:47:33.670 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T12:47:33.709 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T12:47:33.953 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T12:47:33.979 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T12:47:33.991 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T12:47:34.018 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T12:47:34.019 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:47:34.058 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T12:47:34.356 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T12:47:34.360 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua5.1. 2024-04-26T12:47:34.382 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T12:47:34.387 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T12:47:34.423 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:47:34.435 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:47:34.754 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T12:47:34.759 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua-any. 2024-04-26T12:47:34.775 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T12:47:34.781 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T12:47:34.817 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T12:47:34.821 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T12:47:35.089 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package zip. 2024-04-26T12:47:35.115 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T12:47:35.136 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T12:47:35.156 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T12:47:35.163 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T12:47:35.203 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T12:47:35.488 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package unzip. 2024-04-26T12:47:35.515 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T12:47:35.563 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:47:35.760 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T12:47:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T12:47:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:47:35.980 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package luarocks. 2024-04-26T12:47:36.007 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T12:47:36.047 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:47:36.099 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-mako. 2024-04-26T12:47:36.125 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T12:47:36.165 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:47:36.421 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package librgw2. 2024-04-26T12:47:36.447 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../025-librgw2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:36.481 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T12:47:36.489 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:36.507 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T12:47:36.548 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:47:36.846 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T12:47:36.872 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T12:47:36.913 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:47:37.192 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webob. 2024-04-26T12:47:37.218 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T12:47:37.219 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T12:47:37.234 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:37.267 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:47:37.277 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:37.602 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T12:47:37.626 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T12:47:37.633 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T12:47:37.660 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T12:47:37.669 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:47:37.700 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:47:37.972 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T12:47:37.998 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T12:47:38.040 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:47:38.256 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T12:47:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:38.322 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:38.328 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-paste. 2024-04-26T12:47:38.354 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T12:47:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:47:38.702 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T12:47:38.729 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T12:47:38.755 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-common. 2024-04-26T12:47:38.777 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:47:38.781 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:38.821 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:39.074 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T12:47:39.101 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T12:47:39.140 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:47:39.431 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T12:47:39.457 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T12:47:39.499 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T12:47:39.804 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T12:47:39.831 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T12:47:39.871 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:47:40.239 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T12:47:40.266 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T12:47:40.306 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T12:47:40.628 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-idna. 2024-04-26T12:47:40.654 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T12:47:40.691 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-base. 2024-04-26T12:47:40.694 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T12:47:40.718 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:40.767 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:41.076 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T12:47:41.103 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T12:47:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:47:41.459 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests. 2024-04-26T12:47:41.484 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T12:47:41.485 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T12:47:41.511 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T12:47:41.525 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:47:41.551 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:47:42.357 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T12:47:42.385 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T12:47:43.065 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:47:43.409 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T12:47:43.436 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T12:47:43.483 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:47:43.572 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T12:47:43.602 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:43.639 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:43.824 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T12:47:43.851 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T12:47:43.890 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:47:44.016 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T12:47:44.042 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:44.082 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:44.187 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T12:47:44.214 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T12:47:44.262 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:47:44.397 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T12:47:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T12:47:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:47:44.577 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T12:47:44.604 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T12:47:44.644 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:47:44.752 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T12:47:44.779 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T12:47:44.819 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T12:47:44.950 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T12:47:44.977 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T12:47:45.017 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T12:47:45.167 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T12:47:45.194 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:45.234 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:45.314 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-portend. 2024-04-26T12:47:45.341 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T12:47:45.389 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T12:47:45.625 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T12:47:45.651 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:45.691 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:45.695 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T12:47:45.722 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T12:47:45.762 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T12:47:46.101 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T12:47:46.117 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T12:47:46.159 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:47:46.492 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T12:47:46.519 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T12:47:46.559 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T12:47:46.673 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T12:47:46.700 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:46.749 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:46.858 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T12:47:46.884 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T12:47:46.933 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T12:47:47.221 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T12:47:47.248 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T12:47:47.289 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:47:47.586 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-mako. 2024-04-26T12:47:47.613 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T12:47:47.661 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:47:47.985 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T12:47:48.012 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T12:47:48.021 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph. 2024-04-26T12:47:48.037 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../066-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:48.052 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:47:48.080 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:48.437 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T12:47:48.463 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:48.503 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:48.615 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T12:47:48.642 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T12:47:48.690 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:47:48.867 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T12:47:48.894 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:48.944 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:48.997 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webob. 2024-04-26T12:47:49.024 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T12:47:49.063 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:47:49.382 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephadm. 2024-04-26T12:47:49.409 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../069-cephadm_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:49.429 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T12:47:49.449 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:49.455 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T12:47:49.499 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:47:49.747 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T12:47:49.767 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T12:47:49.774 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T12:47:49.794 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T12:47:49.813 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T12:47:49.834 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:47:50.110 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T12:47:50.124 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:47:50.132 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-paste. 2024-04-26T12:47:50.159 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T12:47:50.168 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:47:50.207 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:47:50.515 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T12:47:50.530 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T12:47:50.573 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:47:50.870 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T12:47:50.897 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T12:47:50.937 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:47:51.087 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-babel. 2024-04-26T12:47:51.115 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:47:51.154 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:47:51.235 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T12:47:51.262 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T12:47:51.302 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T12:47:51.486 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T12:47:51.513 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T12:47:51.586 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:47:51.609 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T12:47:51.635 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T12:47:51.675 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:47:51.926 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T12:47:51.954 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:51.993 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:52.069 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T12:47:52.096 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T12:47:52.144 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T12:47:52.324 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T12:47:52.351 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T12:47:52.390 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T12:47:52.499 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-idna. 2024-04-26T12:47:52.526 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T12:47:52.566 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T12:47:52.663 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-routes. 2024-04-26T12:47:52.679 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T12:47:52.714 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:47:52.889 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T12:47:52.916 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T12:47:52.956 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:47:53.038 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T12:47:53.065 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:53.112 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:53.263 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests. 2024-04-26T12:47:53.290 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T12:47:53.330 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:47:53.644 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T12:47:53.671 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T12:47:53.710 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:47:54.017 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T12:47:54.033 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:54.067 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:54.486 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T12:47:54.513 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:54.553 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:54.757 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T12:47:54.773 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T12:47:54.815 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:47:54.884 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T12:47:54.911 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T12:47:54.951 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:47:55.248 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T12:47:55.272 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T12:47:55.298 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T12:47:55.314 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T12:47:55.325 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T12:47:55.364 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:47:55.682 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T12:47:55.707 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:55.712 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T12:47:55.740 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T12:47:55.746 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:55.779 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:47:56.077 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T12:47:56.105 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T12:47:56.152 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:47:56.179 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T12:47:56.206 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:56.245 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:56.977 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T12:47:57.004 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:57.029 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T12:47:57.052 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:57.057 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:47:57.191 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:58.410 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph. 2024-04-26T12:47:58.436 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../066-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:58.476 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:58.582 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T12:47:58.598 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T12:47:58.633 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T12:47:58.915 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T12:47:58.941 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T12:47:58.989 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:47:59.083 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T12:47:59.110 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:59.149 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:59.287 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T12:47:59.314 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T12:47:59.353 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:47:59.538 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T12:47:59.565 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:47:59.605 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:47:59.636 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T12:47:59.663 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T12:47:59.702 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T12:48:00.010 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T12:48:00.037 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T12:48:00.061 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package cephadm. 2024-04-26T12:48:00.077 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T12:48:00.086 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../069-cephadm_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:00.128 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:00.376 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T12:48:00.403 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T12:48:00.443 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:48:00.460 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T12:48:00.487 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T12:48:00.526 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T12:48:00.748 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T12:48:00.775 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T12:48:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T12:48:00.864 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T12:48:00.880 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:48:00.923 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:48:01.130 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T12:48:01.157 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T12:48:01.197 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:48:01.842 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T12:48:01.858 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:48:01.892 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:01.950 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-babel. 2024-04-26T12:48:01.975 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:48:02.017 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:48:02.215 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T12:48:02.242 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T12:48:02.282 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:48:02.349 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T12:48:02.376 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T12:48:02.415 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:48:02.638 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T12:48:02.664 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:48:02.704 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:48:02.781 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T12:48:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:48:02.847 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:02.968 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package jq. 2024-04-26T12:48:02.993 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:48:03.027 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T12:48:03.378 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T12:48:03.405 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T12:48:03.440 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package socat. 2024-04-26T12:48:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T12:48:03.456 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T12:48:03.500 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:48:03.760 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-routes. 2024-04-26T12:48:03.787 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T12:48:03.814 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T12:48:03.826 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:48:03.829 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T12:48:03.872 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:48:04.181 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-test. 2024-04-26T12:48:04.197 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:04.231 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:04.376 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T12:48:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:48:04.442 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:06.162 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T12:48:06.189 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T12:48:06.228 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:48:06.718 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T12:48:06.745 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T12:48:06.786 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:48:07.150 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T12:48:07.178 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T12:48:07.217 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:48:07.532 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T12:48:07.559 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T12:48:07.606 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:48:07.775 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T12:48:07.790 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:48:07.824 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:08.116 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T12:48:08.132 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:08.166 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:08.317 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T12:48:08.345 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:48:08.431 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T12:48:08.447 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T12:48:08.489 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:48:08.513 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:08.806 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T12:48:08.822 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T12:48:08.865 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:48:09.231 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T12:48:09.258 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T12:48:09.297 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:48:09.709 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package pkg-config. 2024-04-26T12:48:09.736 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T12:48:09.785 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:48:09.863 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T12:48:09.890 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T12:48:09.938 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T12:48:10.057 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T12:48:10.073 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T12:48:10.115 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:48:10.236 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T12:48:10.263 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T12:48:10.302 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:48:10.514 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T12:48:10.536 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T12:48:10.580 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T12:48:10.642 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T12:48:10.670 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T12:48:10.717 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:48:10.852 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T12:48:10.879 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T12:48:10.919 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T12:48:11.024 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T12:48:11.051 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T12:48:11.099 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T12:48:11.235 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T12:48:11.262 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T12:48:11.310 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:48:11.415 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T12:48:11.443 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T12:48:11.482 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T12:48:11.617 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T12:48:11.644 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T12:48:11.683 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T12:48:11.788 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T12:48:11.815 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T12:48:11.863 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:48:11.980 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-py. 2024-04-26T12:48:12.007 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T12:48:12.046 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T12:48:12.169 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T12:48:12.197 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T12:48:12.245 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T12:48:12.354 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T12:48:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T12:48:12.421 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:48:12.669 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T12:48:12.696 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T12:48:12.752 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:48:12.880 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T12:48:12.907 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T12:48:12.946 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:48:13.278 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-toml. 2024-04-26T12:48:13.305 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T12:48:13.344 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T12:48:13.389 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T12:48:13.406 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:48:13.447 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:13.641 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T12:48:13.668 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T12:48:13.708 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:48:13.779 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T12:48:13.806 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T12:48:13.846 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:48:14.032 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T12:48:14.056 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T12:48:14.090 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:48:14.209 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T12:48:14.226 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:48:14.267 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:48:14.361 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T12:48:14.377 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T12:48:14.411 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:48:14.799 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package jq. 2024-04-26T12:48:14.827 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:48:14.874 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T12:48:15.078 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package radosgw. 2024-04-26T12:48:15.106 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../116-radosgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:15.120 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package socat. 2024-04-26T12:48:15.136 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T12:48:15.145 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:15.180 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:48:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T12:48:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T12:48:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:48:15.995 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-test. 2024-04-26T12:48:16.012 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:16.053 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:16.110 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T12:48:16.126 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:16.169 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:16.477 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T12:48:16.738 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:48:16.848 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:48:17.108 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T12:48:17.433 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T12:48:17.866 INFO:teuthology.orchestra.run.smithi072.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T12:48:17.946 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:19.177 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user cephadm....done 2024-04-26T12:48:19.327 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:48:19.505 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T12:48:19.533 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:48:19.580 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:19.597 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:48:19.833 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:48:19.897 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T12:48:19.914 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:19.955 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:19.960 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:48:20.222 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T12:48:20.270 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T12:48:20.287 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T12:48:20.328 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:48:20.466 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:48:20.593 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T12:48:20.688 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T12:48:20.717 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T12:48:20.763 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:48:20.896 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:48:21.187 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T12:48:21.215 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T12:48:21.243 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T12:48:21.254 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:48:21.503 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T12:48:21.691 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package pkg-config. 2024-04-26T12:48:21.720 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T12:48:21.766 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:48:21.772 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:48:22.018 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:48:22.029 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T12:48:22.046 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T12:48:22.088 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:48:22.341 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:48:22.562 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T12:48:22.590 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T12:48:22.628 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T12:48:22.722 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:48:22.925 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T12:48:22.953 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T12:48:22.957 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:23.000 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T12:48:23.220 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:48:23.307 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T12:48:23.336 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T12:48:23.346 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:48:23.374 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:48:23.474 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:48:23.576 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:48:23.681 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T12:48:23.709 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T12:48:23.756 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T12:48:23.837 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:48:24.103 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-py. 2024-04-26T12:48:24.130 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T12:48:24.169 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T12:48:24.274 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T12:48:24.304 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T12:48:24.369 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:48:24.493 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T12:48:24.497 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T12:48:24.521 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T12:48:24.560 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:48:24.858 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:48:24.968 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T12:48:25.019 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T12:48:25.047 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T12:48:25.094 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:48:25.237 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:48:25.417 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-toml. 2024-04-26T12:48:25.451 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T12:48:25.483 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T12:48:25.507 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:48:25.772 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T12:48:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T12:48:25.800 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T12:48:25.846 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:48:25.920 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:48:26.188 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T12:48:26.216 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T12:48:26.254 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:48:26.508 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T12:48:26.525 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T12:48:26.567 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:48:26.617 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:48:26.869 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:48:26.996 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:48:27.123 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:48:27.351 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package radosgw. 2024-04-26T12:48:27.379 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../116-radosgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:27.426 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:27.426 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T12:48:27.804 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T12:48:28.047 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:48:28.416 INFO:teuthology.orchestra.run.smithi029.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T12:48:28.419 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:48:28.433 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:48:28.474 INFO:teuthology.orchestra.run.smithi029.stdout:Unpacking rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:28.705 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:48:28.842 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T12:48:29.049 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:48:29.102 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:48:29.237 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:48:29.284 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:48:29.413 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:29.541 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T12:48:29.757 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T12:48:29.882 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T12:48:30.059 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:48:30.264 INFO:teuthology.orchestra.run.smithi029.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T12:48:30.526 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:31.081 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user cephadm....done 2024-04-26T12:48:31.265 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:48:31.298 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:48:31.526 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:48:31.577 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:48:31.661 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T12:48:31.829 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:48:31.930 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:48:31.948 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:48:32.050 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:48:32.160 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:48:32.208 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T12:48:32.454 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:48:32.470 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:48:32.589 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T12:48:32.707 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T12:48:32.900 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:48:32.944 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:48:33.079 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:48:33.306 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T12:48:33.382 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:48:33.566 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T12:48:33.644 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T12:48:33.860 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:48:33.904 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T12:48:34.140 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:48:34.164 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:48:34.400 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:48:34.408 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T12:48:34.662 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:48:34.669 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:48:34.789 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T12:48:34.929 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:35.108 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:48:35.199 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:48:35.210 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:48:35.351 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:48:35.509 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:48:35.513 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:48:35.647 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:48:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:48:35.892 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:48:36.076 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:48:36.195 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:48:36.313 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T12:48:36.323 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:48:36.350 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T12:48:36.405 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T12:48:36.414 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:48:36.541 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T12:48:36.660 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:48:36.787 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:48:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:48:37.039 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T12:48:37.174 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:48:37.299 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:48:37.410 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T12:48:37.537 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T12:48:37.568 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:48:37.797 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:48:37.897 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T12:48:37.924 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:48:38.007 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:48:38.236 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:48:38.530 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:48:38.727 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:48:38.799 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T12:48:38.919 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T12:48:39.023 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:48:39.149 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:48:39.188 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T12:48:39.276 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:48:39.457 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:48:39.595 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T12:48:39.814 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:48:40.008 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T12:48:40.226 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T12:48:40.259 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:48:40.487 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:48:40.662 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:48:40.827 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:48:40.949 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:48:40.953 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:41.082 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:41.200 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:48:41.294 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:48:41.514 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:41.562 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:48:41.642 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:41.690 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:41.761 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T12:48:41.993 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T12:48:42.031 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:42.157 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:42.277 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:42.312 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:48:42.482 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:48:42.482 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:48:42.971 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:43.098 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:43.225 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:43.362 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:48:43.549 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:48:43.812 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:48:43.947 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T12:48:44.208 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:48:44.334 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:48:44.461 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:48:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:44.631 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:44.758 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:44.782 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:48:44.877 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:44.979 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:45.051 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T12:48:45.311 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:48:45.438 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:48:45.519 INFO:teuthology.orchestra.run.smithi072.stdout:Adding group ceph....done 2024-04-26T12:48:45.776 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:48:45.882 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user ceph....done 2024-04-26T12:48:46.036 INFO:teuthology.orchestra.run.smithi072.stdout:Setting system user ceph properties....done 2024-04-26T12:48:46.036 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T12:48:46.055 INFO:teuthology.orchestra.run.smithi072.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T12:48:46.188 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T12:48:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T12:48:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T12:48:46.558 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:48:46.818 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T12:48:46.985 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:47.096 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:48:47.112 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:47.222 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T12:48:47.518 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:48:47.613 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:48:47.613 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:48:47.645 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:48:47.938 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:48:48.066 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:48.241 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:48:48.398 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T12:48:48.502 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:48:48.629 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:48:48.748 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:48:48.830 INFO:teuthology.orchestra.run.smithi029.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T12:48:48.855 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:49.076 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:48:49.096 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:48:49.097 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:48:49.204 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:48:49.592 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:49.616 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:48:49.823 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:48:49.823 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:48:49.868 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T12:48:49.995 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T12:48:50.265 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:48:50.314 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:50.384 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:48:50.669 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:48:50.670 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:48:50.719 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:48:51.029 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:48:51.169 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:51.308 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T12:48:51.387 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:51.435 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T12:48:51.542 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:51.703 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T12:48:51.744 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:48:51.745 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:48:51.972 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:48:52.202 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:52.330 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:48:52.346 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:52.473 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:52.626 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:52.727 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T12:48:52.973 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T12:48:53.021 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:48:53.083 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T12:48:53.247 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T12:48:53.384 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:48:53.513 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:53.640 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:53.767 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:48:54.075 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T12:48:54.099 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:54.226 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:54.336 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T12:48:54.615 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:54.742 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T12:48:54.872 DEBUG:teuthology.parallel:result is None 2024-04-26T12:48:54.873 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:55.088 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:48:55.088 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:48:55.563 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:55.692 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:55.810 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:55.937 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:48:57.221 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:57.348 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:57.466 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:57.595 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:57.721 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:58.279 INFO:teuthology.orchestra.run.smithi029.stdout:Adding group ceph....done 2024-04-26T12:48:58.692 INFO:teuthology.orchestra.run.smithi029.stdout:Adding system user ceph....done 2024-04-26T12:48:58.837 INFO:teuthology.orchestra.run.smithi029.stdout:Setting system user ceph properties....done 2024-04-26T12:48:58.860 INFO:teuthology.orchestra.run.smithi029.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T12:48:59.006 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T12:48:59.397 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T12:48:59.843 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:48:59.961 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:00.424 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:49:00.424 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:49:00.892 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:01.250 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T12:49:01.704 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:01.964 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:49:01.964 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:49:02.434 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:02.662 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:49:02.662 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:49:03.136 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:03.420 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:49:03.421 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:49:03.881 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:04.009 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:04.136 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:04.358 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:49:04.358 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:49:04.806 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:04.957 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:05.078 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:05.229 INFO:teuthology.orchestra.run.smithi029.stdout:Setting up ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:49:05.593 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T12:49:05.719 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T12:49:05.883 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T12:49:07.154 INFO:teuthology.orchestra.run.smithi029.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T12:49:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T12:49:07.929 DEBUG:teuthology.parallel:result is None 2024-04-26T12:49:07.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:49:08.184 DEBUG:teuthology.orchestra.run.smithi029:> dpkg-query -W -f '${Version}' ceph 2024-04-26T12:49:08.204 INFO:teuthology.orchestra.run.smithi029.stdout:19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:49:08.205 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:49:08.205 INFO:teuthology.task.install:The correct ceph version 19.0.0-2451-g7fad7ff2-1jammy is installed. 2024-04-26T12:49:08.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:49:08.443 DEBUG:teuthology.orchestra.run.smithi072:> dpkg-query -W -f '${Version}' ceph 2024-04-26T12:49:08.462 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:49:08.463 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:49:08.463 INFO:teuthology.task.install:The correct ceph version 19.0.0-2451-g7fad7ff2-1jammy is installed. 2024-04-26T12:49:08.464 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:49:08.465 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:08.465 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:49:08.480 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:08.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:49:08.519 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:49:08.519 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:08.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:49:08.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:49:08.593 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:08.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:49:08.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:49:08.662 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:49:08.662 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:08.663 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:49:08.676 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:49:08.732 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:08.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:49:08.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:49:08.797 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:49:08.798 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:08.798 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:49:08.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:49:08.864 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:08.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:49:08.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:49:08.931 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:49:09.020 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:49:09.021 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-04-26T12:49:09.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-04-26T12:49:09.038 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:49:09.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:49:09.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:49:09.094 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:49:09.094 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:49:09.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:49:09.163 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:49:09.164 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:49:09.164 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722', 'branch': 'wip-cbodley2-testing', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7674722', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cbodley2-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley2-testing', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 8596, 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley2-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFd7BgzkXxaFdK4DXaIi4yrqqT2S58K9cpVvtNan3lMwFLAks3Etc2cjtXGDmoznkDftMroLUN3PIPgyEmfZ6mA=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCCzL6QvzSYr6TMP2b/PS44MCRAWQe4wUTwSSPUm6m1TfWtECOVM9PZkvlt7I+pZFsmJVyUkLKPzIjtY0mI6Mao='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_12:10:35', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:49:09.164 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:49:09.194 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:49:09.202 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:49:09.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:49:09.258 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:09.258 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:49:09.302 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:49:09.302 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-26 12:43:35.462899289 +0000 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-26 12:43:35.210901540 +0000 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-26 12:43:35.210901540 +0000 2024-04-26T12:49:09.350 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-26T12:49:09.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:49:09.403 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-26T12:49:09.404 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-26T12:49:09.404 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000217739 s, 2.4 MB/s 2024-04-26T12:49:09.405 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:49:09.455 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-04-26T12:49:09.501 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:49:09.501 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:09.502 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-26T12:49:09.502 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:09.502 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-26 12:43:35.698897181 +0000 2024-04-26T12:49:09.502 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-26 12:43:35.694897216 +0000 2024-04-26T12:49:09.502 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-26 12:43:35.694897216 +0000 2024-04-26T12:49:09.502 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-26T12:49:09.502 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:49:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-26T12:49:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-26T12:49:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000199863 s, 2.6 MB/s 2024-04-26T12:49:09.557 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:49:09.606 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-04-26T12:49:09.653 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:49:09.653 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:09.653 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-26T12:49:09.653 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:09.654 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-26 12:43:36.434890607 +0000 2024-04-26T12:49:09.654 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-26 12:43:36.174892929 +0000 2024-04-26T12:49:09.654 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-26 12:43:36.174892929 +0000 2024-04-26T12:49:09.654 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-26T12:49:09.654 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:49:09.707 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-26T12:49:09.708 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-26T12:49:09.708 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000204866 s, 2.5 MB/s 2024-04-26T12:49:09.709 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:49:09.759 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-04-26T12:49:09.805 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:49:09.805 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:09.805 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-26T12:49:09.805 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:09.805 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-26 12:43:36.930886176 +0000 2024-04-26T12:49:09.805 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-26 12:43:36.674888463 +0000 2024-04-26T12:49:09.805 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-26 12:43:36.674888463 +0000 2024-04-26T12:49:09.806 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-26T12:49:09.806 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:49:09.859 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-26T12:49:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-26T12:49:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.0001976 s, 2.6 MB/s 2024-04-26T12:49:09.861 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:49:09.911 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:49:09.911 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:09.911 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:49:09.917 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:49:09.917 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-04-26T12:49:09.963 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:49:09.964 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:09.964 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-04-26T12:49:09.964 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:09.964 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 12:43:28.249090691 +0000 2024-04-26T12:49:09.964 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 12:43:27.993092975 +0000 2024-04-26T12:49:09.964 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 12:43:27.993092975 +0000 2024-04-26T12:49:09.964 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T12:49:09.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:49:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T12:49:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T12:49:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.00043077 s, 1.2 MB/s 2024-04-26T12:49:10.019 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:49:10.068 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 12:43:28.729086409 +0000 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 12:43:28.469088729 +0000 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 12:43:28.469088729 +0000 2024-04-26T12:49:10.115 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T12:49:10.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:49:10.169 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T12:49:10.169 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T12:49:10.169 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000362492 s, 1.4 MB/s 2024-04-26T12:49:10.170 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:49:10.220 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-04-26T12:49:10.267 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:49:10.267 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-04-26T12:49:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 12:43:29.253081735 +0000 2024-04-26T12:49:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 12:43:28.981084161 +0000 2024-04-26T12:49:10.268 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 12:43:28.981084161 +0000 2024-04-26T12:49:10.268 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T12:49:10.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:49:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T12:49:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T12:49:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000433809 s, 1.2 MB/s 2024-04-26T12:49:10.322 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:49:10.372 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 12:43:29.757077239 +0000 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 12:43:29.497079558 +0000 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 12:43:29.497079558 +0000 2024-04-26T12:49:10.419 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T12:49:10.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:49:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T12:49:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T12:49:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000278489 s, 1.8 MB/s 2024-04-26T12:49:10.475 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:49:10.524 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:49:10.524 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T12:49:10.524 INFO:tasks.ceph:Generating config... 2024-04-26T12:49:10.525 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T12:49:10.525 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-26T12:49:10.525 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-26T12:49:10.525 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-26T12:49:10.526 INFO:tasks.ceph:[client] setuser = ceph 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:49:10.526 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:49:10.527 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:49:10.527 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:49:10.527 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:49:10.527 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:49:10.527 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:49:10.527 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:49:10.527 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:49:10.527 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:49:10.527 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:49:10.527 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:49:10.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:49:10.562 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:49:10.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:49:10.653 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:49:10.709 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29')] 2024-04-26T12:49:10.709 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-26T12:49:10.710 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:10.710 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:49:10.757 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:10.837 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:49:10.837 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:49:10.837 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:10.837 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid e9a80640-28c1-4a64-ae98-6666131f9984 2024-04-26T12:49:10.837 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-04-26T12:49:10.838 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-04-26T12:49:10.838 INFO:teuthology.orchestra.run.smithi029.stdout:fsid e9a80640-28c1-4a64-ae98-6666131f9984 2024-04-26T12:49:10.838 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-04-26T12:49:10.839975+0000 2024-04-26T12:49:10.838 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-26T12:49:10.839975+0000 2024-04-26T12:49:10.838 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 17 (quincy) 2024-04-26T12:49:10.838 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-04-26T12:49:10.839 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-26T12:49:10.839 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-26T12:49:10.840 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:49:10.889 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e9a80640-28c1-4a64-ae98-6666131f9984... 2024-04-26T12:49:10.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:49:10.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:49:10.963 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-04-26T12:49:10.963 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-04-26T12:49:10.963 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:49:10.963 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-04-26T12:49:10.963 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.963 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:49:10.964 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:49:10.965 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-04-26T12:49:10.966 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = 172.21.15.29 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = e9a80640-28c1-4a64-ae98-6666131f9984 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.967 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug trim objects = true 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T12:49:10.969 INFO:teuthology.orchestra.run.smithi029.stdout: debug objclass = 20 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-04-26T12:49:10.970 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-04-26T12:49:10.971 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:49:10.972 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.973 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: rgw gc obj min wait = 15 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: debug rgw = 20 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: setgroup = ceph 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout: setuser = ceph 2024-04-26T12:49:10.974 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.977 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:49:10.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = 172.21.15.29 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = e9a80640-28c1-4a64-ae98-6666131f9984 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug trim objects = true 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.980 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: debug objclass = 20 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2024-04-26T12:49:10.981 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = bitmap 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T12:49:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:49:10.983 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.984 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: rgw gc obj min wait = 15 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: debug rgw = 20 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: setgroup = ceph 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout: setuser = ceph 2024-04-26T12:49:10.985 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-04-26T12:49:10.986 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:49:10.986 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:49:11.070 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:49:11.070 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:11.070 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:49:11.075 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:11.076 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:49:11.121 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T12:49:11.121 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:11.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:49:11.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:49:11.190 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:11.191 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:11.237 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:49:11.237 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:11.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:49:11.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:49:11.261 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:11.261 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:11.307 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:49:11.307 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:49:11.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:49:11.392 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:49:11.401 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:49:11.402 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:49:11.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:49:11.475 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:49:11.484 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:49:11.485 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T12:49:11.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:49:11.498 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:49:11.499 INFO:tasks.ceph:role: osd.0 2024-04-26T12:49:11.499 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T12:49:11.499 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:49:11.553 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:49:11.553 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:49:11.553 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:49:11.553 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:49:11.553 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:49:11.554 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:49:11.554 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:49:11.554 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:49:11.554 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:49:11.554 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:49:11.577 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-26T12:49:11.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-26T12:49:11.579 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:49:11.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:49:11.691 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:49:11.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:49:11.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:11.811+0000 7fa8f17247c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:49:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:11.811+0000 7fa8f17247c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:49:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:11.811+0000 7fa8f17247c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:49:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:11.811+0000 7fa8f17247c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:49:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:11.811+0000 7fa8f17247c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:49:11.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:11.811+0000 7fa8f17247c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:49:14.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:49:14.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:49:14.814 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:49:14.814 INFO:tasks.ceph:role: osd.1 2024-04-26T12:49:14.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:49:14.814 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:49:14.878 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:49:15.364 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-26T12:49:15.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-26T12:49:15.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:49:15.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:49:15.521 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:49:15.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:49:15.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:49:15.580 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:49:15.580 INFO:tasks.ceph:role: osd.2 2024-04-26T12:49:15.580 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:49:15.580 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T12:49:15.642 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:49:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:49:15.643 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:49:16.086 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-26T12:49:16.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-26T12:49:16.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-26T12:49:16.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:49:16.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:49:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:49:16.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T12:49:16.270 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:49:16.270 INFO:tasks.ceph:role: osd.3 2024-04-26T12:49:16.270 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:49:16.270 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:49:16.335 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:49:16.790 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-26T12:49:16.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-26T12:49:16.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-26T12:49:16.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T12:49:16.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:49:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:49:16.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:17.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:17.029+0000 7fca1cd887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:49:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:17.033+0000 7fca1cd887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:49:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:17.033+0000 7fca1cd887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:49:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:17.033+0000 7fca1cd887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:49:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:17.033+0000 7fca1cd887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:49:17.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:17.037+0000 7fca1cd887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:49:19.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:49:20.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:20.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:20.097+0000 7f2099e2f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:49:20.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:20.097+0000 7f2099e2f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:49:20.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:20.097+0000 7f2099e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:49:20.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:20.097+0000 7f2099e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:49:20.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:20.097+0000 7f2099e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:49:20.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:20.097+0000 7f2099e2f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:49:23.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:49:23.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:23.212+0000 7f91fc7847c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T12:49:23.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:23.212+0000 7f91fc7847c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T12:49:23.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:23.212+0000 7f91fc7847c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:49:23.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:23.212+0000 7f91fc7847c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:49:23.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:23.212+0000 7f91fc7847c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:49:23.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:23.212+0000 7f91fc7847c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T12:49:26.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T12:49:26.251 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:49:26.251 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:26.251 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:49:26.265 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:26.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:49:26.307 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:26.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:49:26.362 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:26.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:49:26.418 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:26.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T12:49:26.475 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:26.475 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:49:26.523 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:49:26.523 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:49:26.536 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-04-26T12:49:26.536 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDHoitmL1y/MBAA69KAbzZEhKdxmBOTP7Uj7w== 2024-04-26T12:49:26.536 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-04-26T12:49:26.536 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDHoitmP16JFxAA8ZSyHB4QND3U9K7rnuCNkQ== 2024-04-26T12:49:26.536 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-04-26T12:49:26.536 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDNoitmFKLQARAAcXpSdpyekfNYtN6B8cjBZA== 2024-04-26T12:49:26.537 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-04-26T12:49:26.537 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDQoitmTnHsBRAA2hQnlRv9pC7mzBvyhUnYrA== 2024-04-26T12:49:26.537 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-04-26T12:49:26.537 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDToitmVPPMDBAAEwfGNSCc3WVfSk6le1EbXA== 2024-04-26T12:49:26.537 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-04-26T12:49:26.537 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDHoitmOB+CHBAAc3+dzmkSEhwdss9ii82tZw== 2024-04-26T12:49:26.538 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:49:26.627 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:49:26.670 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:49:26.753 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:49:26.841 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:49:26.882 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:49:26.968 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:49:26.968 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:49:27.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:49:27.122 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:49:27.133 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:49:27.184 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:49:27.184 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:49:27.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:49:27.230 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:49:27.230 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:49:27.230 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:49:27.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:49:27.233 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:49:27.233 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:49:27.233 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:49:27.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f1996b65640 1 Processor -- start 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f1996b65640 1 -- start start 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f1996b65640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 0x7f1990133e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f1996b65640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1990093d00 con 0x7f1990094450 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f1996b65640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f199006b710 con 0x7f1990094f40 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f1994901640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1990094450 0x7f1990094830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33168/0 (socket says 172.21.15.29:33168) 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f1994901640 1 -- 172.21.15.29:0/437077119 learned_addr learned my addr 172.21.15.29:0/437077119 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f198ffff640 1 --2- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 0x7f1990133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f198ffff640 1 -- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 msgr2=0x7f1990133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f198ffff640 1 -- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 msgr2=0x7f1990133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T12:49:27.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f198ffff640 1 --2- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 0x7f1990133e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:49:27.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.347+0000 7f198ffff640 1 --2- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 0x7f1990133e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.359+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966206318 0 0) 0x7f1990093d00 con 0x7f1990094450 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.359+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1980003530 con 0x7f1990094450 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.359+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 954464785 0 0) 0x7f1980003530 con 0x7f1990094450 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 msgr2=0x7f1990133e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f198f7fe640 1 --2- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 0x7f1990133e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1990095c00 con 0x7f1990094450 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3061189159 0 0) 0x7f19840015b0 con 0x7f1990094450 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 >> v1:172.21.15.29:6789/0 conn(0x7f1990094450 legacy=0x7f1990094830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:27.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f198f7fe640 1 --2- 172.21.15.29:0/437077119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f1980003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1980004560 con 0x7f19800039f0 2024-04-26T12:49:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f1994901640 1 --2- 172.21.15.29:0/437077119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f1980003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:27.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.363+0000 7f1994901640 1 -- 172.21.15.29:0/437077119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1980003530 con 0x7f19800039f0 2024-04-26T12:49:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1994901640 1 --2- 172.21.15.29:0/437077119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f1980003df0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1984007fc0 tx=0x7f198401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de335857810fc434 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1984007c90 con 0x7f19800039f0 2024-04-26T12:49:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19840a9070 con 0x7f19800039f0 2024-04-26T12:49:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f198f7fe640 1 -- 172.21.15.29:0/437077119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19840a5b90 con 0x7f19800039f0 2024-04-26T12:49:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 -- 172.21.15.29:0/437077119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 msgr2=0x7f1980003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 --2- 172.21.15.29:0/437077119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f1980003df0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1984007fc0 tx=0x7f198401cca0 comp rx=0 tx=0).stop 2024-04-26T12:49:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 -- 172.21.15.29:0/437077119 shutdown_connections 2024-04-26T12:49:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 --2- 172.21.15.29:0/437077119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f1980003df0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:27.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 --2- 172.21.15.29:0/437077119 >> v2:172.21.15.29:3300/0 conn(0x7f1990094f40 0x7f1990133e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:27.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 -- 172.21.15.29:0/437077119 >> 172.21.15.29:0/437077119 conn(0x7f199009d0b0 msgr2=0x7f199009d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:27.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 -- 172.21.15.29:0/437077119 shutdown_connections 2024-04-26T12:49:27.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.383+0000 7f1996b65640 1 -- 172.21.15.29:0/437077119 wait complete. 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1996b65640 1 Processor -- start 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1996b65640 1 -- start start 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1996b65640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f199008fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1996b65640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1990096cf0 con 0x7f19800039f0 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1994901640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f199008fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1994901640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f199008fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38474/0 (socket says 172.21.15.29:38474) 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1994901640 1 -- 172.21.15.29:0/1605453134 learned_addr learned my addr 172.21.15.29:0/1605453134 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1994901640 1 -- 172.21.15.29:0/1605453134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1990091df0 con 0x7f19800039f0 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1994901640 1 --2- 172.21.15.29:0/1605453134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f199008fec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1984098690 tx=0x7f1980005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f198d7fa640 1 -- 172.21.15.29:0/1605453134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19840a5b00 con 0x7f19800039f0 2024-04-26T12:49:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f198d7fa640 1 -- 172.21.15.29:0/1605453134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19840a5ca0 con 0x7f19800039f0 2024-04-26T12:49:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19900928b0 con 0x7f19800039f0 2024-04-26T12:49:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f198d7fa640 1 -- 172.21.15.29:0/1605453134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19840047f0 con 0x7f19800039f0 2024-04-26T12:49:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199006e5f0 con 0x7f19800039f0 2024-04-26T12:49:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f198d7fa640 1 -- 172.21.15.29:0/1605453134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19840070c0 con 0x7f19800039f0 2024-04-26T12:49:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f198d7fa640 1 -- 172.21.15.29:0/1605453134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f19840b4030 con 0x7f19800039f0 2024-04-26T12:49:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.387+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1990062f80 con 0x7f19800039f0 2024-04-26T12:49:27.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.423+0000 7f198d7fa640 1 -- 172.21.15.29:0/1605453134 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1984016890 con 0x7f19800039f0 2024-04-26T12:49:27.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.491+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1990096a20 con 0x7f19800039f0 2024-04-26T12:49:27.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.491+0000 7f198d7fa640 1 -- 172.21.15.29:0/1605453134 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f19840ae470 con 0x7f19800039f0 2024-04-26T12:49:27.495 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-04-26T12:49:27.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.495+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 msgr2=0x7f199008fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.495+0000 7f1996b65640 1 --2- 172.21.15.29:0/1605453134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f199008fec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1984098690 tx=0x7f1980005840 comp rx=0 tx=0).stop 2024-04-26T12:49:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.495+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 shutdown_connections 2024-04-26T12:49:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.495+0000 7f1996b65640 1 --2- 172.21.15.29:0/1605453134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19800039f0 0x7f199008fec0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.495+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 >> 172.21.15.29:0/1605453134 conn(0x7f199009d0b0 msgr2=0x7f19900984f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.495+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 shutdown_connections 2024-04-26T12:49:27.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:27.495+0000 7f1996b65640 1 -- 172.21.15.29:0/1605453134 wait complete. 2024-04-26T12:49:27.514 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:49:27.514 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:49:27.514 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T12:49:27.514 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:49:27.526 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:27.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:49:27.540 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:27.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:49:27.595 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T12:49:27.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T12:49:27.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new a486baa1-57d4-44e0-81e1-6c67d01653d4 0 2024-04-26T12:49:27.702 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:27.700+0000 7f652b306180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193cb9b640 1 Processor -- start 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193cb9b640 1 -- start start 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193cb9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1938115b10 0x7f1938115f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193cb9b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19381165a0 con 0x7f193810df00 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193cb9b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f193810eac0 con 0x7f1938115b10 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1938115b10 0x7f1938115f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1938115b10 0x7f1938115f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53058/0 (socket says 172.21.15.72:53058) 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193659c640 1 -- 172.21.15.72:0/3119413280 learned_addr learned my addr 172.21.15.72:0/3119413280 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193659c640 1 -- 172.21.15.72:0/3119413280 >> v1:172.21.15.29:6789/0 conn(0x7f193810df00 legacy=0x7f193810e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.824+0000 7f193659c640 1 -- 172.21.15.72:0/3119413280 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193810ec70 con 0x7f1938115b10 2024-04-26T12:49:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193659c640 1 --2- 172.21.15.72:0/3119413280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1938115b10 0x7f1938115f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19280097f0 tx=0x7f192801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8605e181401a874e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193559a640 1 -- 172.21.15.72:0/3119413280 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19280ab580 con 0x7f1938115b10 2024-04-26T12:49:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193559a640 1 -- 172.21.15.72:0/3119413280 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19280b0070 con 0x7f1938115b10 2024-04-26T12:49:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193559a640 1 -- 172.21.15.72:0/3119413280 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19280ab870 con 0x7f1938115b10 2024-04-26T12:49:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 -- 172.21.15.72:0/3119413280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1938115b10 msgr2=0x7f1938115f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 --2- 172.21.15.72:0/3119413280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1938115b10 0x7f1938115f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19280097f0 tx=0x7f192801c430 comp rx=0 tx=0).stop 2024-04-26T12:49:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 -- 172.21.15.72:0/3119413280 shutdown_connections 2024-04-26T12:49:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 --2- 172.21.15.72:0/3119413280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1938115b10 0x7f1938115f10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 -- 172.21.15.72:0/3119413280 >> 172.21.15.72:0/3119413280 conn(0x7f193806fb20 msgr2=0x7f1938071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 -- 172.21.15.72:0/3119413280 shutdown_connections 2024-04-26T12:49:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 -- 172.21.15.72:0/3119413280 wait complete. 2024-04-26T12:49:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 Processor -- start 2024-04-26T12:49:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 -- start start 2024-04-26T12:49:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f193810df00 0x7f19381aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193cb9b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f193811e550 con 0x7f193810df00 2024-04-26T12:49:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f193810df00 0x7f19381aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f193810df00 0x7f19381aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53062/0 (socket says 172.21.15.72:53062) 2024-04-26T12:49:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193659c640 1 -- 172.21.15.72:0/3590579537 learned_addr learned my addr 172.21.15.72:0/3590579537 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193659c640 1 -- 172.21.15.72:0/3590579537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19381af290 con 0x7f193810df00 2024-04-26T12:49:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.828+0000 7f193659c640 1 --2- 172.21.15.72:0/3590579537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f193810df00 0x7f19381aecc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1928019040 tx=0x7f192801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f1926ffd640 1 -- 172.21.15.72:0/3590579537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19280abe50 con 0x7f193810df00 2024-04-26T12:49:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f1926ffd640 1 -- 172.21.15.72:0/3590579537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19280aa8f0 con 0x7f193810df00 2024-04-26T12:49:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19381af4c0 con 0x7f193810df00 2024-04-26T12:49:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f1926ffd640 1 -- 172.21.15.72:0/3590579537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19280aabf0 con 0x7f193810df00 2024-04-26T12:49:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19381a8db0 con 0x7f193810df00 2024-04-26T12:49:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f1926ffd640 1 -- 172.21.15.72:0/3590579537 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19280c77d0 con 0x7f193810df00 2024-04-26T12:49:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f1926ffd640 1 -- 172.21.15.72:0/3590579537 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f19280be940 con 0x7f193810df00 2024-04-26T12:49:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.832+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193804fe90 con 0x7f193810df00 2024-04-26T12:49:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.836+0000 7f1926ffd640 1 -- 172.21.15.72:0/3590579537 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f19280160b0 con 0x7f193810df00 2024-04-26T12:49:27.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.904+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a486baa1-57d4-44e0-81e1-6c67d01653d4", "id": 0} v 0) -- 0x7f1938115b10 con 0x7f193810df00 2024-04-26T12:49:27.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f1926ffd640 1 -- 172.21.15.72:0/3590579537 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a486baa1-57d4-44e0-81e1-6c67d01653d4", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f19280aad90 con 0x7f193810df00 2024-04-26T12:49:27.908 INFO:teuthology.orchestra.run.smithi072.stdout:0 2024-04-26T12:49:27.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f193810df00 msgr2=0x7f19381aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:27.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f193cb9b640 1 --2- 172.21.15.72:0/3590579537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f193810df00 0x7f19381aecc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1928019040 tx=0x7f192801ac70 comp rx=0 tx=0).stop 2024-04-26T12:49:27.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 shutdown_connections 2024-04-26T12:49:27.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f193cb9b640 1 --2- 172.21.15.72:0/3590579537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f193810df00 0x7f19381aecc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:27.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 >> 172.21.15.72:0/3590579537 conn(0x7f193806fb20 msgr2=0x7f193810f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:27.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 shutdown_connections 2024-04-26T12:49:27.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:27.908+0000 7f193cb9b640 1 -- 172.21.15.72:0/3590579537 wait complete. 2024-04-26T12:49:27.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 58ac9945-efae-4b1c-bb23-e53958170e53 1 2024-04-26T12:49:28.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f963ac93640 1 Processor -- start 2024-04-26T12:49:28.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f963ac93640 1 -- start start 2024-04-26T12:49:28.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f963ac93640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96341108f0 0x7f963406bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f963ac93640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f963406c560 con 0x7f963406c0b0 2024-04-26T12:49:28.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f963ac93640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f963406c730 con 0x7f96341108f0 2024-04-26T12:49:28.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f9638a2f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96341108f0 0x7f963406bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f9638a2f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96341108f0 0x7f963406bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53070/0 (socket says 172.21.15.72:53070) 2024-04-26T12:49:28.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f9638a2f640 1 -- 172.21.15.72:0/3013721507 learned_addr learned my addr 172.21.15.72:0/3013721507 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:28.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f9638a2f640 1 -- 172.21.15.72:0/3013721507 >> v1:172.21.15.29:6789/0 conn(0x7f963406c0b0 legacy=0x7f963411c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.044+0000 7f9638a2f640 1 -- 172.21.15.72:0/3013721507 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963406c8e0 con 0x7f96341108f0 2024-04-26T12:49:28.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f9638a2f640 1 --2- 172.21.15.72:0/3013721507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96341108f0 0x7f963406bb70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96240097f0 tx=0x7f962401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7e209a27279cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f96337fe640 1 -- 172.21.15.72:0/3013721507 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96240b0070 con 0x7f96341108f0 2024-04-26T12:49:28.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f96337fe640 1 -- 172.21.15.72:0/3013721507 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9624004160 con 0x7f96341108f0 2024-04-26T12:49:28.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f96337fe640 1 -- 172.21.15.72:0/3013721507 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96240044a0 con 0x7f96341108f0 2024-04-26T12:49:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 -- 172.21.15.72:0/3013721507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96341108f0 msgr2=0x7f963406bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 --2- 172.21.15.72:0/3013721507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96341108f0 0x7f963406bb70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96240097f0 tx=0x7f962401c4c0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 -- 172.21.15.72:0/3013721507 shutdown_connections 2024-04-26T12:49:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 --2- 172.21.15.72:0/3013721507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96341108f0 0x7f963406bb70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 -- 172.21.15.72:0/3013721507 >> 172.21.15.72:0/3013721507 conn(0x7f9634070340 msgr2=0x7f9634072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 -- 172.21.15.72:0/3013721507 shutdown_connections 2024-04-26T12:49:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 -- 172.21.15.72:0/3013721507 wait complete. 2024-04-26T12:49:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 Processor -- start 2024-04-26T12:49:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 -- start start 2024-04-26T12:49:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963406c0b0 0x7f96341aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f963ac93640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f96341207b0 con 0x7f963406c0b0 2024-04-26T12:49:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f9638a2f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963406c0b0 0x7f96341aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f9638a2f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963406c0b0 0x7f96341aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53080/0 (socket says 172.21.15.72:53080) 2024-04-26T12:49:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f9638a2f640 1 -- 172.21.15.72:0/4227871860 learned_addr learned my addr 172.21.15.72:0/4227871860 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.048+0000 7f9638a2f640 1 -- 172.21.15.72:0/4227871860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96341af360 con 0x7f963406c0b0 2024-04-26T12:49:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f9638a2f640 1 --2- 172.21.15.72:0/4227871860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963406c0b0 0x7f96341aed90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f962401a0f0 tx=0x7f9624019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f96317fa640 1 -- 172.21.15.72:0/4227871860 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96240b9020 con 0x7f963406c0b0 2024-04-26T12:49:28.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f96317fa640 1 -- 172.21.15.72:0/4227871860 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96240b1040 con 0x7f963406c0b0 2024-04-26T12:49:28.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96341af5f0 con 0x7f963406c0b0 2024-04-26T12:49:28.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f96317fa640 1 -- 172.21.15.72:0/4227871860 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96240b0050 con 0x7f963406c0b0 2024-04-26T12:49:28.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96341a9000 con 0x7f963406c0b0 2024-04-26T12:49:28.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f96317fa640 1 -- 172.21.15.72:0/4227871860 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96240bc020 con 0x7f963406c0b0 2024-04-26T12:49:28.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f96317fa640 1 -- 172.21.15.72:0/4227871860 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f96240be9c0 con 0x7f963406c0b0 2024-04-26T12:49:28.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.052+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963404fe90 con 0x7f963406c0b0 2024-04-26T12:49:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.056+0000 7f96317fa640 1 -- 172.21.15.72:0/4227871860 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f96240c3030 con 0x7f963406c0b0 2024-04-26T12:49:28.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "58ac9945-efae-4b1c-bb23-e53958170e53", "id": 1} v 0) -- 0x7f96341af7c0 con 0x7f963406c0b0 2024-04-26T12:49:28.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f96317fa640 1 -- 172.21.15.72:0/4227871860 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58ac9945-efae-4b1c-bb23-e53958170e53", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f96240160b0 con 0x7f963406c0b0 2024-04-26T12:49:28.128 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-04-26T12:49:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963406c0b0 msgr2=0x7f96341aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 --2- 172.21.15.72:0/4227871860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963406c0b0 0x7f96341aed90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f962401a0f0 tx=0x7f9624019260 comp rx=0 tx=0).stop 2024-04-26T12:49:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 shutdown_connections 2024-04-26T12:49:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 --2- 172.21.15.72:0/4227871860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963406c0b0 0x7f96341aed90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 >> 172.21.15.72:0/4227871860 conn(0x7f9634070340 msgr2=0x7f9634119a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 shutdown_connections 2024-04-26T12:49:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.128+0000 7f963ac93640 1 -- 172.21.15.72:0/4227871860 wait complete. 2024-04-26T12:49:28.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 152b72f4-b41a-429c-9f88-79befe0eae01 2 2024-04-26T12:49:28.226 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:28.228+0000 7f652b306180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:49:28.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0398f640 1 Processor -- start 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0398f640 1 -- start start 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0398f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9efc1108f0 0x7f9efc06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0398f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9efc06c560 con 0x7f9efc06c0b0 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0398f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9efc06c730 con 0x7f9efc1108f0 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0172b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9efc1108f0 0x7f9efc06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0172b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9efc1108f0 0x7f9efc06bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53084/0 (socket says 172.21.15.72:53084) 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f00f2a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9efc06c0b0 0x7f9efc11c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:60814/0 (socket says 172.21.15.72:60814) 2024-04-26T12:49:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0172b640 1 -- 172.21.15.72:0/4290113855 learned_addr learned my addr 172.21.15.72:0/4290113855 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:28.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0172b640 1 -- 172.21.15.72:0/4290113855 >> v1:172.21.15.29:6789/0 conn(0x7f9efc06c0b0 legacy=0x7f9efc11c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.264+0000 7f9f0172b640 1 -- 172.21.15.72:0/4290113855 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9efc06c8e0 con 0x7f9efc1108f0 2024-04-26T12:49:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0172b640 1 --2- 172.21.15.72:0/4290113855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc1108f0 0x7f9efc06bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0097f0 tx=0x7f9eec01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0c65a11199d658 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9ef3fff640 1 -- 172.21.15.72:0/4290113855 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eec0b0070 con 0x7f9efc1108f0 2024-04-26T12:49:28.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9ef3fff640 1 -- 172.21.15.72:0/4290113855 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec004160 con 0x7f9efc1108f0 2024-04-26T12:49:28.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9ef3fff640 1 -- 172.21.15.72:0/4290113855 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eec0044a0 con 0x7f9efc1108f0 2024-04-26T12:49:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 -- 172.21.15.72:0/4290113855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc1108f0 msgr2=0x7f9efc06bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 --2- 172.21.15.72:0/4290113855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc1108f0 0x7f9efc06bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0097f0 tx=0x7f9eec01c4c0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 -- 172.21.15.72:0/4290113855 shutdown_connections 2024-04-26T12:49:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 --2- 172.21.15.72:0/4290113855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc1108f0 0x7f9efc06bb70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 -- 172.21.15.72:0/4290113855 >> 172.21.15.72:0/4290113855 conn(0x7f9efc070340 msgr2=0x7f9efc072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 -- 172.21.15.72:0/4290113855 shutdown_connections 2024-04-26T12:49:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 -- 172.21.15.72:0/4290113855 wait complete. 2024-04-26T12:49:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.268+0000 7f9f0398f640 1 Processor -- start 2024-04-26T12:49:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0398f640 1 -- start start 2024-04-26T12:49:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0398f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc06c0b0 0x7f9efc1aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0398f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1207b0 con 0x7f9efc06c0b0 2024-04-26T12:49:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0172b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc06c0b0 0x7f9efc1aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0172b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc06c0b0 0x7f9efc1aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53088/0 (socket says 172.21.15.72:53088) 2024-04-26T12:49:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0172b640 1 -- 172.21.15.72:0/2896939370 learned_addr learned my addr 172.21.15.72:0/2896939370 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0172b640 1 -- 172.21.15.72:0/2896939370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9efc1af2e0 con 0x7f9efc06c0b0 2024-04-26T12:49:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0172b640 1 --2- 172.21.15.72:0/2896939370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc06c0b0 0x7f9efc1aed10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9eec01a0f0 tx=0x7f9eec019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9ef1ffb640 1 -- 172.21.15.72:0/2896939370 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eec0b9020 con 0x7f9efc06c0b0 2024-04-26T12:49:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9ef1ffb640 1 -- 172.21.15.72:0/2896939370 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec0b1040 con 0x7f9efc06c0b0 2024-04-26T12:49:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9efc1af570 con 0x7f9efc06c0b0 2024-04-26T12:49:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9ef1ffb640 1 -- 172.21.15.72:0/2896939370 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eec0b0050 con 0x7f9efc06c0b0 2024-04-26T12:49:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9efc1a8f80 con 0x7f9efc06c0b0 2024-04-26T12:49:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9ef1ffb640 1 -- 172.21.15.72:0/2896939370 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9eec0bc020 con 0x7f9efc06c0b0 2024-04-26T12:49:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9ef1ffb640 1 -- 172.21.15.72:0/2896939370 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f9eec0be9f0 con 0x7f9efc06c0b0 2024-04-26T12:49:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.272+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9efc04fe90 con 0x7f9efc06c0b0 2024-04-26T12:49:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.280+0000 7f9ef1ffb640 1 -- 172.21.15.72:0/2896939370 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9eec0c3030 con 0x7f9efc06c0b0 2024-04-26T12:49:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.340+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "152b72f4-b41a-429c-9f88-79befe0eae01", "id": 2} v 0) -- 0x7f9efc1af740 con 0x7f9efc06c0b0 2024-04-26T12:49:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9ef1ffb640 1 -- 172.21.15.72:0/2896939370 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "152b72f4-b41a-429c-9f88-79befe0eae01", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f9eec0160b0 con 0x7f9efc06c0b0 2024-04-26T12:49:28.344 INFO:teuthology.orchestra.run.smithi072.stdout:2 2024-04-26T12:49:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc06c0b0 msgr2=0x7f9efc1aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9f0398f640 1 --2- 172.21.15.72:0/2896939370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc06c0b0 0x7f9efc1aed10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9eec01a0f0 tx=0x7f9eec019260 comp rx=0 tx=0).stop 2024-04-26T12:49:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 shutdown_connections 2024-04-26T12:49:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9f0398f640 1 --2- 172.21.15.72:0/2896939370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9efc06c0b0 0x7f9efc1aed10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 >> 172.21.15.72:0/2896939370 conn(0x7f9efc070340 msgr2=0x7f9efc119ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 shutdown_connections 2024-04-26T12:49:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.344+0000 7f9f0398f640 1 -- 172.21.15.72:0/2896939370 wait complete. 2024-04-26T12:49:28.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new ba649e3f-0dcb-4dbb-a39a-c7557b884273 3 2024-04-26T12:49:28.436 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:28.436+0000 7f652b306180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:49:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede4662640 1 Processor -- start 2024-04-26T12:49:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede4662640 1 -- start start 2024-04-26T12:49:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede4662640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feddc110970 0x7feddc06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede4662640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feddc06c560 con 0x7feddc06c0b0 2024-04-26T12:49:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede4662640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7feddc06c730 con 0x7feddc110970 2024-04-26T12:49:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede23fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feddc110970 0x7feddc06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede23fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feddc110970 0x7feddc06bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53094/0 (socket says 172.21.15.72:53094) 2024-04-26T12:49:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede23fe640 1 -- 172.21.15.72:0/503319548 learned_addr learned my addr 172.21.15.72:0/503319548 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede1bfd640 1 --1- 172.21.15.72:0/503319548 >> v1:172.21.15.29:6789/0 conn(0x7feddc06c0b0 0x7feddc11c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:60818/0 (socket says 172.21.15.72:60818) 2024-04-26T12:49:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede23fe640 1 -- 172.21.15.72:0/503319548 >> v1:172.21.15.29:6789/0 conn(0x7feddc06c0b0 legacy=0x7feddc11c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.468+0000 7fede23fe640 1 -- 172.21.15.72:0/503319548 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc06c8e0 con 0x7feddc110970 2024-04-26T12:49:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede23fe640 1 --2- 172.21.15.72:0/503319548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc110970 0x7feddc06bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fedd80097f0 tx=0x7fedd801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ce2d12dcac2092 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede13fc640 1 -- 172.21.15.72:0/503319548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd80b1070 con 0x7feddc110970 2024-04-26T12:49:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede13fc640 1 -- 172.21.15.72:0/503319548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd80ac530 con 0x7feddc110970 2024-04-26T12:49:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede13fc640 1 -- 172.21.15.72:0/503319548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd80ac830 con 0x7feddc110970 2024-04-26T12:49:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 -- 172.21.15.72:0/503319548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc110970 msgr2=0x7feddc06bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 --2- 172.21.15.72:0/503319548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc110970 0x7feddc06bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fedd80097f0 tx=0x7fedd801c490 comp rx=0 tx=0).stop 2024-04-26T12:49:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 -- 172.21.15.72:0/503319548 shutdown_connections 2024-04-26T12:49:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 --2- 172.21.15.72:0/503319548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc110970 0x7feddc06bb70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 -- 172.21.15.72:0/503319548 >> 172.21.15.72:0/503319548 conn(0x7feddc070340 msgr2=0x7feddc072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 -- 172.21.15.72:0/503319548 shutdown_connections 2024-04-26T12:49:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 -- 172.21.15.72:0/503319548 wait complete. 2024-04-26T12:49:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 Processor -- start 2024-04-26T12:49:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.472+0000 7fede4662640 1 -- start start 2024-04-26T12:49:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede4662640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc06c0b0 0x7feddc1aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede4662640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7feddc1207b0 con 0x7feddc06c0b0 2024-04-26T12:49:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede23fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc06c0b0 0x7feddc1aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede23fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc06c0b0 0x7feddc1aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:53104/0 (socket says 172.21.15.72:53104) 2024-04-26T12:49:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede23fe640 1 -- 172.21.15.72:0/3029518125 learned_addr learned my addr 172.21.15.72:0/3029518125 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede23fe640 1 -- 172.21.15.72:0/3029518125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc1af220 con 0x7feddc06c0b0 2024-04-26T12:49:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede23fe640 1 --2- 172.21.15.72:0/3029518125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc06c0b0 0x7feddc1aec50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fedd80097f0 tx=0x7fedd801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fedd2ffd640 1 -- 172.21.15.72:0/3029518125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd80bb020 con 0x7feddc06c0b0 2024-04-26T12:49:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fedd2ffd640 1 -- 172.21.15.72:0/3029518125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd80ab800 con 0x7feddc06c0b0 2024-04-26T12:49:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fedd2ffd640 1 -- 172.21.15.72:0/3029518125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd80b1040 con 0x7feddc06c0b0 2024-04-26T12:49:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc1af450 con 0x7feddc06c0b0 2024-04-26T12:49:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc1a8cf0 con 0x7feddc06c0b0 2024-04-26T12:49:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fedd2ffd640 1 -- 172.21.15.72:0/3029518125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fedd80be020 con 0x7feddc06c0b0 2024-04-26T12:49:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fedd2ffd640 1 -- 172.21.15.72:0/3029518125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fedd80b7d80 con 0x7feddc06c0b0 2024-04-26T12:49:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.476+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc04fe90 con 0x7feddc06c0b0 2024-04-26T12:49:28.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.484+0000 7fedd2ffd640 1 -- 172.21.15.72:0/3029518125 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fedd80c5030 con 0x7feddc06c0b0 2024-04-26T12:49:28.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.544+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba649e3f-0dcb-4dbb-a39a-c7557b884273", "id": 3} v 0) -- 0x7feddc110970 con 0x7feddc06c0b0 2024-04-26T12:49:28.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fedd2ffd640 1 -- 172.21.15.72:0/3029518125 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba649e3f-0dcb-4dbb-a39a-c7557b884273", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fedd80160b0 con 0x7feddc06c0b0 2024-04-26T12:49:28.548 INFO:teuthology.orchestra.run.smithi072.stdout:3 2024-04-26T12:49:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc06c0b0 msgr2=0x7feddc1aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fede4662640 1 --2- 172.21.15.72:0/3029518125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc06c0b0 0x7feddc1aec50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fedd80097f0 tx=0x7fedd801acd0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 shutdown_connections 2024-04-26T12:49:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fede4662640 1 --2- 172.21.15.72:0/3029518125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feddc06c0b0 0x7feddc1aec50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 >> 172.21.15.72:0/3029518125 conn(0x7feddc070340 msgr2=0x7feddc119a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 shutdown_connections 2024-04-26T12:49:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:28.548+0000 7fede4662640 1 -- 172.21.15.72:0/3029518125 wait complete. 2024-04-26T12:49:28.564 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:49:28.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:49:28.567 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:49:28.567 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:49:28.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:49:28.569 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:49:28.569 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:49:28.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:49:28.571 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:49:28.571 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T12:49:28.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T12:49:28.574 INFO:tasks.ceph.osd.3:Started 2024-04-26T12:49:28.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe33d8f7640 1 Processor -- start 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe33d8f7640 1 -- start start 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe33d8f7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe338095390 0x7fe338095770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe33d8f7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33809d410 con 0x7fe338095cb0 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe33d8f7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe338093cb0 con 0x7fe338095390 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe336ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe338095390 0x7fe338095770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe3367fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe338095cb0 0x7fe33812f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33194/0 (socket says 172.21.15.29:33194) 2024-04-26T12:49:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe3367fc640 1 -- 172.21.15.29:0/2049843627 learned_addr learned my addr 172.21.15.29:0/2049843627 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:28.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe336ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe338095390 0x7fe338095770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38490/0 (socket says 172.21.15.29:38490) 2024-04-26T12:49:28.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe336ffd640 1 -- 172.21.15.29:0/2049843627 >> v1:172.21.15.29:6789/0 conn(0x7fe338095cb0 legacy=0x7fe33812f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe335ffb640 1 -- 172.21.15.29:0/2049843627 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998784007 0 0) 0x7fe33809d410 con 0x7fe338095cb0 2024-04-26T12:49:28.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.691+0000 7fe336ffd640 1 -- 172.21.15.29:0/2049843627 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe338090e70 con 0x7fe338095390 2024-04-26T12:49:28.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe336ffd640 1 --2- 172.21.15.29:0/2049843627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe338095770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe32800b9e0 tx=0x7fe32801ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb28d6da9fc34b8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe335ffb640 1 -- 172.21.15.29:0/2049843627 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3280b4070 con 0x7fe338095390 2024-04-26T12:49:28.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe335ffb640 1 -- 172.21.15.29:0/2049843627 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3280a7960 con 0x7fe338095390 2024-04-26T12:49:28.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe335ffb640 1 -- 172.21.15.29:0/2049843627 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3280a7c60 con 0x7fe338095390 2024-04-26T12:49:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 -- 172.21.15.29:0/2049843627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 msgr2=0x7fe338095770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 --2- 172.21.15.29:0/2049843627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe338095770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe32800b9e0 tx=0x7fe32801ea40 comp rx=0 tx=0).stop 2024-04-26T12:49:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 -- 172.21.15.29:0/2049843627 shutdown_connections 2024-04-26T12:49:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 --2- 172.21.15.29:0/2049843627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe338095770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 -- 172.21.15.29:0/2049843627 >> 172.21.15.29:0/2049843627 conn(0x7fe33809a3f0 msgr2=0x7fe33809a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 -- 172.21.15.29:0/2049843627 shutdown_connections 2024-04-26T12:49:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 -- 172.21.15.29:0/2049843627 wait complete. 2024-04-26T12:49:28.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 Processor -- start 2024-04-26T12:49:28.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.695+0000 7fe33d8f7640 1 -- start start 2024-04-26T12:49:28.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe33d8f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe33812f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:28.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe33d8f7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe338094e60 con 0x7fe338095390 2024-04-26T12:49:28.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe336ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe33812f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:28.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe336ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe33812f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38506/0 (socket says 172.21.15.29:38506) 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe336ffd640 1 -- 172.21.15.29:0/1444649381 learned_addr learned my addr 172.21.15.29:0/1444649381 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe336ffd640 1 -- 172.21.15.29:0/1444649381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe338121a90 con 0x7fe338095390 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe336ffd640 1 --2- 172.21.15.29:0/1444649381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe33812f570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3280b2040 tx=0x7fe32801b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe31ffff640 1 -- 172.21.15.29:0/1444649381 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3280bf020 con 0x7fe338095390 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe31ffff640 1 -- 172.21.15.29:0/1444649381 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3280af820 con 0x7fe338095390 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe31ffff640 1 -- 172.21.15.29:0/1444649381 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3280b4040 con 0x7fe338095390 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33808fb00 con 0x7fe338095390 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe338122db0 con 0x7fe338095390 2024-04-26T12:49:28.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe31ffff640 1 -- 172.21.15.29:0/1444649381 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe3280c2020 con 0x7fe338095390 2024-04-26T12:49:28.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe31ffff640 1 -- 172.21.15.29:0/1444649381 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe3280bac90 con 0x7fe338095390 2024-04-26T12:49:28.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.699+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe338062f80 con 0x7fe338095390 2024-04-26T12:49:28.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.703+0000 7fe31ffff640 1 -- 172.21.15.29:0/1444649381 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe3280c9030 con 0x7fe338095390 2024-04-26T12:49:28.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe338094060 con 0x7fe338095390 2024-04-26T12:49:28.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe31ffff640 1 -- 172.21.15.29:0/1444649381 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fe338090e70 con 0x7fe338095390 2024-04-26T12:49:28.763 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:28.763 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"fsid":"e9a80640-28c1-4a64-ae98-6666131f9984","created":"2024-04-26T12:49:27.360185+0000","modified":"2024-04-26T12:49:28.549061+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:49:28.549061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a486baa1-57d4-44e0-81e1-6c67d01653d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58ac9945-efae-4b1c-bb23-e53958170e53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"152b72f4-b41a-429c-9f88-79befe0eae01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba649e3f-0dcb-4dbb-a39a-c7557b884273","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:49:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 msgr2=0x7fe33812f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 --2- 172.21.15.29:0/1444649381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe33812f570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3280b2040 tx=0x7fe32801b7e0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 shutdown_connections 2024-04-26T12:49:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 --2- 172.21.15.29:0/1444649381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe338095390 0x7fe33812f570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 >> 172.21.15.29:0/1444649381 conn(0x7fe33809a3f0 msgr2=0x7fe33806fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 shutdown_connections 2024-04-26T12:49:28.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:28.759+0000 7fe33d8f7640 1 -- 172.21.15.29:0/1444649381 wait complete. 2024-04-26T12:49:28.781 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:49:28.781 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:49:28.983 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:28.984+0000 7f652b306180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:49:29.037 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.036+0000 7f652b306180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:49:29.088 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.088+0000 7f652b306180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:49:29.164 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.164+0000 7f652b306180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:49:29.167 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-26T12:49:29.168+0000 7fd9d5acb7c0 -1 Falling back to public interface 2024-04-26T12:49:29.178 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-26T12:49:29.175+0000 7fb75b8a37c0 -1 Falling back to public interface 2024-04-26T12:49:29.179 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-26T12:49:29.180+0000 7f9eee1127c0 -1 Falling back to public interface 2024-04-26T12:49:29.185 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:49:29.190 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-26T12:49:29.192+0000 7f10646967c0 -1 Falling back to public interface 2024-04-26T12:49:29.218 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.220+0000 7f652b306180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:49:29.294 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.296+0000 7f652b306180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:49:29.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.299+0000 7f637b467640 1 Processor -- start 2024-04-26T12:49:29.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.299+0000 7f637b467640 1 -- start start 2024-04-26T12:49:29.304 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f637b467640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f637412f4e0 0x7f63741318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:29.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f637b467640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6374128e30 con 0x7f6374129050 2024-04-26T12:49:29.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f637b467640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6374129b40 con 0x7f637412f4e0 2024-04-26T12:49:29.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f6378a02640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f637412f4e0 0x7f63741318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:29.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f6378a02640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f637412f4e0 0x7f63741318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38516/0 (socket says 172.21.15.29:38516) 2024-04-26T12:49:29.305 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f6378a02640 1 -- 172.21.15.29:0/833259127 learned_addr learned my addr 172.21.15.29:0/833259127 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:29.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f6379203640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6374129050 0x7f6374129430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33208/0 (socket says 172.21.15.29:33208) 2024-04-26T12:49:29.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f6378a02640 1 -- 172.21.15.29:0/833259127 >> v1:172.21.15.29:6789/0 conn(0x7f6374129050 legacy=0x7f6374129430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:29.306 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f6378a02640 1 -- 172.21.15.29:0/833259127 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63740703c0 con 0x7f637412f4e0 2024-04-26T12:49:29.307 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f6378a02640 1 --2- 172.21.15.29:0/833259127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f637412f4e0 0x7f63741318d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6364006fd0 tx=0x7f636401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e3e740df397f08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:29.307 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f636bfff640 1 -- 172.21.15.29:0/833259127 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63640b0070 con 0x7f637412f4e0 2024-04-26T12:49:29.307 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f636bfff640 1 -- 172.21.15.29:0/833259127 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63640ab530 con 0x7f637412f4e0 2024-04-26T12:49:29.307 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f636bfff640 1 -- 172.21.15.29:0/833259127 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63640ab830 con 0x7f637412f4e0 2024-04-26T12:49:29.308 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f637b467640 1 -- 172.21.15.29:0/833259127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f637412f4e0 msgr2=0x7f63741318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:29.308 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.303+0000 7f637b467640 1 --2- 172.21.15.29:0/833259127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f637412f4e0 0x7f63741318d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6364006fd0 tx=0x7f636401c410 comp rx=0 tx=0).stop 2024-04-26T12:49:29.309 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- 172.21.15.29:0/833259127 shutdown_connections 2024-04-26T12:49:29.309 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 --2- 172.21.15.29:0/833259127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f637412f4e0 0x7f63741318d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:29.309 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- 172.21.15.29:0/833259127 >> 172.21.15.29:0/833259127 conn(0x7f637409ab10 msgr2=0x7f637409af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:29.309 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- 172.21.15.29:0/833259127 shutdown_connections 2024-04-26T12:49:29.309 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- 172.21.15.29:0/833259127 wait complete. 2024-04-26T12:49:29.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 Processor -- start 2024-04-26T12:49:29.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- start start 2024-04-26T12:49:29.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6374129050 0x7f637412bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:29.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6374134630 con 0x7f6374129050 2024-04-26T12:49:29.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6379203640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6374129050 0x7f637412bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:29.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6379203640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6374129050 0x7f637412bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38522/0 (socket says 172.21.15.29:38522) 2024-04-26T12:49:29.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6379203640 1 -- 172.21.15.29:0/753252450 learned_addr learned my addr 172.21.15.29:0/753252450 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:29.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6379203640 1 -- 172.21.15.29:0/753252450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6374073370 con 0x7f6374129050 2024-04-26T12:49:29.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6379203640 1 --2- 172.21.15.29:0/753252450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6374129050 0x7f637412bbb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f637000c410 tx=0x7f637000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:29.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6369ffb640 1 -- 172.21.15.29:0/753252450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6370007410 con 0x7f6374129050 2024-04-26T12:49:29.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6369ffb640 1 -- 172.21.15.29:0/753252450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63700075b0 con 0x7f6374129050 2024-04-26T12:49:29.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637412b8a0 con 0x7f6374129050 2024-04-26T12:49:29.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6369ffb640 1 -- 172.21.15.29:0/753252450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6370004920 con 0x7f6374129050 2024-04-26T12:49:29.312 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6374099d20 con 0x7f6374129050 2024-04-26T12:49:29.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6369ffb640 1 -- 172.21.15.29:0/753252450 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f637001a020 con 0x7f6374129050 2024-04-26T12:49:29.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f6369ffb640 1 -- 172.21.15.29:0/753252450 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6370013910 con 0x7f6374129050 2024-04-26T12:49:29.313 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.307+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6374062f80 con 0x7f6374129050 2024-04-26T12:49:29.314 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.311+0000 7f6369ffb640 1 -- 172.21.15.29:0/753252450 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6370021070 con 0x7f6374129050 2024-04-26T12:49:29.346 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.348+0000 7f652b306180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:49:29.371 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.367+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f637404f640 con 0x7f6374129050 2024-04-26T12:49:29.372 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f6369ffb640 1 -- 172.21.15.29:0/753252450 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f6370013ba0 con 0x7f6374129050 2024-04-26T12:49:29.372 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T12:49:29.373 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":6,"fsid":"e9a80640-28c1-4a64-ae98-6666131f9984","created":"2024-04-26T12:49:27.360185+0000","modified":"2024-04-26T12:49:28.549061+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:49:28.549061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a486baa1-57d4-44e0-81e1-6c67d01653d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58ac9945-efae-4b1c-bb23-e53958170e53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"152b72f4-b41a-429c-9f88-79befe0eae01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba649e3f-0dcb-4dbb-a39a-c7557b884273","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:49:29.373 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6374129050 msgr2=0x7f637412bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:29.374 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f637b467640 1 --2- 172.21.15.29:0/753252450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6374129050 0x7f637412bbb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f637000c410 tx=0x7f637000c8d0 comp rx=0 tx=0).stop 2024-04-26T12:49:29.374 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 shutdown_connections 2024-04-26T12:49:29.374 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f637b467640 1 --2- 172.21.15.29:0/753252450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6374129050 0x7f637412bbb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:29.374 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 >> 172.21.15.29:0/753252450 conn(0x7f637409ab10 msgr2=0x7f637412e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:29.374 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 shutdown_connections 2024-04-26T12:49:29.374 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:29.371+0000 7f637b467640 1 -- 172.21.15.29:0/753252450 wait complete. 2024-04-26T12:49:29.389 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-26T12:49:29.495 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.496+0000 7f652b306180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:49:29.556 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:29.556+0000 7f652b306180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:49:31.069 INFO:tasks.ceph.mgr.x.smithi072.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T12:49:31.069 INFO:tasks.ceph.mgr.x.smithi072.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T12:49:31.069 INFO:tasks.ceph.mgr.x.smithi072.stderr: from numpy import show_config as show_numpy_config 2024-04-26T12:49:31.139 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:31.140+0000 7f652b306180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:49:31.313 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:31.312+0000 7f652b306180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:49:31.480 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:31.480+0000 7f652b306180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:49:31.557 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:31.556+0000 7f652b306180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:49:31.705 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:31.704+0000 7f652b306180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:49:32.404 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:32.404+0000 7f652b306180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:49:32.479 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:32.480+0000 7f652b306180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:49:32.659 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:32.660+0000 7f652b306180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:49:32.739 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:32.740+0000 7f652b306180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:49:32.846 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-26T12:49:32.843+0000 7fb75b8a37c0 -1 osd.0 0 log_to_monitors true 2024-04-26T12:49:33.028 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:33.028+0000 7f652b306180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:49:33.029 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-26T12:49:33.028+0000 7f9eee1127c0 -1 osd.3 0 log_to_monitors true 2024-04-26T12:49:33.033 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-26T12:49:33.032+0000 7f10646967c0 -1 osd.1 0 log_to_monitors true 2024-04-26T12:49:33.054 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-26T12:49:33.056+0000 7fd9d5acb7c0 -1 osd.2 0 log_to_monitors true 2024-04-26T12:49:33.096 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:33.096+0000 7f652b306180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:49:34.132 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-04-26T12:49:34.132+0000 7f64d2751640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-26T12:49:34.673 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-26T12:49:34.671+0000 7fb757029640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:49:34.693 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-26T12:49:34.691+0000 7fb74f670640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:49:35.793 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:49:35.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41fa1ae640 1 Processor -- start 2024-04-26T12:49:35.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41fa1ae640 1 -- start start 2024-04-26T12:49:35.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41fa1ae640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f41f412f4e0 0x7f41f41318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:35.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41fa1ae640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f4128e30 con 0x7f41f4129050 2024-04-26T12:49:35.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41fa1ae640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f41f4129b40 con 0x7f41f412f4e0 2024-04-26T12:49:35.917 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41f37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f41f4129050 0x7f41f4129430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33224/0 (socket says 172.21.15.29:33224) 2024-04-26T12:49:35.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41ebfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f41f412f4e0 0x7f41f41318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:35.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41f37fe640 1 -- 172.21.15.29:0/285192399 learned_addr learned my addr 172.21.15.29:0/285192399 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:35.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41ebfff640 1 -- 172.21.15.29:0/285192399 >> v1:172.21.15.29:6789/0 conn(0x7f41f4129050 legacy=0x7f41f4129430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:35.918 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41ebfff640 1 -- 172.21.15.29:0/285192399 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f40703c0 con 0x7f41f412f4e0 2024-04-26T12:49:35.920 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41ebfff640 1 --2- 172.21.15.29:0/285192399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f412f4e0 0x7f41f41318d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009730 tx=0x7f41dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b14cff41a76598 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:35.920 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41f2ffd640 1 -- 172.21.15.29:0/285192399 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc0b0070 con 0x7f41f412f4e0 2024-04-26T12:49:35.920 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41f2ffd640 1 -- 172.21.15.29:0/285192399 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc0ab530 con 0x7f41f412f4e0 2024-04-26T12:49:35.920 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.915+0000 7f41f2ffd640 1 -- 172.21.15.29:0/285192399 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc0ab830 con 0x7f41f412f4e0 2024-04-26T12:49:35.921 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/285192399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f412f4e0 msgr2=0x7f41f41318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:35.921 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 --2- 172.21.15.29:0/285192399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f412f4e0 0x7f41f41318d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009730 tx=0x7f41dc01c370 comp rx=0 tx=0).stop 2024-04-26T12:49:35.921 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/285192399 shutdown_connections 2024-04-26T12:49:35.921 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 --2- 172.21.15.29:0/285192399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f412f4e0 0x7f41f41318d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:35.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/285192399 >> 172.21.15.29:0/285192399 conn(0x7f41f409ab10 msgr2=0x7f41f409af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:35.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/285192399 shutdown_connections 2024-04-26T12:49:35.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/285192399 wait complete. 2024-04-26T12:49:35.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 Processor -- start 2024-04-26T12:49:35.922 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- start start 2024-04-26T12:49:35.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f4129050 0x7f41f41c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:35.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4134630 con 0x7f41f4129050 2024-04-26T12:49:35.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f4129050 0x7f41f41c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:35.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f4129050 0x7f41f41c3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38540/0 (socket says 172.21.15.29:38540) 2024-04-26T12:49:35.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f37fe640 1 -- 172.21.15.29:0/4199393455 learned_addr learned my addr 172.21.15.29:0/4199393455 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:35.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f37fe640 1 -- 172.21.15.29:0/4199393455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f4072b40 con 0x7f41f4129050 2024-04-26T12:49:35.924 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f37fe640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f4129050 0x7f41f41c3a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41e400c480 tx=0x7f41e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f0ff9640 1 -- 172.21.15.29:0/4199393455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e4017070 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f0ff9640 1 -- 172.21.15.29:0/4199393455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e4005c20 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f412c400 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f0ff9640 1 -- 172.21.15.29:0/4199393455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e4007070 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f412ca20 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f0ff9640 1 -- 172.21.15.29:0/4199393455 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 3) ==== 43891+0+0 (secure 0 0 0) 0x7f41e401a070 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f4062f80 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f0ff9640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41d4035c00 0x7f41d40380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.919+0000 7f41f0ff9640 1 -- 172.21.15.29:0/4199393455 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1903+0+0 (secure 0 0 0) 0x7f41e4047040 con 0x7f41f4129050 2024-04-26T12:49:35.925 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.923+0000 7f41ebfff640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41d4035c00 0x7f41d40380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:35.926 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.923+0000 7f41ebfff640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41d4035c00 0x7f41d40380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0ad000 tx=0x7f41dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:35.929 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:35.927+0000 7f41f0ff9640 1 -- 172.21.15.29:0/4199393455 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f41e4007210 con 0x7f41f4129050 2024-04-26T12:49:36.092 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.087+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41f412bac0 con 0x7f41f4129050 2024-04-26T12:49:36.092 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41f0ff9640 1 -- 172.21.15.29:0/4199393455 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+4649 (secure 0 0 0) 0x7f41e401b400 con 0x7f41f4129050 2024-04-26T12:49:36.092 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T12:49:36.093 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":9,"fsid":"e9a80640-28c1-4a64-ae98-6666131f9984","created":"2024-04-26T12:49:27.360185+0000","modified":"2024-04-26T12:49:34.914196+0000","last_up_change":"2024-04-26T12:49:34.914196+0000","last_in_change":"2024-04-26T12:49:28.549061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a486baa1-57d4-44e0-81e1-6c67d01653d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6801","nonce":1895601642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6803","nonce":1895601642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6807","nonce":1895601642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6805","nonce":1895601642}]},"public_addr":"172.21.15.29:6801/1895601642","cluster_addr":"172.21.15.29:6803/1895601642","heartbeat_back_addr":"172.21.15.29:6807/1895601642","heartbeat_front_addr":"172.21.15.29:6805/1895601642","state":["exists","up"]},{"osd":1,"uuid":"58ac9945-efae-4b1c-bb23-e53958170e53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"152b72f4-b41a-429c-9f88-79befe0eae01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba649e3f-0dcb-4dbb-a39a-c7557b884273","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:49:36.095 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41d4035c00 msgr2=0x7f41d40380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:36.095 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41d4035c00 0x7f41d40380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0ad000 tx=0x7f41dc008040 comp rx=0 tx=0).stop 2024-04-26T12:49:36.095 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f4129050 msgr2=0x7f41f41c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:36.095 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f4129050 0x7f41f41c3a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41e400c480 tx=0x7f41e400c940 comp rx=0 tx=0).stop 2024-04-26T12:49:36.096 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 shutdown_connections 2024-04-26T12:49:36.096 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41d4035c00 0x7f41d40380c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:36.096 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 --2- 172.21.15.29:0/4199393455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41f4129050 0x7f41f41c3a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:36.096 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 >> 172.21.15.29:0/4199393455 conn(0x7f41f409ab10 msgr2=0x7f41f40992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:36.096 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 shutdown_connections 2024-04-26T12:49:36.096 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:36.091+0000 7f41fa1ae640 1 -- 172.21.15.29:0/4199393455 wait complete. 2024-04-26T12:49:36.111 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-04-26T12:49:36.622 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-26T12:49:36.624+0000 7f9ee9898640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T12:49:36.643 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-04-26T12:49:36.644+0000 7f9ee1edf640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:49:36.663 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-26T12:49:36.664+0000 7f105fe1c640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:49:36.703 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-04-26T12:49:36.704+0000 7f1058463640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:49:36.707 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-26T12:49:36.708+0000 7fd9d1251640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:49:36.727 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-04-26T12:49:36.728+0000 7fd9c9898640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:49:42.515 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:49:42.640 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.635+0000 7faa34b86640 1 Processor -- start 2024-04-26T12:49:42.640 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.635+0000 7faa34b86640 1 -- start start 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa34b86640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa3008dcd0 0x7faa3012fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa34b86640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa3006e9b0 con 0x7faa3008d1e0 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa34b86640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7faa3006de00 con 0x7faa3008dcd0 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2dd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa3008dcd0 0x7faa3012fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2e59c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faa3008d1e0 0x7faa3008d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44460/0 (socket says 172.21.15.29:44460) 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2e59c640 1 -- 172.21.15.29:0/1443651378 learned_addr learned my addr 172.21.15.29:0/1443651378 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2dd9b640 1 -- 172.21.15.29:0/1443651378 >> v1:172.21.15.29:6789/0 conn(0x7faa3008d1e0 legacy=0x7faa3008d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2d59a640 1 -- 172.21.15.29:0/1443651378 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3458844078 0 0) 0x7faa3006e9b0 con 0x7faa3008d1e0 2024-04-26T12:49:42.641 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2dd9b640 1 -- 172.21.15.29:0/1443651378 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3006e570 con 0x7faa3008dcd0 2024-04-26T12:49:42.643 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2dd9b640 1 --2- 172.21.15.29:0/1443651378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008dcd0 0x7faa3012fbf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa2400a8c0 tx=0x7faa2401d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa173b5a2e1a4a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:42.643 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2d59a640 1 -- 172.21.15.29:0/1443651378 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa240b3070 con 0x7faa3008dcd0 2024-04-26T12:49:42.643 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2d59a640 1 -- 172.21.15.29:0/1443651378 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa240a6640 con 0x7faa3008dcd0 2024-04-26T12:49:42.643 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa2d59a640 1 -- 172.21.15.29:0/1443651378 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa2400b040 con 0x7faa3008dcd0 2024-04-26T12:49:42.644 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa34b86640 1 -- 172.21.15.29:0/1443651378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008dcd0 msgr2=0x7faa3012fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:42.644 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.639+0000 7faa34b86640 1 --2- 172.21.15.29:0/1443651378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008dcd0 0x7faa3012fbf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa2400a8c0 tx=0x7faa2401d7b0 comp rx=0 tx=0).stop 2024-04-26T12:49:42.644 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- 172.21.15.29:0/1443651378 shutdown_connections 2024-04-26T12:49:42.644 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 --2- 172.21.15.29:0/1443651378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008dcd0 0x7faa3012fbf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:42.645 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- 172.21.15.29:0/1443651378 >> 172.21.15.29:0/1443651378 conn(0x7faa3009ab10 msgr2=0x7faa3009af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:42.645 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- 172.21.15.29:0/1443651378 shutdown_connections 2024-04-26T12:49:42.645 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- 172.21.15.29:0/1443651378 wait complete. 2024-04-26T12:49:42.646 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 Processor -- start 2024-04-26T12:49:42.646 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- start start 2024-04-26T12:49:42.646 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008d1e0 0x7faa301c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:42.646 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7faa30132ce0 con 0x7faa3008d1e0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa2e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008d1e0 0x7faa301c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa2e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008d1e0 0x7faa301c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55426/0 (socket says 172.21.15.29:55426) 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa2e59c640 1 -- 172.21.15.29:0/690966724 learned_addr learned my addr 172.21.15.29:0/690966724 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa2e59c640 1 -- 172.21.15.29:0/690966724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa30092db0 con 0x7faa3008d1e0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa2e59c640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008d1e0 0x7faa301c3280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c420 tx=0x7faa2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa1effd640 1 -- 172.21.15.29:0/690966724 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa20018070 con 0x7faa3008d1e0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa1effd640 1 -- 172.21.15.29:0/690966724 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa200074d0 con 0x7faa3008d1e0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa30099480 con 0x7faa3008d1e0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa1effd640 1 -- 172.21.15.29:0/690966724 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa20004960 con 0x7faa3008d1e0 2024-04-26T12:49:42.647 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa300948d0 con 0x7faa3008d1e0 2024-04-26T12:49:42.648 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa30062f80 con 0x7faa3008d1e0 2024-04-26T12:49:42.648 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa1effd640 1 -- 172.21.15.29:0/690966724 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7faa2001b070 con 0x7faa3008d1e0 2024-04-26T12:49:42.648 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa1effd640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa10035d20 0x7faa100381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:42.648 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa1effd640 1 -- 172.21.15.29:0/690966724 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7faa200477a0 con 0x7faa3008d1e0 2024-04-26T12:49:42.648 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.643+0000 7faa2dd9b640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa10035d20 0x7faa100381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:42.649 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.647+0000 7faa2dd9b640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa10035d20 0x7faa100381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa240b0000 tx=0x7faa240a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:42.652 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.651+0000 7faa1effd640 1 -- 172.21.15.29:0/690966724 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7faa2001ae10 con 0x7faa3008d1e0 2024-04-26T12:49:42.816 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa3012b6c0 con 0x7faa3008d1e0 2024-04-26T12:49:42.817 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa1effd640 1 -- 172.21.15.29:0/690966724 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+7942 (secure 0 0 0) 0x7faa20011920 con 0x7faa3008d1e0 2024-04-26T12:49:42.817 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T12:49:42.817 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":15,"fsid":"e9a80640-28c1-4a64-ae98-6666131f9984","created":"2024-04-26T12:49:27.360185+0000","modified":"2024-04-26T12:49:41.937388+0000","last_up_change":"2024-04-26T12:49:37.667209+0000","last_in_change":"2024-04-26T12:49:28.549061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:49:39.220591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a486baa1-57d4-44e0-81e1-6c67d01653d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6801","nonce":1895601642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6803","nonce":1895601642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6807","nonce":1895601642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6805","nonce":1895601642}]},"public_addr":"172.21.15.29:6801/1895601642","cluster_addr":"172.21.15.29:6803/1895601642","heartbeat_back_addr":"172.21.15.29:6807/1895601642","heartbeat_front_addr":"172.21.15.29:6805/1895601642","state":["exists","up"]},{"osd":1,"uuid":"58ac9945-efae-4b1c-bb23-e53958170e53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6817","nonce":1811201389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6819","nonce":1811201389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6823","nonce":1811201389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6821","nonce":1811201389}]},"public_addr":"172.21.15.72:6817/1811201389","cluster_addr":"172.21.15.72:6819/1811201389","heartbeat_back_addr":"172.21.15.72:6823/1811201389","heartbeat_front_addr":"172.21.15.72:6821/1811201389","state":["exists","up"]},{"osd":2,"uuid":"152b72f4-b41a-429c-9f88-79befe0eae01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6801","nonce":1931234624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6803","nonce":1931234624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6807","nonce":1931234624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6805","nonce":1931234624}]},"public_addr":"172.21.15.72:6801/1931234624","cluster_addr":"172.21.15.72:6803/1931234624","heartbeat_back_addr":"172.21.15.72:6807/1931234624","heartbeat_front_addr":"172.21.15.72:6805/1931234624","state":["exists","up"]},{"osd":3,"uuid":"ba649e3f-0dcb-4dbb-a39a-c7557b884273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6809","nonce":671626845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6811","nonce":671626845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6815","nonce":671626845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6813","nonce":671626845}]},"public_addr":"172.21.15.72:6809/671626845","cluster_addr":"172.21.15.72:6811/671626845","heartbeat_back_addr":"172.21.15.72:6815/671626845","heartbeat_front_addr":"172.21.15.72:6813/671626845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:33.883530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.050590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.032083+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.030129+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:49:42.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa10035d20 msgr2=0x7faa100381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:42.819 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa10035d20 0x7faa100381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa240b0000 tx=0x7faa240a8070 comp rx=0 tx=0).stop 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008d1e0 msgr2=0x7faa301c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008d1e0 0x7faa301c3280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c420 tx=0x7faa2000c8e0 comp rx=0 tx=0).stop 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 shutdown_connections 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa10035d20 0x7faa100381e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 --2- 172.21.15.29:0/690966724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa3008d1e0 0x7faa301c3280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 >> 172.21.15.29:0/690966724 conn(0x7faa3009ab10 msgr2=0x7faa3012b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 shutdown_connections 2024-04-26T12:49:42.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-26T12:49:42.815+0000 7faa34b86640 1 -- 172.21.15.29:0/690966724 wait complete. 2024-04-26T12:49:42.836 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-26T12:49:42.836 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:49:42.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:49:42.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.951+0000 7f8c66a1a640 1 Processor -- start 2024-04-26T12:49:42.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.951+0000 7f8c66a1a640 1 -- start start 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c66a1a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c60094fa0 0x7f8c60131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c66a1a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6006b810 con 0x7f8c600944b0 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c66a1a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8c60096b70 con 0x7f8c60094fa0 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c5ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8c600944b0 0x7f8c60094890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44462/0 (socket says 172.21.15.29:44462) 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c5ffff640 1 -- 172.21.15.29:0/2775954210 learned_addr learned my addr 172.21.15.29:0/2775954210 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c57fff640 1 --2- 172.21.15.29:0/2775954210 >> v2:172.21.15.29:3300/0 conn(0x7f8c60094fa0 0x7f8c60131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c5f7fe640 1 -- 172.21.15.29:0/2775954210 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963802238 0 0) 0x7f8c6006b810 con 0x7f8c600944b0 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c5f7fe640 1 -- 172.21.15.29:0/2775954210 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c4c003530 con 0x7f8c600944b0 2024-04-26T12:49:42.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c57fff640 1 -- 172.21.15.29:0/2775954210 >> v1:172.21.15.29:6789/0 conn(0x7f8c600944b0 legacy=0x7f8c60094890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:42.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c57fff640 1 -- 172.21.15.29:0/2775954210 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c60096860 con 0x7f8c60094fa0 2024-04-26T12:49:42.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c57fff640 1 --2- 172.21.15.29:0/2775954210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c60094fa0 0x7f8c60131860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009740 tx=0x7f8c5001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32d477ad6ae1412 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:42.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c5f7fe640 1 -- 172.21.15.29:0/2775954210 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500b0070 con 0x7f8c60094fa0 2024-04-26T12:49:42.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c5f7fe640 1 -- 172.21.15.29:0/2775954210 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c500ab530 con 0x7f8c60094fa0 2024-04-26T12:49:42.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.955+0000 7f8c5f7fe640 1 -- 172.21.15.29:0/2775954210 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500ab810 con 0x7f8c60094fa0 2024-04-26T12:49:42.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/2775954210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c60094fa0 msgr2=0x7f8c60131860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:42.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 --2- 172.21.15.29:0/2775954210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c60094fa0 0x7f8c60131860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009740 tx=0x7f8c5001c370 comp rx=0 tx=0).stop 2024-04-26T12:49:42.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/2775954210 shutdown_connections 2024-04-26T12:49:42.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 --2- 172.21.15.29:0/2775954210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c60094fa0 0x7f8c60131860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:42.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/2775954210 >> 172.21.15.29:0/2775954210 conn(0x7f8c6009d0b0 msgr2=0x7f8c6009d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:42.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/2775954210 shutdown_connections 2024-04-26T12:49:42.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/2775954210 wait complete. 2024-04-26T12:49:42.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 Processor -- start 2024-04-26T12:49:42.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- start start 2024-04-26T12:49:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c600944b0 0x7f8c601c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8c60134740 con 0x7f8c600944b0 2024-04-26T12:49:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c600944b0 0x7f8c601c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c600944b0 0x7f8c601c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55446/0 (socket says 172.21.15.29:55446) 2024-04-26T12:49:42.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5ffff640 1 -- 172.21.15.29:0/1432875011 learned_addr learned my addr 172.21.15.29:0/1432875011 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5ffff640 1 -- 172.21.15.29:0/1432875011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6012ca80 con 0x7f8c600944b0 2024-04-26T12:49:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5ffff640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c600944b0 0x7f8c601c3b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c3d0 tx=0x7f8c4800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5d7fa640 1 -- 172.21.15.29:0/1432875011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48017070 con 0x7f8c600944b0 2024-04-26T12:49:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6012cd70 con 0x7f8c600944b0 2024-04-26T12:49:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601c4280 con 0x7f8c600944b0 2024-04-26T12:49:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5d7fa640 1 -- 172.21.15.29:0/1432875011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c48005ce0 con 0x7f8c600944b0 2024-04-26T12:49:42.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5d7fa640 1 -- 172.21.15.29:0/1432875011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c480070d0 con 0x7f8c600944b0 2024-04-26T12:49:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c5d7fa640 1 -- 172.21.15.29:0/1432875011 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f8c4801a070 con 0x7f8c600944b0 2024-04-26T12:49:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.959+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c60062f80 con 0x7f8c600944b0 2024-04-26T12:49:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.963+0000 7f8c5d7fa640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8c40035cd0 0x7f8c40038190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.963+0000 7f8c5d7fa640 1 -- 172.21.15.29:0/1432875011 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7f8c480478c0 con 0x7f8c600944b0 2024-04-26T12:49:42.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.963+0000 7f8c57fff640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8c40035cd0 0x7f8c40038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:42.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.963+0000 7f8c57fff640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8c40035cd0 0x7f8c40038190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c500ad000 tx=0x7f8c500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:42.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:42.967+0000 7f8c5d7fa640 1 -- 172.21.15.29:0/1432875011 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8c48019e10 con 0x7f8c600944b0 2024-04-26T12:49:43.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.131+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f8c600681b0 con 0x7f8c600944b0 2024-04-26T12:49:43.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.943+0000 7f8c5d7fa640 1 -- 172.21.15.29:0/1432875011 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (secure 0 0 0) 0x7f8c48010b60 con 0x7f8c600944b0 2024-04-26T12:49:43.945 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'rbd' created 2024-04-26T12:49:43.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8c40035cd0 msgr2=0x7f8c40038190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:43.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8c40035cd0 0x7f8c40038190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c500ad000 tx=0x7f8c500a6000 comp rx=0 tx=0).stop 2024-04-26T12:49:43.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c600944b0 msgr2=0x7f8c601c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:43.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c600944b0 0x7f8c601c3b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c3d0 tx=0x7f8c4800c890 comp rx=0 tx=0).stop 2024-04-26T12:49:43.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 shutdown_connections 2024-04-26T12:49:43.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8c40035cd0 0x7f8c40038190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:43.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 --2- 172.21.15.29:0/1432875011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c600944b0 0x7f8c601c3b70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:43.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 >> 172.21.15.29:0/1432875011 conn(0x7f8c6009d0b0 msgr2=0x7f8c60072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:43.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 shutdown_connections 2024-04-26T12:49:43.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:43.947+0000 7f8c66a1a640 1 -- 172.21.15.29:0/1432875011 wait complete. 2024-04-26T12:49:43.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:49:44.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.099+0000 7f807ac18640 1 Processor -- start 2024-04-26T12:49:44.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.099+0000 7f807ac18640 1 -- start start 2024-04-26T12:49:44.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.099+0000 7f807ac18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f807412ea80 0x7f807412ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:44.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807408e8f0 con 0x7f807412f3a0 2024-04-26T12:49:44.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8074094420 con 0x7f807412ea80 2024-04-26T12:49:44.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f80789b4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f807412ea80 0x7f807412ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:44.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f8073fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f807412f3a0 0x7f807408cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44466/0 (socket says 172.21.15.29:44466) 2024-04-26T12:49:44.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f8073fff640 1 -- 172.21.15.29:0/791057288 learned_addr learned my addr 172.21.15.29:0/791057288 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:44.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f80789b4640 1 -- 172.21.15.29:0/791057288 >> v1:172.21.15.29:6789/0 conn(0x7f807412f3a0 legacy=0x7f807408cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:44.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f80789b4640 1 -- 172.21.15.29:0/791057288 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807408eec0 con 0x7f807412ea80 2024-04-26T12:49:44.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f80789b4640 1 --2- 172.21.15.29:0/791057288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f807412ee60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8064009740 tx=0x7f806401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4666395caa4efc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:44.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f80737fe640 1 -- 172.21.15.29:0/791057288 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80640b0070 con 0x7f807412ea80 2024-04-26T12:49:44.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f80737fe640 1 -- 172.21.15.29:0/791057288 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80640ab530 con 0x7f807412ea80 2024-04-26T12:49:44.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f80737fe640 1 -- 172.21.15.29:0/791057288 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80640ab830 con 0x7f807412ea80 2024-04-26T12:49:44.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 -- 172.21.15.29:0/791057288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 msgr2=0x7f807412ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:44.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 --2- 172.21.15.29:0/791057288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f807412ee60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8064009740 tx=0x7f806401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:44.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 -- 172.21.15.29:0/791057288 shutdown_connections 2024-04-26T12:49:44.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 --2- 172.21.15.29:0/791057288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f807412ee60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:44.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 -- 172.21.15.29:0/791057288 >> 172.21.15.29:0/791057288 conn(0x7f807409b440 msgr2=0x7f807409b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:44.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 -- 172.21.15.29:0/791057288 shutdown_connections 2024-04-26T12:49:44.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.103+0000 7f807ac18640 1 -- 172.21.15.29:0/791057288 wait complete. 2024-04-26T12:49:44.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f807ac18640 1 Processor -- start 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f807ac18640 1 -- start start 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f807ac18640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f80741c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f807ac18640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f807408e240 con 0x7f807412ea80 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80789b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f80741c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80789b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f80741c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55472/0 (socket says 172.21.15.29:55472) 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80789b4640 1 -- 172.21.15.29:0/3666083641 learned_addr learned my addr 172.21.15.29:0/3666083641 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80789b4640 1 -- 172.21.15.29:0/3666083641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8074072e30 con 0x7f807412ea80 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80789b4640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f80741c6280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80640ae040 tx=0x7f8064019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80717fa640 1 -- 172.21.15.29:0/3666083641 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80640b8020 con 0x7f807412ea80 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80717fa640 1 -- 172.21.15.29:0/3666083641 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80640b4600 con 0x7f807412ea80 2024-04-26T12:49:44.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80740723a0 con 0x7f807412ea80 2024-04-26T12:49:44.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80717fa640 1 -- 172.21.15.29:0/3666083641 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80640b0040 con 0x7f807412ea80 2024-04-26T12:49:44.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80741c67c0 con 0x7f807412ea80 2024-04-26T12:49:44.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8074062f80 con 0x7f807412ea80 2024-04-26T12:49:44.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80717fa640 1 -- 172.21.15.29:0/3666083641 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80640bb020 con 0x7f807412ea80 2024-04-26T12:49:44.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80717fa640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8060035db0 0x7f8060038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:44.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f80717fa640 1 -- 172.21.15.29:0/3666083641 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3471+0+0 (secure 0 0 0) 0x7f80640a4e00 con 0x7f807412ea80 2024-04-26T12:49:44.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.107+0000 7f8073fff640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8060035db0 0x7f8060038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:44.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.111+0000 7f8073fff640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8060035db0 0x7f8060038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8068000f70 tx=0x7f8068007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:44.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.111+0000 7f80717fa640 1 -- 172.21.15.29:0/3666083641 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f80640c2030 con 0x7f807412ea80 2024-04-26T12:49:44.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.279+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f807412f120 con 0x7f807412ea80 2024-04-26T12:49:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.947+0000 7f80717fa640 1 -- 172.21.15.29:0/3666083641 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 173+0+0 (secure 0 0 0) 0x7f8064015ff0 con 0x7f807412ea80 2024-04-26T12:49:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:49:44.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8060035db0 msgr2=0x7f8060038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:44.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8060035db0 0x7f8060038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8068000f70 tx=0x7f8068007a90 comp rx=0 tx=0).stop 2024-04-26T12:49:44.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 msgr2=0x7f80741c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:44.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f80741c6280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80640ae040 tx=0x7f8064019110 comp rx=0 tx=0).stop 2024-04-26T12:49:44.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 shutdown_connections 2024-04-26T12:49:44.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8060035db0 0x7f8060038270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:44.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 --2- 172.21.15.29:0/3666083641 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f807412ea80 0x7f80741c6280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:44.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 >> 172.21.15.29:0/3666083641 conn(0x7f807409b440 msgr2=0x7f807412f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:44.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 shutdown_connections 2024-04-26T12:49:44.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:44.951+0000 7f807ac18640 1 -- 172.21.15.29:0/3666083641 wait complete. 2024-04-26T12:49:44.981 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:49:44.981 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:49:44.981 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:49:44.981 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:49:44.982 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:49:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b99820640 1 Processor -- start 2024-04-26T12:49:45.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b99820640 1 -- start start 2024-04-26T12:49:45.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b99820640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b9412b470 0x7f9b9412b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b99820640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b94092b10 con 0x7f9b9412e430 2024-04-26T12:49:45.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b99820640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9b94092790 con 0x7f9b9412b470 2024-04-26T12:49:45.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b92ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b9412b470 0x7f9b9412b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b927fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9b9412e430 0x7f9b9412e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44468/0 (socket says 172.21.15.29:44468) 2024-04-26T12:49:45.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b92ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b9412b470 0x7f9b9412b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55480/0 (socket says 172.21.15.29:55480) 2024-04-26T12:49:45.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b927fc640 1 -- 172.21.15.29:0/2214953666 learned_addr learned my addr 172.21.15.29:0/2214953666 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:45.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b92ffd640 1 -- 172.21.15.29:0/2214953666 >> v1:172.21.15.29:6789/0 conn(0x7f9b9412e430 legacy=0x7f9b9412e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.107+0000 7f9b92ffd640 1 -- 172.21.15.29:0/2214953666 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9412bd90 con 0x7f9b9412b470 2024-04-26T12:49:45.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b92ffd640 1 --2- 172.21.15.29:0/2214953666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b9412b850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009740 tx=0x7f9b8401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd46022a2982ff1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b91ffb640 1 -- 172.21.15.29:0/2214953666 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b840b0070 con 0x7f9b9412b470 2024-04-26T12:49:45.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b91ffb640 1 -- 172.21.15.29:0/2214953666 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b840ab530 con 0x7f9b9412b470 2024-04-26T12:49:45.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b91ffb640 1 -- 172.21.15.29:0/2214953666 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b840ab830 con 0x7f9b9412b470 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 -- 172.21.15.29:0/2214953666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 msgr2=0x7f9b9412b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 --2- 172.21.15.29:0/2214953666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b9412b850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009740 tx=0x7f9b8401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 -- 172.21.15.29:0/2214953666 shutdown_connections 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 --2- 172.21.15.29:0/2214953666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b9412b850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 -- 172.21.15.29:0/2214953666 >> 172.21.15.29:0/2214953666 conn(0x7f9b940a0c70 msgr2=0x7f9b940a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 -- 172.21.15.29:0/2214953666 shutdown_connections 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 -- 172.21.15.29:0/2214953666 wait complete. 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 Processor -- start 2024-04-26T12:49:45.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 -- start start 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b94071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b99820640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9b94137160 con 0x7f9b9412b470 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b94071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b92ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b94071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55490/0 (socket says 172.21.15.29:55490) 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b92ffd640 1 -- 172.21.15.29:0/1957148056 learned_addr learned my addr 172.21.15.29:0/1957148056 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.111+0000 7f9b92ffd640 1 -- 172.21.15.29:0/1957148056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b94128240 con 0x7f9b9412b470 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b92ffd640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b94071740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b840ae040 tx=0x7f9b8401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b7bfff640 1 -- 172.21.15.29:0/1957148056 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b840b0050 con 0x7f9b9412b470 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b7bfff640 1 -- 172.21.15.29:0/1957148056 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b840b1040 con 0x7f9b9412b470 2024-04-26T12:49:45.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9412f780 con 0x7f9b9412b470 2024-04-26T12:49:45.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b7bfff640 1 -- 172.21.15.29:0/1957148056 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b840b5780 con 0x7f9b9412b470 2024-04-26T12:49:45.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b94071c80 con 0x7f9b9412b470 2024-04-26T12:49:45.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b7bfff640 1 -- 172.21.15.29:0/1957148056 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b840be030 con 0x7f9b9412b470 2024-04-26T12:49:45.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b94062f80 con 0x7f9b9412b470 2024-04-26T12:49:45.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b7bfff640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b80035db0 0x7f9b80038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b7bfff640 1 -- 172.21.15.29:0/1957148056 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f9b840bc070 con 0x7f9b9412b470 2024-04-26T12:49:45.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b927fc640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b80035db0 0x7f9b80038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.115+0000 7f9b927fc640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b80035db0 0x7f9b80038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b88001610 tx=0x7f9b88007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.119+0000 7f9b7bfff640 1 -- 172.21.15.29:0/1957148056 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9b840c5060 con 0x7f9b9412b470 2024-04-26T12:49:45.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.319+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9b940733c0 con 0x7f9b9412b470 2024-04-26T12:49:45.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.319+0000 7f9b7bfff640 1 -- 172.21.15.29:0/1957148056 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84173 (secure 0 0 0) 0x7f9b84015ff0 con 0x7f9b9412b470 2024-04-26T12:49:45.325 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b80035db0 msgr2=0x7f9b80038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b80035db0 0x7f9b80038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b88001610 tx=0x7f9b88007ad0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 msgr2=0x7f9b94071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b94071740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b840ae040 tx=0x7f9b8401abb0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 shutdown_connections 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b80035db0 0x7f9b80038270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 --2- 172.21.15.29:0/1957148056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b9412b470 0x7f9b94071740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 >> 172.21.15.29:0/1957148056 conn(0x7f9b940a0c70 msgr2=0x7f9b9408e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 shutdown_connections 2024-04-26T12:49:45.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.323+0000 7f9b99820640 1 -- 172.21.15.29:0/1957148056 wait complete. 2024-04-26T12:49:45.341 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3729194001},{"type":"v1","addr":"172.21.15.72:6825","nonce":3729194001}]},"active_addr":"172.21.15.72:6825/3729194001","active_change":"2024-04-26T12:49:33.119310+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2217719367}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":787873656}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1249124990}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3813085792}]}]} 2024-04-26T12:49:45.343 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:49:45.343 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:49:45.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:49:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb263b20640 1 Processor -- start 2024-04-26T12:49:45.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb263b20640 1 -- start start 2024-04-26T12:49:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb263b20640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb25c12b470 0x7fb25c12b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb263b20640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25c092b10 con 0x7fb25c12e430 2024-04-26T12:49:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb263b20640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb25c092790 con 0x7fb25c12b470 2024-04-26T12:49:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb2618bc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb25c12b470 0x7fb25c12b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb2610bb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb25c12e430 0x7fb25c12e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44470/0 (socket says 172.21.15.29:44470) 2024-04-26T12:49:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb2610bb640 1 -- 172.21.15.29:0/1641484038 learned_addr learned my addr 172.21.15.29:0/1641484038 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:45.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb2608ba640 1 -- 172.21.15.29:0/1641484038 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022206929 0 0) 0x7fb25c092b10 con 0x7fb25c12e430 2024-04-26T12:49:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb2608ba640 1 -- 172.21.15.29:0/1641484038 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb244003530 con 0x7fb25c12e430 2024-04-26T12:49:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb2618bc640 1 -- 172.21.15.29:0/1641484038 >> v1:172.21.15.29:6789/0 conn(0x7fb25c12e430 legacy=0x7fb25c12e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.451+0000 7fb2618bc640 1 -- 172.21.15.29:0/1641484038 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c12bd90 con 0x7fb25c12b470 2024-04-26T12:49:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb2618bc640 1 --2- 172.21.15.29:0/1641484038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c12b850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb254009d90 tx=0x7fb25401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd748d13e7e5d9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb2608ba640 1 -- 172.21.15.29:0/1641484038 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540b2070 con 0x7fb25c12b470 2024-04-26T12:49:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb2608ba640 1 -- 172.21.15.29:0/1641484038 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540a5740 con 0x7fb25c12b470 2024-04-26T12:49:45.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb2608ba640 1 -- 172.21.15.29:0/1641484038 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540a5a40 con 0x7fb25c12b470 2024-04-26T12:49:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 -- 172.21.15.29:0/1641484038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 msgr2=0x7fb25c12b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 --2- 172.21.15.29:0/1641484038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c12b850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb254009d90 tx=0x7fb25401c8c0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 -- 172.21.15.29:0/1641484038 shutdown_connections 2024-04-26T12:49:45.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 --2- 172.21.15.29:0/1641484038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c12b850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 -- 172.21.15.29:0/1641484038 >> 172.21.15.29:0/1641484038 conn(0x7fb25c0a0c70 msgr2=0x7fb25c0a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 -- 172.21.15.29:0/1641484038 shutdown_connections 2024-04-26T12:49:45.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 -- 172.21.15.29:0/1641484038 wait complete. 2024-04-26T12:49:45.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 Processor -- start 2024-04-26T12:49:45.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 -- start start 2024-04-26T12:49:45.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c1c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb263b20640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c137160 con 0x7fb25c12b470 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb2618bc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c1c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb2618bc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c1c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55504/0 (socket says 172.21.15.29:55504) 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.455+0000 7fb2618bc640 1 -- 172.21.15.29:0/1884121060 learned_addr learned my addr 172.21.15.29:0/1884121060 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb2618bc640 1 -- 172.21.15.29:0/1884121060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c12f580 con 0x7fb25c12b470 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb2618bc640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c1c6470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2540194d0 tx=0x7fb254019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb25a7fc640 1 -- 172.21.15.29:0/1884121060 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540bd020 con 0x7fb25c12b470 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb25a7fc640 1 -- 172.21.15.29:0/1884121060 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540b8470 con 0x7fb25c12b470 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb25a7fc640 1 -- 172.21.15.29:0/1884121060 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540b2040 con 0x7fb25c12b470 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c130070 con 0x7fb25c12b470 2024-04-26T12:49:45.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c1c69b0 con 0x7fb25c12b470 2024-04-26T12:49:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb25a7fc640 1 -- 172.21.15.29:0/1884121060 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2540c0020 con 0x7fb25c12b470 2024-04-26T12:49:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c062f80 con 0x7fb25c12b470 2024-04-26T12:49:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb25a7fc640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb248035db0 0x7fb248038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb25a7fc640 1 -- 172.21.15.29:0/1884121060 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fb2540e3440 con 0x7fb25c12b470 2024-04-26T12:49:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb2610bb640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb248035db0 0x7fb248038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.459+0000 7fb2610bb640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb248035db0 0x7fb248038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb250007fd0 tx=0x7fb250007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.463+0000 7fb25a7fc640 1 -- 172.21.15.29:0/1884121060 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb2540c7030 con 0x7fb25c12b470 2024-04-26T12:49:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.619+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb25c06c2f0 con 0x7fb25c12b470 2024-04-26T12:49:45.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.619+0000 7fb25a7fc640 1 -- 172.21.15.29:0/1884121060 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9723 (secure 0 0 0) 0x7fb254016540 con 0x7fb25c12b470 2024-04-26T12:49:45.624 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:45.624 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"fsid":"e9a80640-28c1-4a64-ae98-6666131f9984","created":"2024-04-26T12:49:27.360185+0000","modified":"2024-04-26T12:49:44.948354+0000","last_up_change":"2024-04-26T12:49:37.667209+0000","last_in_change":"2024-04-26T12:49:28.549061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:49:39.220591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:49:43.178365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a486baa1-57d4-44e0-81e1-6c67d01653d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6801","nonce":1895601642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6803","nonce":1895601642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6807","nonce":1895601642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6805","nonce":1895601642}]},"public_addr":"172.21.15.29:6801/1895601642","cluster_addr":"172.21.15.29:6803/1895601642","heartbeat_back_addr":"172.21.15.29:6807/1895601642","heartbeat_front_addr":"172.21.15.29:6805/1895601642","state":["exists","up"]},{"osd":1,"uuid":"58ac9945-efae-4b1c-bb23-e53958170e53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6817","nonce":1811201389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6819","nonce":1811201389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6823","nonce":1811201389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6821","nonce":1811201389}]},"public_addr":"172.21.15.72:6817/1811201389","cluster_addr":"172.21.15.72:6819/1811201389","heartbeat_back_addr":"172.21.15.72:6823/1811201389","heartbeat_front_addr":"172.21.15.72:6821/1811201389","state":["exists","up"]},{"osd":2,"uuid":"152b72f4-b41a-429c-9f88-79befe0eae01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6801","nonce":1931234624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6803","nonce":1931234624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6807","nonce":1931234624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6805","nonce":1931234624}]},"public_addr":"172.21.15.72:6801/1931234624","cluster_addr":"172.21.15.72:6803/1931234624","heartbeat_back_addr":"172.21.15.72:6807/1931234624","heartbeat_front_addr":"172.21.15.72:6805/1931234624","state":["exists","up"]},{"osd":3,"uuid":"ba649e3f-0dcb-4dbb-a39a-c7557b884273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6809","nonce":671626845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6811","nonce":671626845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6815","nonce":671626845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6813","nonce":671626845}]},"public_addr":"172.21.15.72:6809/671626845","cluster_addr":"172.21.15.72:6811/671626845","heartbeat_back_addr":"172.21.15.72:6815/671626845","heartbeat_front_addr":"172.21.15.72:6813/671626845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:33.883530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.050590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.032083+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.030129+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:49:45.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb248035db0 msgr2=0x7fb248038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb248035db0 0x7fb248038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb250007fd0 tx=0x7fb250007980 comp rx=0 tx=0).stop 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 msgr2=0x7fb25c1c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c1c6470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2540194d0 tx=0x7fb254019660 comp rx=0 tx=0).stop 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 shutdown_connections 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb248035db0 0x7fb248038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 --2- 172.21.15.29:0/1884121060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb25c12b470 0x7fb25c1c6470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 >> 172.21.15.29:0/1884121060 conn(0x7fb25c0a0c70 msgr2=0x7fb25c127750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 shutdown_connections 2024-04-26T12:49:45.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.623+0000 7fb263b20640 1 -- 172.21.15.29:0/1884121060 wait complete. 2024-04-26T12:49:45.643 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:49:45.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:49:45.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7d246640 1 Processor -- start 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7d246640 1 -- start start 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7d246640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e78094cb0 0x7f6e78131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7d246640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e7809d410 con 0x7f6e780939f0 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7d246640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6e78093360 con 0x7f6e78094cb0 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e78094cb0 0x7f6e78131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e78094cb0 0x7f6e78131ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55508/0 (socket says 172.21.15.29:55508) 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7659c640 1 -- 172.21.15.29:0/2578289165 learned_addr learned my addr 172.21.15.29:0/2578289165 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7659c640 1 -- 172.21.15.29:0/2578289165 >> v1:172.21.15.29:6789/0 conn(0x7f6e780939f0 legacy=0x7f6e78093dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.763+0000 7f6e7659c640 1 -- 172.21.15.29:0/2578289165 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e780969b0 con 0x7f6e78094cb0 2024-04-26T12:49:45.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7659c640 1 --2- 172.21.15.29:0/2578289165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e78094cb0 0x7f6e78131ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0097f0 tx=0x7f6e6c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72afacbc8c2e21df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e75d9b640 1 -- 172.21.15.29:0/2578289165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e6c0b0070 con 0x7f6e78094cb0 2024-04-26T12:49:45.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e75d9b640 1 -- 172.21.15.29:0/2578289165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6c0ab530 con 0x7f6e78094cb0 2024-04-26T12:49:45.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e75d9b640 1 -- 172.21.15.29:0/2578289165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e6c0ab830 con 0x7f6e78094cb0 2024-04-26T12:49:45.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 -- 172.21.15.29:0/2578289165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e78094cb0 msgr2=0x7f6e78131ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 --2- 172.21.15.29:0/2578289165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e78094cb0 0x7f6e78131ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0097f0 tx=0x7f6e6c01c430 comp rx=0 tx=0).stop 2024-04-26T12:49:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 -- 172.21.15.29:0/2578289165 shutdown_connections 2024-04-26T12:49:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 --2- 172.21.15.29:0/2578289165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e78094cb0 0x7f6e78131ab0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 -- 172.21.15.29:0/2578289165 >> 172.21.15.29:0/2578289165 conn(0x7f6e7809a3f0 msgr2=0x7f6e7809a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 -- 172.21.15.29:0/2578289165 shutdown_connections 2024-04-26T12:49:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 -- 172.21.15.29:0/2578289165 wait complete. 2024-04-26T12:49:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 Processor -- start 2024-04-26T12:49:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 -- start start 2024-04-26T12:49:45.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e780939f0 0x7f6e78071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e7d246640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6e78134ba0 con 0x7f6e780939f0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.767+0000 7f6e76d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e780939f0 0x7f6e78071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e76d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e780939f0 0x7f6e78071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55516/0 (socket says 172.21.15.29:55516) 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e76d9d640 1 -- 172.21.15.29:0/489706208 learned_addr learned my addr 172.21.15.29:0/489706208 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e76d9d640 1 -- 172.21.15.29:0/489706208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e78122970 con 0x7f6e780939f0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e76d9d640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e780939f0 0x7f6e78071a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c3a0 tx=0x7f6e6800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e5f7fe640 1 -- 172.21.15.29:0/489706208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e68005150 con 0x7f6e780939f0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e5f7fe640 1 -- 172.21.15.29:0/489706208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e680052f0 con 0x7f6e780939f0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e5f7fe640 1 -- 172.21.15.29:0/489706208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e680067e0 con 0x7f6e780939f0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e781219b0 con 0x7f6e780939f0 2024-04-26T12:49:45.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e781223d0 con 0x7f6e780939f0 2024-04-26T12:49:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e78062f80 con 0x7f6e780939f0 2024-04-26T12:49:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e5f7fe640 1 -- 172.21.15.29:0/489706208 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e68019020 con 0x7f6e780939f0 2024-04-26T12:49:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e5f7fe640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6e64035db0 0x7f6e64038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e5f7fe640 1 -- 172.21.15.29:0/489706208 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f6e68047860 con 0x7f6e780939f0 2024-04-26T12:49:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e7659c640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6e64035db0 0x7f6e64038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:45.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.771+0000 7f6e7659c640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6e64035db0 0x7f6e64038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0097f0 tx=0x7f6e6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:45.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.775+0000 7f6e5f7fe640 1 -- 172.21.15.29:0/489706208 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6e6801a7a0 con 0x7f6e780939f0 2024-04-26T12:49:45.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.935+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e780738b0 con 0x7f6e780939f0 2024-04-26T12:49:45.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e5f7fe640 1 -- 172.21.15.29:0/489706208 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9723 (secure 0 0 0) 0x7f6e68007550 con 0x7f6e780939f0 2024-04-26T12:49:45.941 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:45.941 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"fsid":"e9a80640-28c1-4a64-ae98-6666131f9984","created":"2024-04-26T12:49:27.360185+0000","modified":"2024-04-26T12:49:44.948354+0000","last_up_change":"2024-04-26T12:49:37.667209+0000","last_in_change":"2024-04-26T12:49:28.549061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:49:39.220591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:49:43.178365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a486baa1-57d4-44e0-81e1-6c67d01653d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6801","nonce":1895601642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6803","nonce":1895601642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6807","nonce":1895601642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6805","nonce":1895601642}]},"public_addr":"172.21.15.29:6801/1895601642","cluster_addr":"172.21.15.29:6803/1895601642","heartbeat_back_addr":"172.21.15.29:6807/1895601642","heartbeat_front_addr":"172.21.15.29:6805/1895601642","state":["exists","up"]},{"osd":1,"uuid":"58ac9945-efae-4b1c-bb23-e53958170e53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6817","nonce":1811201389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6819","nonce":1811201389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6823","nonce":1811201389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6821","nonce":1811201389}]},"public_addr":"172.21.15.72:6817/1811201389","cluster_addr":"172.21.15.72:6819/1811201389","heartbeat_back_addr":"172.21.15.72:6823/1811201389","heartbeat_front_addr":"172.21.15.72:6821/1811201389","state":["exists","up"]},{"osd":2,"uuid":"152b72f4-b41a-429c-9f88-79befe0eae01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6801","nonce":1931234624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6803","nonce":1931234624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6807","nonce":1931234624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6805","nonce":1931234624}]},"public_addr":"172.21.15.72:6801/1931234624","cluster_addr":"172.21.15.72:6803/1931234624","heartbeat_back_addr":"172.21.15.72:6807/1931234624","heartbeat_front_addr":"172.21.15.72:6805/1931234624","state":["exists","up"]},{"osd":3,"uuid":"ba649e3f-0dcb-4dbb-a39a-c7557b884273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6809","nonce":671626845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6811","nonce":671626845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6815","nonce":671626845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6813","nonce":671626845}]},"public_addr":"172.21.15.72:6809/671626845","cluster_addr":"172.21.15.72:6811/671626845","heartbeat_back_addr":"172.21.15.72:6815/671626845","heartbeat_front_addr":"172.21.15.72:6813/671626845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:33.883530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.050590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.032083+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.030129+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6e64035db0 msgr2=0x7f6e64038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6e64035db0 0x7f6e64038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0097f0 tx=0x7f6e6c008040 comp rx=0 tx=0).stop 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e780939f0 msgr2=0x7f6e78071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e780939f0 0x7f6e78071a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c3a0 tx=0x7f6e6800c860 comp rx=0 tx=0).stop 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 shutdown_connections 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6e64035db0 0x7f6e64038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 --2- 172.21.15.29:0/489706208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e780939f0 0x7f6e78071a50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 >> 172.21.15.29:0/489706208 conn(0x7f6e7809a3f0 msgr2=0x7f6e78097510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 shutdown_connections 2024-04-26T12:49:45.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:45.939+0000 7f6e7d246640 1 -- 172.21.15.29:0/489706208 wait complete. 2024-04-26T12:49:45.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:49:45.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:49:45.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:49:45.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T12:49:46.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.063+0000 7f79a0abc640 1 Processor -- start 2024-04-26T12:49:46.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.063+0000 7f79a0abc640 1 -- start start 2024-04-26T12:49:46.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61f038b640 1 Processor -- start 2024-04-26T12:49:46.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61f038b640 1 -- start start 2024-04-26T12:49:46.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f79a0abc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f799c06df30 0x7f799c06e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f79a0abc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799c06f3f0 con 0x7f799c06e850 2024-04-26T12:49:46.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f79a0abc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f799c09e210 con 0x7f799c06df30 2024-04-26T12:49:46.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799a59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f799c06df30 0x7f799c06e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f7999d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f799c06e850 0x7f799c12d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44488/0 (socket says 172.21.15.29:44488) 2024-04-26T12:49:46.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f7999d9b640 1 -- 172.21.15.29:0/2889778215 learned_addr learned my addr 172.21.15.29:0/2889778215 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:46.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61f038b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61e8070140 0x7f61e8070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61f038b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e8071600 con 0x7f61e8070a60 2024-04-26T12:49:46.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61f038b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f61e809e210 con 0x7f61e8070140 2024-04-26T12:49:46.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ee127640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61e8070140 0x7f61e8070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ee127640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61e8070140 0x7f61e8070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55532/0 (socket says 172.21.15.29:55532) 2024-04-26T12:49:46.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ee127640 1 -- 172.21.15.29:0/1886002935 learned_addr learned my addr 172.21.15.29:0/1886002935 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799959a640 1 -- 172.21.15.29:0/2889778215 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580139221 0 0) 0x7f799c06f3f0 con 0x7f799c06e850 2024-04-26T12:49:46.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799959a640 1 -- 172.21.15.29:0/2889778215 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7984003530 con 0x7f799c06e850 2024-04-26T12:49:46.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799a59c640 1 -- 172.21.15.29:0/2889778215 >> v1:172.21.15.29:6789/0 conn(0x7f799c06e850 legacy=0x7f799c12d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799a59c640 1 -- 172.21.15.29:0/2889778215 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c06fde0 con 0x7f799c06df30 2024-04-26T12:49:46.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ee127640 1 -- 172.21.15.29:0/1886002935 >> v1:172.21.15.29:6789/0 conn(0x7f61e8070a60 legacy=0x7f61e8128f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T12:49:46.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ee127640 1 -- 172.21.15.29:0/1886002935 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e8071ff0 con 0x7f61e8070140 2024-04-26T12:49:46.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777f52c640 1 Processor -- start 2024-04-26T12:49:46.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777f52c640 1 -- start start 2024-04-26T12:49:46.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff8262cd640 1 Processor -- start 2024-04-26T12:49:46.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff8262cd640 1 -- start start 2024-04-26T12:49:46.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777f52c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f777812e310 0x7f777812e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777f52c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7778070930 con 0x7f777812ec30 2024-04-26T12:49:46.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777f52c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f777806d080 con 0x7f777812e310 2024-04-26T12:49:46.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff8262cd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff82012b810 0x7ff82012bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777d2c8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f777812e310 0x7f777812e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777cac7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f777812ec30 0x7f777812b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44500/0 (socket says 172.21.15.29:44500) 2024-04-26T12:49:46.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777cac7640 1 -- 172.21.15.29:0/3031511447 learned_addr learned my addr 172.21.15.29:0/3031511447 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:46.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff8262cd640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff820070eb0 con 0x7ff82006f7c0 2024-04-26T12:49:46.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff8262cd640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff820072ce0 con 0x7ff82012b810 2024-04-26T12:49:46.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff81f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff82006f7c0 0x7ff82006fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44506/0 (socket says 172.21.15.29:44506) 2024-04-26T12:49:46.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff81f7fe640 1 -- 172.21.15.29:0/1835363948 learned_addr learned my addr 172.21.15.29:0/1835363948 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:46.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff81ffff640 1 --2- 172.21.15.29:0/1835363948 >> v2:172.21.15.29:3300/0 conn(0x7ff82012b810 0x7ff82012bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777d2c8640 1 -- 172.21.15.29:0/3031511447 >> v1:172.21.15.29:6789/0 conn(0x7f777812ec30 legacy=0x7f777812b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f777d2c8640 1 -- 172.21.15.29:0/3031511447 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777806d6a0 con 0x7f777812e310 2024-04-26T12:49:46.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff81effd640 1 -- 172.21.15.29:0/1835363948 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755153948 0 0) 0x7ff820070eb0 con 0x7ff82006f7c0 2024-04-26T12:49:46.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff81effd640 1 -- 172.21.15.29:0/1835363948 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff808005740 con 0x7ff82006f7c0 2024-04-26T12:49:46.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff81ffff640 1 -- 172.21.15.29:0/1835363948 >> v1:172.21.15.29:6789/0 conn(0x7ff82006f7c0 legacy=0x7ff82006fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7ff81ffff640 1 -- 172.21.15.29:0/1835363948 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82012b3e0 con 0x7ff82012b810 2024-04-26T12:49:46.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ee127640 1 --2- 172.21.15.29:0/1886002935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e8070520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61e40097f0 tx=0x7f61e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0e2c01689e2b5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799a59c640 1 --2- 172.21.15.29:0/2889778215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06df30 0x7f799c06e310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f798c009740 tx=0x7f798c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315d7e0c9c878b0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ed125640 1 -- 172.21.15.29:0/1886002935 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e40b0070 con 0x7f61e8070140 2024-04-26T12:49:46.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f61ed125640 1 -- 172.21.15.29:0/1886002935 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e40ab530 con 0x7f61e8070140 2024-04-26T12:49:46.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799959a640 1 -- 172.21.15.29:0/2889778215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c0b0070 con 0x7f799c06df30 2024-04-26T12:49:46.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.067+0000 7f799959a640 1 -- 172.21.15.29:0/2889778215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c0ab530 con 0x7f799c06df30 2024-04-26T12:49:46.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61ed125640 1 -- 172.21.15.29:0/1886002935 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e40ab830 con 0x7f61e8070140 2024-04-26T12:49:46.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f799959a640 1 -- 172.21.15.29:0/2889778215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c0ab830 con 0x7f799c06df30 2024-04-26T12:49:46.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- 172.21.15.29:0/1886002935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 msgr2=0x7f61e8070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 --2- 172.21.15.29:0/1886002935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e8070520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61e40097f0 tx=0x7f61e401c430 comp rx=0 tx=0).stop 2024-04-26T12:49:46.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- 172.21.15.29:0/1886002935 shutdown_connections 2024-04-26T12:49:46.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 --2- 172.21.15.29:0/1886002935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e8070520 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- 172.21.15.29:0/1886002935 >> 172.21.15.29:0/1886002935 conn(0x7f61e809b4d0 msgr2=0x7f61e809b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 -- 172.21.15.29:0/2889778215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06df30 msgr2=0x7f799c06e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 --2- 172.21.15.29:0/2889778215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06df30 0x7f799c06e310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f798c009740 tx=0x7f798c01c370 comp rx=0 tx=0).stop 2024-04-26T12:49:46.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- 172.21.15.29:0/1886002935 shutdown_connections 2024-04-26T12:49:46.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- 172.21.15.29:0/1886002935 wait complete. 2024-04-26T12:49:46.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 -- 172.21.15.29:0/2889778215 shutdown_connections 2024-04-26T12:49:46.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 --2- 172.21.15.29:0/2889778215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06df30 0x7f799c06e310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 -- 172.21.15.29:0/2889778215 >> 172.21.15.29:0/2889778215 conn(0x7f799c09b4d0 msgr2=0x7f799c09b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 -- 172.21.15.29:0/2889778215 shutdown_connections 2024-04-26T12:49:46.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 -- 172.21.15.29:0/2889778215 wait complete. 2024-04-26T12:49:46.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777d2c8640 1 --2- 172.21.15.29:0/3031511447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f777812e6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7774009740 tx=0x7f777401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef31eda9310ff557 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f776ffff640 1 -- 172.21.15.29:0/3031511447 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77740b0070 con 0x7f777812e310 2024-04-26T12:49:46.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f776ffff640 1 -- 172.21.15.29:0/3031511447 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77740ab530 con 0x7f777812e310 2024-04-26T12:49:46.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f776ffff640 1 -- 172.21.15.29:0/3031511447 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77740ab830 con 0x7f777812e310 2024-04-26T12:49:46.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 Processor -- start 2024-04-26T12:49:46.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- start start 2024-04-26T12:49:46.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7ff81ffff640 1 --2- 172.21.15.29:0/1835363948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82012b810 0x7ff82012bbf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff810009740 tx=0x7ff810020780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacc1440cd5d9887 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7ff81effd640 1 -- 172.21.15.29:0/1835363948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8100ae520 con 0x7ff82012b810 2024-04-26T12:49:46.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7ff81effd640 1 -- 172.21.15.29:0/1835363948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8100b3070 con 0x7ff82012b810 2024-04-26T12:49:46.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7ff81effd640 1 -- 172.21.15.29:0/1835363948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8100ae810 con 0x7ff82012b810 2024-04-26T12:49:46.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e81c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8134a10 con 0x7f61e8070140 2024-04-26T12:49:46.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 Processor -- start 2024-04-26T12:49:46.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61ee127640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e81c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 -- start start 2024-04-26T12:49:46.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 -- 172.21.15.29:0/3031511447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 msgr2=0x7f777812e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 --2- 172.21.15.29:0/3031511447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f777812e6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7774009740 tx=0x7f777401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:46.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61ee127640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e81c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55560/0 (socket says 172.21.15.29:55560) 2024-04-26T12:49:46.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61ee127640 1 -- 172.21.15.29:0/58784097 learned_addr learned my addr 172.21.15.29:0/58784097 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 -- 172.21.15.29:0/3031511447 shutdown_connections 2024-04-26T12:49:46.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 --2- 172.21.15.29:0/3031511447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f777812e6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 -- 172.21.15.29:0/3031511447 >> 172.21.15.29:0/3031511447 conn(0x7f777809a310 msgr2=0x7f777809a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 -- 172.21.15.29:0/3031511447 shutdown_connections 2024-04-26T12:49:46.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 -- 172.21.15.29:0/3031511447 wait complete. 2024-04-26T12:49:46.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61ee127640 1 -- 172.21.15.29:0/58784097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e806fa90 con 0x7f61e8070140 2024-04-26T12:49:46.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06e850 0x7f799c119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f79a0abc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f799c136bf0 con 0x7f799c06e850 2024-04-26T12:49:46.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7ff8262cd640 1 -- 172.21.15.29:0/1835363948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82012b810 msgr2=0x7ff82012bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7ff8262cd640 1 --2- 172.21.15.29:0/1835363948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82012b810 0x7ff82012bbf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff810009740 tx=0x7ff810020780 comp rx=0 tx=0).stop 2024-04-26T12:49:46.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61ee127640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e81c6010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61e401a060 tx=0x7f61e401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f799a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06e850 0x7f799c119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f799a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06e850 0x7f799c119fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55562/0 (socket says 172.21.15.29:55562) 2024-04-26T12:49:46.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f799a59c640 1 -- 172.21.15.29:0/447429605 learned_addr learned my addr 172.21.15.29:0/447429605 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e40ba020 con 0x7f61e8070140 2024-04-26T12:49:46.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e40b6420 con 0x7f61e8070140 2024-04-26T12:49:46.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e811b770 con 0x7f61e8070140 2024-04-26T12:49:46.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e40b0040 con 0x7f61e8070140 2024-04-26T12:49:46.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e81c6550 con 0x7f61e8070140 2024-04-26T12:49:46.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f799a59c640 1 -- 172.21.15.29:0/447429605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c11d170 con 0x7f799c06e850 2024-04-26T12:49:46.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f799a59c640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06e850 0x7f799c119fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f798c019fa0 tx=0x7f798c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 Processor -- start 2024-04-26T12:49:46.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.071+0000 7f777f52c640 1 -- start start 2024-04-26T12:49:46.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c0b0050 con 0x7f799c06e850 2024-04-26T12:49:46.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c0b1040 con 0x7f799c06e850 2024-04-26T12:49:46.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c0b75a0 con 0x7f799c06e850 2024-04-26T12:49:46.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799c11b8d0 con 0x7f799c06e850 2024-04-26T12:49:46.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799c11a500 con 0x7f799c06e850 2024-04-26T12:49:46.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 -- 172.21.15.29:0/1835363948 shutdown_connections 2024-04-26T12:49:46.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 --2- 172.21.15.29:0/1835363948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82012b810 0x7ff82012bbf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 -- 172.21.15.29:0/1835363948 >> 172.21.15.29:0/1835363948 conn(0x7ff82009cab0 msgr2=0x7ff82009cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61e8062f80 con 0x7f61e8070140 2024-04-26T12:49:46.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f61e40bd020 con 0x7f61e8070140 2024-04-26T12:49:46.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777f52c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f7778132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777f52c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7778136c60 con 0x7f777812e310 2024-04-26T12:49:46.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777d2c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f7778132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777d2c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f7778132610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55572/0 (socket says 172.21.15.29:55572) 2024-04-26T12:49:46.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777d2c8640 1 -- 172.21.15.29:0/2345724678 learned_addr learned my addr 172.21.15.29:0/2345724678 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61deffd640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f61cc035e00 0x7f61cc0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f61e40e2950 con 0x7f61e8070140 2024-04-26T12:49:46.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61deffd640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f61cc03b580 0x7f61cc03d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61e40ade90 con 0x7f61cc03b580 2024-04-26T12:49:46.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f61e40e9050 con 0x7f61e8070140 2024-04-26T12:49:46.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777d2c8640 1 -- 172.21.15.29:0/2345724678 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7778133e50 con 0x7f777812e310 2024-04-26T12:49:46.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61ed926640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f61cc035e00 0x7f61cc0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 -- 172.21.15.29:0/1835363948 shutdown_connections 2024-04-26T12:49:46.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 -- 172.21.15.29:0/1835363948 wait complete. 2024-04-26T12:49:46.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7980000f90 con 0x7f799c06e850 2024-04-26T12:49:46.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f798c0be030 con 0x7f799c06e850 2024-04-26T12:49:46.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f797c035db0 0x7f797c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777d2c8640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f7778132610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7774019fa0 tx=0x7f777401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f798c0bc070 con 0x7f799c06e850 2024-04-26T12:49:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f797c03b530 0x7f797c03d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f798c006800 con 0x7f797c03b530 2024-04-26T12:49:46.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f798c0e9050 con 0x7f799c06e850 2024-04-26T12:49:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77740b0050 con 0x7f777812e310 2024-04-26T12:49:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77740b1040 con 0x7f777812e310 2024-04-26T12:49:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77740b5740 con 0x7f777812e310 2024-04-26T12:49:46.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61ee928640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f61cc03b580 0x7f61cc03d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f7999d9b640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f797c035db0 0x7f797c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f799ad9d640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f797c03b530 0x7f797c03d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 Processor -- start 2024-04-26T12:49:46.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61ee928640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f61cc03b580 0x7f61cc03d9c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 -- start start 2024-04-26T12:49:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61ed926640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f61cc035e00 0x7f61cc0382c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f61d8000f70 tx=0x7f61d8007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82006f7c0 0x7ff8201cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff82006f040 con 0x7ff82006f7c0 2024-04-26T12:49:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7778120c30 con 0x7f777812e310 2024-04-26T12:49:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7778132d20 con 0x7f777812e310 2024-04-26T12:49:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f7999d9b640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f797c035db0 0x7f797c038270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7990007fd0 tx=0x7f7990007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff81ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82006f7c0 0x7ff8201cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff81ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82006f7c0 0x7ff8201cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55582/0 (socket says 172.21.15.29:55582) 2024-04-26T12:49:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff81ffff640 1 -- 172.21.15.29:0/4261575984 learned_addr learned my addr 172.21.15.29:0/4261575984 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61e40ade90 con 0x7f61cc03b580 2024-04-26T12:49:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f799ad9d640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f797c03b530 0x7f797c03d970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7778133740 con 0x7f777812e310 2024-04-26T12:49:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f77740be030 con 0x7f777812e310 2024-04-26T12:49:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff81ffff640 1 -- 172.21.15.29:0/4261575984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff820123dc0 con 0x7ff82006f7c0 2024-04-26T12:49:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff81ffff640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82006f7c0 0x7ff8201cab60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8100b0040 tx=0x7ff81001efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff81cff9640 1 -- 172.21.15.29:0/4261575984 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8100aeca0 con 0x7ff82006f7c0 2024-04-26T12:49:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff81cff9640 1 -- 172.21.15.29:0/4261575984 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8100aee40 con 0x7ff82006f7c0 2024-04-26T12:49:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8201241c0 con 0x7ff82006f7c0 2024-04-26T12:49:46.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f775c035e00 0x7f775c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f77740bc070 con 0x7f777812e310 2024-04-26T12:49:46.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f775c03b580 0x7f775c03d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77740bde80 con 0x7f775c03b580 2024-04-26T12:49:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.075+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f77740e9050 con 0x7f777812e310 2024-04-26T12:49:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7f777cac7640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f775c035e00 0x7f775c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7f777dac9640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f775c03b580 0x7f775c03d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff81cff9640 1 -- 172.21.15.29:0/4261575984 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8100b95b0 con 0x7ff82006f7c0 2024-04-26T12:49:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8201238e0 con 0x7ff82006f7c0 2024-04-26T12:49:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff81cff9640 1 -- 172.21.15.29:0/4261575984 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff8100c0030 con 0x7ff82006f7c0 2024-04-26T12:49:46.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f798c006800 con 0x7f797c03b530 2024-04-26T12:49:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff81cff9640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff80c035d90 0x7ff80c038250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff81cff9640 1 -- 172.21.15.29:0/4261575984 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7ff8100be070 con 0x7ff82006f7c0 2024-04-26T12:49:46.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7f777cac7640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f775c035e00 0x7f775c0382c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7768005890 tx=0x7f7768007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7f777dac9640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f775c03b580 0x7f775c03d9c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff81f7fe640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff80c035d90 0x7ff80c038250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77740bde80 con 0x7f775c03b580 2024-04-26T12:49:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff8262cd640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7ff82012b810 0x7ff820121eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8201244a0 con 0x7ff82012b810 2024-04-26T12:49:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff82486a640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7ff82012b810 0x7ff820121eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff81f7fe640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff80c035d90 0x7ff80c038250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff814007fd0 tx=0x7ff814007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.079+0000 7ff82486a640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7ff82012b810 0x7ff820121eb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.083+0000 7ff81cff9640 1 -- 172.21.15.29:0/4261575984 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8201244a0 con 0x7ff82012b810 2024-04-26T12:49:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77781220a0 con 0x7f775c03b580 2024-04-26T12:49:46.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f776dffb640 1 -- 172.21.15.29:0/2345724678 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77781220a0 con 0x7f775c03b580 2024-04-26T12:49:46.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8201ca700 con 0x7ff82012b810 2024-04-26T12:49:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f775c03b580 msgr2=0x7f775c03d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f775c03b580 0x7f775c03d9c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f775c035e00 msgr2=0x7f775c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f775c035e00 0x7f775c0382c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7768005890 tx=0x7f7768007a90 comp rx=0 tx=0).stop 2024-04-26T12:49:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 msgr2=0x7f7778132610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f7778132610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7774019fa0 tx=0x7f777401abb0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 shutdown_connections 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f775c03b580 0x7f775c03d9c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f775c035e00 0x7f775c0382c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 --2- 172.21.15.29:0/2345724678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f777812e310 0x7f7778132610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 >> 172.21.15.29:0/2345724678 conn(0x7f777809a310 msgr2=0x7f7778113c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 shutdown_connections 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7f777f52c640 1 -- 172.21.15.29:0/2345724678 wait complete. 2024-04-26T12:49:46.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff81cff9640 1 -- 172.21.15.29:0/4261575984 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff8201ca700 con 0x7ff82012b810 2024-04-26T12:49:46.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7ff82012b810 msgr2=0x7ff820121eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7ff82012b810 0x7ff820121eb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff80c035d90 msgr2=0x7ff80c038250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff80c035d90 0x7ff80c038250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff814007fd0 tx=0x7ff814007980 comp rx=0 tx=0).stop 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82006f7c0 msgr2=0x7ff8201cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82006f7c0 0x7ff8201cab60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8100b0040 tx=0x7ff81001efc0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 shutdown_connections 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7ff82012b810 0x7ff820121eb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff80c035d90 0x7ff80c038250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 --2- 172.21.15.29:0/4261575984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff82006f7c0 0x7ff8201cab60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 >> 172.21.15.29:0/4261575984 conn(0x7ff82009cab0 msgr2=0x7ff820125ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 shutdown_connections 2024-04-26T12:49:46.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.095+0000 7ff8262cd640 1 -- 172.21.15.29:0/4261575984 wait complete. 2024-04-26T12:49:46.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61e811b500 con 0x7f61cc03b580 2024-04-26T12:49:46.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61deffd640 1 -- 172.21.15.29:0/58784097 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f61e811b500 con 0x7f61cc03b580 2024-04-26T12:49:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f61cc03b580 msgr2=0x7f61cc03d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61f038b640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f61cc03b580 0x7f61cc03d9c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f61cc035e00 msgr2=0x7f61cc0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61f038b640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f61cc035e00 0x7f61cc0382c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f61d8000f70 tx=0x7f61d8007a40 comp rx=0 tx=0).stop 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 msgr2=0x7f61e81c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.103+0000 7f61f038b640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e81c6010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61e401a060 tx=0x7f61e401ac70 comp rx=0 tx=0).stop 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 shutdown_connections 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f61f038b640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f61cc03b580 0x7f61cc03d9c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f61f038b640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f61cc035e00 0x7f61cc0382c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f61f038b640 1 --2- 172.21.15.29:0/58784097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61e8070140 0x7f61e81c6010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 >> 172.21.15.29:0/58784097 conn(0x7f61e809b4d0 msgr2=0x7f61e812c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 shutdown_connections 2024-04-26T12:49:46.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f61f038b640 1 -- 172.21.15.29:0/58784097 wait complete. 2024-04-26T12:49:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7980002c80 con 0x7f797c03b530 2024-04-26T12:49:46.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f798affd640 1 -- 172.21.15.29:0/447429605 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7980002c80 con 0x7f797c03b530 2024-04-26T12:49:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f797c03b530 msgr2=0x7f797c03d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f797c03b530 0x7f797c03d970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f797c035db0 msgr2=0x7f797c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f797c035db0 0x7f797c038270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7990007fd0 tx=0x7f7990007980 comp rx=0 tx=0).stop 2024-04-26T12:49:46.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06e850 msgr2=0x7f799c119fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06e850 0x7f799c119fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f798c019fa0 tx=0x7f798c01abb0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 shutdown_connections 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f797c03b530 0x7f797c03d970 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f797c035db0 0x7f797c038270 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 --2- 172.21.15.29:0/447429605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f799c06e850 0x7f799c119fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 >> 172.21.15.29:0/447429605 conn(0x7f799c09b4d0 msgr2=0x7f799c12e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 shutdown_connections 2024-04-26T12:49:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.107+0000 7f79a0abc640 1 -- 172.21.15.29:0/447429605 wait complete. 2024-04-26T12:49:46.124 INFO:teuthology.orchestra.run.smithi029.stdout:47244640261 2024-04-26T12:49:46.125 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:49:46.126 INFO:teuthology.orchestra.run.smithi029.stdout:47244640261 2024-04-26T12:49:46.126 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:49:46.129 INFO:teuthology.orchestra.run.smithi029.stdout:38654705669 2024-04-26T12:49:46.129 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:49:46.131 INFO:teuthology.orchestra.run.smithi029.stdout:47244640261 2024-04-26T12:49:46.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:49:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f894ae51640 1 Processor -- start 2024-04-26T12:49:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f894ae51640 1 -- start start 2024-04-26T12:49:46.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f894ae51640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f894412f370 0x7f8944131760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8943fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f894412f370 0x7f8944131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8948bed640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8944128d20 0x7f8944129100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44516/0 (socket says 172.21.15.29:44516) 2024-04-26T12:49:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8948bed640 1 -- 172.21.15.29:0/2820813241 learned_addr learned my addr 172.21.15.29:0/2820813241 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f894ae51640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8944128b20 con 0x7f8944128d20 2024-04-26T12:49:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f894ae51640 1 -- 172.21.15.29:0/2820813241 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8944113cd0 con 0x7f894412f370 2024-04-26T12:49:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8943fff640 1 -- 172.21.15.29:0/2820813241 >> v1:172.21.15.29:6789/0 conn(0x7f8944128d20 legacy=0x7f8944129100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8943fff640 1 -- 172.21.15.29:0/2820813241 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894406d080 con 0x7f894412f370 2024-04-26T12:49:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a96540640 1 Processor -- start 2024-04-26T12:49:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a96540640 1 -- start start 2024-04-26T12:49:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a96540640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a90070c30 0x7f8a901317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a96540640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a90071600 con 0x7f8a90070140 2024-04-26T12:49:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a96540640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9009e210 con 0x7f8a90070c30 2024-04-26T12:49:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a8ffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8a90070140 0x7f8a90070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44522/0 (socket says 172.21.15.29:44522) 2024-04-26T12:49:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a8ffff640 1 -- 172.21.15.29:0/462412320 learned_addr learned my addr 172.21.15.29:0/462412320 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a8f7fe640 1 --2- 172.21.15.29:0/462412320 >> v2:172.21.15.29:3300/0 conn(0x7f8a90070c30 0x7f8a901317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a8f7fe640 1 -- 172.21.15.29:0/462412320 >> v1:172.21.15.29:6789/0 conn(0x7f8a90070140 legacy=0x7f8a90070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a8effd640 1 -- 172.21.15.29:0/462412320 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771268806 0 0) 0x7f8a90071600 con 0x7f8a90070140 2024-04-26T12:49:46.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.231+0000 7f8a8f7fe640 1 -- 172.21.15.29:0/462412320 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a90071ff0 con 0x7f8a90070c30 2024-04-26T12:49:46.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8943fff640 1 --2- 172.21.15.29:0/2820813241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f894412f370 0x7f8944131760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8930009740 tx=0x7f893001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2197c3885f195b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f89437fe640 1 -- 172.21.15.29:0/2820813241 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89300b0070 con 0x7f894412f370 2024-04-26T12:49:46.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f89437fe640 1 -- 172.21.15.29:0/2820813241 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89300ab530 con 0x7f894412f370 2024-04-26T12:49:46.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f89437fe640 1 -- 172.21.15.29:0/2820813241 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89300ab830 con 0x7f894412f370 2024-04-26T12:49:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- 172.21.15.29:0/2820813241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f894412f370 msgr2=0x7f8944131760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 --2- 172.21.15.29:0/2820813241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f894412f370 0x7f8944131760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8930009740 tx=0x7f893001c370 comp rx=0 tx=0).stop 2024-04-26T12:49:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- 172.21.15.29:0/2820813241 shutdown_connections 2024-04-26T12:49:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 --2- 172.21.15.29:0/2820813241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f894412f370 0x7f8944131760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- 172.21.15.29:0/2820813241 >> 172.21.15.29:0/2820813241 conn(0x7f894409a4e0 msgr2=0x7f894409a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- 172.21.15.29:0/2820813241 shutdown_connections 2024-04-26T12:49:46.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- 172.21.15.29:0/2820813241 wait complete. 2024-04-26T12:49:46.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 Processor -- start 2024-04-26T12:49:46.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- start start 2024-04-26T12:49:46.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a8f7fe640 1 --2- 172.21.15.29:0/462412320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070c30 0x7f8a901317e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009740 tx=0x7f8a8401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267669f3b672e5a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8944128d20 0x7f8944124820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a8effd640 1 -- 172.21.15.29:0/462412320 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a840b0070 con 0x7f8a90070c30 2024-04-26T12:49:46.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a8effd640 1 -- 172.21.15.29:0/462412320 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a840ab530 con 0x7f8a90070c30 2024-04-26T12:49:46.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a8effd640 1 -- 172.21.15.29:0/462412320 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a840ab830 con 0x7f8a90070c30 2024-04-26T12:49:46.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8944134640 con 0x7f8944128d20 2024-04-26T12:49:46.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8948bed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8944128d20 0x7f8944124820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8948bed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8944128d20 0x7f8944124820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55606/0 (socket says 172.21.15.29:55606) 2024-04-26T12:49:46.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8948bed640 1 -- 172.21.15.29:0/4152947444 learned_addr learned my addr 172.21.15.29:0/4152947444 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8948bed640 1 -- 172.21.15.29:0/4152947444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8944131770 con 0x7f8944128d20 2024-04-26T12:49:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8948bed640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8944128d20 0x7f8944124820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f893800c480 tx=0x7f893800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f89417fa640 1 -- 172.21.15.29:0/4152947444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8938017070 con 0x7f8944128d20 2024-04-26T12:49:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f89417fa640 1 -- 172.21.15.29:0/4152947444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8938005c20 con 0x7f8944128d20 2024-04-26T12:49:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89441155e0 con 0x7f8944128d20 2024-04-26T12:49:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f89417fa640 1 -- 172.21.15.29:0/4152947444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8938007070 con 0x7f8944128d20 2024-04-26T12:49:46.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8944124d60 con 0x7f8944128d20 2024-04-26T12:49:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a96540640 1 -- 172.21.15.29:0/462412320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070c30 msgr2=0x7f8a901317e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a96540640 1 --2- 172.21.15.29:0/462412320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070c30 0x7f8a901317e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009740 tx=0x7f8a8401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a96540640 1 -- 172.21.15.29:0/462412320 shutdown_connections 2024-04-26T12:49:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a96540640 1 --2- 172.21.15.29:0/462412320 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070c30 0x7f8a901317e0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009740 tx=0x7f8a8401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.235+0000 7f8a96540640 1 -- 172.21.15.29:0/462412320 >> 172.21.15.29:0/462412320 conn(0x7f8a9009b4d0 msgr2=0x7f8a9009b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a96540640 1 -- 172.21.15.29:0/462412320 shutdown_connections 2024-04-26T12:49:46.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a96540640 1 -- 172.21.15.29:0/462412320 wait complete. 2024-04-26T12:49:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8944114990 con 0x7f8944128d20 2024-04-26T12:49:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f89417fa640 1 -- 172.21.15.29:0/4152947444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f893801a070 con 0x7f8944128d20 2024-04-26T12:49:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a96540640 1 Processor -- start 2024-04-26T12:49:46.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f89417fa640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8928035db0 0x7f8928038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a96540640 1 -- start start 2024-04-26T12:49:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f89417fa640 1 -- 172.21.15.29:0/4152947444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f89380478d0 con 0x7f8944128d20 2024-04-26T12:49:46.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a96540640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070140 0x7f8a9006e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a96540640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90134750 con 0x7f8a90070140 2024-04-26T12:49:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8943fff640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8928035db0 0x7f8928038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070140 0x7f8a9006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070140 0x7f8a9006e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55622/0 (socket says 172.21.15.29:55622) 2024-04-26T12:49:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a8ffff640 1 -- 172.21.15.29:0/1088604298 learned_addr learned my addr 172.21.15.29:0/1088604298 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a8ffff640 1 -- 172.21.15.29:0/1088604298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9006f9f0 con 0x7f8a90070140 2024-04-26T12:49:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8a8ffff640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070140 0x7f8a9006e210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c450 tx=0x7f8a8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.239+0000 7f8943fff640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8928035db0 0x7f8928038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f89300ad000 tx=0x7f89300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a8cff9640 1 -- 172.21.15.29:0/1088604298 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a80005c20 con 0x7f8a90070140 2024-04-26T12:49:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a8cff9640 1 -- 172.21.15.29:0/1088604298 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80005dc0 con 0x7f8a90070140 2024-04-26T12:49:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a8cff9640 1 -- 172.21.15.29:0/1088604298 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a800071a0 con 0x7f8a90070140 2024-04-26T12:49:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9011e2c0 con 0x7f8a90070140 2024-04-26T12:49:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9011e5d0 con 0x7f8a90070140 2024-04-26T12:49:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f89417fa640 1 -- 172.21.15.29:0/4152947444 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8938007210 con 0x7f8944128d20 2024-04-26T12:49:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a90062f80 con 0x7f8a90070140 2024-04-26T12:49:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a8cff9640 1 -- 172.21.15.29:0/1088604298 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8a80007400 con 0x7f8a90070140 2024-04-26T12:49:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a8cff9640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8a7c035d60 0x7f8a7c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.247+0000 7f8a8cff9640 1 -- 172.21.15.29:0/1088604298 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f8a80048380 con 0x7f8a90070140 2024-04-26T12:49:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.251+0000 7f8a8f7fe640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8a7c035d60 0x7f8a7c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.251+0000 7f8a8f7fe640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8a7c035d60 0x7f8a7c038220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a840ad000 tx=0x7f8a84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.255+0000 7f8a8cff9640 1 -- 172.21.15.29:0/1088604298 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8a800182b0 con 0x7f8a90070140 2024-04-26T12:49:46.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fe677f640 1 Processor -- start 2024-04-26T12:49:46.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fe677f640 1 -- start start 2024-04-26T12:49:46.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fe677f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fe0099900 0x7f0fe0133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fe677f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fe009ae10 con 0x7f0fe0098e10 2024-04-26T12:49:46.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fe677f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0fe009ab00 con 0x7f0fe0099900 2024-04-26T12:49:46.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fdf7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0fe0099900 0x7f0fe0133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fdffff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0fe0098e10 0x7f0fe00991f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44524/0 (socket says 172.21.15.29:44524) 2024-04-26T12:49:46.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fdffff640 1 -- 172.21.15.29:0/291282710 learned_addr learned my addr 172.21.15.29:0/291282710 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:46.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fdf7fe640 1 -- 172.21.15.29:0/291282710 >> v1:172.21.15.29:6789/0 conn(0x7f0fe0098e10 legacy=0x7f0fe00991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fdeffd640 1 -- 172.21.15.29:0/291282710 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231378413 0 0) 0x7f0fd0001120 con 0x7f0fe0098e10 2024-04-26T12:49:46.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.279+0000 7f0fdf7fe640 1 -- 172.21.15.29:0/291282710 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe00a00c0 con 0x7f0fe0099900 2024-04-26T12:49:46.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdf7fe640 1 --2- 172.21.15.29:0/291282710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0099900 0x7f0fe0133a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009740 tx=0x7f0fd401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd57bce1412e19c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdeffd640 1 -- 172.21.15.29:0/291282710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd40b0070 con 0x7f0fe0099900 2024-04-26T12:49:46.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdeffd640 1 -- 172.21.15.29:0/291282710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd40ab530 con 0x7f0fe0099900 2024-04-26T12:49:46.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdeffd640 1 -- 172.21.15.29:0/291282710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd40ab830 con 0x7f0fe0099900 2024-04-26T12:49:46.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- 172.21.15.29:0/291282710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0099900 msgr2=0x7f0fe0133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 --2- 172.21.15.29:0/291282710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0099900 0x7f0fe0133a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009740 tx=0x7f0fd401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:46.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- 172.21.15.29:0/291282710 shutdown_connections 2024-04-26T12:49:46.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 --2- 172.21.15.29:0/291282710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0099900 0x7f0fe0133a80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- 172.21.15.29:0/291282710 >> 172.21.15.29:0/291282710 conn(0x7f0fe009ee00 msgr2=0x7f0fe009f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- 172.21.15.29:0/291282710 shutdown_connections 2024-04-26T12:49:46.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- 172.21.15.29:0/291282710 wait complete. 2024-04-26T12:49:46.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 Processor -- start 2024-04-26T12:49:46.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- start start 2024-04-26T12:49:46.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0098e10 0x7f0fe0132680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0136b70 con 0x7f0fe0098e10 2024-04-26T12:49:46.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0098e10 0x7f0fe0132680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0098e10 0x7f0fe0132680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55646/0 (socket says 172.21.15.29:55646) 2024-04-26T12:49:46.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdffff640 1 -- 172.21.15.29:0/919513390 learned_addr learned my addr 172.21.15.29:0/919513390 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdffff640 1 -- 172.21.15.29:0/919513390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe0093350 con 0x7f0fe0098e10 2024-04-26T12:49:46.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdffff640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0098e10 0x7f0fe0132680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000c700 tx=0x7f0fd000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdcff9640 1 -- 172.21.15.29:0/919513390 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0018070 con 0x7f0fe0098e10 2024-04-26T12:49:46.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdcff9640 1 -- 172.21.15.29:0/919513390 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd00070d0 con 0x7f0fe0098e10 2024-04-26T12:49:46.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fdcff9640 1 -- 172.21.15.29:0/919513390 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd00073f0 con 0x7f0fe0098e10 2024-04-26T12:49:46.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe0097440 con 0x7f0fe0098e10 2024-04-26T12:49:46.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.283+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe00941b0 con 0x7f0fe0098e10 2024-04-26T12:49:46.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.287+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe0093b20 con 0x7f0fe0098e10 2024-04-26T12:49:46.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.287+0000 7f0fdcff9640 1 -- 172.21.15.29:0/919513390 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0fd001b070 con 0x7f0fe0098e10 2024-04-26T12:49:46.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.287+0000 7f0fdcff9640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0fcc035db0 0x7f0fcc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.287+0000 7f0fdcff9640 1 -- 172.21.15.29:0/919513390 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f0fd0047a50 con 0x7f0fe0098e10 2024-04-26T12:49:46.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.287+0000 7f0fdf7fe640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0fcc035db0 0x7f0fcc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.287+0000 7f0fdf7fe640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0fcc035db0 0x7f0fcc038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40ad000 tx=0x7f0fd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.295+0000 7f0fdcff9640 1 -- 172.21.15.29:0/919513390 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f0fe009ae10 con 0x7f0fe0098e10 2024-04-26T12:49:46.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.299+0000 7f3286146640 1 Processor -- start 2024-04-26T12:49:46.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.299+0000 7f3286146640 1 -- start start 2024-04-26T12:49:46.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f3286146640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f328006ec30 0x7f328006f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f3286146640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3280070500 con 0x7f328006f550 2024-04-26T12:49:46.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f3286146640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f328006fd30 con 0x7f328006ec30 2024-04-26T12:49:46.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f328006ec30 0x7f328006f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f328006f550 0x7f328012af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:44534/0 (socket says 172.21.15.29:44534) 2024-04-26T12:49:46.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327effd640 1 -- 172.21.15.29:0/2056238582 learned_addr learned my addr 172.21.15.29:0/2056238582 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:46.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327f7fe640 1 -- 172.21.15.29:0/2056238582 >> v1:172.21.15.29:6789/0 conn(0x7f328006f550 legacy=0x7f328012af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327f7fe640 1 -- 172.21.15.29:0/2056238582 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3280070c60 con 0x7f328006ec30 2024-04-26T12:49:46.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327f7fe640 1 --2- 172.21.15.29:0/2056238582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f328006f010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3270009740 tx=0x7f327001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45721297727e3420 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327e7fc640 1 -- 172.21.15.29:0/2056238582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700b0070 con 0x7f328006ec30 2024-04-26T12:49:46.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327e7fc640 1 -- 172.21.15.29:0/2056238582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700ab530 con 0x7f328006ec30 2024-04-26T12:49:46.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.303+0000 7f327e7fc640 1 -- 172.21.15.29:0/2056238582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700ab830 con 0x7f328006ec30 2024-04-26T12:49:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- 172.21.15.29:0/2056238582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 msgr2=0x7f328006f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 --2- 172.21.15.29:0/2056238582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f328006f010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3270009740 tx=0x7f327001c370 comp rx=0 tx=0).stop 2024-04-26T12:49:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- 172.21.15.29:0/2056238582 shutdown_connections 2024-04-26T12:49:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 --2- 172.21.15.29:0/2056238582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f328006f010 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- 172.21.15.29:0/2056238582 >> 172.21.15.29:0/2056238582 conn(0x7f328009a310 msgr2=0x7f328009a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- 172.21.15.29:0/2056238582 shutdown_connections 2024-04-26T12:49:46.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- 172.21.15.29:0/2056238582 wait complete. 2024-04-26T12:49:46.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 Processor -- start 2024-04-26T12:49:46.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- start start 2024-04-26T12:49:46.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f32801c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f32800726c0 con 0x7f328006ec30 2024-04-26T12:49:46.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f327f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f32801c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f327f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f32801c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55654/0 (socket says 172.21.15.29:55654) 2024-04-26T12:49:46.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f327f7fe640 1 -- 172.21.15.29:0/3853606400 learned_addr learned my addr 172.21.15.29:0/3853606400 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:46.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f327f7fe640 1 -- 172.21.15.29:0/3853606400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328006d100 con 0x7f328006ec30 2024-04-26T12:49:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f327f7fe640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f32801c4030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f32700ae040 tx=0x7f327001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3267fff640 1 -- 172.21.15.29:0/3853606400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700b0050 con 0x7f328006ec30 2024-04-26T12:49:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3267fff640 1 -- 172.21.15.29:0/3853606400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700b1040 con 0x7f328006ec30 2024-04-26T12:49:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328011b120 con 0x7f328006ec30 2024-04-26T12:49:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3267fff640 1 -- 172.21.15.29:0/3853606400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700aab40 con 0x7f328006ec30 2024-04-26T12:49:46.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.307+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328011b790 con 0x7f328006ec30 2024-04-26T12:49:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.311+0000 7f3267fff640 1 -- 172.21.15.29:0/3853606400 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32700be030 con 0x7f328006ec30 2024-04-26T12:49:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.311+0000 7f3267fff640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f326c035db0 0x7f326c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.311+0000 7f3267fff640 1 -- 172.21.15.29:0/3853606400 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f32700bc070 con 0x7f328006ec30 2024-04-26T12:49:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.311+0000 7f327effd640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f326c035db0 0x7f326c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.311+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3280062f80 con 0x7f328006ec30 2024-04-26T12:49:46.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.311+0000 7f327effd640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f326c035db0 0x7f326c038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3274001630 tx=0x7f3274007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:46.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.319+0000 7f3267fff640 1 -- 172.21.15.29:0/3853606400 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f32700c5020 con 0x7f328006ec30 2024-04-26T12:49:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8944062f80 con 0x7f8944128d20 2024-04-26T12:49:46.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f89417fa640 1 -- 172.21.15.29:0/4152947444 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f893801b3b0 con 0x7f8944128d20 2024-04-26T12:49:46.421 INFO:teuthology.orchestra.run.smithi029.stdout:47244640260 2024-04-26T12:49:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8928035db0 msgr2=0x7f8928038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8928035db0 0x7f8928038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f89300ad000 tx=0x7f89300a6000 comp rx=0 tx=0).stop 2024-04-26T12:49:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8944128d20 msgr2=0x7f8944124820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8944128d20 0x7f8944124820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f893800c480 tx=0x7f893800c940 comp rx=0 tx=0).stop 2024-04-26T12:49:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 shutdown_connections 2024-04-26T12:49:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8928035db0 0x7f8928038270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 --2- 172.21.15.29:0/4152947444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8944128d20 0x7f8944124820 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 >> 172.21.15.29:0/4152947444 conn(0x7f894409a4e0 msgr2=0x7f8944127900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 shutdown_connections 2024-04-26T12:49:46.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.419+0000 7f894ae51640 1 -- 172.21.15.29:0/4152947444 wait complete. 2024-04-26T12:49:46.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-04-26T12:49:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0fe0062f80 con 0x7f0fe0098e10 2024-04-26T12:49:46.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fdcff9640 1 -- 172.21.15.29:0/919513390 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0fd001bc60 con 0x7f0fe0098e10 2024-04-26T12:49:46.460 INFO:teuthology.orchestra.run.smithi029.stdout:38654705667 2024-04-26T12:49:46.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0fcc035db0 msgr2=0x7f0fcc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0fcc035db0 0x7f0fcc038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40ad000 tx=0x7f0fd40a6000 comp rx=0 tx=0).stop 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0098e10 msgr2=0x7f0fe0132680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0098e10 0x7f0fe0132680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000c700 tx=0x7f0fd000cbc0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 shutdown_connections 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0fcc035db0 0x7f0fcc038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 --2- 172.21.15.29:0/919513390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0fe0098e10 0x7f0fe0132680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 >> 172.21.15.29:0/919513390 conn(0x7f0fe009ee00 msgr2=0x7f0fe0096180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 shutdown_connections 2024-04-26T12:49:46.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.459+0000 7f0fe677f640 1 -- 172.21.15.29:0/919513390 wait complete. 2024-04-26T12:49:46.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-04-26T12:49:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8a9011d980 con 0x7f8a90070140 2024-04-26T12:49:46.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a8cff9640 1 -- 172.21.15.29:0/1088604298 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a8001bca0 con 0x7f8a90070140 2024-04-26T12:49:46.485 INFO:teuthology.orchestra.run.smithi029.stdout:47244640260 2024-04-26T12:49:46.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8a7c035d60 msgr2=0x7f8a7c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8a7c035d60 0x7f8a7c038220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a840ad000 tx=0x7f8a84008040 comp rx=0 tx=0).stop 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070140 msgr2=0x7f8a9006e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070140 0x7f8a9006e210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c450 tx=0x7f8a8000c910 comp rx=0 tx=0).stop 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 shutdown_connections 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8a7c035d60 0x7f8a7c038220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 --2- 172.21.15.29:0/1088604298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a90070140 0x7f8a9006e210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 >> 172.21.15.29:0/1088604298 conn(0x7f8a9009b4d0 msgr2=0x7f8a9012bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 shutdown_connections 2024-04-26T12:49:46.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.483+0000 7f8a96540640 1 -- 172.21.15.29:0/1088604298 wait complete. 2024-04-26T12:49:46.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2024-04-26T12:49:46.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.523+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f328006d9d0 con 0x7f328006ec30 2024-04-26T12:49:46.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.523+0000 7f3267fff640 1 -- 172.21.15.29:0/3853606400 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3270015ff0 con 0x7f328006ec30 2024-04-26T12:49:46.528 INFO:teuthology.orchestra.run.smithi029.stdout:47244640260 2024-04-26T12:49:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f326c035db0 msgr2=0x7f326c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f326c035db0 0x7f326c038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3274001630 tx=0x7f3274007a90 comp rx=0 tx=0).stop 2024-04-26T12:49:46.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 msgr2=0x7f32801c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f32801c4030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f32700ae040 tx=0x7f327001abb0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 shutdown_connections 2024-04-26T12:49:46.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f326c035db0 0x7f326c038270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 --2- 172.21.15.29:0/3853606400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f328006ec30 0x7f32801c4030 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 >> 172.21.15.29:0/3853606400 conn(0x7f328009a310 msgr2=0x7f328012dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 shutdown_connections 2024-04-26T12:49:46.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:46.527+0000 7f3286146640 1 -- 172.21.15.29:0/3853606400 wait complete. 2024-04-26T12:49:46.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-04-26T12:49:47.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:49:47.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:49:47.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:49:47.545 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:49:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c69cb5640 1 Processor -- start 2024-04-26T12:49:47.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c69cb5640 1 -- start start 2024-04-26T12:49:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c69cb5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c6412e310 0x7f4c6412e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c69cb5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c64070930 con 0x7f4c6412ec30 2024-04-26T12:49:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c69cb5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6406d700 con 0x7f4c6412e310 2024-04-26T12:49:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c637fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c6412e310 0x7f4c6412e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c637fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4c6412e310 0x7f4c6412e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38926/0 (socket says 172.21.15.29:38926) 2024-04-26T12:49:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c62ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4c6412ec30 0x7f4c6412b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50416/0 (socket says 172.21.15.29:50416) 2024-04-26T12:49:47.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c637fe640 1 -- 172.21.15.29:0/2384493647 learned_addr learned my addr 172.21.15.29:0/2384493647 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c637fe640 1 -- 172.21.15.29:0/2384493647 >> v1:172.21.15.29:6789/0 conn(0x7f4c6412ec30 legacy=0x7f4c6412b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.567+0000 7f4c637fe640 1 -- 172.21.15.29:0/2384493647 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6406d080 con 0x7f4c6412e310 2024-04-26T12:49:47.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c637fe640 1 --2- 172.21.15.29:0/2384493647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c6412e6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c540097f0 tx=0x7f4c5401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125bf3dcdc5ee95e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c627fc640 1 -- 172.21.15.29:0/2384493647 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c540b0070 con 0x7f4c6412e310 2024-04-26T12:49:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c627fc640 1 -- 172.21.15.29:0/2384493647 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c540ab530 con 0x7f4c6412e310 2024-04-26T12:49:47.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c627fc640 1 -- 172.21.15.29:0/2384493647 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c540ab830 con 0x7f4c6412e310 2024-04-26T12:49:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c69cb5640 1 -- 172.21.15.29:0/2384493647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 msgr2=0x7f4c6412e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c69cb5640 1 --2- 172.21.15.29:0/2384493647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c6412e6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c540097f0 tx=0x7f4c5401c430 comp rx=0 tx=0).stop 2024-04-26T12:49:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c69cb5640 1 -- 172.21.15.29:0/2384493647 shutdown_connections 2024-04-26T12:49:47.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c69cb5640 1 --2- 172.21.15.29:0/2384493647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c6412e6f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c69cb5640 1 -- 172.21.15.29:0/2384493647 >> 172.21.15.29:0/2384493647 conn(0x7f4c6409a310 msgr2=0x7f4c6409a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c69cb5640 1 -- 172.21.15.29:0/2384493647 shutdown_connections 2024-04-26T12:49:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.571+0000 7f4c69cb5640 1 -- 172.21.15.29:0/2384493647 wait complete. 2024-04-26T12:49:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c69cb5640 1 Processor -- start 2024-04-26T12:49:47.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c69cb5640 1 -- start start 2024-04-26T12:49:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c69cb5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c64118210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c69cb5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4c64136bf0 con 0x7f4c6412e310 2024-04-26T12:49:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c64118210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c64118210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38930/0 (socket says 172.21.15.29:38930) 2024-04-26T12:49:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c637fe640 1 -- 172.21.15.29:0/4085016799 learned_addr learned my addr 172.21.15.29:0/4085016799 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:47.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c637fe640 1 -- 172.21.15.29:0/4085016799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c64119b80 con 0x7f4c6412e310 2024-04-26T12:49:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c637fe640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c64118210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c5401a060 tx=0x7f4c540191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c4bfff640 1 -- 172.21.15.29:0/4085016799 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c540b0040 con 0x7f4c6412e310 2024-04-26T12:49:47.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c4bfff640 1 -- 172.21.15.29:0/4085016799 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c540b4440 con 0x7f4c6412e310 2024-04-26T12:49:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6411a370 con 0x7f4c6412e310 2024-04-26T12:49:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c4bfff640 1 -- 172.21.15.29:0/4085016799 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c540b4760 con 0x7f4c6412e310 2024-04-26T12:49:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6411a810 con 0x7f4c6412e310 2024-04-26T12:49:47.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c64062f80 con 0x7f4c6412e310 2024-04-26T12:49:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c4bfff640 1 -- 172.21.15.29:0/4085016799 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c540bb020 con 0x7f4c6412e310 2024-04-26T12:49:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c4bfff640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4c50035db0 0x7f4c50038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c4bfff640 1 -- 172.21.15.29:0/4085016799 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f4c540b9020 con 0x7f4c6412e310 2024-04-26T12:49:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.575+0000 7f4c62ffd640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4c50035db0 0x7f4c50038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.579+0000 7f4c62ffd640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4c50035db0 0x7f4c50038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4c58001600 tx=0x7f4c58007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.583+0000 7f4c4bfff640 1 -- 172.21.15.29:0/4085016799 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4c540c2020 con 0x7f4c6412e310 2024-04-26T12:49:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3fc522640 1 Processor -- start 2024-04-26T12:49:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3fc522640 1 -- start start 2024-04-26T12:49:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3fc522640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3f4099900 0x7fb3f4133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3fc522640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f409ae10 con 0x7fb3f4098e10 2024-04-26T12:49:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3fc522640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f409ab00 con 0x7fb3f4099900 2024-04-26T12:49:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3f9abd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3f4099900 0x7fb3f4133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3fa2be640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb3f4098e10 0x7fb3f40991f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50432/0 (socket says 172.21.15.29:50432) 2024-04-26T12:49:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3fa2be640 1 -- 172.21.15.29:0/3046912242 learned_addr learned my addr 172.21.15.29:0/3046912242 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:47.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3f9abd640 1 -- 172.21.15.29:0/3046912242 >> v1:172.21.15.29:6789/0 conn(0x7fb3f4098e10 legacy=0x7fb3f40991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.599+0000 7fb3f9abd640 1 -- 172.21.15.29:0/3046912242 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f40a00c0 con 0x7fb3f4099900 2024-04-26T12:49:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3f9abd640 1 --2- 172.21.15.29:0/3046912242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4099900 0x7fb3f4133a80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009740 tx=0x7fb3e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b1913ae2a7f39e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3f92bc640 1 -- 172.21.15.29:0/3046912242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e40b0070 con 0x7fb3f4099900 2024-04-26T12:49:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3f92bc640 1 -- 172.21.15.29:0/3046912242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e40ab530 con 0x7fb3f4099900 2024-04-26T12:49:47.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3f92bc640 1 -- 172.21.15.29:0/3046912242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e40ab830 con 0x7fb3f4099900 2024-04-26T12:49:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- 172.21.15.29:0/3046912242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4099900 msgr2=0x7fb3f4133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 --2- 172.21.15.29:0/3046912242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4099900 0x7fb3f4133a80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009740 tx=0x7fb3e401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- 172.21.15.29:0/3046912242 shutdown_connections 2024-04-26T12:49:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 --2- 172.21.15.29:0/3046912242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4099900 0x7fb3f4133a80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- 172.21.15.29:0/3046912242 >> 172.21.15.29:0/3046912242 conn(0x7fb3f409ee00 msgr2=0x7fb3f409f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- 172.21.15.29:0/3046912242 shutdown_connections 2024-04-26T12:49:47.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- 172.21.15.29:0/3046912242 wait complete. 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 Processor -- start 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- start start 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4098e10 0x7fb3f41325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f4136b70 con 0x7fb3f4098e10 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fa2be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4098e10 0x7fb3f41325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fa2be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4098e10 0x7fb3f41325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38954/0 (socket says 172.21.15.29:38954) 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fa2be640 1 -- 172.21.15.29:0/106483169 learned_addr learned my addr 172.21.15.29:0/106483169 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:47.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fa2be640 1 -- 172.21.15.29:0/106483169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f4092d40 con 0x7fb3f4098e10 2024-04-26T12:49:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fa2be640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4098e10 0x7fb3f41325c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000c480 tx=0x7fb3f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3eaffd640 1 -- 172.21.15.29:0/106483169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f0017070 con 0x7fb3f4098e10 2024-04-26T12:49:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3eaffd640 1 -- 172.21.15.29:0/106483169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f0005c20 con 0x7fb3f4098e10 2024-04-26T12:49:47.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f4093e70 con 0x7fb3f4098e10 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3eaffd640 1 -- 172.21.15.29:0/106483169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f0007070 con 0x7fb3f4098e10 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.603+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f4132cd0 con 0x7fb3f4098e10 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.607+0000 7fb3eaffd640 1 -- 172.21.15.29:0/106483169 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb3f001a070 con 0x7fb3f4098e10 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.607+0000 7fb3eaffd640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb3d8035d40 0x7fb3d8038200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.607+0000 7fb3eaffd640 1 -- 172.21.15.29:0/106483169 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7fb3f004b120 con 0x7fb3f4098e10 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.607+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f4093a10 con 0x7fb3f4098e10 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.607+0000 7fb3f9abd640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb3d8035d40 0x7fb3d8038200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.607+0000 7fb3f9abd640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb3d8035d40 0x7fb3d8038200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ad000 tx=0x7fb3e40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.611+0000 7fb3eaffd640 1 -- 172.21.15.29:0/106483169 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb3f4093a10 con 0x7fb3f4098e10 2024-04-26T12:49:47.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa40a7640 1 Processor -- start 2024-04-26T12:49:47.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa40a7640 1 -- start start 2024-04-26T12:49:47.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa40a7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a9c070c30 0x7f4a9c1317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa40a7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9c071600 con 0x7f4a9c070140 2024-04-26T12:49:47.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa40a7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9c09e210 con 0x7f4a9c070c30 2024-04-26T12:49:47.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa1642640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a9c070c30 0x7f4a9c1317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa1e43640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4a9c070140 0x7f4a9c070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50448/0 (socket says 172.21.15.29:50448) 2024-04-26T12:49:47.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa1e43640 1 -- 172.21.15.29:0/3380008520 learned_addr learned my addr 172.21.15.29:0/3380008520 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:47.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa1642640 1 -- 172.21.15.29:0/3380008520 >> v1:172.21.15.29:6789/0 conn(0x7f4a9c070140 legacy=0x7f4a9c070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7f4aa1642640 1 -- 172.21.15.29:0/3380008520 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c071ff0 con 0x7f4a9c070c30 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7fa2a003c640 1 Processor -- start 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.675+0000 7fa2a003c640 1 -- start start 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa2a003c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa298095e80 0x7fa298130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa2a003c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa29809d410 con 0x7fa298095390 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa2a003c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa298093cb0 con 0x7fa298095e80 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29ddd8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa298095390 0x7fa298095770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50464/0 (socket says 172.21.15.29:50464) 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29ddd8640 1 -- 172.21.15.29:0/4278306270 learned_addr learned my addr 172.21.15.29:0/4278306270 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29d5d7640 1 --2- 172.21.15.29:0/4278306270 >> v2:172.21.15.29:3300/0 conn(0x7fa298095e80 0x7fa298130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29d5d7640 1 -- 172.21.15.29:0/4278306270 >> v1:172.21.15.29:6789/0 conn(0x7fa298095390 legacy=0x7fa298095770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29d5d7640 1 -- 172.21.15.29:0/4278306270 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa298090e70 con 0x7fa298095e80 2024-04-26T12:49:47.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa1642640 1 --2- 172.21.15.29:0/3380008520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070c30 0x7f4a9c1317e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009740 tx=0x7f4a8c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ead2feffd9d2d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa0e41640 1 -- 172.21.15.29:0/3380008520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8c0b0070 con 0x7f4a9c070c30 2024-04-26T12:49:47.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa0e41640 1 -- 172.21.15.29:0/3380008520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8c0ab530 con 0x7f4a9c070c30 2024-04-26T12:49:47.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa0e41640 1 -- 172.21.15.29:0/3380008520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8c0ab830 con 0x7f4a9c070c30 2024-04-26T12:49:47.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 -- 172.21.15.29:0/3380008520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070c30 msgr2=0x7f4a9c1317e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 --2- 172.21.15.29:0/3380008520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070c30 0x7f4a9c1317e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009740 tx=0x7f4a8c01c370 comp rx=0 tx=0).stop 2024-04-26T12:49:47.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 -- 172.21.15.29:0/3380008520 shutdown_connections 2024-04-26T12:49:47.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 --2- 172.21.15.29:0/3380008520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070c30 0x7f4a9c1317e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 -- 172.21.15.29:0/3380008520 >> 172.21.15.29:0/3380008520 conn(0x7f4a9c09b4d0 msgr2=0x7f4a9c09b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 -- 172.21.15.29:0/3380008520 shutdown_connections 2024-04-26T12:49:47.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 -- 172.21.15.29:0/3380008520 wait complete. 2024-04-26T12:49:47.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29d5d7640 1 --2- 172.21.15.29:0/4278306270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095e80 0x7fa298130680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa288009740 tx=0x7fa28801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e8b0188f62e097 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29cdd6640 1 -- 172.21.15.29:0/4278306270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2880b1070 con 0x7fa298095e80 2024-04-26T12:49:47.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29cdd6640 1 -- 172.21.15.29:0/4278306270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2880ac520 con 0x7fa298095e80 2024-04-26T12:49:47.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7fa29cdd6640 1 -- 172.21.15.29:0/4278306270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2880b1070 con 0x7fa298095e80 2024-04-26T12:49:47.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 Processor -- start 2024-04-26T12:49:47.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.679+0000 7f4aa40a7640 1 -- start start 2024-04-26T12:49:47.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 -- 172.21.15.29:0/4278306270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095e80 msgr2=0x7fa298130680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 --2- 172.21.15.29:0/4278306270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095e80 0x7fa298130680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa288009740 tx=0x7fa28801c370 comp rx=0 tx=0).stop 2024-04-26T12:49:47.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 -- 172.21.15.29:0/4278306270 shutdown_connections 2024-04-26T12:49:47.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 --2- 172.21.15.29:0/4278306270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095e80 0x7fa298130680 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 -- 172.21.15.29:0/4278306270 >> 172.21.15.29:0/4278306270 conn(0x7fa29809a3f0 msgr2=0x7fa29809a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa40a7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070140 0x7f4a9c118e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa40a7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c134750 con 0x7f4a9c070140 2024-04-26T12:49:47.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa1e43640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070140 0x7f4a9c118e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 -- 172.21.15.29:0/4278306270 shutdown_connections 2024-04-26T12:49:47.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa1e43640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070140 0x7f4a9c118e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38980/0 (socket says 172.21.15.29:38980) 2024-04-26T12:49:47.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa1e43640 1 -- 172.21.15.29:0/2937450163 learned_addr learned my addr 172.21.15.29:0/2937450163 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:47.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 -- 172.21.15.29:0/4278306270 wait complete. 2024-04-26T12:49:47.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa1e43640 1 -- 172.21.15.29:0/2937450163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c131600 con 0x7f4a9c070140 2024-04-26T12:49:47.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa1e43640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070140 0x7f4a9c118e20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c380 tx=0x7f4a9800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4a927fc640 1 -- 172.21.15.29:0/2937450163 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a98017070 con 0x7f4a9c070140 2024-04-26T12:49:47.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4a927fc640 1 -- 172.21.15.29:0/2937450163 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98005c20 con 0x7f4a9c070140 2024-04-26T12:49:47.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4a927fc640 1 -- 172.21.15.29:0/2937450163 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a980070d0 con 0x7f4a9c070140 2024-04-26T12:49:47.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa40a7640 1 -- 172.21.15.29:0/2937450163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c11b8b0 con 0x7f4a9c070140 2024-04-26T12:49:47.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa40a7640 1 -- 172.21.15.29:0/2937450163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c11c020 con 0x7f4a9c070140 2024-04-26T12:49:47.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 Processor -- start 2024-04-26T12:49:47.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 -- start start 2024-04-26T12:49:47.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4a927fc640 1 -- 172.21.15.29:0/2937450163 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4a9801a070 con 0x7f4a9c070140 2024-04-26T12:49:47.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a78005090 con 0x7f4a9c070140 2024-04-26T12:49:47.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4a927fc640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a80035db0 0x7f4a80038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095390 0x7fa29812f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa2a003c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa2981335f0 con 0x7fa298095390 2024-04-26T12:49:47.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4a927fc640 1 -- 172.21.15.29:0/2937450163 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f4a98047920 con 0x7f4a9c070140 2024-04-26T12:49:47.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa29ddd8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095390 0x7fa29812f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa29ddd8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095390 0x7fa29812f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38984/0 (socket says 172.21.15.29:38984) 2024-04-26T12:49:47.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa29ddd8640 1 -- 172.21.15.29:0/650995851 learned_addr learned my addr 172.21.15.29:0/650995851 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:47.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa1642640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a80035db0 0x7f4a80038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa29ddd8640 1 -- 172.21.15.29:0/650995851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa298122a80 con 0x7fa298095390 2024-04-26T12:49:47.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7fa29ddd8640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095390 0x7fa29812f490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c3a0 tx=0x7fa29400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.683+0000 7f4aa1642640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a80035db0 0x7f4a80038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0ad000 tx=0x7f4a8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.687+0000 7fa28e7fc640 1 -- 172.21.15.29:0/650995851 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa294017070 con 0x7fa298095390 2024-04-26T12:49:47.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.687+0000 7fa28e7fc640 1 -- 172.21.15.29:0/650995851 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa294005c20 con 0x7fa298095390 2024-04-26T12:49:47.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.687+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29808f050 con 0x7fa298095390 2024-04-26T12:49:47.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.687+0000 7fa28e7fc640 1 -- 172.21.15.29:0/650995851 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2940070d0 con 0x7fa298095390 2024-04-26T12:49:47.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.687+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa298123690 con 0x7fa298095390 2024-04-26T12:49:47.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.687+0000 7f4a927fc640 1 -- 172.21.15.29:0/2937450163 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4a98007270 con 0x7f4a9c070140 2024-04-26T12:49:47.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.687+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa298062f80 con 0x7fa298095390 2024-04-26T12:49:47.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.695+0000 7fa28e7fc640 1 -- 172.21.15.29:0/650995851 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa29401a070 con 0x7fa298095390 2024-04-26T12:49:47.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.695+0000 7fa28e7fc640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa27c035e00 0x7fa27c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:47.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.695+0000 7fa28e7fc640 1 -- 172.21.15.29:0/650995851 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7fa2940482b0 con 0x7fa298095390 2024-04-26T12:49:47.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.695+0000 7fa29d5d7640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa27c035e00 0x7fa27c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:47.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.695+0000 7fa28e7fc640 1 -- 172.21.15.29:0/650995851 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa294010700 con 0x7fa298095390 2024-04-26T12:49:47.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.695+0000 7fa29d5d7640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa27c035e00 0x7fa27c0382c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa288009740 tx=0x7fa2880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.771+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb3f4062f80 con 0x7fb3f4098e10 2024-04-26T12:49:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.771+0000 7fb3eaffd640 1 -- 172.21.15.29:0/106483169 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3f409ae10 con 0x7fb3f4098e10 2024-04-26T12:49:47.775 INFO:teuthology.orchestra.run.smithi029.stdout:38654705667 2024-04-26T12:49:47.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb3d8035d40 msgr2=0x7fb3d8038200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb3d8035d40 0x7fb3d8038200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ad000 tx=0x7fb3e40a6000 comp rx=0 tx=0).stop 2024-04-26T12:49:47.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4098e10 msgr2=0x7fb3f41325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4098e10 0x7fb3f41325c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000c480 tx=0x7fb3f000c940 comp rx=0 tx=0).stop 2024-04-26T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 shutdown_connections 2024-04-26T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb3d8035d40 0x7fb3d8038200 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 --2- 172.21.15.29:0/106483169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3f4098e10 0x7fb3f41325c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 >> 172.21.15.29:0/106483169 conn(0x7fb3f409ee00 msgr2=0x7fb3f4096280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 shutdown_connections 2024-04-26T12:49:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.775+0000 7fb3fc522640 1 -- 172.21.15.29:0/106483169 wait complete. 2024-04-26T12:49:47.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-04-26T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.799+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4c6411aed0 con 0x7f4c6412e310 2024-04-26T12:49:47.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.799+0000 7f4c4bfff640 1 -- 172.21.15.29:0/4085016799 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c540160b0 con 0x7f4c6412e310 2024-04-26T12:49:47.804 INFO:teuthology.orchestra.run.smithi029.stdout:47244640260 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4c50035db0 msgr2=0x7f4c50038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4c50035db0 0x7f4c50038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4c58001600 tx=0x7f4c58007a50 comp rx=0 tx=0).stop 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 msgr2=0x7f4c64118210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c64118210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c5401a060 tx=0x7f4c540191d0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 shutdown_connections 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4c50035db0 0x7f4c50038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 --2- 172.21.15.29:0/4085016799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c6412e310 0x7f4c64118210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 >> 172.21.15.29:0/4085016799 conn(0x7f4c6409a310 msgr2=0x7f4c6412c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 shutdown_connections 2024-04-26T12:49:47.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.803+0000 7f4c69cb5640 1 -- 172.21.15.29:0/4085016799 wait complete. 2024-04-26T12:49:47.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-04-26T12:49:47.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4a78005380 con 0x7f4a9c070140 2024-04-26T12:49:47.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a927fc640 1 -- 172.21.15.29:0/2937450163 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a98012400 con 0x7f4a9c070140 2024-04-26T12:49:47.853 INFO:teuthology.orchestra.run.smithi029.stdout:47244640260 2024-04-26T12:49:47.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a80035db0 msgr2=0x7f4a80038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a80035db0 0x7f4a80038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0ad000 tx=0x7f4a8c008040 comp rx=0 tx=0).stop 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070140 msgr2=0x7f4a9c118e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070140 0x7f4a9c118e20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c380 tx=0x7f4a9800c840 comp rx=0 tx=0).stop 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 shutdown_connections 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a80035db0 0x7f4a80038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 --2- 172.21.15.29:0/2937450163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a9c070140 0x7f4a9c118e20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 >> 172.21.15.29:0/2937450163 conn(0x7f4a9c09b4d0 msgr2=0x7f4a9c12bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 shutdown_connections 2024-04-26T12:49:47.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.851+0000 7f4a7ffff640 1 -- 172.21.15.29:0/2937450163 wait complete. 2024-04-26T12:49:47.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-04-26T12:49:47.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.867+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa298130480 con 0x7fa298095390 2024-04-26T12:49:47.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.867+0000 7fa28e7fc640 1 -- 172.21.15.29:0/650995851 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa294007270 con 0x7fa298095390 2024-04-26T12:49:47.871 INFO:teuthology.orchestra.run.smithi029.stdout:47244640260 2024-04-26T12:49:47.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa27c035e00 msgr2=0x7fa27c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa27c035e00 0x7fa27c0382c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa288009740 tx=0x7fa2880a7000 comp rx=0 tx=0).stop 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095390 msgr2=0x7fa29812f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095390 0x7fa29812f490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c3a0 tx=0x7fa29400c860 comp rx=0 tx=0).stop 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 shutdown_connections 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa27c035e00 0x7fa27c0382c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 --2- 172.21.15.29:0/650995851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa298095390 0x7fa29812f490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 >> 172.21.15.29:0/650995851 conn(0x7fa29809a3f0 msgr2=0x7fa298096ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 shutdown_connections 2024-04-26T12:49:47.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:47.871+0000 7fa2a003c640 1 -- 172.21.15.29:0/650995851 wait complete. 2024-04-26T12:49:47.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2024-04-26T12:49:48.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:49:48.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:49:48.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:49:48.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:49:48.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c91dc640 1 Processor -- start 2024-04-26T12:49:48.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c91dc640 1 -- start start 2024-04-26T12:49:48.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c91dc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c412e290 0x7ff6c4130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:48.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c91dc640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c4072640 con 0x7ff6c412af80 2024-04-26T12:49:48.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c91dc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff6c4071250 con 0x7ff6c412e290 2024-04-26T12:49:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c412e290 0x7ff6c4130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6c412e290 0x7ff6c4130680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38998/0 (socket says 172.21.15.29:38998) 2024-04-26T12:49:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c259c640 1 -- 172.21.15.29:0/1587888588 learned_addr learned my addr 172.21.15.29:0/1587888588 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c2d9d640 1 --1- 172.21.15.29:0/1587888588 >> v1:172.21.15.29:6789/0 conn(0x7ff6c412af80 0x7ff6c412b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50480/0 (socket says 172.21.15.29:50480) 2024-04-26T12:49:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c259c640 1 -- 172.21.15.29:0/1587888588 >> v1:172.21.15.29:6789/0 conn(0x7ff6c412af80 legacy=0x7ff6c412b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:48.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.923+0000 7ff6c259c640 1 -- 172.21.15.29:0/1587888588 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c4071af0 con 0x7ff6c412e290 2024-04-26T12:49:48.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c259c640 1 --2- 172.21.15.29:0/1587888588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412e290 0x7ff6c4130680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097f0 tx=0x7ff6b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89557b25f0bc6366 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:48.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c1d9b640 1 -- 172.21.15.29:0/1587888588 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b80b1070 con 0x7ff6c412e290 2024-04-26T12:49:48.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c1d9b640 1 -- 172.21.15.29:0/1587888588 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b80ac560 con 0x7ff6c412e290 2024-04-26T12:49:48.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c1d9b640 1 -- 172.21.15.29:0/1587888588 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b80a8050 con 0x7ff6c412e290 2024-04-26T12:49:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 -- 172.21.15.29:0/1587888588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412e290 msgr2=0x7ff6c4130680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 --2- 172.21.15.29:0/1587888588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412e290 0x7ff6c4130680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097f0 tx=0x7ff6b801c410 comp rx=0 tx=0).stop 2024-04-26T12:49:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 -- 172.21.15.29:0/1587888588 shutdown_connections 2024-04-26T12:49:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 --2- 172.21.15.29:0/1587888588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412e290 0x7ff6c4130680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 -- 172.21.15.29:0/1587888588 >> 172.21.15.29:0/1587888588 conn(0x7ff6c409a4e0 msgr2=0x7ff6c409a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 -- 172.21.15.29:0/1587888588 shutdown_connections 2024-04-26T12:49:48.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 -- 172.21.15.29:0/1587888588 wait complete. 2024-04-26T12:49:48.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 Processor -- start 2024-04-26T12:49:48.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.927+0000 7ff6c91dc640 1 -- start start 2024-04-26T12:49:48.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c91dc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412af80 0x7ff6c411d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:48.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c91dc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c4133560 con 0x7ff6c412af80 2024-04-26T12:49:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412af80 0x7ff6c411d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412af80 0x7ff6c411d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39006/0 (socket says 172.21.15.29:39006) 2024-04-26T12:49:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c2d9d640 1 -- 172.21.15.29:0/1790781950 learned_addr learned my addr 172.21.15.29:0/1790781950 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:48.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c2d9d640 1 -- 172.21.15.29:0/1790781950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c4120700 con 0x7ff6c412af80 2024-04-26T12:49:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c2d9d640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412af80 0x7ff6c411d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c3b0 tx=0x7ff6b400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6ab7fe640 1 -- 172.21.15.29:0/1790781950 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b4007410 con 0x7ff6c412af80 2024-04-26T12:49:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6ab7fe640 1 -- 172.21.15.29:0/1790781950 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b40075b0 con 0x7ff6c412af80 2024-04-26T12:49:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6ab7fe640 1 -- 172.21.15.29:0/1790781950 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b4004920 con 0x7ff6c412af80 2024-04-26T12:49:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c91dc640 1 -- 172.21.15.29:0/1790781950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c411e990 con 0x7ff6c412af80 2024-04-26T12:49:48.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c91dc640 1 -- 172.21.15.29:0/1790781950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c411fbe0 con 0x7ff6c412af80 2024-04-26T12:49:48.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6ab7fe640 1 -- 172.21.15.29:0/1790781950 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff6b401a020 con 0x7ff6c412af80 2024-04-26T12:49:48.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6ab7fe640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff6b0035db0 0x7ff6b0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:48.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c005090 con 0x7ff6c412af80 2024-04-26T12:49:48.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6ab7fe640 1 -- 172.21.15.29:0/1790781950 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7ff6b4047de0 con 0x7ff6c412af80 2024-04-26T12:49:48.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.931+0000 7ff6c259c640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff6b0035db0 0x7ff6b0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:48.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.935+0000 7ff6c259c640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff6b0035db0 0x7ff6b0038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80ae000 tx=0x7ff6b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:48.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.935+0000 7ff6ab7fe640 1 -- 172.21.15.29:0/1790781950 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff6c4120700 con 0x7ff6c412af80 2024-04-26T12:49:48.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf9b69640 1 Processor -- start 2024-04-26T12:49:48.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf9b69640 1 -- start start 2024-04-26T12:49:48.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf9b69640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbaf4070f60 0x7fbaf4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf9b69640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf4070d60 con 0x7fbaf4072b40 2024-04-26T12:49:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf9b69640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf4113cd0 con 0x7fbaf4070f60 2024-04-26T12:49:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf2ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbaf4072b40 0x7fbaf4128b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50488/0 (socket says 172.21.15.29:50488) 2024-04-26T12:49:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf2ffd640 1 -- 172.21.15.29:0/1968862195 learned_addr learned my addr 172.21.15.29:0/1968862195 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf37fe640 1 --2- 172.21.15.29:0/1968862195 >> v2:172.21.15.29:3300/0 conn(0x7fbaf4070f60 0x7fbaf4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf37fe640 1 -- 172.21.15.29:0/1968862195 >> v1:172.21.15.29:6789/0 conn(0x7fbaf4072b40 legacy=0x7fbaf4128b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:48.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.963+0000 7fbaf37fe640 1 -- 172.21.15.29:0/1968862195 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf406d080 con 0x7fbaf4070f60 2024-04-26T12:49:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf37fe640 1 --2- 172.21.15.29:0/1968862195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf4071340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009740 tx=0x7fbae401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24e70ac2e579b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf27fc640 1 -- 172.21.15.29:0/1968862195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae40b0070 con 0x7fbaf4070f60 2024-04-26T12:49:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf27fc640 1 -- 172.21.15.29:0/1968862195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae40ab530 con 0x7fbaf4070f60 2024-04-26T12:49:48.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf27fc640 1 -- 172.21.15.29:0/1968862195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae40ab830 con 0x7fbaf4070f60 2024-04-26T12:49:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf9b69640 1 -- 172.21.15.29:0/1968862195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 msgr2=0x7fbaf4071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf9b69640 1 --2- 172.21.15.29:0/1968862195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf4071340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009740 tx=0x7fbae401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf9b69640 1 -- 172.21.15.29:0/1968862195 shutdown_connections 2024-04-26T12:49:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf9b69640 1 --2- 172.21.15.29:0/1968862195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf4071340 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:48.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf9b69640 1 -- 172.21.15.29:0/1968862195 >> 172.21.15.29:0/1968862195 conn(0x7fbaf409a310 msgr2=0x7fbaf409a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:48.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.967+0000 7fbaf9b69640 1 -- 172.21.15.29:0/1968862195 shutdown_connections 2024-04-26T12:49:48.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf9b69640 1 -- 172.21.15.29:0/1968862195 wait complete. 2024-04-26T12:49:48.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf9b69640 1 Processor -- start 2024-04-26T12:49:48.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf9b69640 1 -- start start 2024-04-26T12:49:48.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf9b69640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf412f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:48.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf9b69640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4134770 con 0x7fbaf4070f60 2024-04-26T12:49:48.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf412f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:48.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf412f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39038/0 (socket says 172.21.15.29:39038) 2024-04-26T12:49:48.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf37fe640 1 -- 172.21.15.29:0/4077935718 learned_addr learned my addr 172.21.15.29:0/4077935718 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:48.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf37fe640 1 -- 172.21.15.29:0/4077935718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4131890 con 0x7fbaf4070f60 2024-04-26T12:49:48.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf37fe640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf412f460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbae4019fa0 tx=0x7fbae401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:48.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbadbfff640 1 -- 172.21.15.29:0/4077935718 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae40b0050 con 0x7fbaf4070f60 2024-04-26T12:49:48.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbadbfff640 1 -- 172.21.15.29:0/4077935718 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae40b1040 con 0x7fbaf4070f60 2024-04-26T12:49:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf4114630 con 0x7fbaf4070f60 2024-04-26T12:49:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbadbfff640 1 -- 172.21.15.29:0/4077935718 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae40aab60 con 0x7fbaf4070f60 2024-04-26T12:49:48.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.971+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf412f9a0 con 0x7fbaf4070f60 2024-04-26T12:49:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.975+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf4062f80 con 0x7fbaf4070f60 2024-04-26T12:49:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.975+0000 7fbadbfff640 1 -- 172.21.15.29:0/4077935718 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbae40be030 con 0x7fbaf4070f60 2024-04-26T12:49:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.975+0000 7fbadbfff640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbae0035db0 0x7fbae0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.975+0000 7fbadbfff640 1 -- 172.21.15.29:0/4077935718 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7fbae40bc070 con 0x7fbaf4070f60 2024-04-26T12:49:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.975+0000 7fbaf2ffd640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbae0035db0 0x7fbae0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:48.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.975+0000 7fbaf2ffd640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbae0035db0 0x7fbae0038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40720b0 tx=0x7fbae8007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:48.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.983+0000 7fbadbfff640 1 -- 172.21.15.29:0/4077935718 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbae40c5060 con 0x7fbaf4070f60 2024-04-26T12:49:49.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f1893fd0640 1 Processor -- start 2024-04-26T12:49:49.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f689e131640 1 Processor -- start 2024-04-26T12:49:49.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f1893fd0640 1 -- start start 2024-04-26T12:49:49.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f689e131640 1 -- start start 2024-04-26T12:49:49.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f689e131640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6898098e10 0x7f68980991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f689e131640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689809ae10 con 0x7f6898099730 2024-04-26T12:49:49.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f689e131640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f689809ab00 con 0x7f6898098e10 2024-04-26T12:49:49.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f68977fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6898098e10 0x7f68980991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f6896ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6898099730 0x7f6898132a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50504/0 (socket says 172.21.15.29:50504) 2024-04-26T12:49:49.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f6896ffd640 1 -- 172.21.15.29:0/510415692 learned_addr learned my addr 172.21.15.29:0/510415692 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:49.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f1893fd0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f188c099900 0x7f188c133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f1891d6c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f188c098e10 0x7f188c0991f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50518/0 (socket says 172.21.15.29:50518) 2024-04-26T12:49:49.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f68977fe640 1 -- 172.21.15.29:0/510415692 >> v1:172.21.15.29:6789/0 conn(0x7f6898099730 legacy=0x7f6898132a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f68977fe640 1 -- 172.21.15.29:0/510415692 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68980a00c0 con 0x7f6898098e10 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f1891d6c640 1 -- 172.21.15.29:0/594193964 learned_addr learned my addr 172.21.15.29:0/594193964 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f189156b640 1 --2- 172.21.15.29:0/594193964 >> v2:172.21.15.29:3300/0 conn(0x7f188c099900 0x7f188c133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f1893fd0640 1 -- 172.21.15.29:0/594193964 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c09ae10 con 0x7f188c098e10 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:48.999+0000 7f1893fd0640 1 -- 172.21.15.29:0/594193964 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f188c09ab00 con 0x7f188c099900 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f1890d6a640 1 -- 172.21.15.29:0/594193964 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523294849 0 0) 0x7f1888001120 con 0x7f188c098e10 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f1890d6a640 1 -- 172.21.15.29:0/594193964 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1878003530 con 0x7f188c098e10 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f189156b640 1 -- 172.21.15.29:0/594193964 >> v1:172.21.15.29:6789/0 conn(0x7f188c098e10 legacy=0x7f188c0991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f189156b640 1 -- 172.21.15.29:0/594193964 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c0a00c0 con 0x7f188c099900 2024-04-26T12:49:49.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f68977fe640 1 --2- 172.21.15.29:0/510415692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f68980991f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6888009740 tx=0x7f688801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422cb70f829b2375 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f68967fc640 1 -- 172.21.15.29:0/510415692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68880b1070 con 0x7f6898098e10 2024-04-26T12:49:49.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f68967fc640 1 -- 172.21.15.29:0/510415692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689809a160 con 0x7f6898098e10 2024-04-26T12:49:49.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f68967fc640 1 -- 172.21.15.29:0/510415692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68880ac670 con 0x7f6898098e10 2024-04-26T12:49:49.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f189156b640 1 --2- 172.21.15.29:0/594193964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c099900 0x7f188c133a80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f187c009740 tx=0x7f187c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f2fb6270e284a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f1890d6a640 1 -- 172.21.15.29:0/594193964 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187c0b0070 con 0x7f188c099900 2024-04-26T12:49:49.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f1890d6a640 1 -- 172.21.15.29:0/594193964 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c0ab530 con 0x7f188c099900 2024-04-26T12:49:49.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f1890d6a640 1 -- 172.21.15.29:0/594193964 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187c0ab830 con 0x7f188c099900 2024-04-26T12:49:49.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.003+0000 7f689e131640 1 -- 172.21.15.29:0/510415692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 msgr2=0x7f68980991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 --2- 172.21.15.29:0/510415692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f68980991f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6888009740 tx=0x7f688801c370 comp rx=0 tx=0).stop 2024-04-26T12:49:49.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- 172.21.15.29:0/510415692 shutdown_connections 2024-04-26T12:49:49.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 --2- 172.21.15.29:0/510415692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f68980991f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- 172.21.15.29:0/510415692 >> 172.21.15.29:0/510415692 conn(0x7f689809ee00 msgr2=0x7f689809f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- 172.21.15.29:0/594193964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c099900 msgr2=0x7f188c133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 --2- 172.21.15.29:0/594193964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c099900 0x7f188c133a80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f187c009740 tx=0x7f187c01c370 comp rx=0 tx=0).stop 2024-04-26T12:49:49.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- 172.21.15.29:0/510415692 shutdown_connections 2024-04-26T12:49:49.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- 172.21.15.29:0/510415692 wait complete. 2024-04-26T12:49:49.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- 172.21.15.29:0/594193964 shutdown_connections 2024-04-26T12:49:49.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 --2- 172.21.15.29:0/594193964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c099900 0x7f188c133a80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- 172.21.15.29:0/594193964 >> 172.21.15.29:0/594193964 conn(0x7f188c09ee00 msgr2=0x7f188c09f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- 172.21.15.29:0/594193964 shutdown_connections 2024-04-26T12:49:49.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- 172.21.15.29:0/594193964 wait complete. 2024-04-26T12:49:49.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 Processor -- start 2024-04-26T12:49:49.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- start start 2024-04-26T12:49:49.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f6898131ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6898136d40 con 0x7f6898098e10 2024-04-26T12:49:49.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 Processor -- start 2024-04-26T12:49:49.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f68977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f6898131ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f68977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f6898131ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39062/0 (socket says 172.21.15.29:39062) 2024-04-26T12:49:49.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f68977fe640 1 -- 172.21.15.29:0/1398990088 learned_addr learned my addr 172.21.15.29:0/1398990088 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:49.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- start start 2024-04-26T12:49:49.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f68977fe640 1 -- 172.21.15.29:0/1398990088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68980925f0 con 0x7f6898098e10 2024-04-26T12:49:49.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f68977fe640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f6898131ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f688801aa20 tx=0x7f6888019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c098e10 0x7f188c0915a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f188c136b70 con 0x7f188c098e10 2024-04-26T12:49:49.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f687ffff640 1 -- 172.21.15.29:0/1398990088 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68880b9070 con 0x7f6898098e10 2024-04-26T12:49:49.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f687ffff640 1 -- 172.21.15.29:0/1398990088 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68880acc80 con 0x7f6898098e10 2024-04-26T12:49:49.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f687ffff640 1 -- 172.21.15.29:0/1398990088 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68880b1040 con 0x7f6898098e10 2024-04-26T12:49:49.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1891d6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c098e10 0x7f188c0915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1891d6c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c098e10 0x7f188c0915a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39072/0 (socket says 172.21.15.29:39072) 2024-04-26T12:49:49.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1891d6c640 1 -- 172.21.15.29:0/650484472 learned_addr learned my addr 172.21.15.29:0/650484472 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:49.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1891d6c640 1 -- 172.21.15.29:0/650484472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c093580 con 0x7f188c098e10 2024-04-26T12:49:49.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1891d6c640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c098e10 0x7f188c0915a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f188800c6b0 tx=0x7f188800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6898093970 con 0x7f6898098e10 2024-04-26T12:49:49.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6898132220 con 0x7f6898098e10 2024-04-26T12:49:49.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f18827fc640 1 -- 172.21.15.29:0/650484472 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1888017070 con 0x7f188c098e10 2024-04-26T12:49:49.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f18827fc640 1 -- 172.21.15.29:0/650484472 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18880058c0 con 0x7f188c098e10 2024-04-26T12:49:49.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f18827fc640 1 -- 172.21.15.29:0/650484472 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1888005be0 con 0x7f188c098e10 2024-04-26T12:49:49.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c094210 con 0x7f188c098e10 2024-04-26T12:49:49.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.007+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c091ae0 con 0x7f188c098e10 2024-04-26T12:49:49.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c093d70 con 0x7f188c098e10 2024-04-26T12:49:49.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6898062f80 con 0x7f6898098e10 2024-04-26T12:49:49.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f687ffff640 1 -- 172.21.15.29:0/1398990088 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68880bc070 con 0x7f6898098e10 2024-04-26T12:49:49.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f687ffff640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6884035db0 0x7f6884038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f687ffff640 1 -- 172.21.15.29:0/1398990088 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f68880e23e0 con 0x7f6898098e10 2024-04-26T12:49:49.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f18827fc640 1 -- 172.21.15.29:0/650484472 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f188801a070 con 0x7f188c098e10 2024-04-26T12:49:49.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f6896ffd640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6884035db0 0x7f6884038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f18827fc640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1870035db0 0x7f1870038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f18827fc640 1 -- 172.21.15.29:0/650484472 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f18880479f0 con 0x7f188c098e10 2024-04-26T12:49:49.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f189156b640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1870035db0 0x7f1870038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f189156b640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1870035db0 0x7f1870038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f187c0ad000 tx=0x7f187c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.011+0000 7f6896ffd640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6884035db0 0x7f6884038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f688c001610 tx=0x7f688c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.019+0000 7f687ffff640 1 -- 172.21.15.29:0/1398990088 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f68880a9070 con 0x7f6898098e10 2024-04-26T12:49:49.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.027+0000 7f18827fc640 1 -- 172.21.15.29:0/650484472 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1888049e20 con 0x7f188c098e10 2024-04-26T12:49:49.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.123+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff69c005380 con 0x7ff6c412af80 2024-04-26T12:49:49.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6ab7fe640 1 -- 172.21.15.29:0/1790781950 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6b401b9c0 con 0x7ff6c412af80 2024-04-26T12:49:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:38654705669 2024-04-26T12:49:49.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff6b0035db0 msgr2=0x7ff6b0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff6b0035db0 0x7ff6b0038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80ae000 tx=0x7ff6b8008040 comp rx=0 tx=0).stop 2024-04-26T12:49:49.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412af80 msgr2=0x7ff6c411d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412af80 0x7ff6c411d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400c3b0 tx=0x7ff6b400c870 comp rx=0 tx=0).stop 2024-04-26T12:49:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 shutdown_connections 2024-04-26T12:49:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff6b0035db0 0x7ff6b0038270 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80ae000 tx=0x7ff6b8008040 comp rx=0 tx=0).stop 2024-04-26T12:49:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 --2- 172.21.15.29:0/1790781950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c412af80 0x7ff6c411d110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 >> 172.21.15.29:0/1790781950 conn(0x7ff6c409a4e0 msgr2=0x7ff6c412c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 shutdown_connections 2024-04-26T12:49:49.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.127+0000 7ff6a97fa640 1 -- 172.21.15.29:0/1790781950 wait complete. 2024-04-26T12:49:49.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-04-26T12:49:49.152 DEBUG:teuthology.parallel:result is None 2024-04-26T12:49:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.159+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbaf4127cb0 con 0x7fbaf4070f60 2024-04-26T12:49:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbadbfff640 1 -- 172.21.15.29:0/4077935718 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbae4015ff0 con 0x7fbaf4070f60 2024-04-26T12:49:49.165 INFO:teuthology.orchestra.run.smithi029.stdout:47244640261 2024-04-26T12:49:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbae0035db0 msgr2=0x7fbae0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbae0035db0 0x7fbae0038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40720b0 tx=0x7fbae8007ad0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 msgr2=0x7fbaf412f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf412f460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbae4019fa0 tx=0x7fbae401abb0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 shutdown_connections 2024-04-26T12:49:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbae0035db0 0x7fbae0038270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 --2- 172.21.15.29:0/4077935718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbaf4070f60 0x7fbaf412f460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 >> 172.21.15.29:0/4077935718 conn(0x7fbaf409a310 msgr2=0x7fbaf4125650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 shutdown_connections 2024-04-26T12:49:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.163+0000 7fbaf9b69640 1 -- 172.21.15.29:0/4077935718 wait complete. 2024-04-26T12:49:49.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2024-04-26T12:49:49.182 DEBUG:teuthology.parallel:result is None 2024-04-26T12:49:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f68980934d0 con 0x7f6898098e10 2024-04-26T12:49:49.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f687ffff640 1 -- 172.21.15.29:0/1398990088 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6888015ff0 con 0x7f6898098e10 2024-04-26T12:49:49.186 INFO:teuthology.orchestra.run.smithi029.stdout:47244640262 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6884035db0 msgr2=0x7f6884038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6884035db0 0x7f6884038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f688c001610 tx=0x7f688c007ad0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 msgr2=0x7f6898131ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f6898131ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f688801aa20 tx=0x7f6888019110 comp rx=0 tx=0).stop 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 shutdown_connections 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6884035db0 0x7f6884038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 --2- 172.21.15.29:0/1398990088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6898098e10 0x7f6898131ce0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 >> 172.21.15.29:0/1398990088 conn(0x7f689809ee00 msgr2=0x7f6898096450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 shutdown_connections 2024-04-26T12:49:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.183+0000 7f689e131640 1 -- 172.21.15.29:0/1398990088 wait complete. 2024-04-26T12:49:49.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f188c062f80 con 0x7f188c098e10 2024-04-26T12:49:49.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f18827fc640 1 -- 172.21.15.29:0/650484472 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f188c09ae10 con 0x7f188c098e10 2024-04-26T12:49:49.197 INFO:teuthology.orchestra.run.smithi029.stdout:47244640262 2024-04-26T12:49:49.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1870035db0 msgr2=0x7f1870038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1870035db0 0x7f1870038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f187c0ad000 tx=0x7f187c0a6000 comp rx=0 tx=0).stop 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c098e10 msgr2=0x7f188c0915a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c098e10 0x7f188c0915a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f188800c6b0 tx=0x7f188800cb70 comp rx=0 tx=0).stop 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 shutdown_connections 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1870035db0 0x7f1870038270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 --2- 172.21.15.29:0/650484472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f188c098e10 0x7f188c0915a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 >> 172.21.15.29:0/650484472 conn(0x7f188c09ee00 msgr2=0x7f188c096080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 shutdown_connections 2024-04-26T12:49:49.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.195+0000 7f1893fd0640 1 -- 172.21.15.29:0/650484472 wait complete. 2024-04-26T12:49:49.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.3 2024-04-26T12:49:49.204 DEBUG:teuthology.parallel:result is None 2024-04-26T12:49:49.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.1 2024-04-26T12:49:49.215 DEBUG:teuthology.parallel:result is None 2024-04-26T12:49:49.215 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:49:49.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:49:49.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.367+0000 7fa52eb4a640 1 Processor -- start 2024-04-26T12:49:49.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.367+0000 7fa52eb4a640 1 -- start start 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa528099900 0x7fa528133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa52809ae10 con 0x7fa528098e10 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa52809ab00 con 0x7fa528099900 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52c8e6640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa528098e10 0x7fa5280991f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50534/0 (socket says 172.21.15.29:50534) 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52c8e6640 1 -- 172.21.15.29:0/3085238293 learned_addr learned my addr 172.21.15.29:0/3085238293 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa527fff640 1 --2- 172.21.15.29:0/3085238293 >> v2:172.21.15.29:3300/0 conn(0x7fa528099900 0x7fa528133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa5277fe640 1 -- 172.21.15.29:0/3085238293 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293828123 0 0) 0x7fa51c001120 con 0x7fa528098e10 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa5277fe640 1 -- 172.21.15.29:0/3085238293 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa518003530 con 0x7fa528098e10 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa527fff640 1 -- 172.21.15.29:0/3085238293 >> v1:172.21.15.29:6789/0 conn(0x7fa528098e10 legacy=0x7fa5280991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa527fff640 1 -- 172.21.15.29:0/3085238293 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5280a00c0 con 0x7fa528099900 2024-04-26T12:49:49.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa527fff640 1 --2- 172.21.15.29:0/3085238293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528099900 0x7fa528133a80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa514009740 tx=0x7fa51401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205da25f452830f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa5277fe640 1 -- 172.21.15.29:0/3085238293 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5140b0070 con 0x7fa528099900 2024-04-26T12:49:49.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa5277fe640 1 -- 172.21.15.29:0/3085238293 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5140ab530 con 0x7fa528099900 2024-04-26T12:49:49.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa5277fe640 1 -- 172.21.15.29:0/3085238293 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5140ab830 con 0x7fa528099900 2024-04-26T12:49:49.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 -- 172.21.15.29:0/3085238293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528099900 msgr2=0x7fa528133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 --2- 172.21.15.29:0/3085238293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528099900 0x7fa528133a80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa514009740 tx=0x7fa51401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 -- 172.21.15.29:0/3085238293 shutdown_connections 2024-04-26T12:49:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 --2- 172.21.15.29:0/3085238293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528099900 0x7fa528133a80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 -- 172.21.15.29:0/3085238293 >> 172.21.15.29:0/3085238293 conn(0x7fa52809ee00 msgr2=0x7fa52809f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 -- 172.21.15.29:0/3085238293 shutdown_connections 2024-04-26T12:49:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.371+0000 7fa52eb4a640 1 -- 172.21.15.29:0/3085238293 wait complete. 2024-04-26T12:49:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52eb4a640 1 Processor -- start 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52eb4a640 1 -- start start 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52eb4a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528098e10 0x7fa5281327c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52eb4a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa528136b70 con 0x7fa528098e10 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52c8e6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528098e10 0x7fa5281327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52c8e6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528098e10 0x7fa5281327c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39086/0 (socket says 172.21.15.29:39086) 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52c8e6640 1 -- 172.21.15.29:0/275604076 learned_addr learned my addr 172.21.15.29:0/275604076 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52c8e6640 1 -- 172.21.15.29:0/275604076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5280933d0 con 0x7fa528098e10 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52c8e6640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528098e10 0x7fa5281327c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c6b0 tx=0x7fa51c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa5257fa640 1 -- 172.21.15.29:0/275604076 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51c017070 con 0x7fa528098e10 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa5257fa640 1 -- 172.21.15.29:0/275604076 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c0058c0 con 0x7fa528098e10 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa528092f30 con 0x7fa528098e10 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa5257fa640 1 -- 172.21.15.29:0/275604076 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51c005be0 con 0x7fa528098e10 2024-04-26T12:49:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa528132d00 con 0x7fa528098e10 2024-04-26T12:49:49.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa528062f80 con 0x7fa528098e10 2024-04-26T12:49:49.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa5257fa640 1 -- 172.21.15.29:0/275604076 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa51c01a070 con 0x7fa528098e10 2024-04-26T12:49:49.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa5257fa640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa50c035db0 0x7fa50c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa5257fa640 1 -- 172.21.15.29:0/275604076 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7fa51c0478f0 con 0x7fa528098e10 2024-04-26T12:49:49.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa527fff640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa50c035db0 0x7fa50c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.375+0000 7fa527fff640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa50c035db0 0x7fa50c038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5140ad000 tx=0x7fa5140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.379+0000 7fa5257fa640 1 -- 172.21.15.29:0/275604076 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa52809ae10 con 0x7fa528098e10 2024-04-26T12:49:49.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.531+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa528093bc0 con 0x7fa50c035db0 2024-04-26T12:49:49.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa5257fa640 1 -- 172.21.15.29:0/275604076 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31844 (secure 0 0 0) 0x7fa528093bc0 con 0x7fa50c035db0 2024-04-26T12:49:49.553 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa50c035db0 msgr2=0x7fa50c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa50c035db0 0x7fa50c038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5140ad000 tx=0x7fa5140a6000 comp rx=0 tx=0).stop 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528098e10 msgr2=0x7fa5281327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528098e10 0x7fa5281327c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c6b0 tx=0x7fa51c00cb70 comp rx=0 tx=0).stop 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 shutdown_connections 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa50c035db0 0x7fa50c038270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 --2- 172.21.15.29:0/275604076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa528098e10 0x7fa5281327c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 >> 172.21.15.29:0/275604076 conn(0x7fa52809ee00 msgr2=0x7fa528096280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 shutdown_connections 2024-04-26T12:49:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.551+0000 7fa52eb4a640 1 -- 172.21.15.29:0/275604076 wait complete. 2024-04-26T12:49:49.570 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T12:49:49.129887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114572,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377372788,"statfs":{"total":386547056640,"available":386429734912,"internally_reserved":0,"allocated":1785856,"data_stored":1362848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":114878227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001528"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538573+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:49:47.538573+0000","last_peered":"2024-04-26T12:49:47.538573+0000","last_clean":"2024-04-26T12:49:47.538573+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:49:47.538573+0000","last_undegraded":"2024-04-26T12:49:47.538573+0000","last_fullsized":"2024-04-26T12:49:47.538573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.190860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:49:44.967210+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:49:44.967210+0000","last_peered":"2024-04-26T12:49:44.967210+0000","last_clean":"2024-04-26T12:49:44.967210+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:49:44.967210+0000","last_undegraded":"2024-04-26T12:49:44.967210+0000","last_fullsized":"2024-04-26T12:49:44.967210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:22.624113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538592+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:49:47.538592+0000","last_peered":"2024-04-26T12:49:47.538592+0000","last_clean":"2024-04-26T12:49:47.538592+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:49:47.538592+0000","last_undegraded":"2024-04-26T12:49:47.538592+0000","last_fullsized":"2024-04-26T12:49:47.538592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:52.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:49:44.967607+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:49:44.967607+0000","last_peered":"2024-04-26T12:49:44.967607+0000","last_clean":"2024-04-26T12:49:44.967607+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:49:44.967607+0000","last_undegraded":"2024-04-26T12:49:44.967607+0000","last_fullsized":"2024-04-26T12:49:44.967607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:25.754497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538546+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:49:47.538546+0000","last_peered":"2024-04-26T12:49:47.538546+0000","last_clean":"2024-04-26T12:49:47.538546+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:49:47.538546+0000","last_undegraded":"2024-04-26T12:49:47.538546+0000","last_fullsized":"2024-04-26T12:49:47.538546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:33.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:49:44.968098+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:49:44.968098+0000","last_peered":"2024-04-26T12:49:44.968098+0000","last_clean":"2024-04-26T12:49:44.968098+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:49:44.968098+0000","last_undegraded":"2024-04-26T12:49:44.968098+0000","last_fullsized":"2024-04-26T12:49:44.968098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:46.200222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538498+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:49:47.538498+0000","last_peered":"2024-04-26T12:49:47.538498+0000","last_clean":"2024-04-26T12:49:47.538498+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:49:47.538498+0000","last_undegraded":"2024-04-26T12:49:47.538498+0000","last_fullsized":"2024-04-26T12:49:47.538498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:26.774107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538532+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:49:47.538532+0000","last_peered":"2024-04-26T12:49:47.538532+0000","last_clean":"2024-04-26T12:49:47.538532+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:49:47.538532+0000","last_undegraded":"2024-04-26T12:49:47.538532+0000","last_fullsized":"2024-04-26T12:49:47.538532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:44.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":168,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:45.960746+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:49:45.960746+0000","last_peered":"2024-04-26T12:49:45.960746+0000","last_clean":"2024-04-26T12:49:45.960746+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:49:45.960746+0000","last_undegraded":"2024-04-26T12:49:45.960746+0000","last_fullsized":"2024-04-26T12:49:45.960746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:51.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":147456,"data_stored":44523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":741376,"data_stored":634891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":638911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":147456,"data_stored":44523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:49:49.571 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:49:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a45b37640 1 Processor -- start 2024-04-26T12:49:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a45b37640 1 -- start start 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a45b37640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a40131920 0x7f7a40133d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a45b37640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4009d410 con 0x7f7a40092180 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a45b37640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7a4008f390 con 0x7f7a40131920 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a3f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7a40092180 0x7f7a40092560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50548/0 (socket says 172.21.15.29:50548) 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a3effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7a40131920 0x7f7a40133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a3f7fe640 1 -- 172.21.15.29:0/3444887122 learned_addr learned my addr 172.21.15.29:0/3444887122 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a3effd640 1 -- 172.21.15.29:0/3444887122 >> v1:172.21.15.29:6789/0 conn(0x7f7a40092180 legacy=0x7f7a40092560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a3e7fc640 1 -- 172.21.15.29:0/3444887122 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116831813 0 0) 0x7f7a4009d410 con 0x7f7a40092180 2024-04-26T12:49:49.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.679+0000 7f7a3effd640 1 -- 172.21.15.29:0/3444887122 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40091c10 con 0x7f7a40131920 2024-04-26T12:49:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3effd640 1 --2- 172.21.15.29:0/3444887122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40131920 0x7f7a40133d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009740 tx=0x7f7a3401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5574e4a384fda4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3e7fc640 1 -- 172.21.15.29:0/3444887122 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a340b0070 con 0x7f7a40131920 2024-04-26T12:49:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3e7fc640 1 -- 172.21.15.29:0/3444887122 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a340ab530 con 0x7f7a40131920 2024-04-26T12:49:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3e7fc640 1 -- 172.21.15.29:0/3444887122 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a340ab830 con 0x7f7a40131920 2024-04-26T12:49:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 -- 172.21.15.29:0/3444887122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40131920 msgr2=0x7f7a40133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 --2- 172.21.15.29:0/3444887122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40131920 0x7f7a40133d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009740 tx=0x7f7a3401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 -- 172.21.15.29:0/3444887122 shutdown_connections 2024-04-26T12:49:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 --2- 172.21.15.29:0/3444887122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40131920 0x7f7a40133d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 -- 172.21.15.29:0/3444887122 >> 172.21.15.29:0/3444887122 conn(0x7f7a4009a3f0 msgr2=0x7f7a4009a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 -- 172.21.15.29:0/3444887122 shutdown_connections 2024-04-26T12:49:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 -- 172.21.15.29:0/3444887122 wait complete. 2024-04-26T12:49:49.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 Processor -- start 2024-04-26T12:49:49.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 -- start start 2024-04-26T12:49:49.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40092180 0x7f7a40070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a45b37640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7a40136bf0 con 0x7f7a40092180 2024-04-26T12:49:49.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40092180 0x7f7a40070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40092180 0x7f7a40070400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39100/0 (socket says 172.21.15.29:39100) 2024-04-26T12:49:49.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3f7fe640 1 -- 172.21.15.29:0/3076640107 learned_addr learned my addr 172.21.15.29:0/3076640107 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3f7fe640 1 -- 172.21.15.29:0/3076640107 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40072bb0 con 0x7f7a40092180 2024-04-26T12:49:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a3f7fe640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40092180 0x7f7a40070400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800c840 tx=0x7f7a3800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a27fff640 1 -- 172.21.15.29:0/3076640107 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a38018070 con 0x7f7a40092180 2024-04-26T12:49:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a27fff640 1 -- 172.21.15.29:0/3076640107 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3800a660 con 0x7f7a40092180 2024-04-26T12:49:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.683+0000 7f7a27fff640 1 -- 172.21.15.29:0/3076640107 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a3800a850 con 0x7f7a40092180 2024-04-26T12:49:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a40133f20 con 0x7f7a40092180 2024-04-26T12:49:49.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a40073240 con 0x7f7a40092180 2024-04-26T12:49:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a40062f80 con 0x7f7a40092180 2024-04-26T12:49:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a27fff640 1 -- 172.21.15.29:0/3076640107 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7a3801b070 con 0x7f7a40092180 2024-04-26T12:49:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a27fff640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7a2c035e00 0x7f7a2c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a27fff640 1 -- 172.21.15.29:0/3076640107 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7f7a38047e40 con 0x7f7a40092180 2024-04-26T12:49:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a3effd640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7a2c035e00 0x7f7a2c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.687+0000 7f7a3effd640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7a2c035e00 0x7f7a2c0382c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a340ad000 tx=0x7f7a34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.691+0000 7f7a27fff640 1 -- 172.21.15.29:0/3076640107 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7a38011360 con 0x7f7a40092180 2024-04-26T12:49:49.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.843+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a4006c2f0 con 0x7f7a2c035e00 2024-04-26T12:49:49.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.843+0000 7f7a27fff640 1 -- 172.21.15.29:0/3076640107 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31844 (secure 0 0 0) 0x7f7a4006c2f0 con 0x7f7a2c035e00 2024-04-26T12:49:49.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:49.848 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7a2c035e00 msgr2=0x7f7a2c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7a2c035e00 0x7f7a2c0382c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a340ad000 tx=0x7f7a34008040 comp rx=0 tx=0).stop 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40092180 msgr2=0x7f7a40070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40092180 0x7f7a40070400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800c840 tx=0x7f7a3800cd00 comp rx=0 tx=0).stop 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 shutdown_connections 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7a2c035e00 0x7f7a2c0382c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 --2- 172.21.15.29:0/3076640107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7a40092180 0x7f7a40070400 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 >> 172.21.15.29:0/3076640107 conn(0x7f7a4009a3f0 msgr2=0x7f7a4012ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 shutdown_connections 2024-04-26T12:49:49.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.847+0000 7f7a45b37640 1 -- 172.21.15.29:0/3076640107 wait complete. 2024-04-26T12:49:49.865 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T12:49:49.129887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114572,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377372788,"statfs":{"total":386547056640,"available":386429734912,"internally_reserved":0,"allocated":1785856,"data_stored":1362848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":114878227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001528"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538573+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:49:47.538573+0000","last_peered":"2024-04-26T12:49:47.538573+0000","last_clean":"2024-04-26T12:49:47.538573+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:49:47.538573+0000","last_undegraded":"2024-04-26T12:49:47.538573+0000","last_fullsized":"2024-04-26T12:49:47.538573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.190860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:49:44.967210+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:49:44.967210+0000","last_peered":"2024-04-26T12:49:44.967210+0000","last_clean":"2024-04-26T12:49:44.967210+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:49:44.967210+0000","last_undegraded":"2024-04-26T12:49:44.967210+0000","last_fullsized":"2024-04-26T12:49:44.967210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:22.624113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538592+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:49:47.538592+0000","last_peered":"2024-04-26T12:49:47.538592+0000","last_clean":"2024-04-26T12:49:47.538592+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:49:47.538592+0000","last_undegraded":"2024-04-26T12:49:47.538592+0000","last_fullsized":"2024-04-26T12:49:47.538592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:52.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:49:44.967607+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:49:44.967607+0000","last_peered":"2024-04-26T12:49:44.967607+0000","last_clean":"2024-04-26T12:49:44.967607+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:49:44.967607+0000","last_undegraded":"2024-04-26T12:49:44.967607+0000","last_fullsized":"2024-04-26T12:49:44.967607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:25.754497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538546+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:49:47.538546+0000","last_peered":"2024-04-26T12:49:47.538546+0000","last_clean":"2024-04-26T12:49:47.538546+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:49:47.538546+0000","last_undegraded":"2024-04-26T12:49:47.538546+0000","last_fullsized":"2024-04-26T12:49:47.538546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:33.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T12:49:44.968098+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:49:44.968098+0000","last_peered":"2024-04-26T12:49:44.968098+0000","last_clean":"2024-04-26T12:49:44.968098+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:49:44.968098+0000","last_undegraded":"2024-04-26T12:49:44.968098+0000","last_fullsized":"2024-04-26T12:49:44.968098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:46.200222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538498+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:49:47.538498+0000","last_peered":"2024-04-26T12:49:47.538498+0000","last_clean":"2024-04-26T12:49:47.538498+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:49:47.538498+0000","last_undegraded":"2024-04-26T12:49:47.538498+0000","last_fullsized":"2024-04-26T12:49:47.538498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:26.774107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:47.538532+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:49:47.538532+0000","last_peered":"2024-04-26T12:49:47.538532+0000","last_clean":"2024-04-26T12:49:47.538532+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:49:47.538532+0000","last_undegraded":"2024-04-26T12:49:47.538532+0000","last_fullsized":"2024-04-26T12:49:47.538532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:44.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":168,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T12:49:45.960746+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:49:45.960746+0000","last_peered":"2024-04-26T12:49:45.960746+0000","last_clean":"2024-04-26T12:49:45.960746+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:49:45.960746+0000","last_undegraded":"2024-04-26T12:49:45.960746+0000","last_fullsized":"2024-04-26T12:49:45.960746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:51.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":147456,"data_stored":44523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":741376,"data_stored":634891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":638911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":147456,"data_stored":44523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:49:49.866 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:49:49.866 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:49:49.867 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:49:49.867 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:49:49.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd200639640 1 Processor -- start 2024-04-26T12:49:49.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd200639640 1 -- start start 2024-04-26T12:49:49.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd200639640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1f80939f0 0x7fd1f8093dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd200639640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f809d410 con 0x7fd1f8094cb0 2024-04-26T12:49:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd200639640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd1f8093360 con 0x7fd1f80939f0 2024-04-26T12:49:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd1fe3d5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1f80939f0 0x7fd1f8093dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd1fdbd4640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd1f8094cb0 0x7fd1f812c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50556/0 (socket says 172.21.15.29:50556) 2024-04-26T12:49:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd1fdbd4640 1 -- 172.21.15.29:0/2753459365 learned_addr learned my addr 172.21.15.29:0/2753459365 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:49:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd1fe3d5640 1 -- 172.21.15.29:0/2753459365 >> v1:172.21.15.29:6789/0 conn(0x7fd1f8094cb0 legacy=0x7fd1f812c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.975+0000 7fd1fe3d5640 1 -- 172.21.15.29:0/2753459365 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f80969b0 con 0x7fd1f80939f0 2024-04-26T12:49:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fe3d5640 1 --2- 172.21.15.29:0/2753459365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f8093dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009d90 tx=0x7fd1f001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9acda297f9e0e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fd3d3640 1 -- 172.21.15.29:0/2753459365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f00b2070 con 0x7fd1f80939f0 2024-04-26T12:49:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fd3d3640 1 -- 172.21.15.29:0/2753459365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f00a5740 con 0x7fd1f80939f0 2024-04-26T12:49:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fd3d3640 1 -- 172.21.15.29:0/2753459365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f00a5a40 con 0x7fd1f80939f0 2024-04-26T12:49:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- 172.21.15.29:0/2753459365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 msgr2=0x7fd1f8093dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 --2- 172.21.15.29:0/2753459365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f8093dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009d90 tx=0x7fd1f001c8c0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- 172.21.15.29:0/2753459365 shutdown_connections 2024-04-26T12:49:49.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 --2- 172.21.15.29:0/2753459365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f8093dd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:49.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- 172.21.15.29:0/2753459365 >> 172.21.15.29:0/2753459365 conn(0x7fd1f809a3f0 msgr2=0x7fd1f809a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:49.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- 172.21.15.29:0/2753459365 shutdown_connections 2024-04-26T12:49:49.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- 172.21.15.29:0/2753459365 wait complete. 2024-04-26T12:49:49.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 Processor -- start 2024-04-26T12:49:49.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- start start 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f8134e60 con 0x7fd1f80939f0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fe3d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fe3d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f80717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39116/0 (socket says 172.21.15.29:39116) 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fe3d5640 1 -- 172.21.15.29:0/184046603 learned_addr learned my addr 172.21.15.29:0/184046603 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fe3d5640 1 -- 172.21.15.29:0/184046603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f808aa70 con 0x7fd1f80939f0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1fe3d5640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f80717b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd1f001a4f0 tx=0x7fd1f0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1f6ffd640 1 -- 172.21.15.29:0/184046603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f00bd020 con 0x7fd1f80939f0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1f6ffd640 1 -- 172.21.15.29:0/184046603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f00ad770 con 0x7fd1f80939f0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f808a220 con 0x7fd1f80939f0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd1f6ffd640 1 -- 172.21.15.29:0/184046603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f00b2040 con 0x7fd1f80939f0 2024-04-26T12:49:49.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.979+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f8071ec0 con 0x7fd1f80939f0 2024-04-26T12:49:49.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.983+0000 7fd1f6ffd640 1 -- 172.21.15.29:0/184046603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd1f00c0020 con 0x7fd1f80939f0 2024-04-26T12:49:49.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.983+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f808ad50 con 0x7fd1f80939f0 2024-04-26T12:49:49.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.983+0000 7fd1f6ffd640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1e4035db0 0x7fd1e4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:49.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.983+0000 7fd1f6ffd640 1 -- 172.21.15.29:0/184046603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7fd1f00e38b0 con 0x7fd1f80939f0 2024-04-26T12:49:49.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.983+0000 7fd1fdbd4640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1e4035db0 0x7fd1e4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:49.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.983+0000 7fd1fdbd4640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1e4035db0 0x7fd1e4038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec001610 tx=0x7fd1ec007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:49.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:49.987+0000 7fd1f6ffd640 1 -- 172.21.15.29:0/184046603 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd1f808ad50 con 0x7fd1f80939f0 2024-04-26T12:49:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.183+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd1f8062f80 con 0x7fd1f80939f0 2024-04-26T12:49:50.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.183+0000 7fd1f6ffd640 1 -- 172.21.15.29:0/184046603 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd1f00c7030 con 0x7fd1f80939f0 2024-04-26T12:49:50.186 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:49:50.187 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:49:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1e4035db0 msgr2=0x7fd1e4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1e4035db0 0x7fd1e4038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec001610 tx=0x7fd1ec007ad0 comp rx=0 tx=0).stop 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 msgr2=0x7fd1f80717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f80717b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd1f001a4f0 tx=0x7fd1f0019660 comp rx=0 tx=0).stop 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 shutdown_connections 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1e4035db0 0x7fd1e4038270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 --2- 172.21.15.29:0/184046603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1f80939f0 0x7fd1f80717b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 >> 172.21.15.29:0/184046603 conn(0x7fd1f809a3f0 msgr2=0x7fd1f812f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 shutdown_connections 2024-04-26T12:49:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:49:50.187+0000 7fd200639640 1 -- 172.21.15.29:0/184046603 wait complete. 2024-04-26T12:49:50.205 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:49:50.205 INFO:teuthology.run_tasks:Running task rgw... 2024-04-26T12:49:50.221 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-26T12:49:50.221 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-26T12:49:50.221 INFO:tasks.rgw:Creating data pools 2024-04-26T12:49:50.221 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-26T12:49:50.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-04-26T12:49:50.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fdaa0279640 1 Processor -- start 2024-04-26T12:49:50.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fdaa0279640 1 -- start start 2024-04-26T12:49:50.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fdaa0279640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda98116b30 0x7fda98116f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:50.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fdaa0279640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda981174e0 con 0x7fda98111a10 2024-04-26T12:49:50.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fdaa0279640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fda981125a0 con 0x7fda98116b30 2024-04-26T12:49:50.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fda9e015640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda98116b30 0x7fda98116f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:50.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fda9d814640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fda98111a10 0x7fda98111e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:47192/0 (socket says 172.21.15.72:47192) 2024-04-26T12:49:50.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fda9d814640 1 -- 172.21.15.72:0/1006751016 learned_addr learned my addr 172.21.15.72:0/1006751016 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:49:50.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fda9d013640 1 -- 172.21.15.72:0/1006751016 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718215906 0 0) 0x7fda981174e0 con 0x7fda98111a10 2024-04-26T12:49:50.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fda9d013640 1 -- 172.21.15.72:0/1006751016 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda84003530 con 0x7fda98111a10 2024-04-26T12:49:50.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fda9e015640 1 -- 172.21.15.72:0/1006751016 >> v1:172.21.15.29:6789/0 conn(0x7fda98111a10 legacy=0x7fda98111e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.348+0000 7fda9e015640 1 -- 172.21.15.72:0/1006751016 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda98112750 con 0x7fda98116b30 2024-04-26T12:49:50.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fda9e015640 1 --2- 172.21.15.72:0/1006751016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98116b30 0x7fda98116f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda94009740 tx=0x7fda9401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58db8a1a8722dce7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:50.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fda9d013640 1 -- 172.21.15.72:0/1006751016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda940b1070 con 0x7fda98116b30 2024-04-26T12:49:50.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fda9d013640 1 -- 172.21.15.72:0/1006751016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda940ac520 con 0x7fda98116b30 2024-04-26T12:49:50.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fda9d013640 1 -- 172.21.15.72:0/1006751016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda940ac800 con 0x7fda98116b30 2024-04-26T12:49:50.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fdaa0279640 1 -- 172.21.15.72:0/1006751016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98116b30 msgr2=0x7fda98116f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fdaa0279640 1 --2- 172.21.15.72:0/1006751016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98116b30 0x7fda98116f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda94009740 tx=0x7fda9401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fdaa0279640 1 -- 172.21.15.72:0/1006751016 shutdown_connections 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fdaa0279640 1 --2- 172.21.15.72:0/1006751016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98116b30 0x7fda98116f10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fdaa0279640 1 -- 172.21.15.72:0/1006751016 >> 172.21.15.72:0/1006751016 conn(0x7fda9806e8f0 msgr2=0x7fda9810fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fdaa0279640 1 -- 172.21.15.72:0/1006751016 shutdown_connections 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.352+0000 7fdaa0279640 1 -- 172.21.15.72:0/1006751016 wait complete. 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fdaa0279640 1 Processor -- start 2024-04-26T12:49:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fdaa0279640 1 -- start start 2024-04-26T12:49:50.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fdaa0279640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98111a10 0x7fda981a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:50.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fdaa0279640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fda98120610 con 0x7fda98111a10 2024-04-26T12:49:50.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda9e015640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98111a10 0x7fda981a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:50.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda9e015640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98111a10 0x7fda981a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48274/0 (socket says 172.21.15.72:48274) 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda9e015640 1 -- 172.21.15.72:0/2751410004 learned_addr learned my addr 172.21.15.72:0/2751410004 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda9e015640 1 -- 172.21.15.72:0/2751410004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda981a9380 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda9e015640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98111a10 0x7fda981a8e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda9401aa20 tx=0x7fda94019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda8effd640 1 -- 172.21.15.72:0/2751410004 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda940ba020 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda8effd640 1 -- 172.21.15.72:0/2751410004 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda940acc10 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda981a9610 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda8effd640 1 -- 172.21.15.72:0/2751410004 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda940b1040 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda981ad550 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9804fe90 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.356+0000 7fda8effd640 1 -- 172.21.15.72:0/2751410004 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fda940bd020 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.360+0000 7fda8effd640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fda7c035db0 0x7fda7c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.360+0000 7fda8effd640 1 -- 172.21.15.72:0/2751410004 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3482+0+0 (secure 0 0 0) 0x7fda940e2a40 con 0x7fda98111a10 2024-04-26T12:49:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.360+0000 7fda9d814640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fda7c035db0 0x7fda7c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.360+0000 7fda9d814640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fda7c035db0 0x7fda7c038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda88007fd0 tx=0x7fda88007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.372+0000 7fda8effd640 1 -- 172.21.15.72:0/2751410004 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fda940c4030 con 0x7fda98111a10 2024-04-26T12:49:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:50.544+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7fda98116b30 con 0x7fda98111a10 2024-04-26T12:49:51.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fda8effd640 1 -- 172.21.15.72:0/2751410004 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v19) ==== 151+0+0 (secure 0 0 0) 0x7fda940a9070 con 0x7fda98111a10 2024-04-26T12:49:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fda7c035db0 msgr2=0x7fda7c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fda7c035db0 0x7fda7c038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda88007fd0 tx=0x7fda88007980 comp rx=0 tx=0).stop 2024-04-26T12:49:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98111a10 msgr2=0x7fda981a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98111a10 0x7fda981a8e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda9401aa20 tx=0x7fda94019110 comp rx=0 tx=0).stop 2024-04-26T12:49:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 shutdown_connections 2024-04-26T12:49:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fda7c035db0 0x7fda7c038270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 --2- 172.21.15.72:0/2751410004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda98111a10 0x7fda981a8e40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 >> 172.21.15.72:0/2751410004 conn(0x7fda9806e8f0 msgr2=0x7fda9810ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 shutdown_connections 2024-04-26T12:49:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.188+0000 7fdaa0279640 1 -- 172.21.15.72:0/2751410004 wait complete. 2024-04-26T12:49:51.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.340+0000 7f8b06193640 1 Processor -- start 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.340+0000 7f8b06193640 1 -- start start 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.340+0000 7f8b06193640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b0010df90 0x7f8b0010e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.340+0000 7f8b06193640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0010eb20 con 0x7f8b00117930 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.340+0000 7f8b06193640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8b0011c450 con 0x7f8b0010df90 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.344+0000 7f8aff7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b0010df90 0x7f8b0010e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.344+0000 7f8afeffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b00117930 0x7f8b00119d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:47208/0 (socket says 172.21.15.72:47208) 2024-04-26T12:49:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.344+0000 7f8afeffd640 1 -- 172.21.15.72:0/1665005932 learned_addr learned my addr 172.21.15.72:0/1665005932 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:49:51.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.344+0000 7f8aff7fe640 1 -- 172.21.15.72:0/1665005932 >> v1:172.21.15.29:6789/0 conn(0x7f8b00117930 legacy=0x7f8b00119d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:51.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.344+0000 7f8aff7fe640 1 -- 172.21.15.72:0/1665005932 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0011c5d0 con 0x7f8b0010df90 2024-04-26T12:49:51.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.344+0000 7f8aff7fe640 1 --2- 172.21.15.72:0/1665005932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b0010e370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009d90 tx=0x7f8af801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3d9199ab4f49bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:51.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8afe7fc640 1 -- 172.21.15.72:0/1665005932 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af80b2070 con 0x7f8b0010df90 2024-04-26T12:49:51.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8afe7fc640 1 -- 172.21.15.72:0/1665005932 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af80a5850 con 0x7f8b0010df90 2024-04-26T12:49:51.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8afe7fc640 1 -- 172.21.15.72:0/1665005932 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af80a5b50 con 0x7f8b0010df90 2024-04-26T12:49:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- 172.21.15.72:0/1665005932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 msgr2=0x7f8b0010e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 --2- 172.21.15.72:0/1665005932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b0010e370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009d90 tx=0x7f8af801c8c0 comp rx=0 tx=0).stop 2024-04-26T12:49:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- 172.21.15.72:0/1665005932 shutdown_connections 2024-04-26T12:49:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 --2- 172.21.15.72:0/1665005932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b0010e370 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- 172.21.15.72:0/1665005932 >> 172.21.15.72:0/1665005932 conn(0x7f8b0006f580 msgr2=0x7f8b000719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- 172.21.15.72:0/1665005932 shutdown_connections 2024-04-26T12:49:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- 172.21.15.72:0/1665005932 wait complete. 2024-04-26T12:49:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 Processor -- start 2024-04-26T12:49:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- start start 2024-04-26T12:49:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b001acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0011c130 con 0x7f8b0010df90 2024-04-26T12:49:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8aff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b001acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8aff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b001acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48290/0 (socket says 172.21.15.72:48290) 2024-04-26T12:49:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8aff7fe640 1 -- 172.21.15.72:0/2516570926 learned_addr learned my addr 172.21.15.72:0/2516570926 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8aff7fe640 1 -- 172.21.15.72:0/2516570926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b001ad0c0 con 0x7f8b0010df90 2024-04-26T12:49:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8aff7fe640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b001acaf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8af801a4f0 tx=0x7f8af8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8af7fff640 1 -- 172.21.15.72:0/2516570926 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af80bd030 con 0x7f8b0010df90 2024-04-26T12:49:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8af7fff640 1 -- 172.21.15.72:0/2516570926 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af80adaf0 con 0x7f8b0010df90 2024-04-26T12:49:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b001ad2f0 con 0x7f8b0010df90 2024-04-26T12:49:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8af7fff640 1 -- 172.21.15.72:0/2516570926 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af80b2040 con 0x7f8b0010df90 2024-04-26T12:49:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.348+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b001a6b90 con 0x7f8b0010df90 2024-04-26T12:49:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.352+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0004fe90 con 0x7f8b0010df90 2024-04-26T12:49:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.352+0000 7f8af7fff640 1 -- 172.21.15.72:0/2516570926 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8af80c0070 con 0x7f8b0010df90 2024-04-26T12:49:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.352+0000 7f8af7fff640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ae0035d60 0x7f8ae0038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.352+0000 7f8af7fff640 1 -- 172.21.15.72:0/2516570926 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3774+0+0 (secure 0 0 0) 0x7f8af80be070 con 0x7f8b0010df90 2024-04-26T12:49:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.352+0000 7f8afeffd640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ae0035d60 0x7f8ae0038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:51.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.352+0000 7f8afeffd640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ae0035d60 0x7f8ae0038220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8005890 tx=0x7f8ae8007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:51.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.364+0000 7f8af7fff640 1 -- 172.21.15.72:0/2516570926 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8af80c7070 con 0x7f8b0010df90 2024-04-26T12:49:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:51.524+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f8b00117930 con 0x7f8b0010df90 2024-04-26T12:49:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.188+0000 7f8af7fff640 1 -- 172.21.15.72:0/2516570926 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v21) ==== 227+0+0 (secure 0 0 0) 0x7f8af8016540 con 0x7f8b0010df90 2024-04-26T12:49:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'default.rgw.buckets.data' created 2024-04-26T12:49:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ae0035d60 msgr2=0x7f8ae0038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ae0035d60 0x7f8ae0038220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8005890 tx=0x7f8ae8007a90 comp rx=0 tx=0).stop 2024-04-26T12:49:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 msgr2=0x7f8b001acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b001acaf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8af801a4f0 tx=0x7f8af8019660 comp rx=0 tx=0).stop 2024-04-26T12:49:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 shutdown_connections 2024-04-26T12:49:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ae0035d60 0x7f8ae0038220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 --2- 172.21.15.72:0/2516570926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b0010df90 0x7f8b001acaf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 >> 172.21.15.72:0/2516570926 conn(0x7f8b0006f580 msgr2=0x7f8b001169b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 shutdown_connections 2024-04-26T12:49:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.192+0000 7f8b06193640 1 -- 172.21.15.72:0/2516570926 wait complete. 2024-04-26T12:49:53.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-26T12:49:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f19a5216640 1 Processor -- start 2024-04-26T12:49:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f19a5216640 1 -- start start 2024-04-26T12:49:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f19a5216640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19a0118940 0x7f19a011ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f19a5216640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19a011b270 con 0x7f19a010df90 2024-04-26T12:49:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f19a5216640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f19a011c450 con 0x7f19a0118940 2024-04-26T12:49:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f199ed9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f19a010df90 0x7f19a010e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:42640/0 (socket says 172.21.15.72:42640) 2024-04-26T12:49:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f199ed9d640 1 -- 172.21.15.72:0/2886055977 learned_addr learned my addr 172.21.15.72:0/2886055977 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:49:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f199e59c640 1 --2- 172.21.15.72:0/2886055977 >> v2:172.21.15.29:3300/0 conn(0x7f19a0118940 0x7f19a011ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f199dd9b640 1 -- 172.21.15.72:0/2886055977 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2585924347 0 0) 0x7f19a011b270 con 0x7f19a010df90 2024-04-26T12:49:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f199dd9b640 1 -- 172.21.15.72:0/2886055977 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1988003530 con 0x7f19a010df90 2024-04-26T12:49:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f199e59c640 1 -- 172.21.15.72:0/2886055977 >> v1:172.21.15.29:6789/0 conn(0x7f19a010df90 legacy=0x7f19a010e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.352+0000 7f199e59c640 1 -- 172.21.15.72:0/2886055977 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a011c5d0 con 0x7f19a0118940 2024-04-26T12:49:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199e59c640 1 --2- 172.21.15.72:0/2886055977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0118940 0x7f19a011ad30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1994009740 tx=0x7f199401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f10335b451a700 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199dd9b640 1 -- 172.21.15.72:0/2886055977 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19940b1070 con 0x7f19a0118940 2024-04-26T12:49:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199dd9b640 1 -- 172.21.15.72:0/2886055977 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19940ac520 con 0x7f19a0118940 2024-04-26T12:49:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199dd9b640 1 -- 172.21.15.72:0/2886055977 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19940ac820 con 0x7f19a0118940 2024-04-26T12:49:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 -- 172.21.15.72:0/2886055977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0118940 msgr2=0x7f19a011ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 --2- 172.21.15.72:0/2886055977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0118940 0x7f19a011ad30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1994009740 tx=0x7f199401c370 comp rx=0 tx=0).stop 2024-04-26T12:49:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 -- 172.21.15.72:0/2886055977 shutdown_connections 2024-04-26T12:49:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 --2- 172.21.15.72:0/2886055977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0118940 0x7f19a011ad30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 -- 172.21.15.72:0/2886055977 >> 172.21.15.72:0/2886055977 conn(0x7f19a006f580 msgr2=0x7f19a00719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 -- 172.21.15.72:0/2886055977 shutdown_connections 2024-04-26T12:49:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 -- 172.21.15.72:0/2886055977 wait complete. 2024-04-26T12:49:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 Processor -- start 2024-04-26T12:49:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 -- start start 2024-04-26T12:49:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a010df90 0x7f19a01a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f19a5216640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f19a011c170 con 0x7f19a010df90 2024-04-26T12:49:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a010df90 0x7f19a01a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a010df90 0x7f19a01a8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:56618/0 (socket says 172.21.15.72:56618) 2024-04-26T12:49:53.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199ed9d640 1 -- 172.21.15.72:0/1804647488 learned_addr learned my addr 172.21.15.72:0/1804647488 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:53.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199ed9d640 1 -- 172.21.15.72:0/1804647488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a01a93d0 con 0x7f19a010df90 2024-04-26T12:49:53.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.356+0000 7f199ed9d640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a010df90 0x7f19a01a8e90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1990001ec0 tx=0x7f199000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19877fe640 1 -- 172.21.15.72:0/1804647488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990017070 con 0x7f19a010df90 2024-04-26T12:49:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19877fe640 1 -- 172.21.15.72:0/1804647488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1990005c20 con 0x7f19a010df90 2024-04-26T12:49:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a01a96c0 con 0x7f19a010df90 2024-04-26T12:49:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19877fe640 1 -- 172.21.15.72:0/1804647488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990007070 con 0x7f19a010df90 2024-04-26T12:49:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a01ad770 con 0x7f19a010df90 2024-04-26T12:49:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a004fe90 con 0x7f19a010df90 2024-04-26T12:49:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19877fe640 1 -- 172.21.15.72:0/1804647488 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f199001a070 con 0x7f19a010df90 2024-04-26T12:49:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19877fe640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f198c035de0 0x7f198c0382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f19877fe640 1 -- 172.21.15.72:0/1804647488 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4249+0+0 (secure 0 0 0) 0x7f1990048040 con 0x7f19a010df90 2024-04-26T12:49:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f199e59c640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f198c035de0 0x7f198c0382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.360+0000 7f199e59c640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f198c035de0 0x7f198c0382a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19940ae000 tx=0x7f1994008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:53.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.372+0000 7f19877fe640 1 -- 172.21.15.72:0/1804647488 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1990045c60 con 0x7f19a010df90 2024-04-26T12:49:53.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:53.536+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f19a01a98f0 con 0x7f19a010df90 2024-04-26T12:49:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.192+0000 7f19877fe640 1 -- 172.21.15.72:0/1804647488 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v22) ==== 185+0+0 (secure 0 0 0) 0x7f1990045fe0 con 0x7f19a010df90 2024-04-26T12:49:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-26T12:49:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f198c035de0 msgr2=0x7f198c0382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f198c035de0 0x7f198c0382a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f19940ae000 tx=0x7f1994008040 comp rx=0 tx=0).stop 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a010df90 msgr2=0x7f19a01a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a010df90 0x7f19a01a8e90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1990001ec0 tx=0x7f199000c8e0 comp rx=0 tx=0).stop 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 shutdown_connections 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f198c035de0 0x7f198c0382a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 --2- 172.21.15.72:0/1804647488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a010df90 0x7f19a01a8e90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 >> 172.21.15.72:0/1804647488 conn(0x7f19a006f580 msgr2=0x7f19a010f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 shutdown_connections 2024-04-26T12:49:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.196+0000 7f19a5216640 1 -- 172.21.15.72:0/1804647488 wait complete. 2024-04-26T12:49:54.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-26T12:49:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37be27c640 1 Processor -- start 2024-04-26T12:49:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37be27c640 1 -- start start 2024-04-26T12:49:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37be27c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f37b8118940 0x7f37b811ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37be27c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b811b270 con 0x7f37b810df90 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37be27c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f37b811c450 con 0x7f37b8118940 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37b77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f37b8118940 0x7f37b811ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37b77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f37b8118940 0x7f37b811ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:56622/0 (socket says 172.21.15.72:56622) 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37b77fe640 1 -- 172.21.15.72:0/2785118759 learned_addr learned my addr 172.21.15.72:0/2785118759 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37b7fff640 1 --1- 172.21.15.72:0/2785118759 >> v1:172.21.15.29:6789/0 conn(0x7f37b810df90 0x7f37b810e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:42646/0 (socket says 172.21.15.72:42646) 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37b77fe640 1 -- 172.21.15.72:0/2785118759 >> v1:172.21.15.29:6789/0 conn(0x7f37b810df90 legacy=0x7f37b810e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.360+0000 7f37b77fe640 1 -- 172.21.15.72:0/2785118759 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b811c5d0 con 0x7f37b8118940 2024-04-26T12:49:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37b77fe640 1 --2- 172.21.15.72:0/2785118759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b8118940 0x7f37b811ad30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009e50 tx=0x7f37a801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79933dd77d36ebbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37b6ffd640 1 -- 172.21.15.72:0/2785118759 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a8009200 con 0x7f37b8118940 2024-04-26T12:49:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37b6ffd640 1 -- 172.21.15.72:0/2785118759 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a80a57e0 con 0x7f37b8118940 2024-04-26T12:49:54.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37b6ffd640 1 -- 172.21.15.72:0/2785118759 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a80a5ae0 con 0x7f37b8118940 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 -- 172.21.15.72:0/2785118759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b8118940 msgr2=0x7f37b811ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 --2- 172.21.15.72:0/2785118759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b8118940 0x7f37b811ad30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009e50 tx=0x7f37a801c980 comp rx=0 tx=0).stop 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 -- 172.21.15.72:0/2785118759 shutdown_connections 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 --2- 172.21.15.72:0/2785118759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b8118940 0x7f37b811ad30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 -- 172.21.15.72:0/2785118759 >> 172.21.15.72:0/2785118759 conn(0x7f37b806f580 msgr2=0x7f37b80719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 -- 172.21.15.72:0/2785118759 shutdown_connections 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 -- 172.21.15.72:0/2785118759 wait complete. 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 Processor -- start 2024-04-26T12:49:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 -- start start 2024-04-26T12:49:54.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b810df90 0x7f37b81a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37be27c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f37b811c110 con 0x7f37b810df90 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37b7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b810df90 0x7f37b81a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37b7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b810df90 0x7f37b81a6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:56628/0 (socket says 172.21.15.72:56628) 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.364+0000 7f37b7fff640 1 -- 172.21.15.72:0/1957530700 learned_addr learned my addr 172.21.15.72:0/1957530700 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b7fff640 1 -- 172.21.15.72:0/1957530700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b81a7440 con 0x7f37b810df90 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b7fff640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b810df90 0x7f37b81a6f00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c3b0 tx=0x7f37a000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b4ff9640 1 -- 172.21.15.72:0/1957530700 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a0007410 con 0x7f37b810df90 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b81a76d0 con 0x7f37b810df90 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b4ff9640 1 -- 172.21.15.72:0/1957530700 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a00075b0 con 0x7f37b810df90 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b4ff9640 1 -- 172.21.15.72:0/1957530700 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a00047f0 con 0x7f37b810df90 2024-04-26T12:49:54.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b81ab5c0 con 0x7f37b810df90 2024-04-26T12:49:54.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b804fe90 con 0x7f37b810df90 2024-04-26T12:49:54.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b4ff9640 1 -- 172.21.15.72:0/1957530700 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f37a001a020 con 0x7f37b810df90 2024-04-26T12:49:54.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b4ff9640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3798035d60 0x7f3798038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:54.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b4ff9640 1 -- 172.21.15.72:0/1957530700 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4260+0+0 (secure 0 0 0) 0x7f37a00488c0 con 0x7f37b810df90 2024-04-26T12:49:54.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b77fe640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3798035d60 0x7f3798038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:54.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.368+0000 7f37b77fe640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3798035d60 0x7f3798038220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37a80ae000 tx=0x7f37a80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:54.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.380+0000 7f37b4ff9640 1 -- 172.21.15.72:0/1957530700 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f37a0021070 con 0x7f37b810df90 2024-04-26T12:49:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:54.544+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f37b8118940 con 0x7f37b810df90 2024-04-26T12:49:55.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.196+0000 7f37b4ff9640 1 -- 172.21.15.72:0/1957530700 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v23) ==== 169+0+0 (secure 0 0 0) 0x7f37a001adf0 con 0x7f37b810df90 2024-04-26T12:49:55.195 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'default.rgw.buckets.index' created 2024-04-26T12:49:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3798035d60 msgr2=0x7f3798038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3798035d60 0x7f3798038220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37a80ae000 tx=0x7f37a80a7070 comp rx=0 tx=0).stop 2024-04-26T12:49:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b810df90 msgr2=0x7f37b81a6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b810df90 0x7f37b81a6f00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c3b0 tx=0x7f37a000c870 comp rx=0 tx=0).stop 2024-04-26T12:49:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 shutdown_connections 2024-04-26T12:49:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3798035d60 0x7f3798038220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 --2- 172.21.15.72:0/1957530700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37b810df90 0x7f37b81a6f00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 >> 172.21.15.72:0/1957530700 conn(0x7f37b806f580 msgr2=0x7f37b8070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 shutdown_connections 2024-04-26T12:49:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.200+0000 7f37be27c640 1 -- 172.21.15.72:0/1957530700 wait complete. 2024-04-26T12:49:55.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-26T12:49:55.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef90a8640 1 Processor -- start 2024-04-26T12:49:55.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef90a8640 1 -- start start 2024-04-26T12:49:55.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef90a8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ef4117820 0x7f8ef4119c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:55.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef90a8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef411a150 con 0x7f8ef410f930 2024-04-26T12:49:55.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef90a8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8ef411b330 con 0x7f8ef4117820 2024-04-26T12:49:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef259c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ef4117820 0x7f8ef4119c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef2d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8ef410f930 0x7f8ef410fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:42658/0 (socket says 172.21.15.72:42658) 2024-04-26T12:49:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef2d9d640 1 -- 172.21.15.72:0/2425894169 learned_addr learned my addr 172.21.15.72:0/2425894169 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:49:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef259c640 1 -- 172.21.15.72:0/2425894169 >> v1:172.21.15.29:6789/0 conn(0x7f8ef410f930 legacy=0x7f8ef410fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.356+0000 7f8ef259c640 1 -- 172.21.15.72:0/2425894169 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef411b4b0 con 0x7f8ef4117820 2024-04-26T12:49:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef259c640 1 --2- 172.21.15.72:0/2425894169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef4117820 0x7f8ef4119c10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009740 tx=0x7f8ee801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0568707e058641 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef1d9b640 1 -- 172.21.15.72:0/2425894169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee80b1070 con 0x7f8ef4117820 2024-04-26T12:49:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef1d9b640 1 -- 172.21.15.72:0/2425894169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee80ac520 con 0x7f8ef4117820 2024-04-26T12:49:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef1d9b640 1 -- 172.21.15.72:0/2425894169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee80ac820 con 0x7f8ef4117820 2024-04-26T12:49:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 -- 172.21.15.72:0/2425894169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef4117820 msgr2=0x7f8ef4119c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 --2- 172.21.15.72:0/2425894169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef4117820 0x7f8ef4119c10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009740 tx=0x7f8ee801c370 comp rx=0 tx=0).stop 2024-04-26T12:49:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 -- 172.21.15.72:0/2425894169 shutdown_connections 2024-04-26T12:49:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 --2- 172.21.15.72:0/2425894169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef4117820 0x7f8ef4119c10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 -- 172.21.15.72:0/2425894169 >> 172.21.15.72:0/2425894169 conn(0x7f8ef406f580 msgr2=0x7f8ef40719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 -- 172.21.15.72:0/2425894169 shutdown_connections 2024-04-26T12:49:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 -- 172.21.15.72:0/2425894169 wait complete. 2024-04-26T12:49:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 Processor -- start 2024-04-26T12:49:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 -- start start 2024-04-26T12:49:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef410f930 0x7f8ef41aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef90a8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef411b010 con 0x7f8ef410f930 2024-04-26T12:49:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef410f930 0x7f8ef41aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef410f930 0x7f8ef41aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:56640/0 (socket says 172.21.15.72:56640) 2024-04-26T12:49:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.360+0000 7f8ef2d9d640 1 -- 172.21.15.72:0/4008576401 learned_addr learned my addr 172.21.15.72:0/4008576401 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:49:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8ef2d9d640 1 -- 172.21.15.72:0/4008576401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef41af360 con 0x7f8ef410f930 2024-04-26T12:49:55.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8ef2d9d640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef410f930 0x7f8ef41aed90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c450 tx=0x7f8ee400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:55.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8edb7fe640 1 -- 172.21.15.72:0/4008576401 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee4017070 con 0x7f8ef410f930 2024-04-26T12:49:55.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8edb7fe640 1 -- 172.21.15.72:0/4008576401 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee4005c20 con 0x7f8ef410f930 2024-04-26T12:49:55.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef41af5f0 con 0x7f8ef410f930 2024-04-26T12:49:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8edb7fe640 1 -- 172.21.15.72:0/4008576401 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee40070d0 con 0x7f8ef410f930 2024-04-26T12:49:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef41a9050 con 0x7f8ef410f930 2024-04-26T12:49:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef404fe90 con 0x7f8ef410f930 2024-04-26T12:49:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8edb7fe640 1 -- 172.21.15.72:0/4008576401 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8ee401a070 con 0x7f8ef410f930 2024-04-26T12:49:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8edb7fe640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ee0035db0 0x7f8ee0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:49:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8edb7fe640 1 -- 172.21.15.72:0/4008576401 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4624+0+0 (secure 0 0 0) 0x7f8ee4048640 con 0x7f8ef410f930 2024-04-26T12:49:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8ef259c640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ee0035db0 0x7f8ee0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:49:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.364+0000 7f8ef259c640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ee0035db0 0x7f8ee0038270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80ae000 tx=0x7f8ee8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:49:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.376+0000 7f8edb7fe640 1 -- 172.21.15.72:0/4008576401 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8ee4007270 con 0x7f8ef410f930 2024-04-26T12:49:55.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:55.540+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f8ef41af820 con 0x7f8ef410f930 2024-04-26T12:49:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.196+0000 7f8edb7fe640 1 -- 172.21.15.72:0/4008576401 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v24) ==== 187+0+0 (secure 0 0 0) 0x7f8ee40483c0 con 0x7f8ef410f930 2024-04-26T12:49:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ee0035db0 msgr2=0x7f8ee0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ee0035db0 0x7f8ee0038270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80ae000 tx=0x7f8ee8008040 comp rx=0 tx=0).stop 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef410f930 msgr2=0x7f8ef41aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef410f930 0x7f8ef41aed90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c450 tx=0x7f8ee400c910 comp rx=0 tx=0).stop 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 shutdown_connections 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ee0035db0 0x7f8ee0038270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 --2- 172.21.15.72:0/4008576401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ef410f930 0x7f8ef41aed90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:49:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 >> 172.21.15.72:0/4008576401 conn(0x7f8ef406f580 msgr2=0x7f8ef4116be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:49:56.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 shutdown_connections 2024-04-26T12:49:56.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:49:56.200+0000 7f8ef90a8640 1 -- 172.21.15.72:0/4008576401 wait complete. 2024-04-26T12:49:56.239 DEBUG:tasks.rgw:Pools created 2024-04-26T12:49:56.240 INFO:tasks.rgw:Starting rgw... 2024-04-26T12:49:56.240 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-26T12:49:56.240 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-26T12:49:56.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo echo -n http://smithi072.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-26T12:49:56.251 INFO:teuthology.orchestra.run.smithi072.stdout:http://smithi072.front.sepia.ceph.com:80 2024-04-26T12:49:56.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-26T12:49:56.304 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-26T12:49:56.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-26T12:49:56.347 INFO:tasks.rgw.client.0:Started 2024-04-26T12:49:56.347 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi072.front.sepia.ceph.com:80/ 2024-04-26T12:49:56.348 DEBUG:teuthology.orchestra.run.smithi072:> curl http://smithi072.front.sepia.ceph.com:80/ 2024-04-26T12:49:56.384 INFO:teuthology.orchestra.run.smithi072.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:49:56.384 INFO:teuthology.orchestra.run.smithi072.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:49:56.384 INFO:teuthology.orchestra.run.smithi072.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:49:56.385 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:49:56.385 INFO:teuthology.orchestra.run.smithi072.stderr:curl: (7) Failed to connect to smithi072.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:49:57.386 DEBUG:teuthology.orchestra.run.smithi072:> curl http://smithi072.front.sepia.ceph.com:80/ 2024-04-26T12:49:57.399 INFO:teuthology.orchestra.run.smithi072.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:49:57.399 INFO:teuthology.orchestra.run.smithi072.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:49:57.399 INFO:teuthology.orchestra.run.smithi072.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:49:57.399 INFO:teuthology.orchestra.run.smithi072.stderr:curl: (7) Failed to connect to smithi072.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:49:57.400 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:49:59.401 DEBUG:teuthology.orchestra.run.smithi072:> curl http://smithi072.front.sepia.ceph.com:80/ 2024-04-26T12:49:59.413 INFO:teuthology.orchestra.run.smithi072.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:49:59.413 INFO:teuthology.orchestra.run.smithi072.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:49:59.413 INFO:teuthology.orchestra.run.smithi072.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:49:59.414 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:49:59.414 INFO:teuthology.orchestra.run.smithi072.stderr:curl: (7) Failed to connect to smithi072.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:50:03.415 DEBUG:teuthology.orchestra.run.smithi072:> curl http://smithi072.front.sepia.ceph.com:80/ 2024-04-26T12:50:03.427 INFO:teuthology.orchestra.run.smithi072.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:50:03.427 INFO:teuthology.orchestra.run.smithi072.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:50:03.427 INFO:teuthology.orchestra.run.smithi072.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:50:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:curl: (7) Failed to connect to smithi072.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:50:03.428 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:50:05.399 INFO:tasks.rgw.client.0.smithi072.stdout:2024-04-26T12:50:05.400+0000 7f75a31aba40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-26T12:50:11.430 DEBUG:teuthology.orchestra.run.smithi072:> curl http://smithi072.front.sepia.ceph.com:80/ 2024-04-26T12:50:11.442 INFO:teuthology.orchestra.run.smithi072.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:50:11.442 INFO:teuthology.orchestra.run.smithi072.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:50:11.445 INFO:teuthology.orchestra.run.smithi072.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 49275 0 --:--:-- --:--:-- --:--:-- 46750 2024-04-26T12:50:11.446 INFO:teuthology.orchestra.run.smithi072.stdout:anonymous 2024-04-26T12:50:11.447 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-26T12:50:11.534 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-26T12:50:11.534 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-26T12:50:11.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-26T12:50:11.535 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-26T12:50:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3fcf0980 1 Processor -- start 2024-04-26T12:50:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3fcf0980 1 -- start start 2024-04-26T12:50:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3fcf0980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568547f6860 0x5568547f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3fcf0980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568546a4510 con 0x5568547f7180 2024-04-26T12:50:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3fcf0980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5568546ab430 con 0x5568547f6860 2024-04-26T12:50:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3d80b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568547f6860 0x5568547f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3d80b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568547f6860 0x5568547f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48538/0 (socket says 172.21.15.72:48538) 2024-04-26T12:50:11.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2742271117 learned_addr learned my addr 172.21.15.72:0/2742271117 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2742271117 >> v1:172.21.15.29:6789/0 conn(0x5568547f7180 legacy=0x5568547f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.572+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2742271117 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556854680ae0 con 0x5568547f6860 2024-04-26T12:50:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/2742271117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568547f6c40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a7a0 tx=0x7f6e3001d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d710ce33c4eea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3c809640 1 -- 172.21.15.72:0/2742271117 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300b3070 con 0x5568547f6860 2024-04-26T12:50:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3c809640 1 -- 172.21.15.72:0/2742271117 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300a6720 con 0x5568547f6860 2024-04-26T12:50:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3c809640 1 -- 172.21.15.72:0/2742271117 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300a6a20 con 0x5568547f6860 2024-04-26T12:50:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2742271117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 msgr2=0x5568547f6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2742271117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568547f6c40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a7a0 tx=0x7f6e3001d800 comp rx=0 tx=0).stop 2024-04-26T12:50:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2742271117 shutdown_connections 2024-04-26T12:50:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2742271117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568547f6c40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2742271117 >> 172.21.15.72:0/2742271117 conn(0x5568547f11e0 msgr2=0x5568547f3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2742271117 shutdown_connections 2024-04-26T12:50:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.576+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2742271117 wait complete. 2024-04-26T12:50:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.592+0000 7f6e3fcf0980 1 Processor -- start 2024-04-26T12:50:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.592+0000 7f6e3fcf0980 1 -- start start 2024-04-26T12:50:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.592+0000 7f6e3fcf0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548e0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.592+0000 7f6e3fcf0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568546faa70 con 0x5568547f6860 2024-04-26T12:50:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.592+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548e0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.592+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548e0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48544/0 (socket says 172.21.15.72:48544) 2024-04-26T12:50:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.592+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2900961447 learned_addr learned my addr 172.21.15.72:0/2900961447 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2900961447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568548e11a0 con 0x5568547f6860 2024-04-26T12:50:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/2900961447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548e0bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001a410 tx=0x7f6e300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49275f4f4b284b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6d2be07640 1 -- 172.21.15.72:0/2900961447 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300b3070 con 0x5568547f6860 2024-04-26T12:50:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6d2be07640 1 -- 172.21.15.72:0/2900961447 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300b4040 con 0x5568547f6860 2024-04-26T12:50:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6d2be07640 1 -- 172.21.15.72:0/2900961447 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300a6c30 con 0x5568547f6860 2024-04-26T12:50:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2900961447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 msgr2=0x5568548e0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2900961447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548e0bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001a410 tx=0x7f6e300033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2900961447 shutdown_connections 2024-04-26T12:50:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2900961447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548e0bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2900961447 >> 172.21.15.72:0/2900961447 conn(0x5568547f11e0 msgr2=0x5568548dc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2900961447 shutdown_connections 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2900961447 wait complete. 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 Processor -- start 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- start start 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548ec050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568547f5ff0 con 0x5568547f6860 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548ec050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48550/0 (socket says 172.21.15.72:48550) 2024-04-26T12:50:11.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2748245603 learned_addr learned my addr 172.21.15.72:0/2748245603 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568548ec590 con 0x5568547f6860 2024-04-26T12:50:11.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548ec050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001beb0 tx=0x7f6e3001a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6d2a604640 1 -- 172.21.15.72:0/2748245603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300aed80 con 0x5568547f6860 2024-04-26T12:50:11.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6d2a604640 1 -- 172.21.15.72:0/2748245603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300c5070 con 0x5568547f6860 2024-04-26T12:50:11.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568548ec820 con 0x5568547f6860 2024-04-26T12:50:11.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6d2a604640 1 -- 172.21.15.72:0/2748245603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300c0550 con 0x5568547f6860 2024-04-26T12:50:11.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.596+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568548eccb0 con 0x5568547f6860 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6d2a604640 1 -- 172.21.15.72:0/2748245603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e300c0800 con 0x5568547f6860 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6d2a604640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d24034650 0x7f6d24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6d2a604640 1 -- 172.21.15.72:0/2748245603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f6e300bd070 con 0x5568547f6860 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d24034650 0x7f6d24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568547f7180 0x5568548f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568548f3590 con 0x5568547f7180 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3e00c640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568547f7180 0x5568548f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d24034650 0x7f6d24036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000f70 tx=0x7f6e34001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3e00c640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568547f7180 0x5568548f2f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3e00c640 1 -- 172.21.15.72:0/2748245603 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e380083f0 con 0x5568547f7180 2024-04-26T12:50:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568548f3e50 con 0x5568547f7180 2024-04-26T12:50:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3e00c640 1 -- 172.21.15.72:0/2748245603 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e380083f0 con 0x5568547f7180 2024-04-26T12:50:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568548f57a0 0x5568548f7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568548f83c0 con 0x5568548f57a0 2024-04-26T12:50:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.600+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568548f57a0 0x5568548f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568548f57a0 0x5568548f7c30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d80b640 1 -- 172.21.15.72:0/2748245603 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e300b6070 con 0x5568548f57a0 2024-04-26T12:50:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568548f46a0 con 0x5568547f7180 2024-04-26T12:50:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3e00c640 1 -- 172.21.15.72:0/2748245603 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e380083f0 con 0x5568547f7180 2024-04-26T12:50:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568548f9820 0x5568548fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568548fc350 con 0x5568548f9820 2024-04-26T12:50:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568548f9820 0x5568548fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568548f9820 0x5568548fbc10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d00a640 1 -- 172.21.15.72:0/2748245603 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e3400d040 con 0x5568548f9820 2024-04-26T12:50:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3fcf0980 1 Processor -- start 2024-04-26T12:50:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3fcf0980 1 -- start start 2024-04-26T12:50:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3fcf0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55685490a3c0 0x55685490a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3fcf0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568546feab0 con 0x55685490a3c0 2024-04-26T12:50:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55685490a3c0 0x55685490a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55685490a3c0 0x55685490a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48564/0 (socket says 172.21.15.72:48564) 2024-04-26T12:50:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.604+0000 7f6e3d80b640 1 -- 172.21.15.72:0/1749528590 learned_addr learned my addr 172.21.15.72:0/1749528590 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3d80b640 1 -- 172.21.15.72:0/1749528590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55685490ad20 con 0x55685490a3c0 2024-04-26T12:50:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55685490a3c0 0x55685490a7e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e300e2c10 tx=0x7f6e300ca460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6d237fe640 1 -- 172.21.15.72:0/1749528590 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300d70b0 con 0x55685490a3c0 2024-04-26T12:50:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6d237fe640 1 -- 172.21.15.72:0/1749528590 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300d7250 con 0x55685490a3c0 2024-04-26T12:50:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6d237fe640 1 -- 172.21.15.72:0/1749528590 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300bfc80 con 0x55685490a3c0 2024-04-26T12:50:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55685490b7c0 con 0x55685490a3c0 2024-04-26T12:50:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55685490bc90 con 0x55685490a3c0 2024-04-26T12:50:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6d237fe640 1 -- 172.21.15.72:0/1749528590 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e300eb060 con 0x55685490a3c0 2024-04-26T12:50:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6d237fe640 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d180346a0 0x7f6d18036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6d237fe640 1 -- 172.21.15.72:0/1749528590 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f6e300de070 con 0x55685490a3c0 2024-04-26T12:50:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d180346a0 0x7f6d18036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3fcf0980 1 Processor -- start 2024-04-26T12:50:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3fcf0980 1 -- start start 2024-04-26T12:50:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3fcf0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x556854917780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3fcf0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568548e1430 con 0x556854917380 2024-04-26T12:50:11.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d180346a0 0x7f6d18036b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5568548f0650 tx=0x7f6e34006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.608+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x556854917780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x556854917780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48568/0 (socket says 172.21.15.72:48568) 2024-04-26T12:50:11.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 -- 172.21.15.72:0/1734024451 learned_addr learned my addr 172.21.15.72:0/1734024451 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 -- 172.21.15.72:0/1734024451 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556854917d50 con 0x556854917380 2024-04-26T12:50:11.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/1734024451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x556854917780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c07d0 tx=0x7f6e30009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffffe257f0ce4e2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6d217fa640 1 -- 172.21.15.72:0/1734024451 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300fd070 con 0x556854917380 2024-04-26T12:50:11.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6d217fa640 1 -- 172.21.15.72:0/1734024451 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300c9af0 con 0x556854917380 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6d217fa640 1 -- 172.21.15.72:0/1734024451 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300c1030 con 0x556854917380 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1734024451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 msgr2=0x556854917780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/1734024451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x556854917780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c07d0 tx=0x7f6e30009680 comp rx=0 tx=0).stop 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1734024451 shutdown_connections 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/1734024451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x556854917780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1734024451 >> 172.21.15.72:0/1734024451 conn(0x5568549136c0 msgr2=0x556854911720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1734024451 shutdown_connections 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1734024451 wait complete. 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 Processor -- start 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- start start 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x55685491e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556854918430 con 0x556854917380 2024-04-26T12:50:11.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x55685491e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x55685491e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48578/0 (socket says 172.21.15.72:48578) 2024-04-26T12:50:11.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 learned_addr learned my addr 172.21.15.72:0/3083501739 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55685491ebf0 con 0x556854917380 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x55685491e6b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c07d0 tx=0x7f6e30009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6d0f7fe640 1 -- 172.21.15.72:0/3083501739 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e30106070 con 0x556854917380 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55685491ebf0 con 0x556854917380 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6d0f7fe640 1 -- 172.21.15.72:0/3083501739 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300edb10 con 0x556854917380 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.612+0000 7f6d0f7fe640 1 -- 172.21.15.72:0/3083501739 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300fd040 con 0x556854917380 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55685491ebf0 con 0x556854917380 2024-04-26T12:50:11.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6d0f7fe640 1 -- 172.21.15.72:0/3083501739 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e30109070 con 0x556854917380 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6d0f7fe640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d08034650 0x7f6d08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6d0f7fe640 1 -- 172.21.15.72:0/3083501739 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f6e3010cc90 con 0x556854917380 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d08034650 0x7f6d08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556854929770 0x55685492bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55685492c380 con 0x556854929770 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3e00c640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556854929770 0x55685492bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d08034650 0x7f6d08036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e34010fd0 tx=0x7f6e34011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3e00c640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556854929770 0x55685492bc30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 realm 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55685492c790 con 0x556854929770 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55685492d030 con 0x556854929770 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55685492e130 0x556854930520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.616+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556854930a60 con 0x55685492e130 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55685492e130 0x556854930520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d80b640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55685492e130 0x556854930520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3fcf0980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3fcf0980 20 searching for the correct realm 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568549329b0 0x556854934e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556854935540 con 0x5568549329b0 2024-04-26T12:50:11.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568549329b0 0x556854934e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568549329b0 0x556854934e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d00a640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6e3400f3d0 0x7f6e3400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556854935540 con 0x7f6e3400f3d0 2024-04-26T12:50:11.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3e00c640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6e3400f3d0 0x7f6e3400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3e00c640 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6e3400f3d0 0x7f6e3400f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.620+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.624+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e380083f0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.628+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.632+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e380083f0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568549312b0 con 0x556854929770 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568549312b0 con 0x556854929770 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e380083f0 con 0x556854929770 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568549312b0 con 0x5568549329b0 2024-04-26T12:50:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 zone default found 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 4 Realm: () 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 zonegroup default 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556854931b50 con 0x55685492e130 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.636+0000 7f6e3fcf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568549373a0 con 0x5568549329b0 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556854937740 con 0x5568549329b0 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 20 started sync module instance, tier type = 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854936840 con 0x7f6e3400f3d0 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e380083f0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93906583907648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854936840 con 0x7f6e3400f3d0 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568549381d0 con 0x556854929770 2024-04-26T12:50:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.640+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93906583907648] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93906583911616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854936840 con 0x556854929770 2024-04-26T12:50:11.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x5568549329b0 2024-04-26T12:50:11.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93906583914288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854939430 con 0x5568549329b0 2024-04-26T12:50:11.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854939e30 con 0x7f6e3400f3d0 2024-04-26T12:50:11.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93906583911616] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.644+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93906583905168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854939df0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685493a870 con 0x556854929770 2024-04-26T12:50:11.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93906583914288] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93906583905168] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93906583918912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854939090 con 0x556854929770 2024-04-26T12:50:11.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685493ad20 con 0x55685492e130 2024-04-26T12:50:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.648+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93906583918912] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.652+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.652+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93906583921600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854939090 con 0x55685492e130 2024-04-26T12:50:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.652+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685493b810 con 0x55685492e130 2024-04-26T12:50:11.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.652+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93906583921600] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93906583922656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685493ca20 con 0x55685492e130 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93906583930704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685493d1a0 con 0x55685492e130 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 20 add_watcher() i=0 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 20 add_watcher() i=1 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 20 add_watcher() i=2 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 20 add_watcher() i=3 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 20 add_watcher() i=4 2024-04-26T12:50:11.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.656+0000 7f6e3fcf0980 20 add_watcher() i=5 2024-04-26T12:50:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93906583922656] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 20 add_watcher() i=6 2024-04-26T12:50:11.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93906583930704] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 20 add_watcher() i=7 2024-04-26T12:50:11.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:11.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55685493bbb0 con 0x556854929770 2024-04-26T12:50:11.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93906583931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685493bbb0 con 0x556854929770 2024-04-26T12:50:11.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93906583931952] v33'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6cef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:11.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:11.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:11.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.660+0000 7f6e3fcf0980 5 note: GC not initialized 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6cee7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3fcf0980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3fcf0980 20 Filter name: none 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6c5ffff640 20 reqs_thread_entry: start 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556854962fb0 con 0x5568549329b0 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x5568549329b0 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x556854929770 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.664+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x556854929770 2024-04-26T12:50:11.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x55685492e130 2024-04-26T12:50:11.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x5568549329b0 2024-04-26T12:50:11.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.668+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x5568549329b0 2024-04-26T12:50:11.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x7f6e3400f3d0 2024-04-26T12:50:11.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(80 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x556854929770 2024-04-26T12:50:11.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x556854929770 2024-04-26T12:50:11.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x5568549329b0 2024-04-26T12:50:11.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x7f6e3400f3d0 2024-04-26T12:50:11.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x556854929770 2024-04-26T12:50:11.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x5568549329b0 2024-04-26T12:50:11.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.672+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x7f6e3400f3d0 2024-04-26T12:50:11.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x55685492e130 2024-04-26T12:50:11.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x556854929770 2024-04-26T12:50:11.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x5568549329b0 2024-04-26T12:50:11.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55685493c060 con 0x7f6e3400f3d0 2024-04-26T12:50:11.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6cef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:11.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.676+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93906583931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x556854929770 2024-04-26T12:50:11.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.680+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93906583931952] v33'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.680+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93906583907648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.680+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93906583907648] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.680+0000 7f6e3fcf0980 20 remove_watcher() i=0 2024-04-26T12:50:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.680+0000 7f6e3fcf0980 2 removed watcher, disabling cache 2024-04-26T12:50:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.680+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93906583911616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x556854929770 2024-04-26T12:50:11.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.680+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93906583911616] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3fcf0980 20 remove_watcher() i=1 2024-04-26T12:50:11.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93906583914288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55685492d3d0 con 0x5568549329b0 2024-04-26T12:50:11.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3d00a640 1 -- 172.21.15.72:0/3083501739 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93906583914288] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34036040 con 0x5568549329b0 2024-04-26T12:50:11.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3fcf0980 20 remove_watcher() i=2 2024-04-26T12:50:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93906583905168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x7f6e3400f3d0 2024-04-26T12:50:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93906583905168] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x7f6e3400f3d0 2024-04-26T12:50:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3fcf0980 20 remove_watcher() i=3 2024-04-26T12:50:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.684+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93906583918912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x556854929770 2024-04-26T12:50:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.688+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93906583918912] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e38035040 con 0x556854929770 2024-04-26T12:50:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.688+0000 7f6e3fcf0980 20 remove_watcher() i=4 2024-04-26T12:50:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.688+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93906583921600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854938be0 con 0x55685492e130 2024-04-26T12:50:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.688+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93906583921600] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.688+0000 7f6e3fcf0980 20 remove_watcher() i=5 2024-04-26T12:50:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.688+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93906583922656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854937cc0 con 0x55685492e130 2024-04-26T12:50:11.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93906583922656] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 20 remove_watcher() i=6 2024-04-26T12:50:11.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93906583930704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556854939940 con 0x55685492e130 2024-04-26T12:50:11.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3d80b640 1 -- 172.21.15.72:0/3083501739 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93906583930704] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e30112070 con 0x55685492e130 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 20 remove_watcher() i=7 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55685492e130 msgr2=0x556854930520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55685492e130 0x556854930520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556854929770 msgr2=0x55685492bc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556854929770 0x55685492bc30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6e3400f3d0 msgr2=0x7f6e3400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6e3400f3d0 0x7f6e3400f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568549329b0 msgr2=0x556854934e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568549329b0 0x556854934e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d08034650 msgr2=0x7f6d08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d08034650 0x7f6d08036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e34010fd0 tx=0x7f6e34011000 comp rx=0 tx=0).stop 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 msgr2=0x55685491e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/3083501739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556854917380 0x55685491e6b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6e300c07d0 tx=0x7f6e30009730 comp rx=0 tx=0).stop 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 reap_dead start 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3e00c640 1 -- 172.21.15.72:0/3083501739 reap_dead start 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 shutdown_connections 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 >> 172.21.15.72:0/3083501739 conn(0x5568549136c0 msgr2=0x556854910d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 shutdown_connections 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.692+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/3083501739 wait complete. 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d180346a0 msgr2=0x7f6d18036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d180346a0 0x7f6d18036b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5568548f0650 tx=0x7f6e34006000 comp rx=0 tx=0).stop 2024-04-26T12:50:11.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55685490a3c0 msgr2=0x55685490a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55685490a3c0 0x55685490a7e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e300e2c10 tx=0x7f6e300ca460 comp rx=0 tx=0).stop 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 shutdown_connections 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d180346a0 0x7f6d18036b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/1749528590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55685490a3c0 0x55685490a7e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 >> 172.21.15.72:0/1749528590 conn(0x5568548ff1d0 msgr2=0x5568548ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 shutdown_connections 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/1749528590 wait complete. 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568548f57a0 msgr2=0x5568548f7c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568548f57a0 0x5568548f7c30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568547f7180 msgr2=0x5568548f2f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568547f7180 0x5568548f2f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568548f9820 msgr2=0x5568548fbc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568548f9820 0x5568548fbc10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d24034650 msgr2=0x7f6d24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6d24034650 0x7f6d24036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000f70 tx=0x7f6e34001420 comp rx=0 tx=0).stop 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 msgr2=0x5568548ec050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 --2- 172.21.15.72:0/2748245603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568547f6860 0x5568548ec050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001beb0 tx=0x7f6e3001a5a0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3e00c640 1 -- 172.21.15.72:0/2748245603 reap_dead start 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 shutdown_connections 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 >> 172.21.15.72:0/2748245603 conn(0x5568547f11e0 msgr2=0x5568548db270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 shutdown_connections 2024-04-26T12:50:11.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.696+0000 7f6e3fcf0980 1 -- 172.21.15.72:0/2748245603 wait complete. 2024-04-26T12:50:11.705 INFO:teuthology.orchestra.run.smithi072.stdout:[] 2024-04-26T12:50:11.706 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:50:11.706 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-26T12:50:11.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-26T12:50:11.706 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-26T12:50:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f0920e980 1 Processor -- start 2024-04-26T12:50:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f0920e980 1 -- start start 2024-04-26T12:50:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f0920e980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f126656700 0x55f126658af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f0920e980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f126500510 con 0x55f1266521a0 2024-04-26T12:50:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f0920e980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f126507430 con 0x55f126656700 2024-04-26T12:50:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f06528640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f126656700 0x55f126658af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f06d29640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f1266521a0 0x55f126652580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35838/0 (socket says 172.21.15.72:35838) 2024-04-26T12:50:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f06528640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f126656700 0x55f126658af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48594/0 (socket says 172.21.15.72:48594) 2024-04-26T12:50:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f06d29640 1 -- 172.21.15.72:0/1339263773 learned_addr learned my addr 172.21.15.72:0/1339263773 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f06528640 1 -- 172.21.15.72:0/1339263773 >> v1:172.21.15.29:6789/0 conn(0x55f1266521a0 legacy=0x55f126652580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.784+0000 7f7f06528640 1 -- 172.21.15.72:0/1339263773 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1264dcae0 con 0x55f126656700 2024-04-26T12:50:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f06528640 1 --2- 172.21.15.72:0/1339263773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f126658af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00a480 tx=0x7f7efc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df3d9ea71016441 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f05d27640 1 -- 172.21.15.72:0/1339263773 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7efc0b0070 con 0x55f126656700 2024-04-26T12:50:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f05d27640 1 -- 172.21.15.72:0/1339263773 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc0ab540 con 0x55f126656700 2024-04-26T12:50:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f05d27640 1 -- 172.21.15.72:0/1339263773 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7efc0ab840 con 0x55f126656700 2024-04-26T12:50:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f0920e980 1 -- 172.21.15.72:0/1339263773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 msgr2=0x55f126658af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1339263773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f126658af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00a480 tx=0x7f7efc01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:11.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f0920e980 1 -- 172.21.15.72:0/1339263773 shutdown_connections 2024-04-26T12:50:11.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1339263773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f126658af0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f0920e980 1 -- 172.21.15.72:0/1339263773 >> 172.21.15.72:0/1339263773 conn(0x55f12664da70 msgr2=0x55f12664fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f0920e980 1 -- 172.21.15.72:0/1339263773 shutdown_connections 2024-04-26T12:50:11.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.788+0000 7f7f0920e980 1 -- 172.21.15.72:0/1339263773 wait complete. 2024-04-26T12:50:11.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f0920e980 1 Processor -- start 2024-04-26T12:50:11.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f0920e980 1 -- start start 2024-04-26T12:50:11.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f0920e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1266521a0 0x55f12673d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f0920e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f126556a70 con 0x55f1266521a0 2024-04-26T12:50:11.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1266521a0 0x55f12673d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1266521a0 0x55f12673d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48600/0 (socket says 172.21.15.72:48600) 2024-04-26T12:50:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f06d29640 1 -- 172.21.15.72:0/934122912 learned_addr learned my addr 172.21.15.72:0/934122912 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f06d29640 1 -- 172.21.15.72:0/934122912 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f12673d920 con 0x55f1266521a0 2024-04-26T12:50:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7f06d29640 1 --2- 172.21.15.72:0/934122912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1266521a0 0x55f12673d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8001d90 tx=0x7f7ef8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5874d5595af3d9b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7df4e09640 1 -- 172.21.15.72:0/934122912 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8013030 con 0x55f1266521a0 2024-04-26T12:50:11.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7df4e09640 1 -- 172.21.15.72:0/934122912 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef800e690 con 0x55f1266521a0 2024-04-26T12:50:11.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.804+0000 7f7df4e09640 1 -- 172.21.15.72:0/934122912 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef800ea10 con 0x55f1266521a0 2024-04-26T12:50:11.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- 172.21.15.72:0/934122912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1266521a0 msgr2=0x55f12673d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 --2- 172.21.15.72:0/934122912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1266521a0 0x55f12673d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8001d90 tx=0x7f7ef8001e80 comp rx=0 tx=0).stop 2024-04-26T12:50:11.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- 172.21.15.72:0/934122912 shutdown_connections 2024-04-26T12:50:11.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 --2- 172.21.15.72:0/934122912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1266521a0 0x55f12673d350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- 172.21.15.72:0/934122912 >> 172.21.15.72:0/934122912 conn(0x55f12664da70 msgr2=0x55f126738ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- 172.21.15.72:0/934122912 shutdown_connections 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- 172.21.15.72:0/934122912 wait complete. 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 Processor -- start 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- start start 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f1267458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f12665bb20 con 0x55f126656700 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f1267458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f1267458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48612/0 (socket says 172.21.15.72:48612) 2024-04-26T12:50:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f06d29640 1 -- 172.21.15.72:0/2916048162 learned_addr learned my addr 172.21.15.72:0/2916048162 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f06d29640 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f126745e20 con 0x55f126656700 2024-04-26T12:50:11.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f06d29640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f1267458e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8004000 tx=0x7f7ef8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7df3606640 1 -- 172.21.15.72:0/2916048162 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8027070 con 0x55f126656700 2024-04-26T12:50:11.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1267460b0 con 0x55f126656700 2024-04-26T12:50:11.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7df3606640 1 -- 172.21.15.72:0/2916048162 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef8019890 con 0x55f126656700 2024-04-26T12:50:11.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7df3606640 1 -- 172.21.15.72:0/2916048162 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8019bb0 con 0x55f126656700 2024-04-26T12:50:11.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.808+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f126748d30 con 0x55f126656700 2024-04-26T12:50:11.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7df3606640 1 -- 172.21.15.72:0/2916048162 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ef802a070 con 0x55f126656700 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7df3606640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dec034650 0x7f7dec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7df3606640 1 -- 172.21.15.72:0/2916048162 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f7ef801f070 con 0x55f126656700 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f06528640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dec034650 0x7f7dec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f12674a800 0x55f12674cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12674d210 con 0x55f12674a800 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0752a640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f12674a800 0x55f12674cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f06528640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dec034650 0x7f7dec036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ad000 tx=0x7f7efc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0752a640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f12674a800 0x55f12674cbf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0752a640 1 -- 172.21.15.72:0/2916048162 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f12674a800 2024-04-26T12:50:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f126749f50 con 0x55f12674a800 2024-04-26T12:50:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0752a640 1 -- 172.21.15.72:0/2916048162 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f12674a800 2024-04-26T12:50:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12674f560 0x55f126751950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f126752040 con 0x55f12674f560 2024-04-26T12:50:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f06d29640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12674f560 0x55f126751950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f06d29640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12674f560 0x55f126751950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.812+0000 7f7f06d29640 1 -- 172.21.15.72:0/2916048162 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ef8029030 con 0x55f12674f560 2024-04-26T12:50:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12674e400 con 0x55f12674a800 2024-04-26T12:50:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0752a640 1 -- 172.21.15.72:0/2916048162 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f12674a800 2024-04-26T12:50:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f1267534a0 0x55f126755890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f126755fd0 con 0x55f1267534a0 2024-04-26T12:50:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06528640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f1267534a0 0x55f126755890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06528640 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f1267534a0 0x55f126755890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06528640 1 -- 172.21.15.72:0/2916048162 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7efc0b3040 con 0x55f1267534a0 2024-04-26T12:50:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 Processor -- start 2024-04-26T12:50:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 -- start start 2024-04-26T12:50:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126764030 0x55f126764450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f12655aab0 con 0x55f126764030 2024-04-26T12:50:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126764030 0x55f126764450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126764030 0x55f126764450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48620/0 (socket says 172.21.15.72:48620) 2024-04-26T12:50:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06d29640 1 -- 172.21.15.72:0/3067017304 learned_addr learned my addr 172.21.15.72:0/3067017304 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06d29640 1 -- 172.21.15.72:0/3067017304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f126764990 con 0x55f126764030 2024-04-26T12:50:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f06d29640 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126764030 0x55f126764450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8048360 tx=0x7f7ef800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7df0e01640 1 -- 172.21.15.72:0/3067017304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8016570 con 0x55f126764030 2024-04-26T12:50:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7df0e01640 1 -- 172.21.15.72:0/3067017304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef8016710 con 0x55f126764030 2024-04-26T12:50:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f126765430 con 0x55f126764030 2024-04-26T12:50:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7df0e01640 1 -- 172.21.15.72:0/3067017304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef80486e0 con 0x55f126764030 2024-04-26T12:50:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.816+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f126765900 con 0x55f126764030 2024-04-26T12:50:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7df0e01640 1 -- 172.21.15.72:0/3067017304 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ef8016070 con 0x55f126764030 2024-04-26T12:50:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7df0e01640 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7de0034650 0x7f7de0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7df0e01640 1 -- 172.21.15.72:0/3067017304 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f7ef8014070 con 0x55f126764030 2024-04-26T12:50:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f06528640 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7de0034650 0x7f7de0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 Processor -- start 2024-04-26T12:50:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 -- start start 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f06528640 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7de0034650 0x7f7de0036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ae040 tx=0x7f7efc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12673bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f12673dc70 con 0x55f12673b7c0 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12673bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12673bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48628/0 (socket says 172.21.15.72:48628) 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f06d29640 1 -- 172.21.15.72:0/1407571436 learned_addr learned my addr 172.21.15.72:0/1407571436 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f06d29640 1 -- 172.21.15.72:0/1407571436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f12673a010 con 0x55f12673b7c0 2024-04-26T12:50:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f06d29640 1 --2- 172.21.15.72:0/1407571436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12673bbe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8031010 tx=0x7f7ef8022ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aeb9883b759fdb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7dea7fc640 1 -- 172.21.15.72:0/1407571436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8058040 con 0x55f12673b7c0 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7dea7fc640 1 -- 172.21.15.72:0/1407571436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef80385f0 con 0x55f12673b7c0 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7dea7fc640 1 -- 172.21.15.72:0/1407571436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef802add0 con 0x55f12673b7c0 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 -- 172.21.15.72:0/1407571436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 msgr2=0x55f12673bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1407571436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12673bbe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8031010 tx=0x7f7ef8022ca0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 -- 172.21.15.72:0/1407571436 shutdown_connections 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1407571436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12673bbe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 -- 172.21.15.72:0/1407571436 >> 172.21.15.72:0/1407571436 conn(0x55f12676d3a0 msgr2=0x55f12676b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 -- 172.21.15.72:0/1407571436 shutdown_connections 2024-04-26T12:50:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.820+0000 7f7f0920e980 1 -- 172.21.15.72:0/1407571436 wait complete. 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 Processor -- start 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 -- start start 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12677a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f12673a3c0 con 0x55f12673b7c0 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12677a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f06d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12677a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48642/0 (socket says 172.21.15.72:48642) 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 learned_addr learned my addr 172.21.15.72:0/1932939187 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f12677aa80 con 0x55f12673b7c0 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f06d29640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12677a540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8047180 tx=0x7f7ef803ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7de8ff9640 1 -- 172.21.15.72:0/1932939187 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8021370 con 0x55f12673b7c0 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7de8ff9640 1 -- 172.21.15.72:0/1932939187 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef8046dc0 con 0x55f12673b7c0 2024-04-26T12:50:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f12677aa80 con 0x55f12673b7c0 2024-04-26T12:50:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7de8ff9640 1 -- 172.21.15.72:0/1932939187 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8048a60 con 0x55f12673b7c0 2024-04-26T12:50:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f12677aa80 con 0x55f12673b7c0 2024-04-26T12:50:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7de8ff9640 1 -- 172.21.15.72:0/1932939187 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ef8009070 con 0x55f12673b7c0 2024-04-26T12:50:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7de8ff9640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dd0034650 0x7f7dd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7de8ff9640 1 -- 172.21.15.72:0/1932939187 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f7ef8005050 con 0x55f12673b7c0 2024-04-26T12:50:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f06528640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dd0034650 0x7f7dd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f126785610 0x55f126787ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f126788220 con 0x55f126785610 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.824+0000 7f7f0752a640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f126785610 0x55f126787ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f06528640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dd0034650 0x7f7dd0036b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f1267563d0 tx=0x7f7efc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0752a640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f126785610 0x55f126787ad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 realm 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f126788630 con 0x55f126785610 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f126788f00 con 0x55f126785610 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12678a000 0x55f12678c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12678c9c0 con 0x55f12678a000 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f06d29640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12678a000 0x55f12678c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f06d29640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12678a000 0x55f12678c3f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 20 searching for the correct realm 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f12678e910 0x55f126790d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f126791410 con 0x55f12678e910 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f06528640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f12678e910 0x55f126790d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.828+0000 7f7f06528640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f12678e910 0x55f126790d40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06528640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7efc0ab030 0x7f7efc0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f126791410 con 0x7f7efc0ab030 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7efc0ab030 0x7f7efc0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:11.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7efc0ab030 0x7f7efc0d1400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x7f7efc0ab030 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.832+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x7f7efc0ab030 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.836+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x7f7efc0ab030 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x7f7efc0ab030 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.840+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678e910 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f12678a000 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x55f126785610 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1267892a0 con 0x7f7efc0ab030 2024-04-26T12:50:11.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12678d280 con 0x55f126785610 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12678d280 con 0x55f126785610 2024-04-26T12:50:11.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12678d280 con 0x55f12678e910 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 zone default found 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 4 Realm: () 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 zonegroup default 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12678dc50 con 0x55f12678a000 2024-04-26T12:50:11.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12678d7f0 con 0x55f12678e910 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1267937c0 con 0x55f12678e910 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 started sync module instance, tier type = 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:11.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.844+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126792bb0 con 0x7f7efc0ab030 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.848+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.848+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94494220955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126792bb0 con 0x7f7efc0ab030 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.848+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126794280 con 0x55f126785610 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.848+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94494220955824] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.848+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.848+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94494220959088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126792bb0 con 0x55f126785610 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.848+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126794c90 con 0x55f12678e910 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94494220959088] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94494220953344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126792b20 con 0x55f12678e910 2024-04-26T12:50:11.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267959f0 con 0x7f7efc0ab030 2024-04-26T12:50:11.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94494220965088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126796290 con 0x7f7efc0ab030 2024-04-26T12:50:11.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126796c90 con 0x55f126785610 2024-04-26T12:50:11.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.852+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94494220953344] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94494220965088] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94494220963888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126795d60 con 0x55f126785610 2024-04-26T12:50:11.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126797530 con 0x55f12678a000 2024-04-26T12:50:11.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94494220963888] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94494220972160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126795d60 con 0x55f12678a000 2024-04-26T12:50:11.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.856+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126797d80 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94494220972160] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94494220974768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126798520 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267967e0 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94494220974768] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94494220969952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126798b10 con 0x55f12678a000 2024-04-26T12:50:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 20 add_watcher() i=0 2024-04-26T12:50:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 20 add_watcher() i=1 2024-04-26T12:50:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 20 add_watcher() i=2 2024-04-26T12:50:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 20 add_watcher() i=3 2024-04-26T12:50:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 20 add_watcher() i=4 2024-04-26T12:50:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 20 add_watcher() i=5 2024-04-26T12:50:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.860+0000 7f7f0920e980 20 add_watcher() i=6 2024-04-26T12:50:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94494220969952] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0920e980 20 add_watcher() i=7 2024-04-26T12:50:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0920e980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f12679bf40 con 0x55f126785610 2024-04-26T12:50:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94494220976016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126799460 con 0x55f126785610 2024-04-26T12:50:11.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94494220976016] v33'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:11.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0920e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:11.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0920e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:11.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.864+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f12679bd30 con 0x55f126785610 2024-04-26T12:50:11.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.868+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.868+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4ff0 con 0x55f12678a000 2024-04-26T12:50:11.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.868+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.868+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4ff0 con 0x55f12678e910 2024-04-26T12:50:11.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.872+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.872+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a5560 con 0x55f126785610 2024-04-26T12:50:11.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.872+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.872+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a5940 con 0x7f7efc0ab030 2024-04-26T12:50:11.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.872+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.872+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a5eb0 con 0x55f12678e910 2024-04-26T12:50:11.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.876+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.876+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a6420 con 0x55f126785610 2024-04-26T12:50:11.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.876+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.876+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a68d0 con 0x55f12678a000 2024-04-26T12:50:11.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.880+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.880+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a68d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.880+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.880+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a68d0 con 0x55f12678e910 2024-04-26T12:50:11.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.880+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.884+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a46f0 con 0x7f7efc0ab030 2024-04-26T12:50:11.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.884+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.884+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a46f0 con 0x55f12678a000 2024-04-26T12:50:11.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.884+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.884+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x7f7efc0ab030 2024-04-26T12:50:11.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.888+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.888+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a3f80 con 0x55f12678a000 2024-04-26T12:50:11.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.888+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.888+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a3f80 con 0x55f126785610 2024-04-26T12:50:11.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.888+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.888+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678e910 2024-04-26T12:50:11.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.892+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.892+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a3f80 con 0x7f7efc0ab030 2024-04-26T12:50:11.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.892+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.892+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a3f80 con 0x55f12678e910 2024-04-26T12:50:11.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.896+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.896+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4030 con 0x55f126785610 2024-04-26T12:50:11.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.896+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.896+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4030 con 0x55f126785610 2024-04-26T12:50:11.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.896+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.896+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4030 con 0x55f12678e910 2024-04-26T12:50:11.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.900+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.900+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x7f7efc0ab030 2024-04-26T12:50:11.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.900+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.900+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678e910 2024-04-26T12:50:11.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.904+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.904+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678e910 2024-04-26T12:50:11.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.904+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.904+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678e910 2024-04-26T12:50:11.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.904+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.904+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678e910 2024-04-26T12:50:11.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.908+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'14 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.908+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678a000 2024-04-26T12:50:11.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.912+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.912+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678e910 2024-04-26T12:50:11.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.912+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.912+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678a000 2024-04-26T12:50:11.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.916+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.916+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678e910 2024-04-26T12:50:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.916+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.916+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x55f12678a000 2024-04-26T12:50:11.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.920+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.920+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a4690 con 0x7f7efc0ab030 2024-04-26T12:50:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.920+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.920+0000 7f7d37fff640 20 reqs_thread_entry: start 2024-04-26T12:50:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.920+0000 7f7f0920e980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 20 Filter name: none 2024-04-26T12:50:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7d35ffb640 20 reqs_thread_entry: start 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 20 rados->read ofs=0 len=0 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a3b80 con 0x7f7efc0ab030 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:50:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:50:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94494220976016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267a3580 con 0x55f126785610 2024-04-26T12:50:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94494220976016] v33'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.924+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94494220955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126797f90 con 0x7f7efc0ab030 2024-04-26T12:50:11.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.928+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94494220955824] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.928+0000 7f7f0920e980 20 remove_watcher() i=0 2024-04-26T12:50:11.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.928+0000 7f7f0920e980 2 removed watcher, disabling cache 2024-04-26T12:50:11.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.928+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94494220959088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267930b0 con 0x55f126785610 2024-04-26T12:50:11.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.928+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94494220959088] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.928+0000 7f7f0920e980 20 remove_watcher() i=1 2024-04-26T12:50:11.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.928+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94494220953344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267930b0 con 0x55f12678e910 2024-04-26T12:50:11.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f06528640 1 -- 172.21.15.72:0/1932939187 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94494220953344] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7efc0d8040 con 0x55f12678e910 2024-04-26T12:50:11.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0920e980 20 remove_watcher() i=2 2024-04-26T12:50:11.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94494220965088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126792700 con 0x7f7efc0ab030 2024-04-26T12:50:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94494220965088] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x7f7efc0ab030 2024-04-26T12:50:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0920e980 20 remove_watcher() i=3 2024-04-26T12:50:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94494220963888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267930b0 con 0x55f126785610 2024-04-26T12:50:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94494220963888] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f0000a4d0 con 0x55f126785610 2024-04-26T12:50:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0920e980 20 remove_watcher() i=4 2024-04-26T12:50:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.932+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94494220972160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1267954e0 con 0x55f12678a000 2024-04-26T12:50:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.936+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94494220972160] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.936+0000 7f7f0920e980 20 remove_watcher() i=5 2024-04-26T12:50:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.936+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94494220974768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126792700 con 0x55f12678a000 2024-04-26T12:50:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.936+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94494220974768] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.936+0000 7f7f0920e980 20 remove_watcher() i=6 2024-04-26T12:50:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.936+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94494220969952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f126795030 con 0x55f12678a000 2024-04-26T12:50:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f06d29640 1 -- 172.21.15.72:0/1932939187 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94494220969952] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef803e070 con 0x55f12678a000 2024-04-26T12:50:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 20 remove_watcher() i=7 2024-04-26T12:50:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12678a000 msgr2=0x55f12678c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12678a000 0x55f12678c3f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f126785610 msgr2=0x55f126787ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f126785610 0x55f126787ad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7efc0ab030 msgr2=0x7f7efc0d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7efc0ab030 0x7f7efc0d1400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f12678e910 msgr2=0x55f126790d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f12678e910 0x55f126790d40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dd0034650 msgr2=0x7f7dd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dd0034650 0x7f7dd0036b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f1267563d0 tx=0x7f7efc0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 msgr2=0x55f12677a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0752a640 1 -- 172.21.15.72:0/1932939187 reap_dead start 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12677a540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8047180 tx=0x7f7ef803ffb0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 shutdown_connections 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/1932939187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f12673b7c0 0x55f12677a540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 >> 172.21.15.72:0/1932939187 conn(0x55f12676d3a0 msgr2=0x55f12676aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 shutdown_connections 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/1932939187 wait complete. 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7de0034650 msgr2=0x7f7de0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7de0034650 0x7f7de0036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ae040 tx=0x7f7efc005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126764030 msgr2=0x55f126764450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126764030 0x55f126764450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8048360 tx=0x7f7ef800df80 comp rx=0 tx=0).stop 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 shutdown_connections 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7de0034650 0x7f7de0036b10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/3067017304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126764030 0x55f126764450 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 >> 172.21.15.72:0/3067017304 conn(0x55f126758e40 msgr2=0x55f126759950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 shutdown_connections 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/3067017304 wait complete. 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12674f560 msgr2=0x55f126751950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f12674f560 0x55f126751950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f12674a800 msgr2=0x55f12674cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f12674a800 0x55f12674cbf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f1267534a0 msgr2=0x55f126755890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f1267534a0 0x55f126755890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dec034650 msgr2=0x7f7dec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7dec034650 0x7f7dec036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ad000 tx=0x7f7efc0a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 msgr2=0x55f1267458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 --2- 172.21.15.72:0/2916048162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f126656700 0x55f1267458e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8004000 tx=0x7f7ef8000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0752a640 1 -- 172.21.15.72:0/2916048162 reap_dead start 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 shutdown_connections 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.940+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 >> 172.21.15.72:0/2916048162 conn(0x55f12664da70 msgr2=0x55f12673c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.944+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 shutdown_connections 2024-04-26T12:50:11.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:11.944+0000 7f7f0920e980 1 -- 172.21.15.72:0/2916048162 wait complete. 2024-04-26T12:50:11.953 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:50:11.953 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-26T12:50:11.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-26T12:50:11.954 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-26T12:50:12.032 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:12.032 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.032+0000 7fe8f5fef980 1 Processor -- start 2024-04-26T12:50:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.032+0000 7fe8f5fef980 1 -- start start 2024-04-26T12:50:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.032+0000 7fe8f5fef980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56047bd84700 0x56047bd86af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.032+0000 7fe8f5fef980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56047bc2e510 con 0x56047bd801a0 2024-04-26T12:50:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.032+0000 7fe8f5fef980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56047bc35430 con 0x56047bd84700 2024-04-26T12:50:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f3309640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56047bd84700 0x56047bd86af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f3309640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56047bd84700 0x56047bd86af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48658/0 (socket says 172.21.15.72:48658) 2024-04-26T12:50:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f3b0a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56047bd801a0 0x56047bd80580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35842/0 (socket says 172.21.15.72:35842) 2024-04-26T12:50:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f3309640 1 -- 172.21.15.72:0/3883868345 learned_addr learned my addr 172.21.15.72:0/3883868345 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f3309640 1 -- 172.21.15.72:0/3883868345 >> v1:172.21.15.29:6789/0 conn(0x56047bd801a0 legacy=0x56047bd80580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f3309640 1 -- 172.21.15.72:0/3883868345 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047bc0aae0 con 0x56047bd84700 2024-04-26T12:50:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3883868345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd84700 0x56047bd86af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800a5c0 tx=0x7fe8e801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7061e57c14bc855d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f2b08640 1 -- 172.21.15.72:0/3883868345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e80a6070 con 0x56047bd84700 2024-04-26T12:50:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f2b08640 1 -- 172.21.15.72:0/3883868345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e80af070 con 0x56047bd84700 2024-04-26T12:50:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.036+0000 7fe8f2b08640 1 -- 172.21.15.72:0/3883868345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e80aa5c0 con 0x56047bd84700 2024-04-26T12:50:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.040+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3883868345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd84700 msgr2=0x56047bd86af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.040+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3883868345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd84700 0x56047bd86af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800a5c0 tx=0x7fe8e801b340 comp rx=0 tx=0).stop 2024-04-26T12:50:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.040+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3883868345 shutdown_connections 2024-04-26T12:50:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.040+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3883868345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd84700 0x56047bd86af0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.040+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3883868345 >> 172.21.15.72:0/3883868345 conn(0x56047bd7ba70 msgr2=0x56047bd7de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.040+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3883868345 shutdown_connections 2024-04-26T12:50:12.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.040+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3883868345 wait complete. 2024-04-26T12:50:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 Processor -- start 2024-04-26T12:50:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- start start 2024-04-26T12:50:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be6b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56047bc84a70 con 0x56047bd801a0 2024-04-26T12:50:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be6b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be6b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48672/0 (socket says 172.21.15.72:48672) 2024-04-26T12:50:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/526169810 learned_addr learned my addr 172.21.15.72:0/526169810 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/526169810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047be6b920 con 0x56047bd801a0 2024-04-26T12:50:12.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/526169810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be6b350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0015f0 tx=0x7fe8ec001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1962d008ea7054 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe7e1e0b640 1 -- 172.21.15.72:0/526169810 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec013420 con 0x56047bd801a0 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe7e1e0b640 1 -- 172.21.15.72:0/526169810 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0135e0 con 0x56047bd801a0 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe7e1e0b640 1 -- 172.21.15.72:0/526169810 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec013940 con 0x56047bd801a0 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- 172.21.15.72:0/526169810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 msgr2=0x56047be6b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/526169810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be6b350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0015f0 tx=0x7fe8ec001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- 172.21.15.72:0/526169810 shutdown_connections 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/526169810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be6b350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- 172.21.15.72:0/526169810 >> 172.21.15.72:0/526169810 conn(0x56047bd7ba70 msgr2=0x56047be66ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- 172.21.15.72:0/526169810 shutdown_connections 2024-04-26T12:50:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- 172.21.15.72:0/526169810 wait complete. 2024-04-26T12:50:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 Processor -- start 2024-04-26T12:50:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- start start 2024-04-26T12:50:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be725e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.056+0000 7fe8f5fef980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56047bd89b20 con 0x56047bd801a0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be725e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48684/0 (socket says 172.21.15.72:48684) 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/506537516 learned_addr learned my addr 172.21.15.72:0/506537516 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047be72b20 con 0x56047bd801a0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be725e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x56047be6c1e0 tx=0x7fe8ec000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe7dbfff640 1 -- 172.21.15.72:0/506537516 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec006320 con 0x56047bd801a0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe7dbfff640 1 -- 172.21.15.72:0/506537516 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0048b0 con 0x56047bd801a0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56047be72db0 con 0x56047bd801a0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe7dbfff640 1 -- 172.21.15.72:0/506537516 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec004bd0 con 0x56047bd801a0 2024-04-26T12:50:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047bcf43e0 con 0x56047bd801a0 2024-04-26T12:50:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe7dbfff640 1 -- 172.21.15.72:0/506537516 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8ec010070 con 0x56047bd801a0 2024-04-26T12:50:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe7dbfff640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7dc0346f0 0x7fe7dc036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe7dbfff640 1 -- 172.21.15.72:0/506537516 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe8ec021070 con 0x56047bd801a0 2024-04-26T12:50:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f3309640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7dc0346f0 0x7fe7dc036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047bd84700 0x56047be78940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bcf50c0 con 0x56047bd84700 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f430b640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047bd84700 0x56047be78940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f3309640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7dc0346f0 0x7fe7dc036bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80ae000 tx=0x7fe8e80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f430b640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047bd84700 0x56047be78940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f430b640 1 -- 172.21.15.72:0/506537516 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047bd84700 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.060+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bcf4750 con 0x56047bd84700 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f430b640 1 -- 172.21.15.72:0/506537516 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047bd84700 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047be7add0 0x56047be7d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047be7d8b0 con 0x56047be7add0 2024-04-26T12:50:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047be7add0 0x56047be7d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047be7add0 0x56047be7d1c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/506537516 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe8ec02b020 con 0x56047be7add0 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047be79c40 con 0x56047bd84700 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f430b640 1 -- 172.21.15.72:0/506537516 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047bd84700 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047be7ed10 0x56047be81100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047be81800 con 0x56047be7ed10 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f3309640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047be7ed10 0x56047be81100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f3309640 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047be7ed10 0x56047be81100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f3309640 1 -- 172.21.15.72:0/506537516 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047be7ed10 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f5fef980 1 Processor -- start 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.064+0000 7fe8f5fef980 1 -- start start 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f5fef980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047be8f850 0x56047be8fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f5fef980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56047bc88ab0 con 0x56047be8f850 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047be8f850 0x56047be8fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047be8f850 0x56047be8fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48688/0 (socket says 172.21.15.72:48688) 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3012011800 learned_addr learned my addr 172.21.15.72:0/3012011800 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3012011800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047be901b0 con 0x56047be8f850 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047be8f850 0x56047be8fc70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec04a1f0 tx=0x7fe8ec02dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe7d97fa640 1 -- 172.21.15.72:0/3012011800 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec043820 con 0x56047be8f850 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe7d97fa640 1 -- 172.21.15.72:0/3012011800 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec0439c0 con 0x56047be8f850 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe7d97fa640 1 -- 172.21.15.72:0/3012011800 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec043ca0 con 0x56047be8f850 2024-04-26T12:50:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56047be90c50 con 0x56047be8f850 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047be91120 con 0x56047be8f850 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe7d97fa640 1 -- 172.21.15.72:0/3012011800 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8ec043400 con 0x56047be8f850 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe7d97fa640 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7cc034650 0x7fe7cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe7d97fa640 1 -- 172.21.15.72:0/3012011800 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe8ec0478b0 con 0x56047be8f850 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7cc034650 0x7fe7cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f5fef980 1 Processor -- start 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7cc034650 0x7fe7cc036b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56047be78f70 tx=0x7fe8e8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.068+0000 7fe8f5fef980 1 -- start start 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56047be6bc70 con 0x56047bea0c60 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48690/0 (socket says 172.21.15.72:48690) 2024-04-26T12:50:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/606843321 learned_addr learned my addr 172.21.15.72:0/606843321 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/606843321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047bea1650 con 0x56047bea0c60 2024-04-26T12:50:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/606843321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea1080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00a010 tx=0x7fe8ec03af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80c830d5ab13881 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/606843321 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec0397d0 con 0x56047bea0c60 2024-04-26T12:50:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/606843321 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec05b030 con 0x56047bea0c60 2024-04-26T12:50:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/606843321 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec009140 con 0x56047bea0c60 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- 172.21.15.72:0/606843321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 msgr2=0x56047bea1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/606843321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea1080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00a010 tx=0x7fe8ec03af90 comp rx=0 tx=0).stop 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- 172.21.15.72:0/606843321 shutdown_connections 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/606843321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea1080 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- 172.21.15.72:0/606843321 >> 172.21.15.72:0/606843321 conn(0x56047be98be0 msgr2=0x56047be96c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- 172.21.15.72:0/606843321 shutdown_connections 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- 172.21.15.72:0/606843321 wait complete. 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 Processor -- start 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- start start 2024-04-26T12:50:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f5fef980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56047bea1d40 con 0x56047bea0c60 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48700/0 (socket says 172.21.15.72:48700) 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 learned_addr learned my addr 172.21.15.72:0/3285769717 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.072+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047bea84a0 con 0x56047bea0c60 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea7f60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec047ba0 tx=0x7fe8ec047520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe7d17fa640 1 -- 172.21.15.72:0/3285769717 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec025420 con 0x56047bea0c60 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe7d17fa640 1 -- 172.21.15.72:0/3285769717 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec02eb20 con 0x56047bea0c60 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe7d17fa640 1 -- 172.21.15.72:0/3285769717 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8ec0393e0 con 0x56047bea0c60 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56047bea84a0 con 0x56047bea0c60 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047bea84a0 con 0x56047bea0c60 2024-04-26T12:50:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe7d17fa640 1 -- 172.21.15.72:0/3285769717 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8ec04b6c0 con 0x56047bea0c60 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe7d17fa640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7bc034650 0x7fe7bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe7d17fa640 1 -- 172.21.15.72:0/3285769717 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe8ec068070 con 0x56047bea0c60 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7bc034650 0x7fe7bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047beb3030 0x56047beb54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047beb5c40 con 0x56047beb3030 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f430b640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047beb3030 0x56047beb54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7bc034650 0x7fe7bc036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80aa970 tx=0x7fe8e80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f430b640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047beb3030 0x56047beb54f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047beb3030 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 realm 2024-04-26T12:50:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6050 con 0x56047beb3030 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047beb3030 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6920 con 0x56047beb3030 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047beb3030 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047beb3030 2024-04-26T12:50:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047beb7a20 0x56047beb9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.076+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047beba420 con 0x56047beb7a20 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047beb7a20 0x56047beb9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3b0a640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047beb7a20 0x56047beb9e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f5fef980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f5fef980 20 searching for the correct realm 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047bebc370 0x56047bebe760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047bebee30 con 0x56047bebc370 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047bebc370 0x56047bebe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047bebc370 0x56047bebe760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3309640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe8e80e0040 0x7fe8e80e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047bebee30 con 0x7fe8e80e0040 2024-04-26T12:50:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f430b640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe8e80e0040 0x7fe8e80e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f430b640 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe8e80e0040 0x7fe8e80e0420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e40083f0 con 0x7fe8e80e0040 2024-04-26T12:50:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.080+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e40083f0 con 0x56047beb3030 2024-04-26T12:50:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x7fe8e80e0040 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x7fe8e80e0040 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.084+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x7fe8e80e0040 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe8e4026040 con 0x7fe8e80e0040 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.088+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x7fe8e80e0040 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x7fe8e80e0040 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x7fe8e80e0040 2024-04-26T12:50:12.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x7fe8e80e0040 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047bebc370 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb7a20 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x56047beb3030 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.092+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56047beb6cc0 con 0x7fe8e80e0040 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e4026040 con 0x7fe8e80e0040 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:12.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bebace0 con 0x56047beb3030 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bebace0 con 0x56047beb3030 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe8e4026040 con 0x56047beb3030 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bebace0 con 0x56047bebc370 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 zone default found 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 4 Realm: () 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 zonegroup default 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bebb6d0 con 0x56047beb7a20 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bebb2a0 con 0x56047bebc370 2024-04-26T12:50:12.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bec1210 con 0x56047bebc370 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 started sync module instance, tier type = 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec05d0 con 0x7fe8e80e0040 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.096+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4026040 con 0x7fe8e80e0040 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.100+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94577258924752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec05d0 con 0x7fe8e80e0040 2024-04-26T12:50:12.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.100+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec1c90 con 0x56047beb3030 2024-04-26T12:50:12.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.100+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94577258924752] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.100+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.100+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94577258928368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec05d0 con 0x56047beb3030 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.100+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec26d0 con 0x56047bebc370 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.104+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.104+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94577258930720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec2f20 con 0x56047bebc370 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.104+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94577258928368] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.104+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec3940 con 0x7fe8e80e0040 2024-04-26T12:50:12.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.104+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94577258930720] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.108+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.108+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94577258932848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec0120 con 0x7fe8e80e0040 2024-04-26T12:50:12.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.108+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec41e0 con 0x56047beb3030 2024-04-26T12:50:12.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.108+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.108+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94577258937424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec4520 con 0x56047beb3030 2024-04-26T12:50:12.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.108+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec4f70 con 0x56047beb7a20 2024-04-26T12:50:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.112+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94577258932848] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.112+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.112+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94577258941024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec4f30 con 0x56047beb7a20 2024-04-26T12:50:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.112+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec4f30 con 0x56047beb7a20 2024-04-26T12:50:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.112+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94577258937424] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.112+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94577258941024] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.116+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.116+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94577258935344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec54d0 con 0x56047beb7a20 2024-04-26T12:50:12.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.116+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec5d60 con 0x56047beb7a20 2024-04-26T12:50:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.116+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94577258935344] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.116+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.116+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94577258943696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec5da0 con 0x56047beb7a20 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=0 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=1 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=2 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=3 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=4 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=5 2024-04-26T12:50:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=6 2024-04-26T12:50:12.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94577258943696] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 20 add_watcher() i=7 2024-04-26T12:50:12.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:12.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bec91a0 con 0x56047beb3030 2024-04-26T12:50:12.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.120+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94577258945216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec66c0 con 0x56047beb3030 2024-04-26T12:50:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.124+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94577258945216] v33'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.124+0000 7fe7a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.124+0000 7fe8f5fef980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.124+0000 7fe8f5fef980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.124+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec8f90 con 0x56047beb3030 2024-04-26T12:50:12.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.124+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.124+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed2250 con 0x56047beb7a20 2024-04-26T12:50:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.128+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.128+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed2250 con 0x56047bebc370 2024-04-26T12:50:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.132+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.132+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed27c0 con 0x56047beb3030 2024-04-26T12:50:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.132+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.132+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed2b80 con 0x7fe8e80e0040 2024-04-26T12:50:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.136+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.136+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed30f0 con 0x56047bebc370 2024-04-26T12:50:12.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.140+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.140+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed35a0 con 0x56047beb3030 2024-04-26T12:50:12.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.140+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.140+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1860 con 0x56047beb7a20 2024-04-26T12:50:12.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.144+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.144+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1860 con 0x7fe8e80e0040 2024-04-26T12:50:12.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.144+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.144+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1860 con 0x56047bebc370 2024-04-26T12:50:12.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.148+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.148+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1860 con 0x7fe8e80e0040 2024-04-26T12:50:12.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.148+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.148+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1860 con 0x56047beb7a20 2024-04-26T12:50:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.152+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.152+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1950 con 0x7fe8e80e0040 2024-04-26T12:50:12.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.152+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.152+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1950 con 0x56047beb7a20 2024-04-26T12:50:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.156+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.156+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed18f0 con 0x56047beb3030 2024-04-26T12:50:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.160+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.160+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.160+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.160+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x7fe8e80e0040 2024-04-26T12:50:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.164+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.164+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.168+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.168+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047beb3030 2024-04-26T12:50:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.172+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.172+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047beb3030 2024-04-26T12:50:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.172+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.172+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.176+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.176+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x7fe8e80e0040 2024-04-26T12:50:12.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.180+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.180+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.180+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.180+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.184+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.184+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.184+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.184+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.188+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.188+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047beb7a20 2024-04-26T12:50:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.192+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.192+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.192+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.192+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047beb7a20 2024-04-26T12:50:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.196+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.196+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047bebc370 2024-04-26T12:50:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.196+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.196+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x56047beb7a20 2024-04-26T12:50:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.200+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.200+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed3f30 con 0x7fe8e80e0040 2024-04-26T12:50:12.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.200+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe7a8fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:12.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 20 Filter name: none 2024-04-26T12:50:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe7227fc640 20 reqs_thread_entry: start 2024-04-26T12:50:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T12:50:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56047bed1130 con 0x56047beb7a20 2024-04-26T12:50:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-26T12:50:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:50:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:50:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe7a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.204+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94577258945216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bed0ba0 con 0x56047beb3030 2024-04-26T12:50:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94577258945216] v33'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94577258924752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec5a90 con 0x7fe8e80e0040 2024-04-26T12:50:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94577258924752] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f5fef980 20 remove_watcher() i=0 2024-04-26T12:50:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f5fef980 2 removed watcher, disabling cache 2024-04-26T12:50:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94577258928368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec0ad0 con 0x56047beb3030 2024-04-26T12:50:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94577258928368] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f5fef980 20 remove_watcher() i=1 2024-04-26T12:50:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.208+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94577258930720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec0ad0 con 0x56047bebc370 2024-04-26T12:50:12.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.212+0000 7fe8f3309640 1 -- 172.21.15.72:0/3285769717 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94577258930720] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e80aab40 con 0x56047bebc370 2024-04-26T12:50:12.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.212+0000 7fe8f5fef980 20 remove_watcher() i=2 2024-04-26T12:50:12.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.212+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94577258932848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec0ad0 con 0x7fe8e80e0040 2024-04-26T12:50:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.212+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94577258932848] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x7fe8e80e0040 2024-04-26T12:50:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.212+0000 7fe8f5fef980 20 remove_watcher() i=3 2024-04-26T12:50:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.212+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94577258937424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec2a70 con 0x56047beb3030 2024-04-26T12:50:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.216+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94577258937424] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e4036040 con 0x56047beb3030 2024-04-26T12:50:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.216+0000 7fe8f5fef980 20 remove_watcher() i=4 2024-04-26T12:50:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.216+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94577258941024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec0ad0 con 0x56047beb7a20 2024-04-26T12:50:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.216+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94577258941024] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.216+0000 7fe8f5fef980 20 remove_watcher() i=5 2024-04-26T12:50:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.216+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94577258935344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec2a70 con 0x56047beb7a20 2024-04-26T12:50:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.220+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94577258935344] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.220+0000 7fe8f5fef980 20 remove_watcher() i=6 2024-04-26T12:50:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.220+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94577258943696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56047bec4a60 con 0x56047beb7a20 2024-04-26T12:50:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.220+0000 7fe8f3b0a640 1 -- 172.21.15.72:0/3285769717 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94577258943696] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8ec072020 con 0x56047beb7a20 2024-04-26T12:50:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.220+0000 7fe8f5fef980 20 remove_watcher() i=7 2024-04-26T12:50:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.220+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047beb7a20 msgr2=0x56047beb9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.220+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047beb7a20 0x56047beb9e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047beb3030 msgr2=0x56047beb54f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047beb3030 0x56047beb54f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe8e80e0040 msgr2=0x7fe8e80e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe8e80e0040 0x7fe8e80e0420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047bebc370 msgr2=0x56047bebe760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047bebc370 0x56047bebe760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7bc034650 msgr2=0x7fe7bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7bc034650 0x7fe7bc036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80aa970 tx=0x7fe8e80c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 reap_dead start 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 msgr2=0x56047bea7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3285769717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bea0c60 0x56047bea7f60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec047ba0 tx=0x7fe8ec047520 comp rx=0 tx=0).stop 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f430b640 1 -- 172.21.15.72:0/3285769717 reap_dead start 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 shutdown_connections 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 >> 172.21.15.72:0/3285769717 conn(0x56047be98be0 msgr2=0x56047be96240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 shutdown_connections 2024-04-26T12:50:12.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3285769717 wait complete. 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7cc034650 msgr2=0x7fe7cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7cc034650 0x7fe7cc036b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56047be78f70 tx=0x7fe8e8005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047be8f850 msgr2=0x56047be8fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047be8f850 0x56047be8fc70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec04a1f0 tx=0x7fe8ec02dd80 comp rx=0 tx=0).stop 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 shutdown_connections 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7cc034650 0x7fe7cc036b10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/3012011800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047be8f850 0x56047be8fc70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 >> 172.21.15.72:0/3012011800 conn(0x56047be84660 msgr2=0x56047be85170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 shutdown_connections 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/3012011800 wait complete. 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047be7add0 msgr2=0x56047be7d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56047be7add0 0x56047be7d1c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047bd84700 msgr2=0x56047be78940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56047bd84700 0x56047be78940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047be7ed10 msgr2=0x56047be81100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56047be7ed10 0x56047be81100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7dc0346f0 msgr2=0x7fe7dc036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe7dc0346f0 0x7fe7dc036bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80ae000 tx=0x7fe8e80a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:12.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 msgr2=0x56047be725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 --2- 172.21.15.72:0/506537516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56047bd801a0 0x56047be725e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x56047be6c1e0 tx=0x7fe8ec000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:12.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f430b640 1 -- 172.21.15.72:0/506537516 reap_dead start 2024-04-26T12:50:12.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 shutdown_connections 2024-04-26T12:50:12.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 >> 172.21.15.72:0/506537516 conn(0x56047bd7ba70 msgr2=0x56047be659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 shutdown_connections 2024-04-26T12:50:12.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.224+0000 7fe8f5fef980 1 -- 172.21.15.72:0/506537516 wait complete. 2024-04-26T12:50:12.238 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:50:12.239 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T12:50:12.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T12:50:12.239 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T12:50:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:12.315 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:12.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad069b1980 1 Processor -- start 2024-04-26T12:50:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad069b1980 1 -- start start 2024-04-26T12:50:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad069b1980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b8a1687a90 0x55b8a1689e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad069b1980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b8a152e510 con 0x55b8a15f5880 2024-04-26T12:50:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad069b1980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b8a1535430 con 0x55b8a1687a90 2024-04-26T12:50:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad03ccb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b8a1687a90 0x55b8a1689e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad03ccb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b8a1687a90 0x55b8a1689e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48702/0 (socket says 172.21.15.72:48702) 2024-04-26T12:50:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad044cc640 1 --1- 172.21.15.72:0/2953273503 >> v1:172.21.15.29:6789/0 conn(0x55b8a15f5880 0x55b8a1686370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35850/0 (socket says 172.21.15.72:35850) 2024-04-26T12:50:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad03ccb640 1 -- 172.21.15.72:0/2953273503 learned_addr learned my addr 172.21.15.72:0/2953273503 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad03ccb640 1 -- 172.21.15.72:0/2953273503 >> v1:172.21.15.29:6789/0 conn(0x55b8a15f5880 legacy=0x55b8a1686370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.316+0000 7fad03ccb640 1 -- 172.21.15.72:0/2953273503 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a150aae0 con 0x55b8a1687a90 2024-04-26T12:50:12.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad03ccb640 1 --2- 172.21.15.72:0/2953273503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1687a90 0x55b8a1689e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7facf400a4e0 tx=0x7facf401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce62a88624c4acec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad034ca640 1 -- 172.21.15.72:0/2953273503 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facf40aa540 con 0x55b8a1687a90 2024-04-26T12:50:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad034ca640 1 -- 172.21.15.72:0/2953273503 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf40aa6e0 con 0x55b8a1687a90 2024-04-26T12:50:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad034ca640 1 -- 172.21.15.72:0/2953273503 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facf40aaa40 con 0x55b8a1687a90 2024-04-26T12:50:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad069b1980 1 -- 172.21.15.72:0/2953273503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1687a90 msgr2=0x55b8a1689e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad069b1980 1 --2- 172.21.15.72:0/2953273503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1687a90 0x55b8a1689e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7facf400a4e0 tx=0x7facf401b090 comp rx=0 tx=0).stop 2024-04-26T12:50:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad069b1980 1 -- 172.21.15.72:0/2953273503 shutdown_connections 2024-04-26T12:50:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad069b1980 1 --2- 172.21.15.72:0/2953273503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1687a90 0x55b8a1689e80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad069b1980 1 -- 172.21.15.72:0/2953273503 >> 172.21.15.72:0/2953273503 conn(0x55b8a167ba50 msgr2=0x55b8a167de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad069b1980 1 -- 172.21.15.72:0/2953273503 shutdown_connections 2024-04-26T12:50:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.320+0000 7fad069b1980 1 -- 172.21.15.72:0/2953273503 wait complete. 2024-04-26T12:50:12.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad069b1980 1 Processor -- start 2024-04-26T12:50:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad069b1980 1 -- start start 2024-04-26T12:50:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad069b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a176e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad069b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b8a1584a70 con 0x55b8a15f5880 2024-04-26T12:50:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a176e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a176e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48710/0 (socket says 172.21.15.72:48710) 2024-04-26T12:50:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad044cc640 1 -- 172.21.15.72:0/1448873453 learned_addr learned my addr 172.21.15.72:0/1448873453 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad044cc640 1 -- 172.21.15.72:0/1448873453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a176ebf0 con 0x55b8a15f5880 2024-04-26T12:50:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.336+0000 7fad044cc640 1 --2- 172.21.15.72:0/1448873453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a176e620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7facec001e50 tx=0x7facec001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0186936c52234e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fabf260c640 1 -- 172.21.15.72:0/1448873453 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec00e5d0 con 0x55b8a15f5880 2024-04-26T12:50:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fabf260c640 1 -- 172.21.15.72:0/1448873453 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec00e770 con 0x55b8a15f5880 2024-04-26T12:50:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fabf260c640 1 -- 172.21.15.72:0/1448873453 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec00eab0 con 0x55b8a15f5880 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- 172.21.15.72:0/1448873453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 msgr2=0x55b8a176e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 --2- 172.21.15.72:0/1448873453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a176e620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7facec001e50 tx=0x7facec001e80 comp rx=0 tx=0).stop 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- 172.21.15.72:0/1448873453 shutdown_connections 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 --2- 172.21.15.72:0/1448873453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a176e620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- 172.21.15.72:0/1448873453 >> 172.21.15.72:0/1448873453 conn(0x55b8a167ba50 msgr2=0x55b8a176a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- 172.21.15.72:0/1448873453 shutdown_connections 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- 172.21.15.72:0/1448873453 wait complete. 2024-04-26T12:50:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 Processor -- start 2024-04-26T12:50:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- start start 2024-04-26T12:50:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a17758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b8a168ce20 con 0x55b8a15f5880 2024-04-26T12:50:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a17758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a17758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48718/0 (socket says 172.21.15.72:48718) 2024-04-26T12:50:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad044cc640 1 -- 172.21.15.72:0/3689037841 learned_addr learned my addr 172.21.15.72:0/3689037841 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad044cc640 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a1775df0 con 0x55b8a15f5880 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad044cc640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a17758b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55b8a176f4b0 tx=0x7facec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fabf0e09640 1 -- 172.21.15.72:0/3689037841 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec001260 con 0x55b8a15f5880 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8a1776080 con 0x55b8a15f5880 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fabf0e09640 1 -- 172.21.15.72:0/3689037841 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec00fa40 con 0x55b8a15f5880 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fabf0e09640 1 -- 172.21.15.72:0/3689037841 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec00fd80 con 0x55b8a15f5880 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.340+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8a1778cc0 con 0x55b8a15f5880 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fabf0e09640 1 -- 172.21.15.72:0/3689037841 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7facec017070 con 0x55b8a15f5880 2024-04-26T12:50:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fabf0e09640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabec034650 0x7fabec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fabf0e09640 1 -- 172.21.15.72:0/3689037841 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7facec015020 con 0x55b8a15f5880 2024-04-26T12:50:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad03ccb640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabec034650 0x7fabec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a1687a90 0x55b8a177c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a177ce90 con 0x55b8a1687a90 2024-04-26T12:50:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad04ccd640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a1687a90 0x55b8a177c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad03ccb640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabec034650 0x7fabec036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facf40ab000 tx=0x7facf40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad04ccd640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a1687a90 0x55b8a177c910 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad04ccd640 1 -- 172.21.15.72:0/3689037841 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a1687a90 2024-04-26T12:50:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a1779ec0 con 0x55b8a1687a90 2024-04-26T12:50:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad04ccd640 1 -- 172.21.15.72:0/3689037841 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a1687a90 2024-04-26T12:50:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a177f1a0 0x55b8a1781590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a1781c80 con 0x55b8a177f1a0 2024-04-26T12:50:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad044cc640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a177f1a0 0x55b8a1781590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.344+0000 7fad044cc640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a177f1a0 0x55b8a1781590 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad044cc640 1 -- 172.21.15.72:0/3689037841 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7facec02e070 con 0x55b8a177f1a0 2024-04-26T12:50:12.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a177e040 con 0x55b8a1687a90 2024-04-26T12:50:12.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad04ccd640 1 -- 172.21.15.72:0/3689037841 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a1687a90 2024-04-26T12:50:12.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17830e0 0x55b8a17854d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a1785c10 con 0x55b8a17830e0 2024-04-26T12:50:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad03ccb640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17830e0 0x55b8a17854d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad03ccb640 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17830e0 0x55b8a17854d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad03ccb640 1 -- 172.21.15.72:0/3689037841 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7facf40aab70 con 0x55b8a17830e0 2024-04-26T12:50:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 Processor -- start 2024-04-26T12:50:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 -- start start 2024-04-26T12:50:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1793c60 0x55b8a1794080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b8a1588ab0 con 0x55b8a1793c60 2024-04-26T12:50:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1793c60 0x55b8a1794080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1793c60 0x55b8a1794080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48720/0 (socket says 172.21.15.72:48720) 2024-04-26T12:50:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad044cc640 1 -- 172.21.15.72:0/2516118109 learned_addr learned my addr 172.21.15.72:0/2516118109 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad044cc640 1 -- 172.21.15.72:0/2516118109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a17945c0 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad044cc640 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1793c60 0x55b8a1794080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7facec01cfd0 tx=0x7facec01bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fabe9ffb640 1 -- 172.21.15.72:0/2516118109 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec027430 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8a1795060 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fabe9ffb640 1 -- 172.21.15.72:0/2516118109 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec0275d0 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fabe9ffb640 1 -- 172.21.15.72:0/2516118109 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec017980 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.348+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8a1795530 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fabe9ffb640 1 -- 172.21.15.72:0/2516118109 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7facec04abd0 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fabe9ffb640 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabdc0346a0 0x7fabdc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fabe9ffb640 1 -- 172.21.15.72:0/2516118109 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7facec03dc60 con 0x55b8a1793c60 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad03ccb640 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabdc0346a0 0x7fabdc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 Processor -- start 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- start start 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b8a176ef40 con 0x55b8a17a0a80 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad03ccb640 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabdc0346a0 0x7fabdc036b60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55b8a177d340 tx=0x7facf4005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48732/0 (socket says 172.21.15.72:48732) 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad044cc640 1 -- 172.21.15.72:0/734477158 learned_addr learned my addr 172.21.15.72:0/734477158 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad044cc640 1 -- 172.21.15.72:0/734477158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a17a1430 con 0x55b8a17a0a80 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad044cc640 1 --2- 172.21.15.72:0/734477158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a0e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7facec037fd0 tx=0x7facec01a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb575f9fdd3b866 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fabe37fe640 1 -- 172.21.15.72:0/734477158 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec05a020 con 0x55b8a17a0a80 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fabe37fe640 1 -- 172.21.15.72:0/734477158 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec0474e0 con 0x55b8a17a0a80 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fabe37fe640 1 -- 172.21.15.72:0/734477158 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec023240 con 0x55b8a17a0a80 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- 172.21.15.72:0/734477158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 msgr2=0x55b8a17a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 --2- 172.21.15.72:0/734477158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a0e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7facec037fd0 tx=0x7facec01a9a0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- 172.21.15.72:0/734477158 shutdown_connections 2024-04-26T12:50:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 --2- 172.21.15.72:0/734477158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a0e60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- 172.21.15.72:0/734477158 >> 172.21.15.72:0/734477158 conn(0x55b8a179cdc0 msgr2=0x55b8a179ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- 172.21.15.72:0/734477158 shutdown_connections 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- 172.21.15.72:0/734477158 wait complete. 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 Processor -- start 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.352+0000 7fad069b1980 1 -- start start 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad069b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad069b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b8a17a1b10 con 0x55b8a17a0a80 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad044cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48748/0 (socket says 172.21.15.72:48748) 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 learned_addr learned my addr 172.21.15.72:0/748755316 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a17a8270 con 0x55b8a17a0a80 2024-04-26T12:50:12.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad044cc640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a7d30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7facec0239c0 tx=0x7facec04b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fabe1ffb640 1 -- 172.21.15.72:0/748755316 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec06f070 con 0x55b8a17a0a80 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8a17a8270 con 0x55b8a17a0a80 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8a17a8270 con 0x55b8a17a0a80 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fabe1ffb640 1 -- 172.21.15.72:0/748755316 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec04aec0 con 0x55b8a17a0a80 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fabe1ffb640 1 -- 172.21.15.72:0/748755316 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facec023240 con 0x55b8a17a0a80 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fabe1ffb640 1 -- 172.21.15.72:0/748755316 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7facec072070 con 0x55b8a17a0a80 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fabe1ffb640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabd4034650 0x7fabd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fabe1ffb640 1 -- 172.21.15.72:0/748755316 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7facec066030 con 0x55b8a17a0a80 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad03ccb640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabd4034650 0x7fabd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a17b2e30 0x55b8a17b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b5a40 con 0x55b8a17b2e30 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.356+0000 7fad04ccd640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a17b2e30 0x55b8a17b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad03ccb640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabd4034650 0x7fabd4036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facf401b0d0 tx=0x7facf40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad04ccd640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a17b2e30 0x55b8a17b52f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a17b2e30 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 realm 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b5e50 con 0x55b8a17b2e30 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a17b2e30 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6720 con 0x55b8a17b2e30 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a17b2e30 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b2e30 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a17b2e30 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a17b7820 0x55b8a17b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17ba1e0 con 0x55b8a17b7820 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad044cc640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a17b7820 0x55b8a17b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad044cc640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a17b7820 0x55b8a17b9c10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 20 searching for the correct realm 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17bc130 0x55b8a17be540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17bec10 con 0x55b8a17bc130 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.360+0000 7fad03ccb640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17bc130 0x55b8a17be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad03ccb640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17bc130 0x55b8a17be540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad03ccb640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7facf40ce040 0x7facf40db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17bec10 con 0x7facf40ce040 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7facf40ce040 0x7facf40db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7facf40ce040 0x7facf40db920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc0083f0 con 0x7facf40ce040 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b7820 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b2e30 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc0083f0 con 0x55b8a17b2e30 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b2e30 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b7820 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b7820 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.364+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x7facf40ce040 2024-04-26T12:50:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x7facf40ce040 2024-04-26T12:50:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17bc130 2024-04-26T12:50:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b2e30 2024-04-26T12:50:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b7820 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17b2e30 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x7facf40ce040 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7facfc026040 con 0x7facf40ce040 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17b6ac0 con 0x55b8a17bc130 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17bc130 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b7820 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.368+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17bc130 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17bc130 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b2e30 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b2e30 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b7820 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17bc130 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x7facf40ce040 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x7facf40ce040 2024-04-26T12:50:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b2e30 2024-04-26T12:50:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b7820 2024-04-26T12:50:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17bc130 2024-04-26T12:50:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.372+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b7820 2024-04-26T12:50:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x7facf40ce040 2024-04-26T12:50:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x7facf40ce040 2024-04-26T12:50:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17bc130 2024-04-26T12:50:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b7820 2024-04-26T12:50:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x55b8a17b2e30 2024-04-26T12:50:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7facf40e8040 con 0x7facf40ce040 2024-04-26T12:50:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facfc026040 con 0x7facf40ce040 2024-04-26T12:50:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17baaa0 con 0x55b8a17b2e30 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17baaa0 con 0x55b8a17b2e30 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facfc026040 con 0x55b8a17b2e30 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17baaa0 con 0x55b8a17bc130 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 zone default found 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 4 Realm: () 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 zonegroup default 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.376+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17bb460 con 0x55b8a17b7820 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17bb000 con 0x55b8a17bc130 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c0fe0 con 0x55b8a17bc130 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 20 started sync module instance, tier type = 2024-04-26T12:50:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c03b0 con 0x7facf40ce040 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc026040 con 0x7facf40ce040 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94251471603888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c03b0 con 0x7facf40ce040 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.380+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c1a60 con 0x55b8a17b2e30 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94251471607216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c1e80 con 0x55b8a17b2e30 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c2930 con 0x55b8a17bc130 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94251471603888] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94251471607216] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94251471601408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c1e80 con 0x55b8a17bc130 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.384+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c31d0 con 0x7facf40ce040 2024-04-26T12:50:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94251471601408] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94251471613216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c35f0 con 0x7facf40ce040 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c3e80 con 0x55b8a17b2e30 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94251471613216] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94251471614272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c3a10 con 0x55b8a17b2e30 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.388+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c4780 con 0x55b8a17b7820 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94251471614272] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94251471615328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c3980 con 0x55b8a17b7820 2024-04-26T12:50:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c54d0 con 0x55b8a17b7820 2024-04-26T12:50:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94251471615328] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94251471621456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c5d20 con 0x55b8a17b7820 2024-04-26T12:50:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.392+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c66e0 con 0x55b8a17b7820 2024-04-26T12:50:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94251471621456] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94251471624576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c66e0 con 0x55b8a17b7820 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 20 add_watcher() i=0 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 20 add_watcher() i=1 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 20 add_watcher() i=2 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 20 add_watcher() i=3 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 20 add_watcher() i=4 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 20 add_watcher() i=5 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.396+0000 7fad069b1980 20 add_watcher() i=6 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94251471624576] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad069b1980 20 add_watcher() i=7 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad069b1980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c9a20 con 0x55b8a17b2e30 2024-04-26T12:50:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94251471639616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c6850 con 0x55b8a17b2e30 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94251471639616] v33'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fabba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad069b1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad069b1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.400+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c8e50 con 0x55b8a17b2e30 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.404+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.404+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d2bc0 con 0x55b8a17b7820 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.404+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.404+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d2bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.404+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.404+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d3130 con 0x55b8a17b2e30 2024-04-26T12:50:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.408+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.408+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d36a0 con 0x7facf40ce040 2024-04-26T12:50:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.408+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.408+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d3c10 con 0x55b8a17bc130 2024-04-26T12:50:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.408+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.408+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d40c0 con 0x55b8a17b2e30 2024-04-26T12:50:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.412+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.412+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d40c0 con 0x55b8a17b7820 2024-04-26T12:50:12.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.416+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.416+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d40c0 con 0x7facf40ce040 2024-04-26T12:50:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.416+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.416+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d40c0 con 0x55b8a17bc130 2024-04-26T12:50:12.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.416+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.416+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4730 con 0x7facf40ce040 2024-04-26T12:50:12.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.420+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.420+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4710 con 0x55b8a17b7820 2024-04-26T12:50:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.420+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.420+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4710 con 0x7facf40ce040 2024-04-26T12:50:12.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.424+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.424+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4710 con 0x55b8a17b7820 2024-04-26T12:50:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.424+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.424+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4710 con 0x55b8a17b2e30 2024-04-26T12:50:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.428+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.428+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4710 con 0x55b8a17bc130 2024-04-26T12:50:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.428+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.428+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d47a0 con 0x7facf40ce040 2024-04-26T12:50:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.428+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.428+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d47a0 con 0x55b8a17bc130 2024-04-26T12:50:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.432+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.432+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17b2e30 2024-04-26T12:50:12.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.432+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.432+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17b2e30 2024-04-26T12:50:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.432+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.432+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.436+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.436+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x7facf40ce040 2024-04-26T12:50:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.436+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.436+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.440+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.440+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.440+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.440+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.440+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.440+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.444+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.444+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17b7820 2024-04-26T12:50:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.444+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.444+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.448+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.448+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17b7820 2024-04-26T12:50:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.448+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.448+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17bc130 2024-04-26T12:50:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.452+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.452+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4bc0 con 0x55b8a17b7820 2024-04-26T12:50:12.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.452+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.452+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d4be0 con 0x7facf40ce040 2024-04-26T12:50:12.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fabb97e2640 20 reqs_thread_entry: start 2024-04-26T12:50:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 20 Filter name: none 2024-04-26T12:50:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fab2affd640 20 reqs_thread_entry: start 2024-04-26T12:50:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:50:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d24c0 con 0x55b8a17b7820 2024-04-26T12:50:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:50:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.456+0000 7fad069b1980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:50:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.460+0000 7fabba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.460+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94251471639616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17d0fc0 con 0x55b8a17b2e30 2024-04-26T12:50:12.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.460+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94251471639616] v33'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.460+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94251471603888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c9440 con 0x7facf40ce040 2024-04-26T12:50:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.464+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94251471603888] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.464+0000 7fad069b1980 20 remove_watcher() i=0 2024-04-26T12:50:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.464+0000 7fad069b1980 2 removed watcher, disabling cache 2024-04-26T12:50:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.464+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94251471607216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c08b0 con 0x55b8a17b2e30 2024-04-26T12:50:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.464+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94251471607216] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.464+0000 7fad069b1980 20 remove_watcher() i=1 2024-04-26T12:50:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.464+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94251471601408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c08b0 con 0x55b8a17bc130 2024-04-26T12:50:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.468+0000 7fad03ccb640 1 -- 172.21.15.72:0/748755316 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94251471601408] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facf40d9070 con 0x55b8a17bc130 2024-04-26T12:50:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.468+0000 7fad069b1980 20 remove_watcher() i=2 2024-04-26T12:50:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.468+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94251471613216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17bff00 con 0x7facf40ce040 2024-04-26T12:50:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.468+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94251471613216] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x7facf40ce040 2024-04-26T12:50:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.468+0000 7fad069b1980 20 remove_watcher() i=3 2024-04-26T12:50:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.468+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94251471614272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c08b0 con 0x55b8a17b2e30 2024-04-26T12:50:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.472+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94251471614272] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facfc036040 con 0x55b8a17b2e30 2024-04-26T12:50:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.472+0000 7fad069b1980 20 remove_watcher() i=4 2024-04-26T12:50:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.472+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94251471615328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c08b0 con 0x55b8a17b7820 2024-04-26T12:50:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.472+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94251471615328] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.472+0000 7fad069b1980 20 remove_watcher() i=5 2024-04-26T12:50:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.472+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94251471621456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c08b0 con 0x55b8a17b7820 2024-04-26T12:50:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94251471621456] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 20 remove_watcher() i=6 2024-04-26T12:50:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94251471624576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b8a17c4d50 con 0x55b8a17b7820 2024-04-26T12:50:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad044cc640 1 -- 172.21.15.72:0/748755316 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94251471624576] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facec071030 con 0x55b8a17b7820 2024-04-26T12:50:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 20 remove_watcher() i=7 2024-04-26T12:50:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a17b7820 msgr2=0x55b8a17b9c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a17b7820 0x55b8a17b9c10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a17b2e30 msgr2=0x55b8a17b52f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a17b2e30 0x55b8a17b52f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7facf40ce040 msgr2=0x7facf40db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7facf40ce040 0x7facf40db920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17bc130 msgr2=0x55b8a17be540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.476+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17bc130 0x55b8a17be540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabd4034650 msgr2=0x7fabd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabd4034650 0x7fabd4036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facf401b0d0 tx=0x7facf40a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad04ccd640 1 -- 172.21.15.72:0/748755316 reap_dead start 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 msgr2=0x55b8a17a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a7d30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7facec0239c0 tx=0x7facec04b390 comp rx=0 tx=0).stop 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 shutdown_connections 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/748755316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a17a0a80 0x55b8a17a7d30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 >> 172.21.15.72:0/748755316 conn(0x55b8a179cdc0 msgr2=0x55b8a179a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 shutdown_connections 2024-04-26T12:50:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/748755316 wait complete. 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabdc0346a0 msgr2=0x7fabdc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabdc0346a0 0x7fabdc036b60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55b8a177d340 tx=0x7facf4005e50 comp rx=0 tx=0).stop 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1793c60 msgr2=0x55b8a1794080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1793c60 0x55b8a1794080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7facec01cfd0 tx=0x7facec01bd50 comp rx=0 tx=0).stop 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 shutdown_connections 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabdc0346a0 0x7fabdc036b60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/2516118109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a1793c60 0x55b8a1794080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 >> 172.21.15.72:0/2516118109 conn(0x55b8a1788a70 msgr2=0x55b8a1789580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 shutdown_connections 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/2516118109 wait complete. 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a177f1a0 msgr2=0x55b8a1781590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b8a177f1a0 0x55b8a1781590 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a1687a90 msgr2=0x55b8a177c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b8a1687a90 0x55b8a177c910 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17830e0 msgr2=0x55b8a17854d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b8a17830e0 0x55b8a17854d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabec034650 msgr2=0x7fabec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fabec034650 0x7fabec036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facf40ab000 tx=0x7facf40a5000 comp rx=0 tx=0).stop 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 msgr2=0x55b8a17758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 --2- 172.21.15.72:0/3689037841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b8a15f5880 0x55b8a17758b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55b8a176f4b0 tx=0x7facec000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad04ccd640 1 -- 172.21.15.72:0/3689037841 reap_dead start 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 shutdown_connections 2024-04-26T12:50:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 >> 172.21.15.72:0/3689037841 conn(0x55b8a167ba50 msgr2=0x55b8a1768cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 shutdown_connections 2024-04-26T12:50:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.480+0000 7fad069b1980 1 -- 172.21.15.72:0/3689037841 wait complete. 2024-04-26T12:50:12.492 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:50:12.493 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T12:50:12.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T12:50:12.493 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T12:50:12.571 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:12.571 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:12.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bedad980 1 Processor -- start 2024-04-26T12:50:12.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bedad980 1 -- start start 2024-04-26T12:50:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bedad980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555c533689f0 0x555c5336ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bedad980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c5320f510 con 0x555c533644e0 2024-04-26T12:50:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bedad980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x555c53216430 con 0x555c533689f0 2024-04-26T12:50:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bc0c7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555c533689f0 0x555c5336ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bc8c8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x555c533644e0 0x555c533648c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35856/0 (socket says 172.21.15.72:35856) 2024-04-26T12:50:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.572+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4083943415 learned_addr learned my addr 172.21.15.72:0/4083943415 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4083943415 >> v1:172.21.15.29:6789/0 conn(0x555c533644e0 legacy=0x555c533648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4083943415 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c531ebae0 con 0x555c533689f0 2024-04-26T12:50:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/4083943415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533689f0 0x555c5336ade0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f42b000a480 tx=0x7f42b001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b5452b20cbb5b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bb8c6640 1 -- 172.21.15.72:0/4083943415 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b00b0070 con 0x555c533689f0 2024-04-26T12:50:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bb8c6640 1 -- 172.21.15.72:0/4083943415 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b00ab540 con 0x555c533689f0 2024-04-26T12:50:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bb8c6640 1 -- 172.21.15.72:0/4083943415 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b00ab840 con 0x555c533689f0 2024-04-26T12:50:12.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bedad980 1 -- 172.21.15.72:0/4083943415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533689f0 msgr2=0x555c5336ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bedad980 1 --2- 172.21.15.72:0/4083943415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533689f0 0x555c5336ade0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f42b000a480 tx=0x7f42b001b280 comp rx=0 tx=0).stop 2024-04-26T12:50:12.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bedad980 1 -- 172.21.15.72:0/4083943415 shutdown_connections 2024-04-26T12:50:12.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bedad980 1 --2- 172.21.15.72:0/4083943415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533689f0 0x555c5336ade0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bedad980 1 -- 172.21.15.72:0/4083943415 >> 172.21.15.72:0/4083943415 conn(0x555c532d7bc0 msgr2=0x555c532d7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bedad980 1 -- 172.21.15.72:0/4083943415 shutdown_connections 2024-04-26T12:50:12.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.576+0000 7f42bedad980 1 -- 172.21.15.72:0/4083943415 wait complete. 2024-04-26T12:50:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.592+0000 7f42bedad980 1 Processor -- start 2024-04-26T12:50:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.592+0000 7f42bedad980 1 -- start start 2024-04-26T12:50:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.592+0000 7f42bedad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c5344f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.592+0000 7f42bedad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c53265a70 con 0x555c533644e0 2024-04-26T12:50:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.592+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c5344f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.592+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c5344f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48768/0 (socket says 172.21.15.72:48768) 2024-04-26T12:50:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.592+0000 7f42bc8c8640 1 -- 172.21.15.72:0/1397031167 learned_addr learned my addr 172.21.15.72:0/1397031167 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bc8c8640 1 -- 172.21.15.72:0/1397031167 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c5344fbd0 con 0x555c533644e0 2024-04-26T12:50:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/1397031167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c5344f600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0015f0 tx=0x7f42ac001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9fb4391f670854 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f41aae0d640 1 -- 172.21.15.72:0/1397031167 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac004530 con 0x555c533644e0 2024-04-26T12:50:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f41aae0d640 1 -- 172.21.15.72:0/1397031167 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac0046f0 con 0x555c533644e0 2024-04-26T12:50:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f41aae0d640 1 -- 172.21.15.72:0/1397031167 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac004a90 con 0x555c533644e0 2024-04-26T12:50:12.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 -- 172.21.15.72:0/1397031167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 msgr2=0x555c5344f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 --2- 172.21.15.72:0/1397031167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c5344f600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0015f0 tx=0x7f42ac001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 -- 172.21.15.72:0/1397031167 shutdown_connections 2024-04-26T12:50:12.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 --2- 172.21.15.72:0/1397031167 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c5344f600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 -- 172.21.15.72:0/1397031167 >> 172.21.15.72:0/1397031167 conn(0x555c532d7bc0 msgr2=0x555c5344b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 -- 172.21.15.72:0/1397031167 shutdown_connections 2024-04-26T12:50:12.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 -- 172.21.15.72:0/1397031167 wait complete. 2024-04-26T12:50:12.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 Processor -- start 2024-04-26T12:50:12.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 -- start start 2024-04-26T12:50:12.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c53456890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bedad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c5336de10 con 0x555c533644e0 2024-04-26T12:50:12.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c53456890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c53456890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48772/0 (socket says 172.21.15.72:48772) 2024-04-26T12:50:12.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bc8c8640 1 -- 172.21.15.72:0/3224414592 learned_addr learned my addr 172.21.15.72:0/3224414592 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bc8c8640 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c53456dd0 con 0x555c533644e0 2024-04-26T12:50:12.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.596+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c53456890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x555c53450490 tx=0x7f42ac000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f41a960a640 1 -- 172.21.15.72:0/3224414592 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac013760 con 0x555c533644e0 2024-04-26T12:50:12.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c53457060 con 0x555c533644e0 2024-04-26T12:50:12.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f41a960a640 1 -- 172.21.15.72:0/3224414592 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac013900 con 0x555c533644e0 2024-04-26T12:50:12.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f41a960a640 1 -- 172.21.15.72:0/3224414592 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac013be0 con 0x555c533644e0 2024-04-26T12:50:12.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c53459ca0 con 0x555c533644e0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f41a960a640 1 -- 172.21.15.72:0/3224414592 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42ac010070 con 0x555c533644e0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f41a960a640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41a4034650 0x7f41a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f41a960a640 1 -- 172.21.15.72:0/3224414592 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f42ac018070 con 0x555c533644e0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41a4034650 0x7f41a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c533689f0 0x555c5345d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5345de50 con 0x555c533689f0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bd0c9640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c533689f0 0x555c5345d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41a4034650 0x7f41a4036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ad000 tx=0x7f42b00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bd0c9640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c533689f0 0x555c5345d7e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bd0c9640 1 -- 172.21.15.72:0/3224414592 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b40083f0 con 0x555c533689f0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5345aec0 con 0x555c533689f0 2024-04-26T12:50:12.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bd0c9640 1 -- 172.21.15.72:0/3224414592 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42b40083f0 con 0x555c533689f0 2024-04-26T12:50:12.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53460180 0x555c53462570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c53462c40 con 0x555c53460180 2024-04-26T12:50:12.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.600+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53460180 0x555c53462570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53460180 0x555c53462570 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc8c8640 1 -- 172.21.15.72:0/3224414592 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53460180 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5345eff0 con 0x555c533689f0 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bd0c9640 1 -- 172.21.15.72:0/3224414592 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42b40083f0 con 0x555c533689f0 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c53464080 0x555c53466470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c53466be0 con 0x555c53464080 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c53464080 0x555c53466470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c53464080 0x555c53466470 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc0c7640 1 -- 172.21.15.72:0/3224414592 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f42b00b3040 con 0x555c53464080 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bedad980 1 Processor -- start 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bedad980 1 -- start start 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bedad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53474bd0 0x555c53474ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bedad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c53269ab0 con 0x555c53474bd0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53474bd0 0x555c53474ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53474bd0 0x555c53474ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48788/0 (socket says 172.21.15.72:48788) 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.604+0000 7f42bc8c8640 1 -- 172.21.15.72:0/884141871 learned_addr learned my addr 172.21.15.72:0/884141871 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc8c8640 1 -- 172.21.15.72:0/884141871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c53475530 con 0x555c53474bd0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53474bd0 0x555c53474ff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42ac006540 tx=0x7f42ac012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f41a27fc640 1 -- 172.21.15.72:0/884141871 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac020c30 con 0x555c53474bd0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c53475fd0 con 0x555c53474bd0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f41a27fc640 1 -- 172.21.15.72:0/884141871 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac020dd0 con 0x555c53474bd0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f41a27fc640 1 -- 172.21.15.72:0/884141871 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac029470 con 0x555c53474bd0 2024-04-26T12:50:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c534764a0 con 0x555c53474bd0 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f41a27fc640 1 -- 172.21.15.72:0/884141871 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42ac029610 con 0x555c53474bd0 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f41a27fc640 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4194034650 0x7f4194036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f41a27fc640 1 -- 172.21.15.72:0/884141871 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f42ac03b070 con 0x555c53474bd0 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4194034650 0x7f4194036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bedad980 1 Processor -- start 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bedad980 1 -- start start 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bedad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53481f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4194034650 0x7f4194036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ab510 tx=0x7f42b0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bedad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c5344ff20 con 0x555c53481b50 2024-04-26T12:50:12.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53481f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53481f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48804/0 (socket says 172.21.15.72:48804) 2024-04-26T12:50:12.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4093669633 learned_addr learned my addr 172.21.15.72:0/4093669633 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4093669633 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c53482540 con 0x555c53481b50 2024-04-26T12:50:12.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/4093669633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53481f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f42ac013fd0 tx=0x7f42ac0366e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bad1896f3a410f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.608+0000 7f4193fff640 1 -- 172.21.15.72:0/4093669633 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac060070 con 0x555c53481b50 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f4193fff640 1 -- 172.21.15.72:0/4093669633 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac054070 con 0x555c53481b50 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f4193fff640 1 -- 172.21.15.72:0/4093669633 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac028830 con 0x555c53481b50 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- 172.21.15.72:0/4093669633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 msgr2=0x555c53481f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 --2- 172.21.15.72:0/4093669633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53481f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f42ac013fd0 tx=0x7f42ac0366e0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- 172.21.15.72:0/4093669633 shutdown_connections 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 --2- 172.21.15.72:0/4093669633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53481f70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- 172.21.15.72:0/4093669633 >> 172.21.15.72:0/4093669633 conn(0x555c5347de90 msgr2=0x555c5347bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- 172.21.15.72:0/4093669633 shutdown_connections 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- 172.21.15.72:0/4093669633 wait complete. 2024-04-26T12:50:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 Processor -- start 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- start start 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53488e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555c53482c00 con 0x555c53481b50 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53488e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bc8c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53488e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48812/0 (socket says 172.21.15.72:48812) 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 learned_addr learned my addr 172.21.15.72:0/4272119677 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c534893b0 con 0x555c53481b50 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53488e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42ac012aa0 tx=0x7f42ac024ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f41927fc640 1 -- 172.21.15.72:0/4272119677 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac060030 con 0x555c53481b50 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c534893b0 con 0x555c53481b50 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f41927fc640 1 -- 172.21.15.72:0/4272119677 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac06c070 con 0x555c53481b50 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c534893b0 con 0x555c53481b50 2024-04-26T12:50:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f41927fc640 1 -- 172.21.15.72:0/4272119677 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac041600 con 0x555c53481b50 2024-04-26T12:50:12.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.612+0000 7f41927fc640 1 -- 172.21.15.72:0/4272119677 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42ac020070 con 0x555c53481b50 2024-04-26T12:50:12.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f41927fc640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41880346a0 0x7f4188036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f41927fc640 1 -- 172.21.15.72:0/4272119677 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f42ac061070 con 0x555c53481b50 2024-04-26T12:50:12.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41880346a0 0x7f4188036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c53493f30 0x555c534963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c53496b40 con 0x555c53493f30 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bd0c9640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c53493f30 0x555c534963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41880346a0 0x7f4188036b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42b00b6fd0 tx=0x7f42b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bd0c9640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c53493f30 0x555c534963f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b40083f0 con 0x555c53493f30 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 realm 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c53496f50 con 0x555c53493f30 2024-04-26T12:50:12.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b40083f0 con 0x555c53493f30 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c53497820 con 0x555c53493f30 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b40083f0 con 0x555c53493f30 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42b40083f0 con 0x555c53493f30 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53498920 0x555c5349ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5349b2d0 con 0x555c53498920 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53498920 0x555c5349ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.616+0000 7f42bc8c8640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53498920 0x555c5349ad10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bedad980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:12.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bedad980 20 searching for the correct realm 2024-04-26T12:50:12.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c5349d220 0x555c5349f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c5349fd00 con 0x555c5349d220 2024-04-26T12:50:12.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c5349d220 0x555c5349f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c5349d220 0x555c5349f630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc0c7640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f42b00ab030 0x7f42b00b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c5349fd00 con 0x7f42b00ab030 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f42b00ab030 0x7f42b00b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f42b00ab030 0x7f42b00b7400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b40083f0 con 0x7f42b00ab030 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b40083f0 con 0x555c53493f30 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.620+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x7f42b00ab030 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x7f42b00ab030 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x7f42b00ab030 2024-04-26T12:50:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f42b4026040 con 0x7f42b00ab030 2024-04-26T12:50:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.624+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x7f42b00ab030 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x7f42b00ab030 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.628+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x7f42b00ab030 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x7f42b00ab030 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c5349d220 2024-04-26T12:50:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53498920 2024-04-26T12:50:12.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x555c53493f30 2024-04-26T12:50:12.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c53497bc0 con 0x7f42b00ab030 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4026040 con 0x7f42b00ab030 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.632+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5349bb90 con 0x555c53493f30 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5349bb90 con 0x555c53493f30 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42b4026040 con 0x555c53493f30 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5349bb90 con 0x555c5349d220 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 zone default found 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 4 Realm: () 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 zonegroup default 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5349c550 con 0x555c53498920 2024-04-26T12:50:12.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c5349c0f0 con 0x555c5349d220 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c534a20b0 con 0x555c5349d220 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 started sync module instance, tier type = 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a14a0 con 0x7f42b00ab030 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4026040 con 0x7f42b00ab030 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93855022717376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a14a0 con 0x7f42b00ab030 2024-04-26T12:50:12.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.636+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a2b10 con 0x555c53493f30 2024-04-26T12:50:12.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.640+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.640+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93855022720608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a2a80 con 0x555c53493f30 2024-04-26T12:50:12.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.640+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a3a70 con 0x555c5349d220 2024-04-26T12:50:12.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.640+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93855022717376] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.640+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93855022720608] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.644+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.644+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93855022722816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a3550 con 0x555c5349d220 2024-04-26T12:50:12.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.644+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a4310 con 0x7f42b00ab030 2024-04-26T12:50:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.644+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.644+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93855022727024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a49e0 con 0x7f42b00ab030 2024-04-26T12:50:12.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.644+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a5500 con 0x555c53493f30 2024-04-26T12:50:12.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93855022722816] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93855022727024] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93855022731216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a54c0 con 0x555c53493f30 2024-04-26T12:50:12.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a58f0 con 0x555c53498920 2024-04-26T12:50:12.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93855022731216] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93855022728240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a58f0 con 0x555c53498920 2024-04-26T12:50:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.648+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a61d0 con 0x555c53498920 2024-04-26T12:50:12.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93855022728240] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93855022714864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a6190 con 0x555c53498920 2024-04-26T12:50:12.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a6c00 con 0x555c53498920 2024-04-26T12:50:12.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93855022714864] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93855022737104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a6de0 con 0x555c53498920 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 20 add_watcher() i=0 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 20 add_watcher() i=1 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 20 add_watcher() i=2 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 20 add_watcher() i=3 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 20 add_watcher() i=4 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 20 add_watcher() i=5 2024-04-26T12:50:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.652+0000 7f42bedad980 20 add_watcher() i=6 2024-04-26T12:50:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.656+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93855022737104] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.656+0000 7f42bedad980 20 add_watcher() i=7 2024-04-26T12:50:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.656+0000 7f42bedad980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.656+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c534aa1b0 con 0x555c53493f30 2024-04-26T12:50:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.656+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.656+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93855022738640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a75a0 con 0x555c53493f30 2024-04-26T12:50:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.660+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93855022738640] v33'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.660+0000 7f4172fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.660+0000 7f42bedad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.660+0000 7f42bedad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.660+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b2b00 con 0x555c53493f30 2024-04-26T12:50:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.660+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.660+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b3130 con 0x555c53498920 2024-04-26T12:50:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.664+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.664+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b3130 con 0x555c5349d220 2024-04-26T12:50:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.664+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.664+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b3740 con 0x555c53493f30 2024-04-26T12:50:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.668+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.668+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b3bf0 con 0x7f42b00ab030 2024-04-26T12:50:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.672+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.672+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b3fb0 con 0x555c5349d220 2024-04-26T12:50:12.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.672+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.672+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4520 con 0x555c53493f30 2024-04-26T12:50:12.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.676+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.676+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b45b0 con 0x555c53498920 2024-04-26T12:50:12.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.680+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.680+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4640 con 0x7f42b00ab030 2024-04-26T12:50:12.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.680+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.680+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b46d0 con 0x555c5349d220 2024-04-26T12:50:12.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.684+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.684+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4b80 con 0x7f42b00ab030 2024-04-26T12:50:12.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.684+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.684+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4b80 con 0x555c53498920 2024-04-26T12:50:12.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.688+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.688+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4b80 con 0x7f42b00ab030 2024-04-26T12:50:12.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.688+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.688+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4af0 con 0x555c53498920 2024-04-26T12:50:12.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.692+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.692+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4b80 con 0x555c53493f30 2024-04-26T12:50:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.692+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.692+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4b80 con 0x555c5349d220 2024-04-26T12:50:12.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.692+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.692+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b5130 con 0x7f42b00ab030 2024-04-26T12:50:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.696+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.696+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b5110 con 0x555c5349d220 2024-04-26T12:50:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.696+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.696+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b5110 con 0x555c53493f30 2024-04-26T12:50:12.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.700+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.700+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c53493f30 2024-04-26T12:50:12.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.700+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.700+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c5349d220 2024-04-26T12:50:12.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.704+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.704+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x7f42b00ab030 2024-04-26T12:50:12.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.704+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.704+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c5349d220 2024-04-26T12:50:12.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.708+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.708+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c5349d220 2024-04-26T12:50:12.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.708+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.708+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c5349d220 2024-04-26T12:50:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.712+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.712+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c5349d220 2024-04-26T12:50:12.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.712+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.712+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c53498920 2024-04-26T12:50:12.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.716+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.716+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c5349d220 2024-04-26T12:50:12.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.716+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.716+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c53498920 2024-04-26T12:50:12.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.720+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.720+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c5349d220 2024-04-26T12:50:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.720+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.720+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x555c53498920 2024-04-26T12:50:12.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.724+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.724+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534b4f40 con 0x7f42b00ab030 2024-04-26T12:50:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f4171fe3640 20 reqs_thread_entry: start 2024-04-26T12:50:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 20 Filter name: none 2024-04-26T12:50:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f40e37fe640 20 reqs_thread_entry: start 2024-04-26T12:50:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 20 rados->read ofs=0 len=0 2024-04-26T12:50:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c534aecf0 con 0x555c53493f30 2024-04-26T12:50:12.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:12.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-26T12:50:12.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:12.729 INFO:teuthology.orchestra.run.smithi072.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:50:12.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f4172fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:12.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.728+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93855022738640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534ae800 con 0x555c53493f30 2024-04-26T12:50:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.732+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93855022738640] v33'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.732+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93855022717376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a6cd0 con 0x7f42b00ab030 2024-04-26T12:50:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.732+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93855022717376] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.732+0000 7f42bedad980 20 remove_watcher() i=0 2024-04-26T12:50:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.732+0000 7f42bedad980 2 removed watcher, disabling cache 2024-04-26T12:50:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.732+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93855022720608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a6cd0 con 0x555c53493f30 2024-04-26T12:50:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.736+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93855022720608] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.736+0000 7f42bedad980 20 remove_watcher() i=1 2024-04-26T12:50:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.736+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93855022722816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a2660 con 0x555c5349d220 2024-04-26T12:50:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.736+0000 7f42bc0c7640 1 -- 172.21.15.72:0/4272119677 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93855022722816] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b00b3040 con 0x555c5349d220 2024-04-26T12:50:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.736+0000 7f42bedad980 20 remove_watcher() i=2 2024-04-26T12:50:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.736+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93855022727024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a6cd0 con 0x7f42b00ab030 2024-04-26T12:50:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.740+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93855022727024] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x7f42b00ab030 2024-04-26T12:50:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.740+0000 7f42bedad980 20 remove_watcher() i=3 2024-04-26T12:50:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.740+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93855022731216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a2660 con 0x555c53493f30 2024-04-26T12:50:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.740+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93855022731216] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4036040 con 0x555c53493f30 2024-04-26T12:50:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.740+0000 7f42bedad980 20 remove_watcher() i=4 2024-04-26T12:50:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.740+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93855022728240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a3f70 con 0x555c53498920 2024-04-26T12:50:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.744+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93855022728240] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.744+0000 7f42bedad980 20 remove_watcher() i=5 2024-04-26T12:50:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.744+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93855022714864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a6cd0 con 0x555c53498920 2024-04-26T12:50:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.744+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93855022714864] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.744+0000 7f42bedad980 20 remove_watcher() i=6 2024-04-26T12:50:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.744+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93855022737104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c534a2660 con 0x555c53498920 2024-04-26T12:50:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bc8c8640 1 -- 172.21.15.72:0/4272119677 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93855022737104] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac01b030 con 0x555c53498920 2024-04-26T12:50:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 20 remove_watcher() i=7 2024-04-26T12:50:12.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53498920 msgr2=0x555c5349ad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53498920 0x555c5349ad10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c53493f30 msgr2=0x555c534963f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c53493f30 0x555c534963f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f42b00ab030 msgr2=0x7f42b00b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f42b00ab030 0x7f42b00b7400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c5349d220 msgr2=0x555c5349f630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c5349d220 0x555c5349f630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41880346a0 msgr2=0x7f4188036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41880346a0 0x7f4188036b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42b00b6fd0 tx=0x7f42b00a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bd0c9640 1 -- 172.21.15.72:0/4272119677 reap_dead start 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 msgr2=0x555c53488e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53488e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42ac012aa0 tx=0x7f42ac024ef0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 shutdown_connections 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/4272119677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53481b50 0x555c53488e70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 >> 172.21.15.72:0/4272119677 conn(0x555c5347de90 msgr2=0x555c5347b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 shutdown_connections 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/4272119677 wait complete. 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4194034650 msgr2=0x7f4194036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4194034650 0x7f4194036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ab510 tx=0x7f42b0005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53474bd0 msgr2=0x555c53474ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53474bd0 0x555c53474ff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42ac006540 tx=0x7f42ac012950 comp rx=0 tx=0).stop 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 shutdown_connections 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4194034650 0x7f4194036b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/884141871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c53474bd0 0x555c53474ff0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 >> 172.21.15.72:0/884141871 conn(0x555c534699e0 msgr2=0x555c5346a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 shutdown_connections 2024-04-26T12:50:12.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/884141871 wait complete. 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53460180 msgr2=0x555c53462570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555c53460180 0x555c53462570 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c533689f0 msgr2=0x555c5345d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555c533689f0 0x555c5345d7e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c53464080 msgr2=0x555c53466470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555c53464080 0x555c53466470 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41a4034650 msgr2=0x7f41a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f41a4034650 0x7f41a4036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42b00ad000 tx=0x7f42b00a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 msgr2=0x555c53456890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 --2- 172.21.15.72:0/3224414592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555c533644e0 0x555c53456890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x555c53450490 tx=0x7f42ac000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bd0c9640 1 -- 172.21.15.72:0/3224414592 reap_dead start 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 shutdown_connections 2024-04-26T12:50:12.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.748+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 >> 172.21.15.72:0/3224414592 conn(0x555c532d7bc0 msgr2=0x555c53449ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.752+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 shutdown_connections 2024-04-26T12:50:12.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.752+0000 7f42bedad980 1 -- 172.21.15.72:0/3224414592 wait complete. 2024-04-26T12:50:12.766 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:50:12.766 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:50:12.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:50:12.767 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-26T12:50:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd514b3980 1 Processor -- start 2024-04-26T12:50:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd514b3980 1 -- start start 2024-04-26T12:50:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd514b3980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55aa921927f0 0x55aa92194be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd514b3980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aa9203b510 con 0x55aa9218e2e0 2024-04-26T12:50:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd514b3980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55aa92042430 con 0x55aa921927f0 2024-04-26T12:50:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd4e7cd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55aa921927f0 0x55aa92194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd4e7cd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55aa921927f0 0x55aa92194be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48826/0 (socket says 172.21.15.72:48826) 2024-04-26T12:50:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd4e7cd640 1 -- 172.21.15.72:0/3101325784 learned_addr learned my addr 172.21.15.72:0/3101325784 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd4efce640 1 --1- 172.21.15.72:0/3101325784 >> v1:172.21.15.29:6789/0 conn(0x55aa9218e2e0 0x55aa9218e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35872/0 (socket says 172.21.15.72:35872) 2024-04-26T12:50:12.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd4e7cd640 1 -- 172.21.15.72:0/3101325784 >> v1:172.21.15.29:6789/0 conn(0x55aa9218e2e0 legacy=0x55aa9218e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.852+0000 7fcd4e7cd640 1 -- 172.21.15.72:0/3101325784 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa92017ae0 con 0x55aa921927f0 2024-04-26T12:50:12.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd4e7cd640 1 --2- 172.21.15.72:0/3101325784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa921927f0 0x55aa92194be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400a5c0 tx=0x7fcd4401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbfc01b98befdfc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd4dfcc640 1 -- 172.21.15.72:0/3101325784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd440a6070 con 0x55aa921927f0 2024-04-26T12:50:12.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd4dfcc640 1 -- 172.21.15.72:0/3101325784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd440af070 con 0x55aa921927f0 2024-04-26T12:50:12.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd4dfcc640 1 -- 172.21.15.72:0/3101325784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd440aa5c0 con 0x55aa921927f0 2024-04-26T12:50:12.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd514b3980 1 -- 172.21.15.72:0/3101325784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa921927f0 msgr2=0x55aa92194be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd514b3980 1 --2- 172.21.15.72:0/3101325784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa921927f0 0x55aa92194be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400a5c0 tx=0x7fcd4401b340 comp rx=0 tx=0).stop 2024-04-26T12:50:12.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd514b3980 1 -- 172.21.15.72:0/3101325784 shutdown_connections 2024-04-26T12:50:12.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd514b3980 1 --2- 172.21.15.72:0/3101325784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa921927f0 0x55aa92194be0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd514b3980 1 -- 172.21.15.72:0/3101325784 >> 172.21.15.72:0/3101325784 conn(0x55aa92189bb0 msgr2=0x55aa9218bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd514b3980 1 -- 172.21.15.72:0/3101325784 shutdown_connections 2024-04-26T12:50:12.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.856+0000 7fcd514b3980 1 -- 172.21.15.72:0/3101325784 wait complete. 2024-04-26T12:50:12.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.872+0000 7fcd514b3980 1 Processor -- start 2024-04-26T12:50:12.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.872+0000 7fcd514b3980 1 -- start start 2024-04-26T12:50:12.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.872+0000 7fcd514b3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa922794a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.872+0000 7fcd514b3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55aa92091a70 con 0x55aa9218e2e0 2024-04-26T12:50:12.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.872+0000 7fcd4efce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa922794a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.872+0000 7fcd4efce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa922794a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48836/0 (socket says 172.21.15.72:48836) 2024-04-26T12:50:12.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.872+0000 7fcd4efce640 1 -- 172.21.15.72:0/1414135449 learned_addr learned my addr 172.21.15.72:0/1414135449 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd4efce640 1 -- 172.21.15.72:0/1414135449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa92279a70 con 0x55aa9218e2e0 2024-04-26T12:50:12.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd4efce640 1 --2- 172.21.15.72:0/1414135449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa922794a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd40001690 tx=0x7fcd40001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311b70a53c93f603 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcc3ce09640 1 -- 172.21.15.72:0/1414135449 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40003460 con 0x55aa9218e2e0 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcc3ce09640 1 -- 172.21.15.72:0/1414135449 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd40003600 con 0x55aa9218e2e0 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcc3ce09640 1 -- 172.21.15.72:0/1414135449 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40003920 con 0x55aa9218e2e0 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- 172.21.15.72:0/1414135449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 msgr2=0x55aa922794a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 --2- 172.21.15.72:0/1414135449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa922794a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd40001690 tx=0x7fcd40001b50 comp rx=0 tx=0).stop 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- 172.21.15.72:0/1414135449 shutdown_connections 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 --2- 172.21.15.72:0/1414135449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa922794a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- 172.21.15.72:0/1414135449 >> 172.21.15.72:0/1414135449 conn(0x55aa92189bb0 msgr2=0x55aa92275030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- 172.21.15.72:0/1414135449 shutdown_connections 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- 172.21.15.72:0/1414135449 wait complete. 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 Processor -- start 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- start start 2024-04-26T12:50:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa92280720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55aa92197c10 con 0x55aa9218e2e0 2024-04-26T12:50:12.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd4efce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa92280720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd4efce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa92280720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48838/0 (socket says 172.21.15.72:48838) 2024-04-26T12:50:12.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd4efce640 1 -- 172.21.15.72:0/2652106119 learned_addr learned my addr 172.21.15.72:0/2652106119 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd4efce640 1 -- 172.21.15.72:0/2652106119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa92280c60 con 0x55aa9218e2e0 2024-04-26T12:50:12.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd4efce640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa92280720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcd40000f90 tx=0x7fcd40001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcc3b606640 1 -- 172.21.15.72:0/2652106119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40022020 con 0x55aa9218e2e0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa92280ef0 con 0x55aa9218e2e0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcc3b606640 1 -- 172.21.15.72:0/2652106119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd40006840 con 0x55aa9218e2e0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcc3b606640 1 -- 172.21.15.72:0/2652106119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4001e800 con 0x55aa9218e2e0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.876+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa92283b30 con 0x55aa9218e2e0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 Processor -- start 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- start start 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa921027d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55aa92095ab0 con 0x55aa92104250 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcc3b606640 1 -- 172.21.15.72:0/2652106119 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcd40025020 con 0x55aa9218e2e0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa921027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa921027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48852/0 (socket says 172.21.15.72:48852) 2024-04-26T12:50:12.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 -- 172.21.15.72:0/2118193938 learned_addr learned my addr 172.21.15.72:0/2118193938 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcc3b606640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc34034600 0x7fcc34036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcc3b606640 1 -- 172.21.15.72:0/2652106119 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fcd40049c70 con 0x55aa9218e2e0 2024-04-26T12:50:12.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4efce640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc34034600 0x7fcc34036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 -- 172.21.15.72:0/2118193938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa92102d10 con 0x55aa92104250 2024-04-26T12:50:12.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4efce640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc34034600 0x7fcc34036ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd40026f90 tx=0x7fcd40034040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 --2- 172.21.15.72:0/2118193938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa921027d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800a440 tx=0x7fcd4800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0dd9af9e696d09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcc39602640 1 -- 172.21.15.72:0/2118193938 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48008850 con 0x55aa92104250 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcc39602640 1 -- 172.21.15.72:0/2118193938 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48008a10 con 0x55aa92104250 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcc39602640 1 -- 172.21.15.72:0/2118193938 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48008d30 con 0x55aa92104250 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- 172.21.15.72:0/2118193938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 msgr2=0x55aa921027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2118193938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa921027d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800a440 tx=0x7fcd4800a900 comp rx=0 tx=0).stop 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- 172.21.15.72:0/2118193938 shutdown_connections 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2118193938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa921027d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- 172.21.15.72:0/2118193938 >> 172.21.15.72:0/2118193938 conn(0x55aa921927f0 msgr2=0x55aa92288fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- 172.21.15.72:0/2118193938 shutdown_connections 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- 172.21.15.72:0/2118193938 wait complete. 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 Processor -- start 2024-04-26T12:50:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- start start 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa922970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd514b3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55aa92104670 con 0x55aa92104250 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa922970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa922970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48856/0 (socket says 172.21.15.72:48856) 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.880+0000 7fcd4f7cf640 1 -- 172.21.15.72:0/3846194843 learned_addr learned my addr 172.21.15.72:0/3846194843 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd4f7cf640 1 -- 172.21.15.72:0/3846194843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa922975f0 con 0x55aa92104250 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd4f7cf640 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa922970b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd48010000 tx=0x7fcd48003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcc337fe640 1 -- 172.21.15.72:0/3846194843 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48013a20 con 0x55aa92104250 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcc337fe640 1 -- 172.21.15.72:0/3846194843 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48019040 con 0x55aa92104250 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa92297880 con 0x55aa92104250 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcc337fe640 1 -- 172.21.15.72:0/3846194843 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48013d50 con 0x55aa92104250 2024-04-26T12:50:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa9229a560 con 0x55aa92104250 2024-04-26T12:50:12.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcc337fe640 1 -- 172.21.15.72:0/3846194843 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcd4801e420 con 0x55aa92104250 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 1 Processor -- start 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcc337fe640 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc280346a0 0x7fcc28036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 1 -- start start 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcc337fe640 1 -- 172.21.15.72:0/3846194843 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fcd4804a140 con 0x55aa92104250 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd4f7cf640 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc280346a0 0x7fcc28036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa922b1050 0x55aa922b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd514b3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55aa92279d60 con 0x55aa922b1050 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd4f7cf640 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc280346a0 0x7fcc28036b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd4801e8d0 tx=0x7fcd4801e760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd4efce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa922b1050 0x55aa922b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd4efce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa922b1050 0x55aa922b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48864/0 (socket says 172.21.15.72:48864) 2024-04-26T12:50:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.884+0000 7fcd4efce640 1 -- 172.21.15.72:0/1127531281 learned_addr learned my addr 172.21.15.72:0/1127531281 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd4efce640 1 -- 172.21.15.72:0/1127531281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa922b19b0 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd4efce640 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa922b1050 0x55aa922b1470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd40047ff0 tx=0x7fcd40028cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcc0effd640 1 -- 172.21.15.72:0/1127531281 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd400285f0 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa922b2390 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcc0effd640 1 -- 172.21.15.72:0/1127531281 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4001d3e0 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcc0effd640 1 -- 172.21.15.72:0/1127531281 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4001d6e0 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa922b2860 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcc0effd640 1 -- 172.21.15.72:0/1127531281 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcd40039070 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcc0effd640 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcb88034600 0x7fcb88036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcc0effd640 1 -- 172.21.15.72:0/1127531281 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fcd40043070 con 0x55aa922b1050 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd4e7cd640 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcb88034600 0x7fcb88036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcc0cff9640 20 reqs_thread_entry: start 2024-04-26T12:50:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55aa922b6b70 0x55aa922b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa922b9690 con 0x55aa922b6b70 2024-04-26T12:50:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd4e7cd640 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcb88034600 0x7fcb88036ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ae000 tx=0x7fcd440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd4f7cf640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55aa922b6b70 0x55aa922b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd4f7cf640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55aa922b6b70 0x55aa922b8fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd4f7cf640 1 -- 172.21.15.72:0/2652106119 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd48024020 con 0x55aa922b6b70 2024-04-26T12:50:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55aa922bb460 0x55aa922bd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.888+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:2 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa922bdf90 con 0x55aa922bb460 2024-04-26T12:50:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.892+0000 7fcd4efce640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55aa922bb460 0x55aa922bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.892+0000 7fcd4efce640 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55aa922bb460 0x55aa922bd850 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.892+0000 7fcd4efce640 1 -- 172.21.15.72:0/2652106119 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(2 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcd4005c040 con 0x55aa922bb460 2024-04-26T12:50:12.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.892+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa922c2d30 con 0x55aa922bb460 2024-04-26T12:50:12.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd4efce640 1 -- 172.21.15.72:0/2652106119 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [stat,call,call,writefull 0~993] v33'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fcd4005c040 con 0x55aa922bb460 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc280346a0 msgr2=0x7fcc28036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc280346a0 0x7fcc28036b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd4801e8d0 tx=0x7fcd4801e760 comp rx=0 tx=0).stop 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 msgr2=0x55aa922970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa922970b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd48010000 tx=0x7fcd48003000 comp rx=0 tx=0).stop 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 shutdown_connections 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc280346a0 0x7fcc28036b60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/3846194843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa92104250 0x55aa922970b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 >> 172.21.15.72:0/3846194843 conn(0x55aa921927f0 msgr2=0x55aa92287de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 shutdown_connections 2024-04-26T12:50:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/3846194843 wait complete. 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcb88034600 msgr2=0x7fcb88036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcb88034600 0x7fcb88036ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ae000 tx=0x7fcd440a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa922b1050 msgr2=0x55aa922b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa922b1050 0x55aa922b1470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd40047ff0 tx=0x7fcd40028cc0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 shutdown_connections 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcb88034600 0x7fcb88036ac0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/1127531281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa922b1050 0x55aa922b1470 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 >> 172.21.15.72:0/1127531281 conn(0x55aa922a5c30 msgr2=0x55aa922a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 shutdown_connections 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/1127531281 wait complete. 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55aa922bb460 msgr2=0x55aa922bd850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55aa922bb460 0x55aa922bd850 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55aa922b6b70 msgr2=0x55aa922b8fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55aa922b6b70 0x55aa922b8fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc34034600 msgr2=0x7fcc34036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc34034600 0x7fcc34036ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd40026f90 tx=0x7fcd40034040 comp rx=0 tx=0).stop 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 msgr2=0x55aa92280720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa92280720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcd40000f90 tx=0x7fcd40001260 comp rx=0 tx=0).stop 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 shutdown_connections 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55aa922bb460 0x55aa922bd850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55aa922b6b70 0x55aa922b8fe0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcc34034600 0x7fcc34036ac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 --2- 172.21.15.72:0/2652106119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55aa9218e2e0 0x55aa92280720 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 >> 172.21.15.72:0/2652106119 conn(0x55aa92189bb0 msgr2=0x55aa92273b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 shutdown_connections 2024-04-26T12:50:12.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.896+0000 7fcd514b3980 1 -- 172.21.15.72:0/2652106119 wait complete. 2024-04-26T12:50:12.907 INFO:teuthology.orchestra.run.smithi072.stdout:{"id":"fe657080-460c-4bb9-93cf-69170ee92cfa","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T12:50:12.907 DEBUG:tasks.util.rgw: json result: {'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T12:50:12.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-26T12:50:12.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-26T12:50:12.909 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-26T12:50:12.979 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:12.979 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:12.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0cbd3980 1 Processor -- start 2024-04-26T12:50:12.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0cbd3980 1 -- start start 2024-04-26T12:50:12.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0cbd3980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562db53d04d0 0x562db53d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:12.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0cbd3980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562db527b510 con 0x562db53d0df0 2024-04-26T12:50:12.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0cbd3980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x562db5282430 con 0x562db53d04d0 2024-04-26T12:50:12.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0a6ee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562db53d04d0 0x562db53d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:12.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0a6ee640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562db53d04d0 0x562db53d08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48872/0 (socket says 172.21.15.72:48872) 2024-04-26T12:50:12.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/2594651787 learned_addr learned my addr 172.21.15.72:0/2594651787 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:12.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/2594651787 >> v1:172.21.15.29:6789/0 conn(0x562db53d0df0 legacy=0x562db53d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.980+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/2594651787 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db5257ae0 con 0x562db53d04d0 2024-04-26T12:50:12.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/2594651787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db53d08b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a5c0 tx=0x7f29fc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91973a22f8791800 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:12.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a096ec640 1 -- 172.21.15.72:0/2594651787 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0a6070 con 0x562db53d04d0 2024-04-26T12:50:12.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a096ec640 1 -- 172.21.15.72:0/2594651787 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0af070 con 0x562db53d04d0 2024-04-26T12:50:12.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a096ec640 1 -- 172.21.15.72:0/2594651787 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0aa5c0 con 0x562db53d04d0 2024-04-26T12:50:12.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2594651787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 msgr2=0x562db53d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:12.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/2594651787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db53d08b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a5c0 tx=0x7f29fc01b340 comp rx=0 tx=0).stop 2024-04-26T12:50:12.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2594651787 shutdown_connections 2024-04-26T12:50:12.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/2594651787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db53d08b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:12.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2594651787 >> 172.21.15.72:0/2594651787 conn(0x562db5343bb0 msgr2=0x562db5343fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:12.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2594651787 shutdown_connections 2024-04-26T12:50:12.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:12.984+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2594651787 wait complete. 2024-04-26T12:50:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0cbd3980 1 Processor -- start 2024-04-26T12:50:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0cbd3980 1 -- start start 2024-04-26T12:50:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0cbd3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54bbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0cbd3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562db52d1a70 con 0x562db53d04d0 2024-04-26T12:50:13.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54bbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54bbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48876/0 (socket says 172.21.15.72:48876) 2024-04-26T12:50:13.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/4126559951 learned_addr learned my addr 172.21.15.72:0/4126559951 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.000+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/4126559951 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db54bc300 con 0x562db53d04d0 2024-04-26T12:50:13.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/4126559951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54bbd30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a5c0 tx=0x7f29fc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87217b4b3204a4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f28f8608640 1 -- 172.21.15.72:0/4126559951 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0aa9b0 con 0x562db53d04d0 2024-04-26T12:50:13.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f28f8608640 1 -- 172.21.15.72:0/4126559951 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0aab50 con 0x562db53d04d0 2024-04-26T12:50:13.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f28f8608640 1 -- 172.21.15.72:0/4126559951 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0aae50 con 0x562db53d04d0 2024-04-26T12:50:13.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/4126559951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 msgr2=0x562db54bbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/4126559951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54bbd30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a5c0 tx=0x7f29fc003030 comp rx=0 tx=0).stop 2024-04-26T12:50:13.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/4126559951 shutdown_connections 2024-04-26T12:50:13.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/4126559951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54bbd30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/4126559951 >> 172.21.15.72:0/4126559951 conn(0x562db5343bb0 msgr2=0x562db54b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/4126559951 shutdown_connections 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/4126559951 wait complete. 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 Processor -- start 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- start start 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562db53da520 con 0x562db53d04d0 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48882/0 (socket says 172.21.15.72:48882) 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1527603885 learned_addr learned my addr 172.21.15.72:0/1527603885 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db54c3390 con 0x562db53d04d0 2024-04-26T12:50:13.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54c2e50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a5c0 tx=0x7f29fc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f28f6e05640 1 -- 172.21.15.72:0/1527603885 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0c6750 con 0x562db53d04d0 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562db54c3620 con 0x562db53d04d0 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f28f6e05640 1 -- 172.21.15.72:0/1527603885 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0c68f0 con 0x562db53d04d0 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db54c6230 con 0x562db53d04d0 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.004+0000 7f28f6e05640 1 -- 172.21.15.72:0/1527603885 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0c6bd0 con 0x562db53d04d0 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f28f6e05640 1 -- 172.21.15.72:0/1527603885 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f29fc0ce020 con 0x562db53d04d0 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f28f6e05640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28f00346a0 0x7f28f0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f28f6e05640 1 -- 172.21.15.72:0/1527603885 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f29fc0cc020 con 0x562db53d04d0 2024-04-26T12:50:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28f00346a0 0x7f28f0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db53d0df0 0x562db54c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db54ca3a0 con 0x562db53d0df0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0aeef640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db53d0df0 0x562db54c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28f00346a0 0x7f28f0036b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001e20 tx=0x7f2a000013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0aeef640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db53d0df0 0x562db54c9d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1527603885 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db53d0df0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db54cac80 con 0x562db53d0df0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1527603885 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db53d0df0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db54cc5d0 0x562db54cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db54cf1f0 con 0x562db54cc5d0 2024-04-26T12:50:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db54cc5d0 0x562db54cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.008+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db54cc5d0 0x562db54cea60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1527603885 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f29fc0c6d70 con 0x562db54cc5d0 2024-04-26T12:50:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db54cb4d0 con 0x562db53d0df0 2024-04-26T12:50:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1527603885 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db53d0df0 2024-04-26T12:50:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db54d0650 0x562db54d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db54d3130 con 0x562db54d0650 2024-04-26T12:50:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db54d0650 0x562db54d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db54d0650 0x562db54d2a40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a09eed640 1 -- 172.21.15.72:0/1527603885 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a0000d040 con 0x562db54d0650 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 Processor -- start 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 -- start start 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54e11c0 0x562db54e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562db52d5ab0 con 0x562db54e11c0 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54e11c0 0x562db54e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54e11c0 0x562db54e15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48888/0 (socket says 172.21.15.72:48888) 2024-04-26T12:50:13.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/334484035 learned_addr learned my addr 172.21.15.72:0/334484035 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/334484035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db54e1b20 con 0x562db54e11c0 2024-04-26T12:50:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54e11c0 0x562db54e15e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01b170 tx=0x7f29fc0de0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f28effff640 1 -- 172.21.15.72:0/334484035 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0e3d40 con 0x562db54e11c0 2024-04-26T12:50:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562db54e25c0 con 0x562db54e11c0 2024-04-26T12:50:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f28effff640 1 -- 172.21.15.72:0/334484035 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0e9070 con 0x562db54e11c0 2024-04-26T12:50:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f28effff640 1 -- 172.21.15.72:0/334484035 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0c5ae0 con 0x562db54e11c0 2024-04-26T12:50:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.012+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db54e2a90 con 0x562db54e11c0 2024-04-26T12:50:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f28effff640 1 -- 172.21.15.72:0/334484035 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f29fc0c5ca0 con 0x562db54e11c0 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f28effff640 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28e40346a0 0x7f28e4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f28effff640 1 -- 172.21.15.72:0/334484035 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f29fc0efca0 con 0x562db54e11c0 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a09eed640 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28e40346a0 0x7f28e4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 Processor -- start 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 -- start start 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a09eed640 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28e40346a0 0x7f28e4036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x562db54c75b0 tx=0x7f2a00006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54ee510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562db54bc590 con 0x562db54ee0f0 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54ee510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48898/0 (socket says 172.21.15.72:48898) 2024-04-26T12:50:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/2338227228 learned_addr learned my addr 172.21.15.72:0/2338227228 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/2338227228 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db54eeae0 con 0x562db54ee0f0 2024-04-26T12:50:13.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/2338227228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54ee510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0d2480 tx=0x7f29fc0c7900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd38ec6553937f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f28edffb640 1 -- 172.21.15.72:0/2338227228 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0b5e30 con 0x562db54ee0f0 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f28edffb640 1 -- 172.21.15.72:0/2338227228 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0d08f0 con 0x562db54ee0f0 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f28edffb640 1 -- 172.21.15.72:0/2338227228 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0ba530 con 0x562db54ee0f0 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2338227228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 msgr2=0x562db54ee510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/2338227228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54ee510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0d2480 tx=0x7f29fc0c7900 comp rx=0 tx=0).stop 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2338227228 shutdown_connections 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/2338227228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54ee510 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2338227228 >> 172.21.15.72:0/2338227228 conn(0x562db54ea4c0 msgr2=0x562db54e8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2338227228 shutdown_connections 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.016+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/2338227228 wait complete. 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 Processor -- start 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 -- start start 2024-04-26T12:50:13.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562db54ef0b0 con 0x562db54ee0f0 2024-04-26T12:50:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0a6ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48912/0 (socket says 172.21.15.72:48912) 2024-04-26T12:50:13.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 learned_addr learned my addr 172.21.15.72:0/1383107428 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db54f5970 con 0x562db54ee0f0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54f5430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0d2480 tx=0x7f29fc0bbf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f28dbfff640 1 -- 172.21.15.72:0/1383107428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc114070 con 0x562db54ee0f0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562db54f5970 con 0x562db54ee0f0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f28dbfff640 1 -- 172.21.15.72:0/1383107428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0c1ad0 con 0x562db54ee0f0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db54f5de0 con 0x562db54ee0f0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f28dbfff640 1 -- 172.21.15.72:0/1383107428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0c1db0 con 0x562db54ee0f0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f28dbfff640 1 -- 172.21.15.72:0/1383107428 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f29fc117070 con 0x562db54ee0f0 2024-04-26T12:50:13.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f28dbfff640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28d4034650 0x7f28d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f28dbfff640 1 -- 172.21.15.72:0/1383107428 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f29fc10c070 con 0x562db54ee0f0 2024-04-26T12:50:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28d4034650 0x7f28d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db5500470 0x562db5502910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.020+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5503060 con 0x562db5500470 2024-04-26T12:50:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0aeef640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db5500470 0x562db5502910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28d4034650 0x7f28d4036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x562db54d3530 tx=0x7f2a00011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0aeef640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db5500470 0x562db5502910 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 realm 2024-04-26T12:50:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5503470 con 0x562db5500470 2024-04-26T12:50:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5503d10 con 0x562db5500470 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db5504e10 0x562db5507200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5507780 con 0x562db5504e10 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db5504e10 0x562db5507200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0a6ee640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db5504e10 0x562db5507200 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 20 searching for the correct realm 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db55096b0 0x562db550bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db550c240 con 0x562db55096b0 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db55096b0 0x562db550bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.024+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db55096b0 0x562db550bb70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a09eed640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a0000f3d0 0x7f2a0000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db550c240 con 0x7f2a0000f3d0 2024-04-26T12:50:13.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a0000f3d0 0x7f2a0000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a0000f3d0 0x7f2a0000f7f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.028+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.032+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.036+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db55096b0 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5504e10 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x562db5500470 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562db55040b0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5507fd0 con 0x562db5500470 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5507fd0 con 0x562db5500470 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5507fd0 con 0x562db55096b0 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 zone default found 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 4 Realm: () 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 zonegroup default 2024-04-26T12:50:13.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5508870 con 0x562db5504e10 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.040+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db550e0a0 con 0x562db55096b0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db550e440 con 0x562db55096b0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 20 started sync module instance, tier type = 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db550d540 con 0x7f2a0000f3d0 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94754315491904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db550d540 con 0x7f2a0000f3d0 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db550ee00 con 0x562db5500470 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94754315491904] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94754315496032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db550d540 con 0x562db5500470 2024-04-26T12:50:13.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.044+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db550f810 con 0x562db55096b0 2024-04-26T12:50:13.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.048+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.048+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94754315498336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5510060 con 0x562db55096b0 2024-04-26T12:50:13.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.048+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5510a80 con 0x7f2a0000f3d0 2024-04-26T12:50:13.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.048+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94754315496032] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94754315498336] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94754315502960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db550fbb0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5511320 con 0x562db5500470 2024-04-26T12:50:13.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94754315504800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5511570 con 0x562db5500470 2024-04-26T12:50:13.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5511dc0 con 0x562db5504e10 2024-04-26T12:50:13.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.052+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94754315502960] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94754315504800] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94754315505856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db550d1a0 con 0x562db5504e10 2024-04-26T12:50:13.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db55120c0 con 0x562db5504e10 2024-04-26T12:50:13.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94754315505856] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94754315508656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5512570 con 0x562db5504e10 2024-04-26T12:50:13.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.056+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5511500 con 0x562db5504e10 2024-04-26T12:50:13.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94754315508656] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94754315509888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db55124a0 con 0x562db5504e10 2024-04-26T12:50:13.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 20 add_watcher() i=0 2024-04-26T12:50:13.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 20 add_watcher() i=1 2024-04-26T12:50:13.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 20 add_watcher() i=2 2024-04-26T12:50:13.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 20 add_watcher() i=3 2024-04-26T12:50:13.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 20 add_watcher() i=4 2024-04-26T12:50:13.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 20 add_watcher() i=5 2024-04-26T12:50:13.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.060+0000 7f2a0cbd3980 20 add_watcher() i=6 2024-04-26T12:50:13.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94754315509888] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 20 add_watcher() i=7 2024-04-26T12:50:13.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:13.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5516040 con 0x562db5500470 2024-04-26T12:50:13.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94754315512672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5513430 con 0x562db5500470 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94754315512672] v33'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f28c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 5 note: GC not initialized 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f283b7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 20 Filter name: none 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f28397fa640 20 reqs_thread_entry: start 2024-04-26T12:50:13.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b80 con 0x562db5500470 2024-04-26T12:50:13.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b80 con 0x7f2a0000f3d0 2024-04-26T12:50:13.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.064+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x7f2a0000f3d0 2024-04-26T12:50:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.068+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x7f2a0000f3d0 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.072+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f28c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.076+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94754315512672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.080+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94754315512672] v33'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.080+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94754315491904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x7f2a0000f3d0 2024-04-26T12:50:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.080+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94754315491904] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.080+0000 7f2a0cbd3980 20 remove_watcher() i=0 2024-04-26T12:50:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.080+0000 7f2a0cbd3980 2 removed watcher, disabling cache 2024-04-26T12:50:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.080+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94754315496032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94754315496032] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0cbd3980 20 remove_watcher() i=1 2024-04-26T12:50:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94754315498336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db55096b0 2024-04-26T12:50:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a09eed640 1 -- 172.21.15.72:0/1383107428 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94754315498336] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00036040 con 0x562db55096b0 2024-04-26T12:50:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0cbd3980 20 remove_watcher() i=2 2024-04-26T12:50:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94754315502960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x7f2a0000f3d0 2024-04-26T12:50:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94754315502960] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x7f2a0000f3d0 2024-04-26T12:50:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0cbd3980 20 remove_watcher() i=3 2024-04-26T12:50:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.084+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94754315504800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5500470 2024-04-26T12:50:13.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.088+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94754315504800] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0400a4d0 con 0x562db5500470 2024-04-26T12:50:13.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.088+0000 7f2a0cbd3980 20 remove_watcher() i=4 2024-04-26T12:50:13.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.088+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94754315505856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.088+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94754315505856] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.092+0000 7f2a0cbd3980 20 remove_watcher() i=5 2024-04-26T12:50:13.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.092+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94754315508656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.092+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94754315508656] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.092+0000 7f2a0cbd3980 20 remove_watcher() i=6 2024-04-26T12:50:13.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.092+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94754315509888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562db5539b40 con 0x562db5504e10 2024-04-26T12:50:13.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0a6ee640 1 -- 172.21.15.72:0/1383107428 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94754315509888] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29fc116030 con 0x562db5504e10 2024-04-26T12:50:13.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 20 remove_watcher() i=7 2024-04-26T12:50:13.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db5504e10 msgr2=0x562db5507200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db5504e10 0x562db5507200 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db5500470 msgr2=0x562db5502910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db5500470 0x562db5502910 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a0000f3d0 msgr2=0x7f2a0000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a0000f3d0 0x7f2a0000f7f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db55096b0 msgr2=0x562db550bb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db55096b0 0x562db550bb70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28d4034650 msgr2=0x7f28d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28d4034650 0x7f28d4036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x562db54d3530 tx=0x7f2a00011000 comp rx=0 tx=0).stop 2024-04-26T12:50:13.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 msgr2=0x562db54f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1383107428 reap_dead start 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54f5430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0d2480 tx=0x7f29fc0bbf10 comp rx=0 tx=0).stop 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 shutdown_connections 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1383107428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54ee0f0 0x562db54f5430 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0d2480 tx=0x7f29fc0bbf10 comp rx=0 tx=0).stop 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 >> 172.21.15.72:0/1383107428 conn(0x562db54ea4c0 msgr2=0x562db54e7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 shutdown_connections 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1383107428 wait complete. 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28e40346a0 msgr2=0x7f28e4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28e40346a0 0x7f28e4036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x562db54c75b0 tx=0x7f2a00006000 comp rx=0 tx=0).stop 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54e11c0 msgr2=0x562db54e15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54e11c0 0x562db54e15e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01b170 tx=0x7f29fc0de0b0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 shutdown_connections 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28e40346a0 0x7f28e4036b60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/334484035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db54e11c0 0x562db54e15e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 >> 172.21.15.72:0/334484035 conn(0x562db54d5fd0 msgr2=0x562db54d6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 shutdown_connections 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/334484035 wait complete. 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db54cc5d0 msgr2=0x562db54cea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562db54cc5d0 0x562db54cea60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db53d0df0 msgr2=0x562db54c9d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562db53d0df0 0x562db54c9d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db54d0650 msgr2=0x562db54d2a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562db54d0650 0x562db54d2a40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28f00346a0 msgr2=0x7f28f0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f28f00346a0 0x7f28f0036b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001e20 tx=0x7f2a000013a0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 msgr2=0x562db54c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 --2- 172.21.15.72:0/1527603885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562db53d04d0 0x562db54c2e50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a5c0 tx=0x7f29fc0180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0aeef640 1 -- 172.21.15.72:0/1527603885 reap_dead start 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 shutdown_connections 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 >> 172.21.15.72:0/1527603885 conn(0x562db5343bb0 msgr2=0x562db54b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 shutdown_connections 2024-04-26T12:50:13.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.096+0000 7f2a0cbd3980 1 -- 172.21.15.72:0/1527603885 wait complete. 2024-04-26T12:50:13.106 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[],"summary":[]} 2024-04-26T12:50:13.106 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-26T12:50:13.107 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:13.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:13.107 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:13.185 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:13.185 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f59387e9980 1 Processor -- start 2024-04-26T12:50:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f59387e9980 1 -- start start 2024-04-26T12:50:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f59387e9980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea054ae880 0x55ea0553cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f59387e9980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea053e7510 con 0x55ea0553d4b0 2024-04-26T12:50:13.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f59387e9980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ea053ee430 con 0x55ea054ae880 2024-04-26T12:50:13.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f5936304640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea054ae880 0x55ea0553cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f5936304640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea054ae880 0x55ea0553cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48928/0 (socket says 172.21.15.72:48928) 2024-04-26T12:50:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f5936304640 1 -- 172.21.15.72:0/2483250802 learned_addr learned my addr 172.21.15.72:0/2483250802 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f5935b03640 1 --1- 172.21.15.72:0/2483250802 >> v1:172.21.15.29:6789/0 conn(0x55ea0553d4b0 0x55ea0553f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35892/0 (socket says 172.21.15.72:35892) 2024-04-26T12:50:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f5936304640 1 -- 172.21.15.72:0/2483250802 >> v1:172.21.15.29:6789/0 conn(0x55ea0553d4b0 legacy=0x55ea0553f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.188+0000 7f5936304640 1 -- 172.21.15.72:0/2483250802 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea053c3ae0 con 0x55ea054ae880 2024-04-26T12:50:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f5936304640 1 --2- 172.21.15.72:0/2483250802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0553cf70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f592800a5c0 tx=0x7f592801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f81571aaafe438 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f5935302640 1 -- 172.21.15.72:0/2483250802 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280a6070 con 0x55ea054ae880 2024-04-26T12:50:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f5935302640 1 -- 172.21.15.72:0/2483250802 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59280af070 con 0x55ea054ae880 2024-04-26T12:50:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f5935302640 1 -- 172.21.15.72:0/2483250802 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280aa5c0 con 0x55ea054ae880 2024-04-26T12:50:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f59387e9980 1 -- 172.21.15.72:0/2483250802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 msgr2=0x55ea0553cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f59387e9980 1 --2- 172.21.15.72:0/2483250802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0553cf70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f592800a5c0 tx=0x7f592801b340 comp rx=0 tx=0).stop 2024-04-26T12:50:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f59387e9980 1 -- 172.21.15.72:0/2483250802 shutdown_connections 2024-04-26T12:50:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f59387e9980 1 --2- 172.21.15.72:0/2483250802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0553cf70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f59387e9980 1 -- 172.21.15.72:0/2483250802 >> 172.21.15.72:0/2483250802 conn(0x55ea05534a50 msgr2=0x55ea05536e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f59387e9980 1 -- 172.21.15.72:0/2483250802 shutdown_connections 2024-04-26T12:50:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.192+0000 7f59387e9980 1 -- 172.21.15.72:0/2483250802 wait complete. 2024-04-26T12:50:13.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f59387e9980 1 Processor -- start 2024-04-26T12:50:13.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f59387e9980 1 -- start start 2024-04-26T12:50:13.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f59387e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea056254f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f59387e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea0543da70 con 0x55ea054ae880 2024-04-26T12:50:13.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea056254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea056254f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48930/0 (socket says 172.21.15.72:48930) 2024-04-26T12:50:13.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5936304640 1 -- 172.21.15.72:0/1627384916 learned_addr learned my addr 172.21.15.72:0/1627384916 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5936304640 1 -- 172.21.15.72:0/1627384916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea05625ac0 con 0x55ea054ae880 2024-04-26T12:50:13.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5936304640 1 --2- 172.21.15.72:0/1627384916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea056254f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59280ac040 tx=0x7f5928003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503add70d0562e8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5824608640 1 -- 172.21.15.72:0/1627384916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280aa9b0 con 0x55ea054ae880 2024-04-26T12:50:13.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5824608640 1 -- 172.21.15.72:0/1627384916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59280aab50 con 0x55ea054ae880 2024-04-26T12:50:13.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.208+0000 7f5824608640 1 -- 172.21.15.72:0/1627384916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280bd3f0 con 0x55ea054ae880 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- 172.21.15.72:0/1627384916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 msgr2=0x55ea056254f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 --2- 172.21.15.72:0/1627384916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea056254f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59280ac040 tx=0x7f5928003030 comp rx=0 tx=0).stop 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- 172.21.15.72:0/1627384916 shutdown_connections 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 --2- 172.21.15.72:0/1627384916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea056254f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- 172.21.15.72:0/1627384916 >> 172.21.15.72:0/1627384916 conn(0x55ea05534a50 msgr2=0x55ea05621080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- 172.21.15.72:0/1627384916 shutdown_connections 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- 172.21.15.72:0/1627384916 wait complete. 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 Processor -- start 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- start start 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0562c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea05541ad0 con 0x55ea054ae880 2024-04-26T12:50:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0562c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0562c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48934/0 (socket says 172.21.15.72:48934) 2024-04-26T12:50:13.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5936304640 1 -- 172.21.15.72:0/2124009901 learned_addr learned my addr 172.21.15.72:0/2124009901 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5936304640 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea0562cb50 con 0x55ea054ae880 2024-04-26T12:50:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5936304640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0562c610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f592801bbe0 tx=0x7f59280180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5822e05640 1 -- 172.21.15.72:0/2124009901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280c6750 con 0x55ea054ae880 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea0562cde0 con 0x55ea054ae880 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5822e05640 1 -- 172.21.15.72:0/2124009901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59280cc070 con 0x55ea054ae880 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5822e05640 1 -- 172.21.15.72:0/2124009901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280c6a40 con 0x55ea054ae880 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea0562f9f0 con 0x55ea054ae880 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.212+0000 7f5822e05640 1 -- 172.21.15.72:0/2124009901 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f59280c6be0 con 0x55ea054ae880 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5822e05640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f581c034650 0x7f581c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5822e05640 1 -- 172.21.15.72:0/2124009901 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f59280e52f0 con 0x55ea054ae880 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5935b03640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f581c034650 0x7f581c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea0553d4b0 0x55ea056334d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05633b20 con 0x55ea0553d4b0 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936b05640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea0553d4b0 0x55ea056334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5935b03640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f581c034650 0x7f581c036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f70 tx=0x7f592c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936b05640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea0553d4b0 0x55ea056334d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936b05640 1 -- 172.21.15.72:0/2124009901 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea0553d4b0 2024-04-26T12:50:13.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05630c10 con 0x55ea0553d4b0 2024-04-26T12:50:13.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936b05640 1 -- 172.21.15.72:0/2124009901 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea0553d4b0 2024-04-26T12:50:13.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea05635ea0 0x55ea05638290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05638980 con 0x55ea05635ea0 2024-04-26T12:50:13.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936304640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea05635ea0 0x55ea05638290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936304640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea05635ea0 0x55ea05638290 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936304640 1 -- 172.21.15.72:0/2124009901 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f59280c5cd0 con 0x55ea05635ea0 2024-04-26T12:50:13.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05634d40 con 0x55ea0553d4b0 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f5936b05640 1 -- 172.21.15.72:0/2124009901 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea0553d4b0 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05639de0 0x55ea0563c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.216+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea0563c910 con 0x55ea05639de0 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5935b03640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05639de0 0x55ea0563c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5935b03640 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05639de0 0x55ea0563c1d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5935b03640 1 -- 172.21.15.72:0/2124009901 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f592c00f6a0 con 0x55ea05639de0 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f59387e9980 1 Processor -- start 2024-04-26T12:50:13.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f59387e9980 1 -- start start 2024-04-26T12:50:13.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f59387e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0564a9a0 0x55ea0564adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f59387e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea05441ab0 con 0x55ea0564a9a0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0564a9a0 0x55ea0564adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0564a9a0 0x55ea0564adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48950/0 (socket says 172.21.15.72:48950) 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5936304640 1 -- 172.21.15.72:0/170370580 learned_addr learned my addr 172.21.15.72:0/170370580 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5936304640 1 -- 172.21.15.72:0/170370580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea0564b300 con 0x55ea0564a9a0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f5936304640 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0564a9a0 0x55ea0564adc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f59280d0fd0 tx=0x7f59280b38c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f581bfff640 1 -- 172.21.15.72:0/170370580 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280bcdd0 con 0x55ea0564a9a0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea0564bda0 con 0x55ea0564a9a0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea0564c270 con 0x55ea0564a9a0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f581bfff640 1 -- 172.21.15.72:0/170370580 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59280e9070 con 0x55ea0564a9a0 2024-04-26T12:50:13.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.220+0000 7f581bfff640 1 -- 172.21.15.72:0/170370580 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280f3060 con 0x55ea0564a9a0 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f581bfff640 1 -- 172.21.15.72:0/170370580 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f59280c5740 con 0x55ea0564a9a0 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f581bfff640 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f58100345b0 0x7f5810036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f581bfff640 1 -- 172.21.15.72:0/170370580 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f59280d20b0 con 0x55ea0564a9a0 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5935b03640 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f58100345b0 0x7f5810036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 Processor -- start 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- start start 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5935b03640 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f58100345b0 0x7f5810036a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55ea05634020 tx=0x7f592c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea05657d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea05625d50 con 0x55ea056579b0 2024-04-26T12:50:13.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea05657d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea05657d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48964/0 (socket says 172.21.15.72:48964) 2024-04-26T12:50:13.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5936304640 1 -- 172.21.15.72:0/2658261277 learned_addr learned my addr 172.21.15.72:0/2658261277 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5936304640 1 -- 172.21.15.72:0/2658261277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea05658360 con 0x55ea056579b0 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5936304640 1 --2- 172.21.15.72:0/2658261277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea05657d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f59280e3230 tx=0x7f59280de910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab2f2eb6a0a7044 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5819ffb640 1 -- 172.21.15.72:0/2658261277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280e48b0 con 0x55ea056579b0 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5819ffb640 1 -- 172.21.15.72:0/2658261277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59280c95f0 con 0x55ea056579b0 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f5819ffb640 1 -- 172.21.15.72:0/2658261277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280ae180 con 0x55ea056579b0 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- 172.21.15.72:0/2658261277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 msgr2=0x55ea05657d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 --2- 172.21.15.72:0/2658261277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea05657d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f59280e3230 tx=0x7f59280de910 comp rx=0 tx=0).stop 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- 172.21.15.72:0/2658261277 shutdown_connections 2024-04-26T12:50:13.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 --2- 172.21.15.72:0/2658261277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea05657d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- 172.21.15.72:0/2658261277 >> 172.21.15.72:0/2658261277 conn(0x55ea05653d40 msgr2=0x55ea05651da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- 172.21.15.72:0/2658261277 shutdown_connections 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- 172.21.15.72:0/2658261277 wait complete. 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 Processor -- start 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- start start 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea0565ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.224+0000 7f59387e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea05658930 con 0x55ea056579b0 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea0565ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea0565ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48978/0 (socket says 172.21.15.72:48978) 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 learned_addr learned my addr 172.21.15.72:0/2903581808 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea0565f1a0 con 0x55ea056579b0 2024-04-26T12:50:13.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936304640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea0565ec60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59280f1040 tx=0x7f59280eaf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5807fff640 1 -- 172.21.15.72:0/2903581808 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280de490 con 0x55ea056579b0 2024-04-26T12:50:13.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea0565f1a0 con 0x55ea056579b0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5807fff640 1 -- 172.21.15.72:0/2903581808 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59280b5c40 con 0x55ea056579b0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5807fff640 1 -- 172.21.15.72:0/2903581808 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59280e4a70 con 0x55ea056579b0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea0565f610 con 0x55ea056579b0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5807fff640 1 -- 172.21.15.72:0/2903581808 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f59280e4c10 con 0x55ea056579b0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5807fff640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5800034600 0x7f5800036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5807fff640 1 -- 172.21.15.72:0/2903581808 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f5928115c40 con 0x55ea056579b0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5935b03640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5800034600 0x7f5800036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea05669d30 0x55ea0566c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566c920 con 0x55ea05669d30 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936b05640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea05669d30 0x55ea0566c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5935b03640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5800034600 0x7f5800036ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f592c00ffd0 tx=0x7f592c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936b05640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea05669d30 0x55ea0566c1d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 20 realm 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.228+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566cd30 con 0x55ea05669d30 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d5d0 con 0x55ea05669d30 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea0566e6d0 0x55ea05670ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05671040 con 0x55ea0566e6d0 2024-04-26T12:50:13.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936304640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea0566e6d0 0x55ea05670ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936304640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea0566e6d0 0x55ea05670ac0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:13.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 20 searching for the correct realm 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05672fb0 0x55ea05675470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea05675b40 con 0x55ea05672fb0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5935b03640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05672fb0 0x55ea05675470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5935b03640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05672fb0 0x55ea05675470 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5935b03640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f592c01fbe0 0x7f592c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea05675b40 con 0x7f592c01fbe0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936b05640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f592c01fbe0 0x7f592c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.232+0000 7f5936b05640 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f592c01fbe0 0x7f592c03a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x7f592c01fbe0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.236+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x7f592c01fbe0 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.240+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x7f592c01fbe0 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x7f592c01fbe0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05672fb0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.244+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea0566e6d0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x55ea05669d30 2024-04-26T12:50:13.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea0566d970 con 0x7f592c01fbe0 2024-04-26T12:50:13.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05671890 con 0x55ea05669d30 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05671890 con 0x55ea05669d30 2024-04-26T12:50:13.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05671890 con 0x55ea05672fb0 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 zone default found 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 4 Realm: () 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 zonegroup default 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05672130 con 0x55ea0566e6d0 2024-04-26T12:50:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea056779a0 con 0x55ea05672fb0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.248+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05677d40 con 0x55ea05672fb0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 20 started sync module instance, tier type = 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05676e40 con 0x7f592c01fbe0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94463601374016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05676e40 con 0x7f592c01fbe0 2024-04-26T12:50:13.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05678800 con 0x55ea05669d30 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94463601374016] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94463601378032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05676e40 con 0x55ea05669d30 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.252+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05679210 con 0x55ea05672fb0 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94463601380704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05679ab0 con 0x55ea05672fb0 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94463601378032] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05676990 con 0x7f592c01fbe0 2024-04-26T12:50:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94463601385408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567a890 con 0x7f592c01fbe0 2024-04-26T12:50:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567b250 con 0x55ea05669d30 2024-04-26T12:50:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.256+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94463601380704] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94463601382912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567b250 con 0x55ea05669d30 2024-04-26T12:50:13.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567bb50 con 0x55ea0566e6d0 2024-04-26T12:50:13.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94463601385408] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94463601382912] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94463601386464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567b750 con 0x55ea0566e6d0 2024-04-26T12:50:13.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.260+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567b250 con 0x55ea0566e6d0 2024-04-26T12:50:13.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94463601386464] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94463601393968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567b250 con 0x55ea0566e6d0 2024-04-26T12:50:13.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567cd00 con 0x55ea0566e6d0 2024-04-26T12:50:13.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94463601393968] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94463601388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567b1c0 con 0x55ea0566e6d0 2024-04-26T12:50:13.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 20 add_watcher() i=0 2024-04-26T12:50:13.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 20 add_watcher() i=1 2024-04-26T12:50:13.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 20 add_watcher() i=2 2024-04-26T12:50:13.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 20 add_watcher() i=3 2024-04-26T12:50:13.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 20 add_watcher() i=4 2024-04-26T12:50:13.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 20 add_watcher() i=5 2024-04-26T12:50:13.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.264+0000 7f59387e9980 20 add_watcher() i=6 2024-04-26T12:50:13.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94463601388960] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f59387e9980 20 add_watcher() i=7 2024-04-26T12:50:13.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f59387e9980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:13.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea05680200 con 0x55ea05669d30 2024-04-26T12:50:13.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94463601396928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea0567d720 con 0x55ea05669d30 2024-04-26T12:50:13.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94463601396928] v33'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f57ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f59387e9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f59387e9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.268+0000 7f59387e9980 5 note: GC not initialized 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f57677fe640 20 reqs_thread_entry: start 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f59387e9980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f59387e9980 20 Filter name: none 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f57657fa640 20 reqs_thread_entry: start 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f59387e9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea056a3530 con 0x55ea05669d30 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f59387e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:could not fetch user info: no user info saved 2024-04-26T12:50:13.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f57ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94463601396928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea056a34f0 con 0x55ea05669d30 2024-04-26T12:50:13.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94463601396928] v33'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.272+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94463601374016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea056a34f0 con 0x7f592c01fbe0 2024-04-26T12:50:13.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.276+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94463601374016] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.276+0000 7f59387e9980 20 remove_watcher() i=0 2024-04-26T12:50:13.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.276+0000 7f59387e9980 2 removed watcher, disabling cache 2024-04-26T12:50:13.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.276+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94463601378032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea056a34f0 con 0x55ea05669d30 2024-04-26T12:50:13.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.276+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94463601378032] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.276+0000 7f59387e9980 20 remove_watcher() i=1 2024-04-26T12:50:13.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.276+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94463601380704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea056a34f0 con 0x55ea05672fb0 2024-04-26T12:50:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f5935b03640 1 -- 172.21.15.72:0/2903581808 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94463601380704] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592c037040 con 0x55ea05672fb0 2024-04-26T12:50:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f59387e9980 20 remove_watcher() i=2 2024-04-26T12:50:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94463601385408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05677340 con 0x7f592c01fbe0 2024-04-26T12:50:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94463601385408] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x7f592c01fbe0 2024-04-26T12:50:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f59387e9980 20 remove_watcher() i=3 2024-04-26T12:50:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94463601382912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea056782f0 con 0x55ea05669d30 2024-04-26T12:50:13.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94463601382912] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f593000a4d0 con 0x55ea05669d30 2024-04-26T12:50:13.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f59387e9980 20 remove_watcher() i=4 2024-04-26T12:50:13.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.280+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94463601386464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05679fc0 con 0x55ea0566e6d0 2024-04-26T12:50:13.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.284+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94463601386464] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.284+0000 7f59387e9980 20 remove_watcher() i=5 2024-04-26T12:50:13.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.284+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94463601393968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea05677340 con 0x55ea0566e6d0 2024-04-26T12:50:13.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.284+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94463601393968] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.284+0000 7f59387e9980 20 remove_watcher() i=6 2024-04-26T12:50:13.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.284+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94463601388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea056782f0 con 0x55ea0566e6d0 2024-04-26T12:50:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f5936304640 1 -- 172.21.15.72:0/2903581808 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94463601388960] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f592811a020 con 0x55ea0566e6d0 2024-04-26T12:50:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 20 remove_watcher() i=7 2024-04-26T12:50:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea0566e6d0 msgr2=0x55ea05670ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea0566e6d0 0x55ea05670ac0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea05669d30 msgr2=0x55ea0566c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea05669d30 0x55ea0566c1d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f592c01fbe0 msgr2=0x7f592c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f592c01fbe0 0x7f592c03a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05672fb0 msgr2=0x55ea05675470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05672fb0 0x55ea05675470 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5800034600 msgr2=0x7f5800036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5800034600 0x7f5800036ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f592c00ffd0 tx=0x7f592c010000 comp rx=0 tx=0).stop 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 msgr2=0x55ea0565ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f5936b05640 1 -- 172.21.15.72:0/2903581808 reap_dead start 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea0565ec60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59280f1040 tx=0x7f59280eaf20 comp rx=0 tx=0).stop 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 shutdown_connections 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2903581808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea056579b0 0x55ea0565ec60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 >> 172.21.15.72:0/2903581808 conn(0x55ea05653d40 msgr2=0x55ea056513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 shutdown_connections 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2903581808 wait complete. 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f58100345b0 msgr2=0x7f5810036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f58100345b0 0x7f5810036a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55ea05634020 tx=0x7f592c00f000 comp rx=0 tx=0).stop 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0564a9a0 msgr2=0x55ea0564adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0564a9a0 0x55ea0564adc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f59280d0fd0 tx=0x7f59280b38c0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 shutdown_connections 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f58100345b0 0x7f5810036a70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/170370580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0564a9a0 0x55ea0564adc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 >> 172.21.15.72:0/170370580 conn(0x55ea0563f7b0 msgr2=0x55ea056402c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 shutdown_connections 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/170370580 wait complete. 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea05635ea0 msgr2=0x55ea05638290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea05635ea0 0x55ea05638290 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea0553d4b0 msgr2=0x55ea056334d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea0553d4b0 0x55ea056334d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05639de0 msgr2=0x55ea0563c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea05639de0 0x55ea0563c1d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f581c034650 msgr2=0x7f581c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f581c034650 0x7f581c036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f70 tx=0x7f592c001380 comp rx=0 tx=0).stop 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 msgr2=0x55ea0562c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 --2- 172.21.15.72:0/2124009901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea054ae880 0x55ea0562c610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f592801bbe0 tx=0x7f59280180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f5936b05640 1 -- 172.21.15.72:0/2124009901 reap_dead start 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 shutdown_connections 2024-04-26T12:50:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 >> 172.21.15.72:0/2124009901 conn(0x55ea05534a50 msgr2=0x55ea0561fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 shutdown_connections 2024-04-26T12:50:13.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.288+0000 7f59387e9980 1 -- 172.21.15.72:0/2124009901 wait complete. 2024-04-26T12:50:13.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:50:13.300 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-26T12:50:13.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-26T12:50:13.301 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-26T12:50:13.389 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:13.389 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:13.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f590358b980 1 Processor -- start 2024-04-26T12:50:13.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f590358b980 1 -- start start 2024-04-26T12:50:13.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f590358b980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56424250d5b0 0x5642425a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f590358b980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564242445510 con 0x56424250e8f0 2024-04-26T12:50:13.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f590358b980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56424244c430 con 0x56424250d5b0 2024-04-26T12:50:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f59010a6640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56424250e8f0 0x56424250cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35902/0 (socket says 172.21.15.72:35902) 2024-04-26T12:50:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f59008a5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56424250d5b0 0x5642425a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f59010a6640 1 -- 172.21.15.72:0/1643145210 learned_addr learned my addr 172.21.15.72:0/1643145210 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f59008a5640 1 -- 172.21.15.72:0/1643145210 >> v1:172.21.15.29:6789/0 conn(0x56424250e8f0 legacy=0x56424250cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f58f3fff640 1 -- 172.21.15.72:0/1643145210 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036093082 0 0) 0x564242445510 con 0x56424250e8f0 2024-04-26T12:50:13.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.392+0000 7f59008a5640 1 -- 172.21.15.72:0/1643145210 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564242421ae0 con 0x56424250d5b0 2024-04-26T12:50:13.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f59008a5640 1 --2- 172.21.15.72:0/1643145210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x5642425a1270 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f58f800a480 tx=0x7f58f801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df720345eeaef89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f58f3fff640 1 -- 172.21.15.72:0/1643145210 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f80b0070 con 0x56424250d5b0 2024-04-26T12:50:13.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f58f3fff640 1 -- 172.21.15.72:0/1643145210 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f80ab540 con 0x56424250d5b0 2024-04-26T12:50:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f58f3fff640 1 -- 172.21.15.72:0/1643145210 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f80ab840 con 0x56424250d5b0 2024-04-26T12:50:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f590358b980 1 -- 172.21.15.72:0/1643145210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 msgr2=0x5642425a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f590358b980 1 --2- 172.21.15.72:0/1643145210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x5642425a1270 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f58f800a480 tx=0x7f58f801b280 comp rx=0 tx=0).stop 2024-04-26T12:50:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f590358b980 1 -- 172.21.15.72:0/1643145210 shutdown_connections 2024-04-26T12:50:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f590358b980 1 --2- 172.21.15.72:0/1643145210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x5642425a1270 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f590358b980 1 -- 172.21.15.72:0/1643145210 >> 172.21.15.72:0/1643145210 conn(0x564242593b30 msgr2=0x564242595f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f590358b980 1 -- 172.21.15.72:0/1643145210 shutdown_connections 2024-04-26T12:50:13.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.396+0000 7f590358b980 1 -- 172.21.15.72:0/1643145210 wait complete. 2024-04-26T12:50:13.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f590358b980 1 Processor -- start 2024-04-26T12:50:13.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f590358b980 1 -- start start 2024-04-26T12:50:13.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f590358b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x564242685910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f590358b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56424249ba70 con 0x56424250d5b0 2024-04-26T12:50:13.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x564242685910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x564242685910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48990/0 (socket says 172.21.15.72:48990) 2024-04-26T12:50:13.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f59010a6640 1 -- 172.21.15.72:0/652974385 learned_addr learned my addr 172.21.15.72:0/652974385 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f59010a6640 1 -- 172.21.15.72:0/652974385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564242685ee0 con 0x56424250d5b0 2024-04-26T12:50:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f59010a6640 1 --2- 172.21.15.72:0/652974385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x564242685910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0016c0 tx=0x7f58fc001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f22e45b5af1368a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f57ef606640 1 -- 172.21.15.72:0/652974385 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc003460 con 0x56424250d5b0 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f57ef606640 1 -- 172.21.15.72:0/652974385 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc003600 con 0x56424250d5b0 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.412+0000 7f57ef606640 1 -- 172.21.15.72:0/652974385 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc003920 con 0x56424250d5b0 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- 172.21.15.72:0/652974385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 msgr2=0x564242685910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 --2- 172.21.15.72:0/652974385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x564242685910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0016c0 tx=0x7f58fc001b80 comp rx=0 tx=0).stop 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- 172.21.15.72:0/652974385 shutdown_connections 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 --2- 172.21.15.72:0/652974385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x564242685910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- 172.21.15.72:0/652974385 >> 172.21.15.72:0/652974385 conn(0x564242593b30 msgr2=0x5642426814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- 172.21.15.72:0/652974385 shutdown_connections 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- 172.21.15.72:0/652974385 wait complete. 2024-04-26T12:50:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 Processor -- start 2024-04-26T12:50:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- start start 2024-04-26T12:50:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x56424268cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5642425a42a0 con 0x56424250d5b0 2024-04-26T12:50:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x56424268cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x56424268cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48992/0 (socket says 172.21.15.72:48992) 2024-04-26T12:50:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f59010a6640 1 -- 172.21.15.72:0/1637629744 learned_addr learned my addr 172.21.15.72:0/1637629744 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f59010a6640 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424268d140 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f59010a6640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x56424268cc00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0012f0 tx=0x7f58fc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f57ede03640 1 -- 172.21.15.72:0/1637629744 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc013760 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56424268d3d0 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f57ede03640 1 -- 172.21.15.72:0/1637629744 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc023070 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564242690060 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.416+0000 7f57ede03640 1 -- 172.21.15.72:0/1637629744 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc013a30 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f57ede03640 1 -- 172.21.15.72:0/1637629744 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58fc010070 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f57ede03640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57e80346a0 0x7f57e8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f57ede03640 1 -- 172.21.15.72:0/1637629744 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f58fc049d20 con 0x56424250d5b0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59008a5640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57e80346a0 0x7f57e8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56424250e8f0 0x564242693b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426941c0 con 0x56424250e8f0 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59018a7640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56424250e8f0 0x564242693b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59008a5640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57e80346a0 0x7f57e8036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ad000 tx=0x7f58f80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59018a7640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56424250e8f0 0x564242693b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59018a7640 1 -- 172.21.15.72:0/1637629744 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f40083f0 con 0x56424250e8f0 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564242691280 con 0x56424250e8f0 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59018a7640 1 -- 172.21.15.72:0/1637629744 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58f40083f0 con 0x56424250e8f0 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564242696510 0x564242698900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564242698fd0 con 0x564242696510 2024-04-26T12:50:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59010a6640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564242696510 0x564242698900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59010a6640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564242696510 0x564242698900 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f59010a6640 1 -- 172.21.15.72:0/1637629744 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f58fc00f030 con 0x564242696510 2024-04-26T12:50:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.420+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426953b0 con 0x56424250e8f0 2024-04-26T12:50:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59018a7640 1 -- 172.21.15.72:0/1637629744 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58f40083f0 con 0x56424250e8f0 2024-04-26T12:50:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56424269a410 0x56424269c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56424269cf90 con 0x56424269a410 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59008a5640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56424269a410 0x56424269c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59008a5640 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56424269a410 0x56424269c800 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59008a5640 1 -- 172.21.15.72:0/1637629744 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f58f80b3040 con 0x56424269a410 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 Processor -- start 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 -- start start 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426aafe0 0x5642426ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56424249fab0 con 0x5642426aafe0 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426aafe0 0x5642426ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426aafe0 0x5642426ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49004/0 (socket says 172.21.15.72:49004) 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59010a6640 1 -- 172.21.15.72:0/2280740444 learned_addr learned my addr 172.21.15.72:0/2280740444 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59010a6640 1 -- 172.21.15.72:0/2280740444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642426ab940 con 0x5642426aafe0 2024-04-26T12:50:13.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f59010a6640 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426aafe0 0x5642426ab400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58fc01dfd0 tx=0x7f58fc028bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f57e6ffd640 1 -- 172.21.15.72:0/2280740444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc041e60 con 0x5642426aafe0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642426ac3e0 con 0x5642426aafe0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f57e6ffd640 1 -- 172.21.15.72:0/2280740444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc019040 con 0x5642426aafe0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f57e6ffd640 1 -- 172.21.15.72:0/2280740444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc041c60 con 0x5642426aafe0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.424+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642426ac8b0 con 0x5642426aafe0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f57e6ffd640 1 -- 172.21.15.72:0/2280740444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58fc041170 con 0x5642426aafe0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f57e6ffd640 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57d8034650 0x7f57d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f57e6ffd640 1 -- 172.21.15.72:0/2280740444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f58fc0157e0 con 0x5642426aafe0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f59008a5640 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57d8034650 0x7f57d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 Processor -- start 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 -- start start 2024-04-26T12:50:13.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f59008a5640 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57d8034650 0x7f57d8036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000c10 tx=0x7f58f8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564242686230 con 0x5642426b81b0 2024-04-26T12:50:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49018/0 (socket says 172.21.15.72:49018) 2024-04-26T12:50:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f59010a6640 1 -- 172.21.15.72:0/3694111240 learned_addr learned my addr 172.21.15.72:0/3694111240 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f59010a6640 1 -- 172.21.15.72:0/3694111240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642426b8ba0 con 0x5642426b81b0 2024-04-26T12:50:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f59010a6640 1 --2- 172.21.15.72:0/3694111240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426b85d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58fc027c00 tx=0x7f58fc026640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e7485b3ae4309e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f57e4ff9640 1 -- 172.21.15.72:0/3694111240 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc01d590 con 0x5642426b81b0 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f57e4ff9640 1 -- 172.21.15.72:0/3694111240 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc04e070 con 0x5642426b81b0 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f57e4ff9640 1 -- 172.21.15.72:0/3694111240 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc032af0 con 0x5642426b81b0 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 -- 172.21.15.72:0/3694111240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 msgr2=0x5642426b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 --2- 172.21.15.72:0/3694111240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426b85d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58fc027c00 tx=0x7f58fc026640 comp rx=0 tx=0).stop 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 -- 172.21.15.72:0/3694111240 shutdown_connections 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 --2- 172.21.15.72:0/3694111240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426b85d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 -- 172.21.15.72:0/3694111240 >> 172.21.15.72:0/3694111240 conn(0x5642426b44f0 msgr2=0x5642426b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 -- 172.21.15.72:0/3694111240 shutdown_connections 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 -- 172.21.15.72:0/3694111240 wait complete. 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.428+0000 7f590358b980 1 Processor -- start 2024-04-26T12:50:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 1 -- start start 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426bf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5642426b9240 con 0x5642426b81b0 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59010a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426bf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49034/0 (socket says 172.21.15.72:49034) 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 learned_addr learned my addr 172.21.15.72:0/3082189782 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642426bf9d0 con 0x5642426b81b0 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59010a6640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426bf490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f58fc027c00 tx=0x7f58fc0154f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f57d6ffd640 1 -- 172.21.15.72:0/3082189782 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc074070 con 0x5642426b81b0 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5642426bf9d0 con 0x5642426b81b0 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f57d6ffd640 1 -- 172.21.15.72:0/3082189782 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc069070 con 0x5642426b81b0 2024-04-26T12:50:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f57d6ffd640 1 -- 172.21.15.72:0/3082189782 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58fc041520 con 0x5642426b81b0 2024-04-26T12:50:13.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642426bfe40 con 0x5642426b81b0 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f57d6ffd640 1 -- 172.21.15.72:0/3082189782 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58fc077070 con 0x5642426b81b0 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f57d6ffd640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57cc034650 0x7f57cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f57d6ffd640 1 -- 172.21.15.72:0/3082189782 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f58fc07ac80 con 0x5642426b81b0 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59008a5640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57cc034650 0x7f57cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5642426ca5a0 0x5642426cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426cd1b0 con 0x5642426ca5a0 2024-04-26T12:50:13.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59018a7640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5642426ca5a0 0x5642426cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.432+0000 7f59008a5640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57cc034650 0x7f57cc036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56424269d390 tx=0x7f58f80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59018a7640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5642426ca5a0 0x5642426cca60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f40083f0 con 0x5642426ca5a0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 realm 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426cd5c0 con 0x5642426ca5a0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f40083f0 con 0x5642426ca5a0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426cde90 con 0x5642426ca5a0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f40083f0 con 0x5642426ca5a0 2024-04-26T12:50:13.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58f40083f0 con 0x5642426ca5a0 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5642426cef90 0x5642426d1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426d1990 con 0x5642426cef90 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59010a6640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5642426cef90 0x5642426d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59010a6640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5642426cef90 0x5642426d1380 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 20 searching for the correct realm 2024-04-26T12:50:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5642426d38e0 0x5642426d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426d63c0 con 0x5642426d38e0 2024-04-26T12:50:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59008a5640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5642426d38e0 0x5642426d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.436+0000 7f59008a5640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5642426d38e0 0x5642426d5cf0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59008a5640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f58f80cc040 0x7f58f80dc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426d63c0 con 0x7f58f80cc040 2024-04-26T12:50:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f58f80cc040 0x7f58f80dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f58f80cc040 0x7f58f80dc430 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f40083f0 con 0x7f58f80cc040 2024-04-26T12:50:13.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f40083f0 con 0x5642426ca5a0 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.440+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x7f58f80cc040 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x7f58f80cc040 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x7f58f80cc040 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f58f4026040 con 0x7f58f80cc040 2024-04-26T12:50:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.444+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x7f58f80cc040 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x7f58f80cc040 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.448+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x7f58f80cc040 2024-04-26T12:50:13.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x7f58f80cc040 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426d38e0 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426cef90 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x5642426ca5a0 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5642426ce230 con 0x7f58f80cc040 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f4026040 con 0x7f58f80cc040 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426d2250 con 0x5642426ca5a0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426d2250 con 0x5642426ca5a0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58f4026040 con 0x5642426ca5a0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426d2250 con 0x5642426d38e0 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 zone default found 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 4 Realm: () 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 zonegroup default 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.452+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426d2ba0 con 0x5642426cef90 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426d8280 con 0x5642426d38e0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426d86c0 con 0x5642426d38e0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 20 started sync module instance, tier type = 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426d76c0 con 0x7f58f80cc040 2024-04-26T12:50:13.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4026040 con 0x7f58f80cc040 2024-04-26T12:50:13.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94842582301632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426d76c0 con 0x7f58f80cc040 2024-04-26T12:50:13.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.456+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426d91d0 con 0x5642426ca5a0 2024-04-26T12:50:13.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.460+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.460+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94842582305984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426d9190 con 0x5642426ca5a0 2024-04-26T12:50:13.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.460+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426da0f0 con 0x5642426d38e0 2024-04-26T12:50:13.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.460+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94842582301632] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94842582305984] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94842582308288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426d7210 con 0x5642426d38e0 2024-04-26T12:50:13.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426da990 con 0x7f58f80cc040 2024-04-26T12:50:13.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94842582312432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426db040 con 0x7f58f80cc040 2024-04-26T12:50:13.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426dbb30 con 0x5642426ca5a0 2024-04-26T12:50:13.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.464+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94842582308288] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94842582316544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426dbaf0 con 0x5642426ca5a0 2024-04-26T12:50:13.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426dc540 con 0x5642426cef90 2024-04-26T12:50:13.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94842582312432] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94842582319248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426dc8e0 con 0x5642426cef90 2024-04-26T12:50:13.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426dd130 con 0x5642426cef90 2024-04-26T12:50:13.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.468+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94842582316544] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94842582322304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426dd550 con 0x5642426cef90 2024-04-26T12:50:13.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94842582319248] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426daa90 con 0x5642426cef90 2024-04-26T12:50:13.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94842582313616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426ddf10 con 0x5642426cef90 2024-04-26T12:50:13.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 20 add_watcher() i=0 2024-04-26T12:50:13.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 20 add_watcher() i=1 2024-04-26T12:50:13.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 20 add_watcher() i=2 2024-04-26T12:50:13.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 20 add_watcher() i=3 2024-04-26T12:50:13.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 20 add_watcher() i=4 2024-04-26T12:50:13.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 20 add_watcher() i=5 2024-04-26T12:50:13.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94842582322304] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.472+0000 7f590358b980 20 add_watcher() i=6 2024-04-26T12:50:13.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94842582313616] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f590358b980 20 add_watcher() i=7 2024-04-26T12:50:13.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f590358b980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:13.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642426dd0a0 con 0x5642426ca5a0 2024-04-26T12:50:13.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94842582323360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642426de310 con 0x5642426ca5a0 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94842582323360] v33'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f57b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f590358b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f590358b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.476+0000 7f590358b980 5 note: GC not initialized 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f57b6fe5640 20 reqs_thread_entry: start 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 Filter name: none 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f57b4fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642427047e0 con 0x5642426ca5a0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564242702e20 con 0x5642426ca5a0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564242703210 con 0x5642426cef90 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-26T12:50:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242703780 con 0x5642426ca5a0 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94842582483504 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564242708300 con 0x5642426ca5a0 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== watch-notify(notify (1) cookie 94842582316544 notify 141733920768 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564242703b20 con 0x5642426ca5a0 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f57e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94842582316544 notifier 4300 bl.length()=567 2024-04-26T12:50:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f57e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f57e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 notify.4 [notify cookie 94842582483504 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.480+0000 7f57e4ff9640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f57c4003eb0 con 0x5642426ca5a0 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== watch-notify(notify_complete (2) cookie 94842582483504 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564242703370 con 0x5642426ca5a0 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242704230 con 0x5642426ca5a0 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f590358b980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f590358b980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f590358b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94842582483504 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564242708730 con 0x7f58f80cc040 2024-04-26T12:50:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== watch-notify(notify (1) cookie 94842582312432 notify 141733920768 ret 0) ==== 211+0+0 (crc 0 0 0) 0x564242703370 con 0x7f58f80cc040 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f57e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94842582312432 notifier 4300 bl.length()=169 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(69 notify.3 [notify cookie 94842582483504 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f57e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f57e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f57e4ff9640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f57c4003eb0 con 0x7f58f80cc040 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== watch-notify(notify_complete (2) cookie 94842582483504 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f58f4010040 con 0x7f58f80cc040 2024-04-26T12:50:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.484+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5642427063c0 con 0x5642426cef90 2024-04-26T12:50:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f590358b980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-26T12:50:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f590358b980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f590358b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94842582490544 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5642427063c0 con 0x7f58f80cc040 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== watch-notify(notify (1) cookie 94842582312432 notify 141733920769 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f58f4010040 con 0x7f58f80cc040 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f57e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94842582312432 notifier 4300 bl.length()=177 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f57e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f57e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(72 notify.3 [notify cookie 94842582490544 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f57e4ff9640 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f57c4003eb0 con 0x7f58f80cc040 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== watch-notify(notify_complete (2) cookie 94842582490544 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f58f402a730 con 0x7f58f80cc040 2024-04-26T12:50:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.490 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:13.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f57b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.488+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94842582323360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x5642426ca5a0 2024-04-26T12:50:13.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.492+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94842582323360] v33'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.492+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94842582301632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x7f58f80cc040 2024-04-26T12:50:13.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.492+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94842582301632] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.492+0000 7f590358b980 20 remove_watcher() i=0 2024-04-26T12:50:13.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.492+0000 7f590358b980 2 removed watcher, disabling cache 2024-04-26T12:50:13.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.492+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94842582305984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x5642426ca5a0 2024-04-26T12:50:13.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94842582305984] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f590358b980 20 remove_watcher() i=1 2024-04-26T12:50:13.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94842582308288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x5642426d38e0 2024-04-26T12:50:13.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f59008a5640 1 -- 172.21.15.72:0/3082189782 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94842582308288] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f80c8030 con 0x5642426d38e0 2024-04-26T12:50:13.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f590358b980 20 remove_watcher() i=2 2024-04-26T12:50:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94842582312432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x7f58f80cc040 2024-04-26T12:50:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94842582312432] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x7f58f80cc040 2024-04-26T12:50:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f590358b980 20 remove_watcher() i=3 2024-04-26T12:50:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.496+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94842582316544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x5642426ca5a0 2024-04-26T12:50:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.500+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94842582316544] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f4036040 con 0x5642426ca5a0 2024-04-26T12:50:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.500+0000 7f590358b980 20 remove_watcher() i=4 2024-04-26T12:50:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.500+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94842582319248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x5642426cef90 2024-04-26T12:50:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.500+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94842582319248] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.500+0000 7f590358b980 20 remove_watcher() i=5 2024-04-26T12:50:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.500+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94842582322304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x5642426cef90 2024-04-26T12:50:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.504+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94842582322304] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.504+0000 7f590358b980 20 remove_watcher() i=6 2024-04-26T12:50:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.504+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94842582313616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564242702480 con 0x5642426cef90 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.504+0000 7f59010a6640 1 -- 172.21.15.72:0/3082189782 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94842582313616] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58fc076030 con 0x5642426cef90 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.504+0000 7f590358b980 20 remove_watcher() i=7 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5642426cef90 msgr2=0x5642426d1380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5642426cef90 0x5642426d1380 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5642426ca5a0 msgr2=0x5642426cca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5642426ca5a0 0x5642426cca60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f58f80cc040 msgr2=0x7f58f80dc430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f58f80cc040 0x7f58f80dc430 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5642426d38e0 msgr2=0x5642426d5cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5642426d38e0 0x5642426d5cf0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57cc034650 msgr2=0x7f57cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57cc034650 0x7f57cc036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56424269d390 tx=0x7f58f80b9040 comp rx=0 tx=0).stop 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 msgr2=0x5642426bf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426bf490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f58fc027c00 tx=0x7f58fc0154f0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f59018a7640 1 -- 172.21.15.72:0/3082189782 reap_dead start 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 shutdown_connections 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/3082189782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426b81b0 0x5642426bf490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 >> 172.21.15.72:0/3082189782 conn(0x5642426b44f0 msgr2=0x5642426b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 shutdown_connections 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/3082189782 wait complete. 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57d8034650 msgr2=0x7f57d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57d8034650 0x7f57d8036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58f8000c10 tx=0x7f58f8005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426aafe0 msgr2=0x5642426ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426aafe0 0x5642426ab400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58fc01dfd0 tx=0x7f58fc028bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 shutdown_connections 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57d8034650 0x7f57d8036b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/2280740444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5642426aafe0 0x5642426ab400 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 >> 172.21.15.72:0/2280740444 conn(0x56424269fdf0 msgr2=0x5642426a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 shutdown_connections 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/2280740444 wait complete. 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564242696510 msgr2=0x564242698900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564242696510 0x564242698900 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56424250e8f0 msgr2=0x564242693b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56424250e8f0 0x564242693b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56424269a410 msgr2=0x56424269c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56424269a410 0x56424269c800 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57e80346a0 msgr2=0x7f57e8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57e80346a0 0x7f57e8036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ad000 tx=0x7f58f80a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 msgr2=0x56424268cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 --2- 172.21.15.72:0/1637629744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56424250d5b0 0x56424268cc00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0012f0 tx=0x7f58fc001260 comp rx=0 tx=0).stop 2024-04-26T12:50:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f59018a7640 1 -- 172.21.15.72:0/1637629744 reap_dead start 2024-04-26T12:50:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 shutdown_connections 2024-04-26T12:50:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 >> 172.21.15.72:0/1637629744 conn(0x564242593b30 msgr2=0x56424267ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 shutdown_connections 2024-04-26T12:50:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.508+0000 7f590358b980 1 -- 172.21.15.72:0/1637629744 wait complete. 2024-04-26T12:50:13.518 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:13.519 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-26T12:50:13.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-26T12:50:13.519 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-26T12:50:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983d691980 1 Processor -- start 2024-04-26T12:50:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983d691980 1 -- start start 2024-04-26T12:50:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983d691980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558dea4c75f0 0x558dea4c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983d691980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558dea370510 con 0x558dea437860 2024-04-26T12:50:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983d691980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x558dea377430 con 0x558dea4c75f0 2024-04-26T12:50:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983a9ab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558dea4c75f0 0x558dea4c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983a9ab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558dea4c75f0 0x558dea4c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49050/0 (socket says 172.21.15.72:49050) 2024-04-26T12:50:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983a9ab640 1 -- 172.21.15.72:0/3574309196 learned_addr learned my addr 172.21.15.72:0/3574309196 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983b1ac640 1 --1- 172.21.15.72:0/3574309196 >> v1:172.21.15.29:6789/0 conn(0x558dea437860 0x558dea4c5ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35914/0 (socket says 172.21.15.72:35914) 2024-04-26T12:50:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983a9ab640 1 -- 172.21.15.72:0/3574309196 >> v1:172.21.15.29:6789/0 conn(0x558dea437860 legacy=0x558dea4c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.556+0000 7f983a9ab640 1 -- 172.21.15.72:0/3574309196 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dea34cae0 con 0x558dea4c75f0 2024-04-26T12:50:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983a9ab640 1 --2- 172.21.15.72:0/3574309196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea4c75f0 0x558dea4c99e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f983000a5c0 tx=0x7f983001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f655115ebdf6a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983a1aa640 1 -- 172.21.15.72:0/3574309196 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98300a6070 con 0x558dea4c75f0 2024-04-26T12:50:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983a1aa640 1 -- 172.21.15.72:0/3574309196 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98300af070 con 0x558dea4c75f0 2024-04-26T12:50:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983a1aa640 1 -- 172.21.15.72:0/3574309196 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98300aa5c0 con 0x558dea4c75f0 2024-04-26T12:50:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983d691980 1 -- 172.21.15.72:0/3574309196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea4c75f0 msgr2=0x558dea4c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983d691980 1 --2- 172.21.15.72:0/3574309196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea4c75f0 0x558dea4c99e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f983000a5c0 tx=0x7f983001b340 comp rx=0 tx=0).stop 2024-04-26T12:50:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983d691980 1 -- 172.21.15.72:0/3574309196 shutdown_connections 2024-04-26T12:50:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983d691980 1 --2- 172.21.15.72:0/3574309196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea4c75f0 0x558dea4c99e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983d691980 1 -- 172.21.15.72:0/3574309196 >> 172.21.15.72:0/3574309196 conn(0x558dea4bd9f0 msgr2=0x558dea4bfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983d691980 1 -- 172.21.15.72:0/3574309196 shutdown_connections 2024-04-26T12:50:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.560+0000 7f983d691980 1 -- 172.21.15.72:0/3574309196 wait complete. 2024-04-26T12:50:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983d691980 1 Processor -- start 2024-04-26T12:50:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983d691980 1 -- start start 2024-04-26T12:50:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983d691980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea437860 0x558dea4c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983d691980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dea3c6a70 con 0x558dea437860 2024-04-26T12:50:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea437860 0x558dea4c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea437860 0x558dea4c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49058/0 (socket says 172.21.15.72:49058) 2024-04-26T12:50:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983b1ac640 1 -- 172.21.15.72:0/2913258347 learned_addr learned my addr 172.21.15.72:0/2913258347 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983b1ac640 1 -- 172.21.15.72:0/2913258347 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dea4c3c00 con 0x558dea437860 2024-04-26T12:50:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f983b1ac640 1 --2- 172.21.15.72:0/2913258347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea437860 0x558dea4c3630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f982c00b240 tx=0x7f982c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb7ab687dcfbf85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f972960a640 1 -- 172.21.15.72:0/2913258347 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c00e700 con 0x558dea437860 2024-04-26T12:50:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f972960a640 1 -- 172.21.15.72:0/2913258347 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c00e8a0 con 0x558dea437860 2024-04-26T12:50:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.576+0000 7f972960a640 1 -- 172.21.15.72:0/2913258347 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c00eb80 con 0x558dea437860 2024-04-26T12:50:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- 172.21.15.72:0/2913258347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea437860 msgr2=0x558dea4c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 --2- 172.21.15.72:0/2913258347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea437860 0x558dea4c3630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f982c00b240 tx=0x7f982c00b700 comp rx=0 tx=0).stop 2024-04-26T12:50:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- 172.21.15.72:0/2913258347 shutdown_connections 2024-04-26T12:50:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 --2- 172.21.15.72:0/2913258347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea437860 0x558dea4c3630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- 172.21.15.72:0/2913258347 >> 172.21.15.72:0/2913258347 conn(0x558dea4bd9f0 msgr2=0x558dea5aa040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- 172.21.15.72:0/2913258347 shutdown_connections 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- 172.21.15.72:0/2913258347 wait complete. 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 Processor -- start 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- start start 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5b7c40 0x558dea5b8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dea4caac0 con 0x558dea5b7c40 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5b7c40 0x558dea5b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5b7c40 0x558dea5b8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49066/0 (socket says 172.21.15.72:49066) 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983b1ac640 1 -- 172.21.15.72:0/3935520972 learned_addr learned my addr 172.21.15.72:0/3935520972 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983b1ac640 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dea5b8560 con 0x558dea5b7c40 2024-04-26T12:50:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983b1ac640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5b7c40 0x558dea5b8020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c10 tx=0x7f982c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f9727e07640 1 -- 172.21.15.72:0/3935520972 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c001530 con 0x558dea5b7c40 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dea5b87f0 con 0x558dea5b7c40 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dea5bb270 con 0x558dea5b7c40 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f9727e07640 1 -- 172.21.15.72:0/3935520972 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c00f9f0 con 0x558dea5b7c40 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f9727e07640 1 -- 172.21.15.72:0/3935520972 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c02c060 con 0x558dea5b7c40 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f9727e07640 1 -- 172.21.15.72:0/3935520972 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f982c017070 con 0x558dea5b7c40 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.580+0000 7f9727e07640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97200346a0 0x7f9720036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f9727e07640 1 -- 172.21.15.72:0/3935520972 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f982c015020 con 0x558dea5b7c40 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983a9ab640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97200346a0 0x7f9720036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5bcf10 0x558dea5bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5bf940 con 0x558dea5bcf10 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b9ad640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5bcf10 0x558dea5bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983a9ab640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97200346a0 0x7f9720036b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98300ae000 tx=0x7f98300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b9ad640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5bcf10 0x558dea5bf320 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b9ad640 1 -- 172.21.15.72:0/3935520972 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5bcf10 2024-04-26T12:50:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5bc4f0 con 0x558dea5bcf10 2024-04-26T12:50:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b9ad640 1 -- 172.21.15.72:0/3935520972 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5bcf10 2024-04-26T12:50:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5c1c90 0x558dea5c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5c4750 con 0x558dea5c1c90 2024-04-26T12:50:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b1ac640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5c1c90 0x558dea5c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b1ac640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5c1c90 0x558dea5c4080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b1ac640 1 -- 172.21.15.72:0/3935520972 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5c1c90 2024-04-26T12:50:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5c0b30 con 0x558dea5bcf10 2024-04-26T12:50:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983b9ad640 1 -- 172.21.15.72:0/3935520972 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5bcf10 2024-04-26T12:50:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5c5b90 0x558dea5c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5c8710 con 0x558dea5c5b90 2024-04-26T12:50:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.584+0000 7f983a9ab640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5c5b90 0x558dea5c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983a9ab640 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5c5b90 0x558dea5c7f80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983a9ab640 1 -- 172.21.15.72:0/3935520972 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5c5b90 2024-04-26T12:50:13.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983d691980 1 Processor -- start 2024-04-26T12:50:13.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983d691980 1 -- start start 2024-04-26T12:50:13.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983d691980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5d6760 0x558dea5d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983d691980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dea3caab0 con 0x558dea5d6760 2024-04-26T12:50:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5d6760 0x558dea5d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5d6760 0x558dea5d6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49068/0 (socket says 172.21.15.72:49068) 2024-04-26T12:50:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983b1ac640 1 -- 172.21.15.72:0/3692148255 learned_addr learned my addr 172.21.15.72:0/3692148255 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983b1ac640 1 -- 172.21.15.72:0/3692148255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dea5d70c0 con 0x558dea5d6760 2024-04-26T12:50:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983b1ac640 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5d6760 0x558dea5d6b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f982c01b8c0 tx=0x7f982c043e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f9725602640 1 -- 172.21.15.72:0/3692148255 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c041020 con 0x558dea5d6760 2024-04-26T12:50:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dea5d7b60 con 0x558dea5d6760 2024-04-26T12:50:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dea5d7b60 con 0x558dea5d6760 2024-04-26T12:50:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f9725602640 1 -- 172.21.15.72:0/3692148255 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c0477e0 con 0x558dea5d6760 2024-04-26T12:50:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f9725602640 1 -- 172.21.15.72:0/3692148255 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c04f060 con 0x558dea5d6760 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f9725602640 1 -- 172.21.15.72:0/3692148255 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f982c04aa00 con 0x558dea5d6760 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.588+0000 7f9725602640 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9714034600 0x7f9714036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f9725602640 1 -- 172.21.15.72:0/3692148255 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f982c033ca0 con 0x558dea5d6760 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983a9ab640 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9714034600 0x7f9714036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 Processor -- start 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- start start 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5e3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dea4c1df0 con 0x558dea5e3560 2024-04-26T12:50:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983a9ab640 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9714034600 0x7f9714036ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c10 tx=0x7f9830005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5e3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5e3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49072/0 (socket says 172.21.15.72:49072) 2024-04-26T12:50:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 -- 172.21.15.72:0/1120701804 learned_addr learned my addr 172.21.15.72:0/1120701804 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 -- 172.21.15.72:0/1120701804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dea5e3f10 con 0x558dea5e3560 2024-04-26T12:50:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 --2- 172.21.15.72:0/1120701804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5e3940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f982c00f6b0 tx=0x7f982c0534c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec1c3f68b4c78ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f971effd640 1 -- 172.21.15.72:0/1120701804 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c0278b0 con 0x558dea5e3560 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f971effd640 1 -- 172.21.15.72:0/1120701804 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c01a7b0 con 0x558dea5e3560 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f971effd640 1 -- 172.21.15.72:0/1120701804 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c027a50 con 0x558dea5e3560 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- 172.21.15.72:0/1120701804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 msgr2=0x558dea5e3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 --2- 172.21.15.72:0/1120701804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5e3940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f982c00f6b0 tx=0x7f982c0534c0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- 172.21.15.72:0/1120701804 shutdown_connections 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 --2- 172.21.15.72:0/1120701804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5e3940 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- 172.21.15.72:0/1120701804 >> 172.21.15.72:0/1120701804 conn(0x558dea5df8a0 msgr2=0x558dea5dd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- 172.21.15.72:0/1120701804 shutdown_connections 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- 172.21.15.72:0/1120701804 wait complete. 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 Processor -- start 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- start start 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5ea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983d691980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558dea5e4610 con 0x558dea5e3560 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5ea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5ea8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49086/0 (socket says 172.21.15.72:49086) 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 learned_addr learned my addr 172.21.15.72:0/2544262039 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.592+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dea5eae10 con 0x558dea5e3560 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983b1ac640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5ea8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f982c007f30 tx=0x7f982c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f971d7fa640 1 -- 172.21.15.72:0/2544262039 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c06d020 con 0x558dea5e3560 2024-04-26T12:50:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dea5eae10 con 0x558dea5e3560 2024-04-26T12:50:13.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f971d7fa640 1 -- 172.21.15.72:0/2544262039 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c03d620 con 0x558dea5e3560 2024-04-26T12:50:13.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f971d7fa640 1 -- 172.21.15.72:0/2544262039 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c03d980 con 0x558dea5e3560 2024-04-26T12:50:13.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dea5eb2e0 con 0x558dea5e3560 2024-04-26T12:50:13.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f971d7fa640 1 -- 172.21.15.72:0/2544262039 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f982c070020 con 0x558dea5e3560 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f971d7fa640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9704034650 0x7f9704036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f971d7fa640 1 -- 172.21.15.72:0/2544262039 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f982c064050 con 0x558dea5e3560 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983a9ab640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9704034650 0x7f9704036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5f59c0 0x558dea5f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f85d0 con 0x558dea5f59c0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983b9ad640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5f59c0 0x558dea5f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983a9ab640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9704034650 0x7f9704036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98300aafd0 tx=0x7f98300c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983b9ad640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5f59c0 0x558dea5f7e80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 realm 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f89e0 con 0x558dea5f59c0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9280 con 0x558dea5f59c0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.596+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5fa380 0x558dea5fc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5fcdc0 con 0x558dea5fa380 2024-04-26T12:50:13.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b1ac640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5fa380 0x558dea5fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b1ac640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5fa380 0x558dea5fc770 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 20 searching for the correct realm 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5feca0 0x558dea601110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea601790 con 0x558dea5feca0 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983a9ab640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5feca0 0x558dea601110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983a9ab640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5feca0 0x558dea601110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983a9ab640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f98300e0040 0x7f98300e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea601790 con 0x7f98300e0040 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b9ad640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f98300e0040 0x7f98300e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b9ad640 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f98300e0040 0x7f98300e0420 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.600+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x7f98300e0040 2024-04-26T12:50:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.604+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x7f98300e0040 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.608+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x7f98300e0040 2024-04-26T12:50:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x7f98300e0040 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5feca0 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5fa380 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x558dea5f59c0 2024-04-26T12:50:13.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.612+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558dea5f9620 con 0x7f98300e0040 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5fd610 con 0x558dea5f59c0 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5fd610 con 0x558dea5f59c0 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5fd610 con 0x558dea5feca0 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 zone default found 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 4 Realm: () 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 zonegroup default 2024-04-26T12:50:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea5fdf40 con 0x558dea5fa380 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea603620 con 0x558dea5feca0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea603a80 con 0x558dea5feca0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 started sync module instance, tier type = 2024-04-26T12:50:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:13.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.616+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea602a90 con 0x7f98300e0040 2024-04-26T12:50:13.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.620+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.620+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94068010921872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea602a90 con 0x7f98300e0040 2024-04-26T12:50:13.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.620+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea6045f0 con 0x558dea5f59c0 2024-04-26T12:50:13.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.620+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94068010921872] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.620+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.620+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94068010926304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea602a90 con 0x558dea5f59c0 2024-04-26T12:50:13.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.620+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea605030 con 0x558dea5feca0 2024-04-26T12:50:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94068010929024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea6058d0 con 0x558dea5feca0 2024-04-26T12:50:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea6062f0 con 0x7f98300e0040 2024-04-26T12:50:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94068010926304] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94068010933728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea6066e0 con 0x7f98300e0040 2024-04-26T12:50:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea6070a0 con 0x558dea5f59c0 2024-04-26T12:50:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94068010929024] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94068010933728] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94068010919392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea606bf0 con 0x558dea5f59c0 2024-04-26T12:50:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.624+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea607440 con 0x558dea5fa380 2024-04-26T12:50:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.628+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94068010919392] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.628+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.628+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94068010937328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea607010 con 0x558dea5fa380 2024-04-26T12:50:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.628+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea608140 con 0x558dea5fa380 2024-04-26T12:50:13.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94068010937328] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94068010940656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea6082e0 con 0x558dea5fa380 2024-04-26T12:50:13.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea608e00 con 0x558dea5fa380 2024-04-26T12:50:13.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94068010940656] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94068010944720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea608dc0 con 0x558dea5fa380 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 20 add_watcher() i=0 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 20 add_watcher() i=1 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 20 add_watcher() i=2 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 20 add_watcher() i=3 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 20 add_watcher() i=4 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 20 add_watcher() i=5 2024-04-26T12:50:13.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.632+0000 7f983d691980 20 add_watcher() i=6 2024-04-26T12:50:13.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94068010944720] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 20 add_watcher() i=7 2024-04-26T12:50:13.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:13.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea60c250 con 0x558dea5f59c0 2024-04-26T12:50:13.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94068010941776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea609710 con 0x558dea5f59c0 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94068010941776] v33'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f96f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 5 note: GC not initialized 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f96f0fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 20 Filter name: none 2024-04-26T12:50:13.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f966a7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:13.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:50:13.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.636+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea62fad0 con 0x558dea5fa380 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea62e110 con 0x558dea5f59c0 2024-04-26T12:50:13.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 20 rados_obj.operate() r=0 bl.length=7 2024-04-26T12:50:13.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-26T12:50:13.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:50:13.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:13.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558dea62e500 con 0x558dea5f59c0 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-26T12:50:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 20 get_user_info_from_index found 0 xattrs 2024-04-26T12:50:13.643 INFO:teuthology.orchestra.run.smithi072.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-26T12:50:13.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f96f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94068010941776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea5eff90 con 0x558dea5f59c0 2024-04-26T12:50:13.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94068010941776] v33'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.640+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94068010921872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x7f98300e0040 2024-04-26T12:50:13.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.644+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94068010921872] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.644+0000 7f983d691980 20 remove_watcher() i=0 2024-04-26T12:50:13.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.644+0000 7f983d691980 2 removed watcher, disabling cache 2024-04-26T12:50:13.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.644+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94068010926304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x558dea5f59c0 2024-04-26T12:50:13.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.644+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94068010926304] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.644+0000 7f983d691980 20 remove_watcher() i=1 2024-04-26T12:50:13.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.644+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94068010929024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x558dea5feca0 2024-04-26T12:50:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.648+0000 7f983a9ab640 1 -- 172.21.15.72:0/2544262039 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94068010929024] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98300aa9e0 con 0x558dea5feca0 2024-04-26T12:50:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.648+0000 7f983d691980 20 remove_watcher() i=2 2024-04-26T12:50:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.648+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94068010933728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x7f98300e0040 2024-04-26T12:50:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.648+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94068010933728] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x7f98300e0040 2024-04-26T12:50:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.648+0000 7f983d691980 20 remove_watcher() i=3 2024-04-26T12:50:13.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.648+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94068010919392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x558dea5f59c0 2024-04-26T12:50:13.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.652+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94068010919392] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983400a4d0 con 0x558dea5f59c0 2024-04-26T12:50:13.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.652+0000 7f983d691980 20 remove_watcher() i=4 2024-04-26T12:50:13.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.652+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94068010937328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x558dea5fa380 2024-04-26T12:50:13.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.652+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94068010937328] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.652+0000 7f983d691980 20 remove_watcher() i=5 2024-04-26T12:50:13.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.652+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94068010940656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x558dea5fa380 2024-04-26T12:50:13.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94068010940656] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 20 remove_watcher() i=6 2024-04-26T12:50:13.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94068010944720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558dea62d800 con 0x558dea5fa380 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983b1ac640 1 -- 172.21.15.72:0/2544262039 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94068010944720] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982c02e070 con 0x558dea5fa380 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 20 remove_watcher() i=7 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5fa380 msgr2=0x558dea5fc770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5fa380 0x558dea5fc770 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5f59c0 msgr2=0x558dea5f7e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5f59c0 0x558dea5f7e80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f98300e0040 msgr2=0x7f98300e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f98300e0040 0x7f98300e0420 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5feca0 msgr2=0x558dea601110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5feca0 0x558dea601110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9704034650 msgr2=0x7f9704036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9704034650 0x7f9704036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98300aafd0 tx=0x7f98300c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 msgr2=0x558dea5ea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/2544262039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5e3560 0x558dea5ea8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f982c007f30 tx=0x7f982c007ec0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 reap_dead start 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983b9ad640 1 -- 172.21.15.72:0/2544262039 reap_dead start 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 shutdown_connections 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 >> 172.21.15.72:0/2544262039 conn(0x558dea5df8a0 msgr2=0x558dea5dcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 shutdown_connections 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/2544262039 wait complete. 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9714034600 msgr2=0x7f9714036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9714034600 0x7f9714036ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c10 tx=0x7f9830005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5d6760 msgr2=0x558dea5d6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5d6760 0x558dea5d6b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f982c01b8c0 tx=0x7f982c043e80 comp rx=0 tx=0).stop 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 shutdown_connections 2024-04-26T12:50:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9714034600 0x7f9714036ac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/3692148255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5d6760 0x558dea5d6b80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 >> 172.21.15.72:0/3692148255 conn(0x558dea5cb570 msgr2=0x558dea5cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 shutdown_connections 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3692148255 wait complete. 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5c1c90 msgr2=0x558dea5c4080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558dea5c1c90 0x558dea5c4080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5bcf10 msgr2=0x558dea5bf320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558dea5bcf10 0x558dea5bf320 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5c5b90 msgr2=0x558dea5c7f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.656+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558dea5c5b90 0x558dea5c7f80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97200346a0 msgr2=0x7f9720036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97200346a0 0x7f9720036b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98300ae000 tx=0x7f98300a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5b7c40 msgr2=0x558dea5b8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 --2- 172.21.15.72:0/3935520972 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558dea5b7c40 0x558dea5b8020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f982c000c10 tx=0x7f982c000ee0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983b9ad640 1 -- 172.21.15.72:0/3935520972 reap_dead start 2024-04-26T12:50:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 shutdown_connections 2024-04-26T12:50:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 >> 172.21.15.72:0/3935520972 conn(0x558dea4bd9f0 msgr2=0x558dea5a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 shutdown_connections 2024-04-26T12:50:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.660+0000 7f983d691980 1 -- 172.21.15.72:0/3935520972 wait complete. 2024-04-26T12:50:13.668 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-26T12:50:13.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:13.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:13.669 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:13.740 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:13.740 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.740+0000 7f2a7046f980 1 Processor -- start 2024-04-26T12:50:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.740+0000 7f2a7046f980 1 -- start start 2024-04-26T12:50:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.740+0000 7f2a7046f980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557aa99bdff0 0x557aa9a4f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a7046f980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557aa98f7510 con 0x557aa9a4f8d0 2024-04-26T12:50:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a7046f980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x557aa98fe430 con 0x557aa99bdff0 2024-04-26T12:50:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6df8a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557aa99bdff0 0x557aa9a4f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6d789640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x557aa9a4f8d0 0x557aa9a51cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35926/0 (socket says 172.21.15.72:35926) 2024-04-26T12:50:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6d789640 1 -- 172.21.15.72:0/1807973734 learned_addr learned my addr 172.21.15.72:0/1807973734 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6df8a640 1 -- 172.21.15.72:0/1807973734 >> v1:172.21.15.29:6789/0 conn(0x557aa9a4f8d0 legacy=0x557aa9a51cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6df8a640 1 -- 172.21.15.72:0/1807973734 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa98d3ae0 con 0x557aa99bdff0 2024-04-26T12:50:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/1807973734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa99bdff0 0x557aa9a4f390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000a480 tx=0x7f2a6001b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2020b13e060d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6cf88640 1 -- 172.21.15.72:0/1807973734 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600af070 con 0x557aa99bdff0 2024-04-26T12:50:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6cf88640 1 -- 172.21.15.72:0/1807973734 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a600a3e50 con 0x557aa99bdff0 2024-04-26T12:50:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.744+0000 7f2a6cf88640 1 -- 172.21.15.72:0/1807973734 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600aa680 con 0x557aa99bdff0 2024-04-26T12:50:13.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.748+0000 7f2a7046f980 1 -- 172.21.15.72:0/1807973734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa99bdff0 msgr2=0x557aa9a4f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.748+0000 7f2a7046f980 1 --2- 172.21.15.72:0/1807973734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa99bdff0 0x557aa9a4f390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000a480 tx=0x7f2a6001b110 comp rx=0 tx=0).stop 2024-04-26T12:50:13.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.748+0000 7f2a7046f980 1 -- 172.21.15.72:0/1807973734 shutdown_connections 2024-04-26T12:50:13.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.748+0000 7f2a7046f980 1 --2- 172.21.15.72:0/1807973734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa99bdff0 0x557aa9a4f390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.748+0000 7f2a7046f980 1 -- 172.21.15.72:0/1807973734 >> 172.21.15.72:0/1807973734 conn(0x557aa9a44a70 msgr2=0x557aa9a46e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.748+0000 7f2a7046f980 1 -- 172.21.15.72:0/1807973734 shutdown_connections 2024-04-26T12:50:13.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.748+0000 7f2a7046f980 1 -- 172.21.15.72:0/1807973734 wait complete. 2024-04-26T12:50:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.760+0000 7f2a7046f980 1 Processor -- start 2024-04-26T12:50:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.760+0000 7f2a7046f980 1 -- start start 2024-04-26T12:50:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.760+0000 7f2a7046f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b377d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.760+0000 7f2a7046f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557aa994da70 con 0x557aa9a4f8d0 2024-04-26T12:50:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.760+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.760+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49106/0 (socket says 172.21.15.72:49106) 2024-04-26T12:50:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.760+0000 7f2a6df8a640 1 -- 172.21.15.72:0/3290828283 learned_addr learned my addr 172.21.15.72:0/3290828283 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a6df8a640 1 -- 172.21.15.72:0/3290828283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa9b37da0 con 0x557aa9a4f8d0 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/3290828283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b377d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a60018d40 tx=0x7f2a60003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e866042d62e5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f295be07640 1 -- 172.21.15.72:0/3290828283 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600af040 con 0x557aa9a4f8d0 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f295be07640 1 -- 172.21.15.72:0/3290828283 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a600aa8b0 con 0x557aa9a4f8d0 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f295be07640 1 -- 172.21.15.72:0/3290828283 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600aabd0 con 0x557aa9a4f8d0 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- 172.21.15.72:0/3290828283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 msgr2=0x557aa9b377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 --2- 172.21.15.72:0/3290828283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b377d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a60018d40 tx=0x7f2a60003030 comp rx=0 tx=0).stop 2024-04-26T12:50:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- 172.21.15.72:0/3290828283 shutdown_connections 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 --2- 172.21.15.72:0/3290828283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b377d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- 172.21.15.72:0/3290828283 >> 172.21.15.72:0/3290828283 conn(0x557aa9a44a70 msgr2=0x557aa9b332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- 172.21.15.72:0/3290828283 shutdown_connections 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- 172.21.15.72:0/3290828283 wait complete. 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 Processor -- start 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- start start 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b3e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557aa9a55e40 con 0x557aa9a4f8d0 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b3e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b3e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49108/0 (socket says 172.21.15.72:49108) 2024-04-26T12:50:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a6df8a640 1 -- 172.21.15.72:0/90885163 learned_addr learned my addr 172.21.15.72:0/90885163 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a6df8a640 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa9b3ee50 con 0x557aa9a4f8d0 2024-04-26T12:50:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b3e910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a600197c0 tx=0x7f2a60017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f295a604640 1 -- 172.21.15.72:0/90885163 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600c3020 con 0x557aa9a4f8d0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aa9b3f0e0 con 0x557aa9a4f8d0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.764+0000 7f295a604640 1 -- 172.21.15.72:0/90885163 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a600b5ae0 con 0x557aa9a4f8d0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa9b41d20 con 0x557aa9a4f8d0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f295a604640 1 -- 172.21.15.72:0/90885163 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600af070 con 0x557aa9a4f8d0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f295a604640 1 -- 172.21.15.72:0/90885163 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2a600c6020 con 0x557aa9a4f8d0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f295a604640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f29540346a0 0x7f2954036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f295a604640 1 -- 172.21.15.72:0/90885163 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f2a600ba070 con 0x557aa9a4f8d0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6d789640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f29540346a0 0x7f2954036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b437f0 0x557aa9b45be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b46230 con 0x557aa9b437f0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6e78b640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b437f0 0x557aa9b45be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6d789640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f29540346a0 0x7f2954036b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b350 tx=0x7f2a64001530 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6e78b640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b437f0 0x557aa9b45be0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6e78b640 1 -- 172.21.15.72:0/90885163 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b437f0 2024-04-26T12:50:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b42f20 con 0x557aa9b437f0 2024-04-26T12:50:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6e78b640 1 -- 172.21.15.72:0/90885163 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b437f0 2024-04-26T12:50:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b48540 0x557aa9b4a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b4b020 con 0x557aa9b48540 2024-04-26T12:50:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b48540 0x557aa9b4a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.768+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b48540 0x557aa9b4a930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6df8a640 1 -- 172.21.15.72:0/90885163 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a600b2040 con 0x557aa9b48540 2024-04-26T12:50:13.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b473e0 con 0x557aa9b437f0 2024-04-26T12:50:13.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6e78b640 1 -- 172.21.15.72:0/90885163 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b437f0 2024-04-26T12:50:13.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b4c480 0x557aa9b4e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b4efb0 con 0x557aa9b4c480 2024-04-26T12:50:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6d789640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b4c480 0x557aa9b4e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6d789640 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b4c480 0x557aa9b4e870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6d789640 1 -- 172.21.15.72:0/90885163 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a6400f8c0 con 0x557aa9b4c480 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a7046f980 1 Processor -- start 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a7046f980 1 -- start start 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a7046f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b5d040 0x557aa9b5d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a7046f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557aa9951ab0 con 0x557aa9b5d040 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b5d040 0x557aa9b5d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b5d040 0x557aa9b5d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49120/0 (socket says 172.21.15.72:49120) 2024-04-26T12:50:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6df8a640 1 -- 172.21.15.72:0/4049278696 learned_addr learned my addr 172.21.15.72:0/4049278696 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.772+0000 7f2a6df8a640 1 -- 172.21.15.72:0/4049278696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa9b5d9a0 con 0x557aa9b5d040 2024-04-26T12:50:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b5d040 0x557aa9b5d460 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a600e2e90 tx=0x7f2a600ac3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f29537fe640 1 -- 172.21.15.72:0/4049278696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600b4b10 con 0x557aa9b5d040 2024-04-26T12:50:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f29537fe640 1 -- 172.21.15.72:0/4049278696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a600b4cb0 con 0x557aa9b5d040 2024-04-26T12:50:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f29537fe640 1 -- 172.21.15.72:0/4049278696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600bf470 con 0x557aa9b5d040 2024-04-26T12:50:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aa9b5e440 con 0x557aa9b5d040 2024-04-26T12:50:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa9b5e440 con 0x557aa9b5d040 2024-04-26T12:50:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f29537fe640 1 -- 172.21.15.72:0/4049278696 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2a600bf610 con 0x557aa9b5d040 2024-04-26T12:50:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f29537fe640 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2948034650 0x7f2948036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f29537fe640 1 -- 172.21.15.72:0/4049278696 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f2a600e60c0 con 0x557aa9b5d040 2024-04-26T12:50:13.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a6d789640 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2948034650 0x7f2948036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a7046f980 1 Processor -- start 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a7046f980 1 -- start start 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a6d789640 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2948034650 0x7f2948036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x557aa9b466e0 tx=0x7f2a64006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a7046f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b6a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a7046f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557aa9b38030 con 0x557aa9b69e30 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b6a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b6a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49124/0 (socket says 172.21.15.72:49124) 2024-04-26T12:50:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a6df8a640 1 -- 172.21.15.72:0/3562415210 learned_addr learned my addr 172.21.15.72:0/3562415210 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.776+0000 7f2a6df8a640 1 -- 172.21.15.72:0/3562415210 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa9b6a820 con 0x557aa9b69e30 2024-04-26T12:50:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/3562415210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b6a250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a600e1c60 tx=0x7f2a600caf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76908d453e152874 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f29517fa640 1 -- 172.21.15.72:0/3562415210 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600cb9d0 con 0x557aa9b69e30 2024-04-26T12:50:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f29517fa640 1 -- 172.21.15.72:0/3562415210 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a600f6070 con 0x557aa9b69e30 2024-04-26T12:50:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f29517fa640 1 -- 172.21.15.72:0/3562415210 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600cb490 con 0x557aa9b69e30 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- 172.21.15.72:0/3562415210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 msgr2=0x557aa9b6a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 --2- 172.21.15.72:0/3562415210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b6a250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a600e1c60 tx=0x7f2a600caf80 comp rx=0 tx=0).stop 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- 172.21.15.72:0/3562415210 shutdown_connections 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 --2- 172.21.15.72:0/3562415210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b6a250 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- 172.21.15.72:0/3562415210 >> 172.21.15.72:0/3562415210 conn(0x557aa9b661c0 msgr2=0x557aa9b64220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- 172.21.15.72:0/3562415210 shutdown_connections 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- 172.21.15.72:0/3562415210 wait complete. 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 Processor -- start 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- start start 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557aa9b6af10 con 0x557aa9b69e30 2024-04-26T12:50:13.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a6df8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49128/0 (socket says 172.21.15.72:49128) 2024-04-26T12:50:13.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 learned_addr learned my addr 172.21.15.72:0/2122752654 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa9b716f0 con 0x557aa9b69e30 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b711b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a600e1c60 tx=0x7f2a600e1ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f293f7fe640 1 -- 172.21.15.72:0/2122752654 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a6010b070 con 0x557aa9b69e30 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aa9b716f0 con 0x557aa9b69e30 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f293f7fe640 1 -- 172.21.15.72:0/2122752654 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a600e1500 con 0x557aa9b69e30 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f293f7fe640 1 -- 172.21.15.72:0/2122752654 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a600e17e0 con 0x557aa9b69e30 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.780+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa9b71b60 con 0x557aa9b69e30 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f293f7fe640 1 -- 172.21.15.72:0/2122752654 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2a6010e070 con 0x557aa9b69e30 2024-04-26T12:50:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f293f7fe640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2938034650 0x7f2938036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f293f7fe640 1 -- 172.21.15.72:0/2122752654 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f2a60111c80 con 0x557aa9b69e30 2024-04-26T12:50:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6d789640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2938034650 0x7f2938036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b7c170 0x557aa9b7e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7ed80 con 0x557aa9b7c170 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6e78b640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b7c170 0x557aa9b7e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6d789640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2938034650 0x7f2938036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400ffd0 tx=0x7f2a64010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6e78b640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b7c170 0x557aa9b7e630 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 realm 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7f190 con 0x557aa9b7c170 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fa30 con 0x557aa9b7c170 2024-04-26T12:50:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b80b30 0x557aa9b82f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b834a0 con 0x557aa9b80b30 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b80b30 0x557aa9b82f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.784+0000 7f2a6df8a640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b80b30 0x557aa9b82f20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a7046f980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a7046f980 20 searching for the correct realm 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b85410 0x557aa9b878d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b87fa0 con 0x557aa9b85410 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6d789640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b85410 0x557aa9b878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6d789640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b85410 0x557aa9b878d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6d789640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a6402e910 0x7f2a6403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b87fa0 con 0x7f2a6402e910 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a6402e910 0x7f2a6403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a6402e910 0x7f2a6403a3c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.788+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x7f2a6402e910 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x7f2a6402e910 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.792+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x7f2a6402e910 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.796+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x7f2a6402e910 2024-04-26T12:50:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b85410 2024-04-26T12:50:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b80b30 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x557aa9b7c170 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b7fdd0 con 0x7f2a6402e910 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b83cf0 con 0x557aa9b7c170 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b83cf0 con 0x557aa9b7c170 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.800+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b83cf0 con 0x557aa9b85410 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 zone default found 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 4 Realm: () 2024-04-26T12:50:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 zonegroup default 2024-04-26T12:50:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b84590 con 0x557aa9b80b30 2024-04-26T12:50:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b89e00 con 0x557aa9b85410 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8a1a0 con 0x557aa9b85410 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 started sync module instance, tier type = 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b892a0 con 0x7f2a6402e910 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93985321818064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b892a0 con 0x7f2a6402e910 2024-04-26T12:50:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8abc0 con 0x557aa9b7c170 2024-04-26T12:50:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.804+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93985321818064] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.808+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.808+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93985321821872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b892a0 con 0x557aa9b7c170 2024-04-26T12:50:13.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.808+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8b5d0 con 0x557aa9b85410 2024-04-26T12:50:13.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.808+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93985321821872] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.808+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.808+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93985321815536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b89210 con 0x557aa9b85410 2024-04-26T12:50:13.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.808+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8c320 con 0x7f2a6402e910 2024-04-26T12:50:13.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93985321828224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8ca10 con 0x7f2a6402e910 2024-04-26T12:50:13.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8d500 con 0x557aa9b7c170 2024-04-26T12:50:13.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93985321815536] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93985321828224] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93985321832400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8d4c0 con 0x557aa9b7c170 2024-04-26T12:50:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.812+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8dda0 con 0x557aa9b80b30 2024-04-26T12:50:13.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93985321832400] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93985321826752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8d4c0 con 0x557aa9b80b30 2024-04-26T12:50:13.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8e250 con 0x557aa9b80b30 2024-04-26T12:50:13.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93985321826752] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93985321835936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8e1c0 con 0x557aa9b80b30 2024-04-26T12:50:13.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.816+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8ec70 con 0x557aa9b80b30 2024-04-26T12:50:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93985321835936] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93985321838432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8ec30 con 0x557aa9b80b30 2024-04-26T12:50:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=0 2024-04-26T12:50:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=1 2024-04-26T12:50:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=2 2024-04-26T12:50:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=3 2024-04-26T12:50:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=4 2024-04-26T12:50:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=5 2024-04-26T12:50:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=6 2024-04-26T12:50:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93985321838432] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 20 add_watcher() i=7 2024-04-26T12:50:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b92130 con 0x557aa9b7c170 2024-04-26T12:50:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.820+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93985321834656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8f540 con 0x557aa9b7c170 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93985321834656] v33'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f291f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 5 note: GC not initialized 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f291e7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 20 Filter name: none 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f288ffff640 20 reqs_thread_entry: start 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557aa9bb5410 con 0x557aa9b7c170 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:13.825 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f291f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.824+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93985321834656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9bb4200 con 0x557aa9b7c170 2024-04-26T12:50:13.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93985321834656] v33'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93985321818064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8d8a0 con 0x7f2a6402e910 2024-04-26T12:50:13.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93985321818064] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a7046f980 20 remove_watcher() i=0 2024-04-26T12:50:13.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a7046f980 2 removed watcher, disabling cache 2024-04-26T12:50:13.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93985321821872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8d8a0 con 0x557aa9b7c170 2024-04-26T12:50:13.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93985321821872] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a7046f980 20 remove_watcher() i=1 2024-04-26T12:50:13.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.828+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93985321815536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8d8a0 con 0x557aa9b85410 2024-04-26T12:50:13.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.832+0000 7f2a6d789640 1 -- 172.21.15.72:0/2122752654 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93985321815536] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a64037040 con 0x557aa9b85410 2024-04-26T12:50:13.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.832+0000 7f2a7046f980 20 remove_watcher() i=2 2024-04-26T12:50:13.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.832+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93985321828224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b88df0 con 0x7f2a6402e910 2024-04-26T12:50:13.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.832+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93985321828224] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x7f2a6402e910 2024-04-26T12:50:13.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.832+0000 7f2a7046f980 20 remove_watcher() i=3 2024-04-26T12:50:13.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.832+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93985321832400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8bf80 con 0x557aa9b7c170 2024-04-26T12:50:13.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.836+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93985321832400] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6800a4d0 con 0x557aa9b7c170 2024-04-26T12:50:13.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.836+0000 7f2a7046f980 20 remove_watcher() i=4 2024-04-26T12:50:13.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.836+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93985321826752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b88df0 con 0x557aa9b80b30 2024-04-26T12:50:13.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.836+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93985321826752] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.836+0000 7f2a7046f980 20 remove_watcher() i=5 2024-04-26T12:50:13.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.836+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93985321835936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8cfd0 con 0x557aa9b80b30 2024-04-26T12:50:13.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93985321835936] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 20 remove_watcher() i=6 2024-04-26T12:50:13.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93985321838432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557aa9b8bf80 con 0x557aa9b80b30 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a6df8a640 1 -- 172.21.15.72:0/2122752654 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93985321838432] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a6010d030 con 0x557aa9b80b30 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 20 remove_watcher() i=7 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b80b30 msgr2=0x557aa9b82f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b80b30 0x557aa9b82f20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b7c170 msgr2=0x557aa9b7e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b7c170 0x557aa9b7e630 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a6402e910 msgr2=0x7f2a6403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2a6402e910 0x7f2a6403a3c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b85410 msgr2=0x557aa9b878d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b85410 0x557aa9b878d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2938034650 msgr2=0x7f2938036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2938034650 0x7f2938036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400ffd0 tx=0x7f2a64010000 comp rx=0 tx=0).stop 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a6e78b640 1 -- 172.21.15.72:0/2122752654 reap_dead start 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 msgr2=0x557aa9b711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b711b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a600e1c60 tx=0x7f2a600e1ac0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 shutdown_connections 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/2122752654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b69e30 0x557aa9b711b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 >> 172.21.15.72:0/2122752654 conn(0x557aa9b661c0 msgr2=0x557aa9b63820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 shutdown_connections 2024-04-26T12:50:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/2122752654 wait complete. 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2948034650 msgr2=0x7f2948036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2948034650 0x7f2948036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x557aa9b466e0 tx=0x7f2a64006000 comp rx=0 tx=0).stop 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b5d040 msgr2=0x557aa9b5d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b5d040 0x557aa9b5d460 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a600e2e90 tx=0x7f2a600ac3e0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 shutdown_connections 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2948034650 0x7f2948036b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 --2- 172.21.15.72:0/4049278696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9b5d040 0x557aa9b5d460 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 >> 172.21.15.72:0/4049278696 conn(0x557aa9b51e50 msgr2=0x557aa9b52960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 shutdown_connections 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.840+0000 7f2a7046f980 1 -- 172.21.15.72:0/4049278696 wait complete. 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b48540 msgr2=0x557aa9b4a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557aa9b48540 0x557aa9b4a930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b437f0 msgr2=0x557aa9b45be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557aa9b437f0 0x557aa9b45be0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b4c480 msgr2=0x557aa9b4e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557aa9b4c480 0x557aa9b4e870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f29540346a0 msgr2=0x7f2954036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f29540346a0 0x7f2954036b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b350 tx=0x7f2a64001530 comp rx=0 tx=0).stop 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 msgr2=0x557aa9b3e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 --2- 172.21.15.72:0/90885163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557aa9a4f8d0 0x557aa9b3e910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a600197c0 tx=0x7f2a60017eb0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a6e78b640 1 -- 172.21.15.72:0/90885163 reap_dead start 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 shutdown_connections 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 >> 172.21.15.72:0/90885163 conn(0x557aa9a44a70 msgr2=0x557aa9b31dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 shutdown_connections 2024-04-26T12:50:13.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.844+0000 7f2a7046f980 1 -- 172.21.15.72:0/90885163 wait complete. 2024-04-26T12:50:13.851 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:13.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-26T12:50:13.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-26T12:50:13.852 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-26T12:50:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:13.927 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:13.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c104df980 1 Processor -- start 2024-04-26T12:50:13.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c104df980 1 -- start start 2024-04-26T12:50:13.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c104df980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563492e432c0 0x563492e436a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c104df980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563492cf0510 con 0x563492e43be0 2024-04-26T12:50:13.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c104df980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x563492cf7430 con 0x563492e432c0 2024-04-26T12:50:13.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c0dffa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563492e432c0 0x563492e436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c0d7f9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x563492e43be0 0x563492e445a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35942/0 (socket says 172.21.15.72:35942) 2024-04-26T12:50:13.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c0dffa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563492e432c0 0x563492e436a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49134/0 (socket says 172.21.15.72:49134) 2024-04-26T12:50:13.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/773417002 learned_addr learned my addr 172.21.15.72:0/773417002 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:13.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c0dffa640 1 -- 172.21.15.72:0/773417002 >> v1:172.21.15.29:6789/0 conn(0x563492e43be0 legacy=0x563492e445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.928+0000 7f0c0dffa640 1 -- 172.21.15.72:0/773417002 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492cccae0 con 0x563492e432c0 2024-04-26T12:50:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/773417002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492e436a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800a420 tx=0x7f0c0801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8fda3ebe4673e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c0cff8640 1 -- 172.21.15.72:0/773417002 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080af070 con 0x563492e432c0 2024-04-26T12:50:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c0cff8640 1 -- 172.21.15.72:0/773417002 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c080aa530 con 0x563492e432c0 2024-04-26T12:50:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c0cff8640 1 -- 172.21.15.72:0/773417002 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080aa850 con 0x563492e432c0 2024-04-26T12:50:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c104df980 1 -- 172.21.15.72:0/773417002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 msgr2=0x563492e436a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c104df980 1 --2- 172.21.15.72:0/773417002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492e436a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800a420 tx=0x7f0c0801afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c104df980 1 -- 172.21.15.72:0/773417002 shutdown_connections 2024-04-26T12:50:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c104df980 1 --2- 172.21.15.72:0/773417002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492e436a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c104df980 1 -- 172.21.15.72:0/773417002 >> 172.21.15.72:0/773417002 conn(0x563492e3eb90 msgr2=0x563492e40fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c104df980 1 -- 172.21.15.72:0/773417002 shutdown_connections 2024-04-26T12:50:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.932+0000 7f0c104df980 1 -- 172.21.15.72:0/773417002 wait complete. 2024-04-26T12:50:13.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 Processor -- start 2024-04-26T12:50:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 -- start start 2024-04-26T12:50:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f2eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563492d46a70 con 0x563492e432c0 2024-04-26T12:50:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f2eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f2eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49144/0 (socket says 172.21.15.72:49144) 2024-04-26T12:50:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c0dffa640 1 -- 172.21.15.72:0/3025486949 learned_addr learned my addr 172.21.15.72:0/3025486949 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c0dffa640 1 -- 172.21.15.72:0/3025486949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492f2f0d0 con 0x563492e432c0 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/3025486949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f2eb00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800a420 tx=0x7f0c080033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9f6bda1a47c4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0afbe07640 1 -- 172.21.15.72:0/3025486949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080af050 con 0x563492e432c0 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0afbe07640 1 -- 172.21.15.72:0/3025486949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c080b0040 con 0x563492e432c0 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0afbe07640 1 -- 172.21.15.72:0/3025486949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080aac60 con 0x563492e432c0 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 -- 172.21.15.72:0/3025486949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 msgr2=0x563492f2eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 --2- 172.21.15.72:0/3025486949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f2eb00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800a420 tx=0x7f0c080033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 -- 172.21.15.72:0/3025486949 shutdown_connections 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 --2- 172.21.15.72:0/3025486949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f2eb00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 -- 172.21.15.72:0/3025486949 >> 172.21.15.72:0/3025486949 conn(0x563492e3eb90 msgr2=0x563492f2a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 -- 172.21.15.72:0/3025486949 shutdown_connections 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 -- 172.21.15.72:0/3025486949 wait complete. 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.948+0000 7f0c104df980 1 Processor -- start 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c104df980 1 -- start start 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c104df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f35c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c104df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563492e4d310 con 0x563492e432c0 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f35c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f35c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49150/0 (socket says 172.21.15.72:49150) 2024-04-26T12:50:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0dffa640 1 -- 172.21.15.72:0/1245042383 learned_addr learned my addr 172.21.15.72:0/1245042383 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0dffa640 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492f36180 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f35c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c0801b010 tx=0x7f0c08019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0afa604640 1 -- 172.21.15.72:0/1245042383 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080c5030 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563492f36410 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0afa604640 1 -- 172.21.15.72:0/1245042383 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c080c15b0 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0afa604640 1 -- 172.21.15.72:0/1245042383 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080c1890 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563492f39050 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0afa604640 1 -- 172.21.15.72:0/1245042383 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c080c8070 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0afa604640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0af4034650 0x7f0af4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0afa604640 1 -- 172.21.15.72:0/1245042383 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f0c080c6070 con 0x563492e432c0 2024-04-26T12:50:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0af4034650 0x7f0af4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492e43be0 0x563492f3cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f3d220 con 0x563492e43be0 2024-04-26T12:50:13.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0e7fb640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492e43be0 0x563492f3cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0af4034650 0x7f0af4036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8001da0 tx=0x7f0bf8001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.952+0000 7f0c0e7fb640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492e43be0 0x563492f3cca0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/1245042383 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c000083f0 con 0x563492e43be0 2024-04-26T12:50:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f3daf0 con 0x563492e43be0 2024-04-26T12:50:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/1245042383 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c000083f0 con 0x563492e43be0 2024-04-26T12:50:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f3f440 0x563492f418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f42060 con 0x563492f3f440 2024-04-26T12:50:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f3f440 0x563492f418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f3f440 0x563492f418d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0dffa640 1 -- 172.21.15.72:0/1245042383 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c080b2070 con 0x563492f3f440 2024-04-26T12:50:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f3e340 con 0x563492e43be0 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/1245042383 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c000083f0 con 0x563492e43be0 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f434c0 0x563492f458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f45ff0 con 0x563492f434c0 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f434c0 0x563492f458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f434c0 0x563492f458b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.956+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/1245042383 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f434c0 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 Processor -- start 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 -- start start 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f54080 0x563492f544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563492d4aab0 con 0x563492f54080 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f54080 0x563492f544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f54080 0x563492f544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49160/0 (socket says 172.21.15.72:49160) 2024-04-26T12:50:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c0dffa640 1 -- 172.21.15.72:0/1425821135 learned_addr learned my addr 172.21.15.72:0/1425821135 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c0dffa640 1 -- 172.21.15.72:0/1425821135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492f549e0 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f54080 0x563492f544a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c080e3940 tx=0x7f0c080bfdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0af37fe640 1 -- 172.21.15.72:0/1425821135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080bf660 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0af37fe640 1 -- 172.21.15.72:0/1425821135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c080bf800 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563492f55480 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0af37fe640 1 -- 172.21.15.72:0/1425821135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080e2200 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563492f55480 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0af37fe640 1 -- 172.21.15.72:0/1425821135 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c080e23a0 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0af37fe640 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ae8034650 0x7f0ae8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0af37fe640 1 -- 172.21.15.72:0/1425821135 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f0c080dd070 con 0x563492f54080 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ae8034650 0x7f0ae8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 Processor -- start 2024-04-26T12:50:13.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 -- start start 2024-04-26T12:50:13.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ae8034650 0x7f0ae8036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x563492f42430 tx=0x7f0bf800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f61240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.960+0000 7f0c104df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563492f2f360 con 0x563492f60e20 2024-04-26T12:50:13.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f61240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f61240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49174/0 (socket says 172.21.15.72:49174) 2024-04-26T12:50:13.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 -- 172.21.15.72:0/1273355431 learned_addr learned my addr 172.21.15.72:0/1273355431 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 -- 172.21.15.72:0/1273355431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492f61810 con 0x563492f60e20 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/1273355431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f61240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c080adff0 tx=0x7f0c080a9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7adfdd9a15cfb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0af17fa640 1 -- 172.21.15.72:0/1273355431 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080f7070 con 0x563492f60e20 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0af17fa640 1 -- 172.21.15.72:0/1273355431 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c080d6500 con 0x563492f60e20 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0af17fa640 1 -- 172.21.15.72:0/1273355431 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080d6880 con 0x563492f60e20 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 -- 172.21.15.72:0/1273355431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 msgr2=0x563492f61240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 --2- 172.21.15.72:0/1273355431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f61240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c080adff0 tx=0x7f0c080a9f60 comp rx=0 tx=0).stop 2024-04-26T12:50:13.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 -- 172.21.15.72:0/1273355431 shutdown_connections 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 --2- 172.21.15.72:0/1273355431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f61240 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 -- 172.21.15.72:0/1273355431 >> 172.21.15.72:0/1273355431 conn(0x563492f5d1b0 msgr2=0x563492f5b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 -- 172.21.15.72:0/1273355431 shutdown_connections 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 -- 172.21.15.72:0/1273355431 wait complete. 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 Processor -- start 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 -- start start 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f68120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c104df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563492f61f00 con 0x563492f60e20 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f68120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f68120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49176/0 (socket says 172.21.15.72:49176) 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 learned_addr learned my addr 172.21.15.72:0/2428966990 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:13.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.964+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492f68660 con 0x563492f60e20 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f68120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c080d6fd0 tx=0x7f0c080cb1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0adf7fe640 1 -- 172.21.15.72:0/2428966990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c0810d070 con 0x563492f60e20 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563492f68660 con 0x563492f60e20 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0adf7fe640 1 -- 172.21.15.72:0/2428966990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c08102070 con 0x563492f60e20 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0adf7fe640 1 -- 172.21.15.72:0/2428966990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080e0840 con 0x563492f60e20 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563492f68660 con 0x563492f60e20 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0adf7fe640 1 -- 172.21.15.72:0/2428966990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c08110070 con 0x563492f60e20 2024-04-26T12:50:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0adf7fe640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ad8034650 0x7f0ad8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0adf7fe640 1 -- 172.21.15.72:0/2428966990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f0c080bb070 con 0x563492f60e20 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ad8034650 0x7f0ad8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492f731f0 0x563492f75670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f75dc0 con 0x563492f731f0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0e7fb640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492f731f0 0x563492f75670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ad8034650 0x7f0ad8036b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x563492f3dac0 tx=0x7f0bf8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0e7fb640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492f731f0 0x563492f75670 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c000083f0 con 0x563492f731f0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 realm 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f761d0 con 0x563492f731f0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c000083f0 con 0x563492f731f0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f76a70 con 0x563492f731f0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c000083f0 con 0x563492f731f0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c000083f0 con 0x563492f731f0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f77b70 0x563492f79f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.968+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f7a5b0 con 0x563492f77b70 2024-04-26T12:50:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f77b70 0x563492f79f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0dffa640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f77b70 0x563492f79f60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c104df980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c104df980 20 searching for the correct realm 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f7c490 0x563492f7e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f7ef40 con 0x563492f7c490 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f7c490 0x563492f7e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f7c490 0x563492f7e8c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0d7f9640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0bf8037040 0x7f0bf8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f7ef40 con 0x7f0bf8037040 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0e7fb640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0bf8037040 0x7f0bf8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0e7fb640 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0bf8037040 0x7f0bf8036410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c000083f0 con 0x7f0bf8037040 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.972+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c000083f0 con 0x563492f731f0 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x7f0bf8037040 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x7f0bf8037040 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x7f0bf8037040 2024-04-26T12:50:13.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c00026040 con 0x7f0bf8037040 2024-04-26T12:50:13.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.976+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x7f0bf8037040 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x7f0bf8037040 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.980+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x7f0bf8037040 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x7f0bf8037040 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f7c490 2024-04-26T12:50:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f77b70 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x563492f731f0 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563492f76e10 con 0x7f0bf8037040 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c00026040 con 0x7f0bf8037040 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f7ae00 con 0x563492f731f0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f7ae00 con 0x563492f731f0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c00026040 con 0x563492f731f0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f7ae00 con 0x563492f7c490 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 zone default found 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 4 Realm: () 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 zonegroup default 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.984+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f7b7d0 con 0x563492f77b70 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f80e30 con 0x563492f7c490 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f81300 con 0x563492f7c490 2024-04-26T12:50:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 20 started sync module instance, tier type = 2024-04-26T12:50:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f80240 con 0x7f0bf8037040 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00026040 con 0x7f0bf8037040 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94783804016448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f80240 con 0x7f0bf8037040 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f81e00 con 0x563492f731f0 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94783804016448] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x7f0bf8037040 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94783804020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f80240 con 0x563492f731f0 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.988+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f82810 con 0x563492f7c490 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.992+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94783804020944] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.992+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.992+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94783804013968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f801b0 con 0x563492f7c490 2024-04-26T12:50:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.992+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f83510 con 0x7f0bf8037040 2024-04-26T12:50:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.992+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x7f0bf8037040 2024-04-26T12:50:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.992+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94783804027280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f83db0 con 0x7f0bf8037040 2024-04-26T12:50:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.992+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f84770 con 0x563492f731f0 2024-04-26T12:50:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94783804013968] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94783804027280] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x7f0bf8037040 2024-04-26T12:50:13.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:13.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94783804031680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f83d20 con 0x563492f731f0 2024-04-26T12:50:13.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f846e0 con 0x563492f77b70 2024-04-26T12:50:13.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94783804031680] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:13.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:13.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:13.996+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94783804029344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f85010 con 0x563492f77b70 2024-04-26T12:50:13.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.000+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f85860 con 0x563492f77b70 2024-04-26T12:50:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.000+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94783804029344] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.000+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.000+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94783804036016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f85c80 con 0x563492f77b70 2024-04-26T12:50:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.000+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f86680 con 0x563492f77b70 2024-04-26T12:50:14.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.000+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94783804036016] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94783804039568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f86860 con 0x563492f77b70 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=0 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=1 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=2 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=3 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=4 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=5 2024-04-26T12:50:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=6 2024-04-26T12:50:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94783804039568] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 add_watcher() i=7 2024-04-26T12:50:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492f89c30 con 0x563492f731f0 2024-04-26T12:50:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94783804041040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492f87020 con 0x563492f731f0 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94783804041040] v33'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0abf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 5 note: GC not initialized 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0abe7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 Filter name: none 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0a2ffff640 20 reqs_thread_entry: start 2024-04-26T12:50:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.004+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492fad330 con 0x563492f731f0 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492fafdc0 con 0x7f0bf8037040 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x7f0bf8037040 2024-04-26T12:50:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fb3520 con 0x563492f731f0 2024-04-26T12:50:14.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94783804223376 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563492faedb0 con 0x563492f731f0 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94783804031680 notify 141733920769 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f0c00010040 con 0x563492f731f0 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0af17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94783804031680 notifier 4321 bl.length()=567 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0af17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0af17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify cookie 94783804223376 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0af17fa640 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0ad0003eb0 con 0x563492f731f0 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== watch-notify(notify_complete (2) cookie 94783804223376 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c0000ae20 con 0x563492f731f0 2024-04-26T12:50:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.010 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0abf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.008+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94783804041040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x563492f731f0 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94783804041040] v33'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94783804016448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x7f0bf8037040 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94783804016448] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x7f0bf8037040 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c104df980 20 remove_watcher() i=0 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c104df980 2 removed watcher, disabling cache 2024-04-26T12:50:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94783804020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x563492f731f0 2024-04-26T12:50:14.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94783804020944] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c104df980 20 remove_watcher() i=1 2024-04-26T12:50:14.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.012+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94783804013968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x563492f7c490 2024-04-26T12:50:14.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.016+0000 7f0c0d7f9640 1 -- 172.21.15.72:0/2428966990 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94783804013968] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf800e6c0 con 0x563492f7c490 2024-04-26T12:50:14.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.016+0000 7f0c104df980 20 remove_watcher() i=2 2024-04-26T12:50:14.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.016+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94783804027280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x7f0bf8037040 2024-04-26T12:50:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.016+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94783804027280] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x7f0bf8037040 2024-04-26T12:50:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.016+0000 7f0c104df980 20 remove_watcher() i=3 2024-04-26T12:50:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.016+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94783804031680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x563492f731f0 2024-04-26T12:50:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.020+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94783804031680] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c00036040 con 0x563492f731f0 2024-04-26T12:50:14.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.020+0000 7f0c104df980 20 remove_watcher() i=4 2024-04-26T12:50:14.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.020+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94783804029344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x563492f77b70 2024-04-26T12:50:14.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.020+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94783804029344] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.020+0000 7f0c104df980 20 remove_watcher() i=5 2024-04-26T12:50:14.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.020+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94783804036016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x563492f77b70 2024-04-26T12:50:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94783804036016] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 20 remove_watcher() i=6 2024-04-26T12:50:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94783804039568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563492fab060 con 0x563492f77b70 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c0dffa640 1 -- 172.21.15.72:0/2428966990 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94783804039568] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0810f030 con 0x563492f77b70 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 20 remove_watcher() i=7 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f77b70 msgr2=0x563492f79f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f77b70 0x563492f79f60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492f731f0 msgr2=0x563492f75670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492f731f0 0x563492f75670 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0bf8037040 msgr2=0x7f0bf8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0bf8037040 0x7f0bf8036410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f7c490 msgr2=0x563492f7e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f7c490 0x563492f7e8c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ad8034650 msgr2=0x7f0ad8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ad8034650 0x7f0ad8036b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x563492f3dac0 tx=0x7f0bf8010000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/2428966990 reap_dead start 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 msgr2=0x563492f68120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f68120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c080d6fd0 tx=0x7f0c080cb1c0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 shutdown_connections 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/2428966990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f60e20 0x563492f68120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 >> 172.21.15.72:0/2428966990 conn(0x563492f5d1b0 msgr2=0x563492f5a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 shutdown_connections 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/2428966990 wait complete. 2024-04-26T12:50:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ae8034650 msgr2=0x7f0ae8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ae8034650 0x7f0ae8036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x563492f42430 tx=0x7f0bf800f000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f54080 msgr2=0x563492f544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f54080 0x563492f544a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c080e3940 tx=0x7f0c080bfdb0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 shutdown_connections 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0ae8034650 0x7f0ae8036b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1425821135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492f54080 0x563492f544a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 >> 172.21.15.72:0/1425821135 conn(0x563492f48e90 msgr2=0x563492f499a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 shutdown_connections 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1425821135 wait complete. 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f3f440 msgr2=0x563492f418d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563492f3f440 0x563492f418d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492e43be0 msgr2=0x563492f3cca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563492e43be0 0x563492f3cca0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f434c0 msgr2=0x563492f458b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563492f434c0 0x563492f458b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0af4034650 msgr2=0x7f0af4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0af4034650 0x7f0af4036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8001da0 tx=0x7f0bf8001300 comp rx=0 tx=0).stop 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 msgr2=0x563492f35c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 --2- 172.21.15.72:0/1245042383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563492e432c0 0x563492f35c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c0801b010 tx=0x7f0c08019810 comp rx=0 tx=0).stop 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c0e7fb640 1 -- 172.21.15.72:0/1245042383 reap_dead start 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 shutdown_connections 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 >> 172.21.15.72:0/1245042383 conn(0x563492e3eb90 msgr2=0x563492f291a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 shutdown_connections 2024-04-26T12:50:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.024+0000 7f0c104df980 1 -- 172.21.15.72:0/1245042383 wait complete. 2024-04-26T12:50:14.034 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:14.034 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:14.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:14.035 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:14.105 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:14.105 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:14.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf878b1980 1 Processor -- start 2024-04-26T12:50:14.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf878b1980 1 -- start start 2024-04-26T12:50:14.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf878b1980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555dab93c9f0 0x555dab93ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf878b1980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555dab7e3510 con 0x555dab9384e0 2024-04-26T12:50:14.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf878b1980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x555dab7ea430 con 0x555dab93c9f0 2024-04-26T12:50:14.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf7cbcb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555dab93c9f0 0x555dab93ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf853cc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x555dab9384e0 0x555dab9388c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35954/0 (socket says 172.21.15.72:35954) 2024-04-26T12:50:14.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf853cc640 1 -- 172.21.15.72:0/997547331 learned_addr learned my addr 172.21.15.72:0/997547331 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:14.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf7cbcb640 1 -- 172.21.15.72:0/997547331 >> v1:172.21.15.29:6789/0 conn(0x555dab9384e0 legacy=0x555dab9388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf7cbcb640 1 -- 172.21.15.72:0/997547331 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dab7bfae0 con 0x555dab93c9f0 2024-04-26T12:50:14.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.108+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/997547331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab93c9f0 0x555dab93ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf7000a480 tx=0x7faf7001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805d16e13da00f40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf84bcb640 1 -- 172.21.15.72:0/997547331 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf700b0070 con 0x555dab93c9f0 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf84bcb640 1 -- 172.21.15.72:0/997547331 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf700ab540 con 0x555dab93c9f0 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf84bcb640 1 -- 172.21.15.72:0/997547331 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf700ab840 con 0x555dab93c9f0 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf878b1980 1 -- 172.21.15.72:0/997547331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab93c9f0 msgr2=0x555dab93ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf878b1980 1 --2- 172.21.15.72:0/997547331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab93c9f0 0x555dab93ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf7000a480 tx=0x7faf7001b280 comp rx=0 tx=0).stop 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf878b1980 1 -- 172.21.15.72:0/997547331 shutdown_connections 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf878b1980 1 --2- 172.21.15.72:0/997547331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab93c9f0 0x555dab93ede0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf878b1980 1 -- 172.21.15.72:0/997547331 >> 172.21.15.72:0/997547331 conn(0x555dab8abbc0 msgr2=0x555dab8abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf878b1980 1 -- 172.21.15.72:0/997547331 shutdown_connections 2024-04-26T12:50:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.112+0000 7faf878b1980 1 -- 172.21.15.72:0/997547331 wait complete. 2024-04-26T12:50:14.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 Processor -- start 2024-04-26T12:50:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 -- start start 2024-04-26T12:50:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555dab839a70 con 0x555dab9384e0 2024-04-26T12:50:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba23600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49202/0 (socket says 172.21.15.72:49202) 2024-04-26T12:50:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf853cc640 1 -- 172.21.15.72:0/2482089961 learned_addr learned my addr 172.21.15.72:0/2482089961 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf853cc640 1 -- 172.21.15.72:0/2482089961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555daba23bd0 con 0x555dab9384e0 2024-04-26T12:50:14.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf853cc640 1 --2- 172.21.15.72:0/2482089961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba23600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf780015f0 tx=0x7faf78001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f1664f9d24997e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7fae73606640 1 -- 172.21.15.72:0/2482089961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78004530 con 0x555dab9384e0 2024-04-26T12:50:14.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7fae73606640 1 -- 172.21.15.72:0/2482089961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf780046f0 con 0x555dab9384e0 2024-04-26T12:50:14.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7fae73606640 1 -- 172.21.15.72:0/2482089961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78004a90 con 0x555dab9384e0 2024-04-26T12:50:14.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 -- 172.21.15.72:0/2482089961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 msgr2=0x555daba23600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 --2- 172.21.15.72:0/2482089961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba23600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf780015f0 tx=0x7faf78001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 -- 172.21.15.72:0/2482089961 shutdown_connections 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 --2- 172.21.15.72:0/2482089961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba23600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 -- 172.21.15.72:0/2482089961 >> 172.21.15.72:0/2482089961 conn(0x555dab8abbc0 msgr2=0x555daba1f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 -- 172.21.15.72:0/2482089961 shutdown_connections 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.124+0000 7faf878b1980 1 -- 172.21.15.72:0/2482089961 wait complete. 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 Processor -- start 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 -- start start 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba2a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555dab941e10 con 0x555dab9384e0 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba2a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba2a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49218/0 (socket says 172.21.15.72:49218) 2024-04-26T12:50:14.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf853cc640 1 -- 172.21.15.72:0/2978138727 learned_addr learned my addr 172.21.15.72:0/2978138727 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf853cc640 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555daba2add0 con 0x555dab9384e0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf853cc640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba2a890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x555daba24490 tx=0x7faf78000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7fae71e03640 1 -- 172.21.15.72:0/2978138727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78013760 con 0x555dab9384e0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555daba2b060 con 0x555dab9384e0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7fae71e03640 1 -- 172.21.15.72:0/2978138727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf78013900 con 0x555dab9384e0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7fae71e03640 1 -- 172.21.15.72:0/2978138727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78013be0 con 0x555dab9384e0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555daba2dca0 con 0x555dab9384e0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7fae71e03640 1 -- 172.21.15.72:0/2978138727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faf78010070 con 0x555dab9384e0 2024-04-26T12:50:14.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7fae71e03640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae6c034650 0x7fae6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7fae71e03640 1 -- 172.21.15.72:0/2978138727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7faf78018070 con 0x555dab9384e0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae6c034650 0x7fae6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555dab93c9f0 0x555daba317e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba31e50 con 0x555dab93c9f0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf85bcd640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555dab93c9f0 0x555daba317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae6c034650 0x7fae6c036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf700ad000 tx=0x7faf700a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.128+0000 7faf85bcd640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555dab93c9f0 0x555daba317e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf85bcd640 1 -- 172.21.15.72:0/2978138727 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf800083f0 con 0x555dab93c9f0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba2eec0 con 0x555dab93c9f0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf85bcd640 1 -- 172.21.15.72:0/2978138727 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf800083f0 con 0x555dab93c9f0 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba34180 0x555daba36570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba36c60 con 0x555daba34180 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf853cc640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba34180 0x555daba36570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf853cc640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba34180 0x555daba36570 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf853cc640 1 -- 172.21.15.72:0/2978138727 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf7801b030 con 0x555daba34180 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba33020 con 0x555dab93c9f0 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf85bcd640 1 -- 172.21.15.72:0/2978138727 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf800083f0 con 0x555dab93c9f0 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba380c0 0x555daba3a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba3abf0 con 0x555daba380c0 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba380c0 0x555daba3a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba380c0 0x555daba3a4b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2978138727 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf700b3040 con 0x555daba380c0 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.132+0000 7faf878b1980 1 Processor -- start 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 -- start start 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba48c40 0x555daba49060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555dab83dab0 con 0x555daba48c40 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba48c40 0x555daba49060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba48c40 0x555daba49060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49234/0 (socket says 172.21.15.72:49234) 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf853cc640 1 -- 172.21.15.72:0/3962387494 learned_addr learned my addr 172.21.15.72:0/3962387494 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf853cc640 1 -- 172.21.15.72:0/3962387494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555daba495a0 con 0x555daba48c40 2024-04-26T12:50:14.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf853cc640 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba48c40 0x555daba49060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf780483b0 tx=0x7faf78029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7fae6affd640 1 -- 172.21.15.72:0/3962387494 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78043040 con 0x555daba48c40 2024-04-26T12:50:14.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555daba4a040 con 0x555daba48c40 2024-04-26T12:50:14.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555daba4a510 con 0x555daba48c40 2024-04-26T12:50:14.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7fae6affd640 1 -- 172.21.15.72:0/3962387494 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7804b070 con 0x555daba48c40 2024-04-26T12:50:14.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7fae6affd640 1 -- 172.21.15.72:0/3962387494 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78041a10 con 0x555daba48c40 2024-04-26T12:50:14.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7fae6affd640 1 -- 172.21.15.72:0/3962387494 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faf78041c70 con 0x555daba48c40 2024-04-26T12:50:14.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7fae6affd640 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae5c034600 0x7fae5c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7fae6affd640 1 -- 172.21.15.72:0/3962387494 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7faf7803c030 con 0x555daba48c40 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae5c034600 0x7fae5c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 Processor -- start 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 -- start start 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae5c034600 0x7fae5c036ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x555daba32300 tx=0x7faf70005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba56120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.136+0000 7faf878b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555daba23f20 con 0x555daba55d00 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba56120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba56120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49246/0 (socket says 172.21.15.72:49246) 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 -- 172.21.15.72:0/4291051206 learned_addr learned my addr 172.21.15.72:0/4291051206 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 -- 172.21.15.72:0/4291051206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555daba566f0 con 0x555daba55d00 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 --2- 172.21.15.72:0/4291051206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba56120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf78048510 tx=0x7faf78008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977d0b90c714bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7fae68ff9640 1 -- 172.21.15.72:0/4291051206 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78065070 con 0x555daba55d00 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7fae68ff9640 1 -- 172.21.15.72:0/4291051206 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf78034440 con 0x555daba55d00 2024-04-26T12:50:14.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7fae68ff9640 1 -- 172.21.15.72:0/4291051206 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78058070 con 0x555daba55d00 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- 172.21.15.72:0/4291051206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 msgr2=0x555daba56120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 --2- 172.21.15.72:0/4291051206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba56120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf78048510 tx=0x7faf78008f90 comp rx=0 tx=0).stop 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- 172.21.15.72:0/4291051206 shutdown_connections 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 --2- 172.21.15.72:0/4291051206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba56120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- 172.21.15.72:0/4291051206 >> 172.21.15.72:0/4291051206 conn(0x555daba52040 msgr2=0x555daba500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- 172.21.15.72:0/4291051206 shutdown_connections 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- 172.21.15.72:0/4291051206 wait complete. 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 Processor -- start 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- start start 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba5d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555daba56db0 con 0x555daba55d00 2024-04-26T12:50:14.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba5d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba5d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49254/0 (socket says 172.21.15.72:49254) 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 learned_addr learned my addr 172.21.15.72:0/2341833619 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555daba5d600 con 0x555daba55d00 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf853cc640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba5d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf78048510 tx=0x7faf78017f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7fae5affd640 1 -- 172.21.15.72:0/2341833619 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf78065030 con 0x555daba55d00 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555daba5d600 con 0x555daba55d00 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555daba5d600 con 0x555daba55d00 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7fae5affd640 1 -- 172.21.15.72:0/2341833619 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf78066040 con 0x555daba55d00 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.140+0000 7fae5affd640 1 -- 172.21.15.72:0/2341833619 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf7805b040 con 0x555daba55d00 2024-04-26T12:50:14.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7fae5affd640 1 -- 172.21.15.72:0/2341833619 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faf78041500 con 0x555daba55d00 2024-04-26T12:50:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7fae5affd640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae50034600 0x7fae50036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7fae5affd640 1 -- 172.21.15.72:0/2341833619 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7faf78070910 con 0x555daba55d00 2024-04-26T12:50:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae50034600 0x7fae50036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555daba68120 0x555daba6a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6ad30 con 0x555daba68120 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf85bcd640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555daba68120 0x555daba6a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae50034600 0x7fae50036ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf700b6fd0 tx=0x7faf700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf85bcd640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555daba68120 0x555daba6a5e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf800083f0 con 0x555daba68120 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 realm 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6b140 con 0x555daba68120 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf800083f0 con 0x555daba68120 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6b9e0 con 0x555daba68120 2024-04-26T12:50:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf800083f0 con 0x555daba68120 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6bd80 con 0x555daba68120 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf800083f0 con 0x555daba68120 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba6cae0 0x555daba6eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6f410 con 0x555daba6cae0 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf853cc640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba6cae0 0x555daba6eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.144+0000 7faf853cc640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba6cae0 0x555daba6eed0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf878b1980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:14.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf878b1980 20 searching for the correct realm 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba71180 0x555daba73570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555daba73b80 con 0x555daba71180 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba71180 0x555daba73570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba71180 0x555daba73570 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf7cbcb640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faf700ab030 0x7faf700b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555daba73b80 con 0x7faf700ab030 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faf700ab030 0x7faf700b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faf700ab030 0x7faf700b7400 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf800083f0 con 0x7faf700ab030 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555daba6bd80 con 0x555daba6cae0 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf800083f0 con 0x555daba68120 2024-04-26T12:50:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.148+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x7faf700ab030 2024-04-26T12:50:14.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x7faf700ab030 2024-04-26T12:50:14.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x7faf700ab030 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf80026040 con 0x7faf700ab030 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.152+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x7faf700ab030 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x7faf700ab030 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x7faf700ab030 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x7faf700ab030 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba71180 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.156+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba6cae0 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x555daba68120 2024-04-26T12:50:14.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7faf78083040 con 0x7faf700ab030 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf80026040 con 0x7faf700ab030 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6bd80 con 0x555daba68120 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6bd80 con 0x555daba68120 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf80026040 con 0x555daba68120 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6bd80 con 0x555daba71180 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 zone default found 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 4 Realm: () 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 zonegroup default 2024-04-26T12:50:14.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba6ff70 con 0x555daba6cae0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba70840 con 0x555daba71180 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba759e0 con 0x555daba71180 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 started sync module instance, tier type = 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:14.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.160+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba74e80 con 0x7faf700ab030 2024-04-26T12:50:14.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.164+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80026040 con 0x7faf700ab030 2024-04-26T12:50:14.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.164+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93860800189344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba74e80 con 0x7faf700ab030 2024-04-26T12:50:14.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.164+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba76400 con 0x555daba68120 2024-04-26T12:50:14.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.164+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93860800189344] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x7faf700ab030 2024-04-26T12:50:14.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.164+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.164+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93860800192240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba74e80 con 0x555daba68120 2024-04-26T12:50:14.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.164+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba76e40 con 0x555daba71180 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93860800194960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba77690 con 0x555daba71180 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba78090 con 0x7faf700ab030 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93860800192240] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x7faf700ab030 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93860800186832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba784b0 con 0x7faf700ab030 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba78e70 con 0x555daba68120 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93860800194960] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93860800186832] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x7faf700ab030 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93860800199584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba789c0 con 0x555daba68120 2024-04-26T12:50:14.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.168+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79210 con 0x555daba6cae0 2024-04-26T12:50:14.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93860800199584] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93860800203200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79290 con 0x555daba6cae0 2024-04-26T12:50:14.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79ae0 con 0x555daba6cae0 2024-04-26T12:50:14.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93860800203200] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93860800204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79a10 con 0x555daba6cae0 2024-04-26T12:50:14.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.172+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba7a530 con 0x555daba6cae0 2024-04-26T12:50:14.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93860800204736] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93860800208896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba7a4f0 con 0x555daba6cae0 2024-04-26T12:50:14.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=0 2024-04-26T12:50:14.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=1 2024-04-26T12:50:14.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=2 2024-04-26T12:50:14.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=3 2024-04-26T12:50:14.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=4 2024-04-26T12:50:14.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=5 2024-04-26T12:50:14.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=6 2024-04-26T12:50:14.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93860800208896] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 20 add_watcher() i=7 2024-04-26T12:50:14.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:14.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555daba7d980 con 0x555daba68120 2024-04-26T12:50:14.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.176+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93860800205920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba7ae40 con 0x555daba68120 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93860800205920] v33'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7fae3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 5 note: GC not initialized 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7fae3a7e4640 20 reqs_thread_entry: start 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 20 Filter name: none 2024-04-26T12:50:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7fadabfff640 20 reqs_thread_entry: start 2024-04-26T12:50:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555dabaa0d60 con 0x555daba68120 2024-04-26T12:50:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:14.181 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:14.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7fae3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.180+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93860800205920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba9fb50 con 0x555daba68120 2024-04-26T12:50:14.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93860800205920] v33'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93860800189344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79460 con 0x7faf700ab030 2024-04-26T12:50:14.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93860800189344] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x7faf700ab030 2024-04-26T12:50:14.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf878b1980 20 remove_watcher() i=0 2024-04-26T12:50:14.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf878b1980 2 removed watcher, disabling cache 2024-04-26T12:50:14.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93860800192240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79460 con 0x555daba68120 2024-04-26T12:50:14.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93860800192240] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf878b1980 20 remove_watcher() i=1 2024-04-26T12:50:14.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.184+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93860800194960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79460 con 0x555daba71180 2024-04-26T12:50:14.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.188+0000 7faf7cbcb640 1 -- 172.21.15.72:0/2341833619 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93860800194960] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf700b3040 con 0x555daba71180 2024-04-26T12:50:14.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.188+0000 7faf878b1980 20 remove_watcher() i=2 2024-04-26T12:50:14.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.188+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93860800186832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79460 con 0x7faf700ab030 2024-04-26T12:50:14.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.188+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93860800186832] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x7faf700ab030 2024-04-26T12:50:14.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.188+0000 7faf878b1980 20 remove_watcher() i=3 2024-04-26T12:50:14.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.188+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93860800199584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba749d0 con 0x555daba68120 2024-04-26T12:50:14.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.192+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93860800199584] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf80036040 con 0x555daba68120 2024-04-26T12:50:14.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.192+0000 7faf878b1980 20 remove_watcher() i=4 2024-04-26T12:50:14.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.192+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93860800203200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba79460 con 0x555daba6cae0 2024-04-26T12:50:14.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.192+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93860800203200] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.192+0000 7faf878b1980 20 remove_watcher() i=5 2024-04-26T12:50:14.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.192+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93860800204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba77ba0 con 0x555daba6cae0 2024-04-26T12:50:14.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93860800204736] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 20 remove_watcher() i=6 2024-04-26T12:50:14.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93860800208896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555daba749d0 con 0x555daba6cae0 2024-04-26T12:50:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf853cc640 1 -- 172.21.15.72:0/2341833619 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93860800208896] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7801b030 con 0x555daba6cae0 2024-04-26T12:50:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 20 remove_watcher() i=7 2024-04-26T12:50:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba6cae0 msgr2=0x555daba6eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba6cae0 0x555daba6eed0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555daba68120 msgr2=0x555daba6a5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555daba68120 0x555daba6a5e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faf700ab030 msgr2=0x7faf700b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faf700ab030 0x7faf700b7400 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba71180 msgr2=0x555daba73570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba71180 0x555daba73570 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae50034600 msgr2=0x7fae50036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae50034600 0x7fae50036ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf700b6fd0 tx=0x7faf700a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 msgr2=0x555daba5d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf85bcd640 1 -- 172.21.15.72:0/2341833619 reap_dead start 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba5d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf78048510 tx=0x7faf78017f20 comp rx=0 tx=0).stop 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 shutdown_connections 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2341833619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba55d00 0x555daba5d0c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 >> 172.21.15.72:0/2341833619 conn(0x555daba52040 msgr2=0x555daba4f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 shutdown_connections 2024-04-26T12:50:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2341833619 wait complete. 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae5c034600 msgr2=0x7fae5c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae5c034600 0x7fae5c036ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x555daba32300 tx=0x7faf70005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba48c40 msgr2=0x555daba49060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba48c40 0x555daba49060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf780483b0 tx=0x7faf78029840 comp rx=0 tx=0).stop 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 shutdown_connections 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae5c034600 0x7fae5c036ac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/3962387494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555daba48c40 0x555daba49060 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 >> 172.21.15.72:0/3962387494 conn(0x555daba3da50 msgr2=0x555daba3e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 shutdown_connections 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/3962387494 wait complete. 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba34180 msgr2=0x555daba36570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x555daba34180 0x555daba36570 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555dab93c9f0 msgr2=0x555daba317e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555dab93c9f0 0x555daba317e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba380c0 msgr2=0x555daba3a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555daba380c0 0x555daba3a4b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae6c034650 msgr2=0x7fae6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fae6c034650 0x7fae6c036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf700ad000 tx=0x7faf700a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 msgr2=0x555daba2a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 --2- 172.21.15.72:0/2978138727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555dab9384e0 0x555daba2a890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x555daba24490 tx=0x7faf78000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf85bcd640 1 -- 172.21.15.72:0/2978138727 reap_dead start 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 shutdown_connections 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 >> 172.21.15.72:0/2978138727 conn(0x555dab8abbc0 msgr2=0x555daba1dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 shutdown_connections 2024-04-26T12:50:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.196+0000 7faf878b1980 1 -- 172.21.15.72:0/2978138727 wait complete. 2024-04-26T12:50:14.206 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:14.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-26T12:50:14.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-26T12:50:14.207 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-26T12:50:14.277 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:14.278 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f7730101980 1 Processor -- start 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f7730101980 1 -- start start 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f7730101980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5587586836e0 0x558758685ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f7730101980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55875852d510 con 0x55875867f180 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f7730101980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x558758534430 con 0x5587586836e0 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f772d41b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5587586836e0 0x558758685ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f772d41b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5587586836e0 0x558758685ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49260/0 (socket says 172.21.15.72:49260) 2024-04-26T12:50:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f772d41b640 1 -- 172.21.15.72:0/244403470 learned_addr learned my addr 172.21.15.72:0/244403470 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f772d41b640 1 -- 172.21.15.72:0/244403470 >> v1:172.21.15.29:6789/0 conn(0x55875867f180 legacy=0x55875867f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.280+0000 7f772d41b640 1 -- 172.21.15.72:0/244403470 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558758509ae0 con 0x5587586836e0 2024-04-26T12:50:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f772d41b640 1 --2- 172.21.15.72:0/244403470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587586836e0 0x558758685ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f772400a5c0 tx=0x7f772401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2f6eef3583fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f772cc1a640 1 -- 172.21.15.72:0/244403470 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77240a6070 con 0x5587586836e0 2024-04-26T12:50:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f772cc1a640 1 -- 172.21.15.72:0/244403470 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77240af070 con 0x5587586836e0 2024-04-26T12:50:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f772cc1a640 1 -- 172.21.15.72:0/244403470 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77240aa5c0 con 0x5587586836e0 2024-04-26T12:50:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f7730101980 1 -- 172.21.15.72:0/244403470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587586836e0 msgr2=0x558758685ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f7730101980 1 --2- 172.21.15.72:0/244403470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587586836e0 0x558758685ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f772400a5c0 tx=0x7f772401b340 comp rx=0 tx=0).stop 2024-04-26T12:50:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f7730101980 1 -- 172.21.15.72:0/244403470 shutdown_connections 2024-04-26T12:50:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f7730101980 1 --2- 172.21.15.72:0/244403470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587586836e0 0x558758685ad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f7730101980 1 -- 172.21.15.72:0/244403470 >> 172.21.15.72:0/244403470 conn(0x55875867aa50 msgr2=0x55875867ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f7730101980 1 -- 172.21.15.72:0/244403470 shutdown_connections 2024-04-26T12:50:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.284+0000 7f7730101980 1 -- 172.21.15.72:0/244403470 wait complete. 2024-04-26T12:50:14.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f7730101980 1 Processor -- start 2024-04-26T12:50:14.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f7730101980 1 -- start start 2024-04-26T12:50:14.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f7730101980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x55875876a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f7730101980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558758583a70 con 0x55875867f180 2024-04-26T12:50:14.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x55875876a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x55875876a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49262/0 (socket says 172.21.15.72:49262) 2024-04-26T12:50:14.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f772dc1c640 1 -- 172.21.15.72:0/4164676920 learned_addr learned my addr 172.21.15.72:0/4164676920 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f772dc1c640 1 -- 172.21.15.72:0/4164676920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875876a900 con 0x55875867f180 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f772dc1c640 1 --2- 172.21.15.72:0/4164676920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x55875876a330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7720001ea0 tx=0x7f772000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba526f720ae5877 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f761be07640 1 -- 172.21.15.72:0/4164676920 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772000b6b0 con 0x55875867f180 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f761be07640 1 -- 172.21.15.72:0/4164676920 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772000b890 con 0x55875867f180 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.296+0000 7f761be07640 1 -- 172.21.15.72:0/4164676920 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772000bbb0 con 0x55875867f180 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- 172.21.15.72:0/4164676920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 msgr2=0x55875876a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 --2- 172.21.15.72:0/4164676920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x55875876a330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7720001ea0 tx=0x7f772000d890 comp rx=0 tx=0).stop 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- 172.21.15.72:0/4164676920 shutdown_connections 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 --2- 172.21.15.72:0/4164676920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x55875876a330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- 172.21.15.72:0/4164676920 >> 172.21.15.72:0/4164676920 conn(0x55875867aa50 msgr2=0x558758765ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- 172.21.15.72:0/4164676920 shutdown_connections 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- 172.21.15.72:0/4164676920 wait complete. 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 Processor -- start 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- start start 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x558758770480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558758688b00 con 0x55875867f180 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x558758770480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x558758770480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49268/0 (socket says 172.21.15.72:49268) 2024-04-26T12:50:14.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f772dc1c640 1 -- 172.21.15.72:0/1520424134 learned_addr learned my addr 172.21.15.72:0/1520424134 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f772dc1c640 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587587709c0 con 0x55875867f180 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f772dc1c640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x558758770480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7720002000 tx=0x7f7720000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f761a604640 1 -- 172.21.15.72:0/1520424134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720001520 con 0x55875867f180 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558758770c50 con 0x55875867f180 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f761a604640 1 -- 172.21.15.72:0/1520424134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720016690 con 0x55875867f180 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587587738e0 con 0x55875867f180 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f761a604640 1 -- 172.21.15.72:0/1520424134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720016970 con 0x55875867f180 2024-04-26T12:50:14.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.300+0000 7f761a604640 1 -- 172.21.15.72:0/1520424134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7720028020 con 0x55875867f180 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f761a604640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f76140346a0 0x7f7614036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f761a604640 1 -- 172.21.15.72:0/1520424134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f7720026020 con 0x55875867f180 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772d41b640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f76140346a0 0x7f7614036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587586836e0 0x5587587773c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587779e0 con 0x5587586836e0 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772e41d640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587586836e0 0x5587587773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772d41b640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f76140346a0 0x7f7614036b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77240ae000 tx=0x7f77240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772e41d640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587586836e0 0x5587587773c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772e41d640 1 -- 172.21.15.72:0/1520424134 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587586836e0 2024-04-26T12:50:14.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558758774b00 con 0x5587586836e0 2024-04-26T12:50:14.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772e41d640 1 -- 172.21.15.72:0/1520424134 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f772800a4d0 con 0x5587586836e0 2024-04-26T12:50:14.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558758779d10 0x55875877c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55875877c7f0 con 0x558758779d10 2024-04-26T12:50:14.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772dc1c640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558758779d10 0x55875877c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772dc1c640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558758779d10 0x55875877c100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772dc1c640 1 -- 172.21.15.72:0/1520424134 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7720016cf0 con 0x558758779d10 2024-04-26T12:50:14.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558758778bb0 con 0x5587586836e0 2024-04-26T12:50:14.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772e41d640 1 -- 172.21.15.72:0/1520424134 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f772800a4d0 con 0x5587586836e0 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55875877dc50 0x558758780040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558758780780 con 0x55875877dc50 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772d41b640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55875877dc50 0x558758780040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.304+0000 7f772d41b640 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55875877dc50 0x558758780040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f772d41b640 1 -- 172.21.15.72:0/1520424134 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77240aaac0 con 0x55875877dc50 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f7730101980 1 Processor -- start 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f7730101980 1 -- start start 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f7730101980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875878e7b0 0x55875878ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f7730101980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558758587ab0 con 0x55875878e7b0 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875878e7b0 0x55875878ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875878e7b0 0x55875878ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49278/0 (socket says 172.21.15.72:49278) 2024-04-26T12:50:14.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f772dc1c640 1 -- 172.21.15.72:0/141089394 learned_addr learned my addr 172.21.15.72:0/141089394 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f772dc1c640 1 -- 172.21.15.72:0/141089394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875878f110 con 0x55875878e7b0 2024-04-26T12:50:14.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f772dc1c640 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875878e7b0 0x55875878ebd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7720009f90 tx=0x7f7720048370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f76137fe640 1 -- 172.21.15.72:0/141089394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720015ce0 con 0x55875878e7b0 2024-04-26T12:50:14.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55875878fbb0 con 0x55875878e7b0 2024-04-26T12:50:14.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55875878fbb0 con 0x55875878e7b0 2024-04-26T12:50:14.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f76137fe640 1 -- 172.21.15.72:0/141089394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720015e80 con 0x55875878e7b0 2024-04-26T12:50:14.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f76137fe640 1 -- 172.21.15.72:0/141089394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720014380 con 0x55875878e7b0 2024-04-26T12:50:14.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f76137fe640 1 -- 172.21.15.72:0/141089394 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7720014520 con 0x55875878e7b0 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f76137fe640 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7608034650 0x7f7608036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f76137fe640 1 -- 172.21.15.72:0/141089394 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f772002b020 con 0x55875878e7b0 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f772d41b640 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7608034650 0x7f7608036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.308+0000 7f7730101980 1 Processor -- start 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- start start 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772d41b640 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7608034650 0x7f7608036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x558758778b80 tx=0x7f7724005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x55875879ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55875876ac50 con 0x55875879b630 2024-04-26T12:50:14.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x55875879ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x55875879ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49294/0 (socket says 172.21.15.72:49294) 2024-04-26T12:50:14.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 -- 172.21.15.72:0/2552934586 learned_addr learned my addr 172.21.15.72:0/2552934586 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 -- 172.21.15.72:0/2552934586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875879c020 con 0x55875879b630 2024-04-26T12:50:14.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 --2- 172.21.15.72:0/2552934586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x55875879ba50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7720048420 tx=0x7f7720035680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c394fb87c82c77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f76117fa640 1 -- 172.21.15.72:0/2552934586 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772004d430 con 0x55875879b630 2024-04-26T12:50:14.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f76117fa640 1 -- 172.21.15.72:0/2552934586 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720020900 con 0x55875879b630 2024-04-26T12:50:14.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f76117fa640 1 -- 172.21.15.72:0/2552934586 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772004d5d0 con 0x55875879b630 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- 172.21.15.72:0/2552934586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 msgr2=0x55875879ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 --2- 172.21.15.72:0/2552934586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x55875879ba50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7720048420 tx=0x7f7720035680 comp rx=0 tx=0).stop 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- 172.21.15.72:0/2552934586 shutdown_connections 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 --2- 172.21.15.72:0/2552934586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x55875879ba50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- 172.21.15.72:0/2552934586 >> 172.21.15.72:0/2552934586 conn(0x558758797970 msgr2=0x5587587959d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- 172.21.15.72:0/2552934586 shutdown_connections 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- 172.21.15.72:0/2552934586 wait complete. 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 Processor -- start 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- start start 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x5587587a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f7730101980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55875879c6e0 con 0x55875879b630 2024-04-26T12:50:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x5587587a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x5587587a2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49306/0 (socket says 172.21.15.72:49306) 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 learned_addr learned my addr 172.21.15.72:0/2283406329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587587a2e50 con 0x55875879b630 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.312+0000 7f772dc1c640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x5587587a2910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7720048420 tx=0x7f772002cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f75ff7fe640 1 -- 172.21.15.72:0/2283406329 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772006f070 con 0x55875879b630 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587587a2e50 con 0x55875879b630 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587587a2e50 con 0x55875879b630 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f75ff7fe640 1 -- 172.21.15.72:0/2283406329 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720042c80 con 0x55875879b630 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f75ff7fe640 1 -- 172.21.15.72:0/2283406329 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720042fa0 con 0x55875879b630 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f75ff7fe640 1 -- 172.21.15.72:0/2283406329 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7720072070 con 0x55875879b630 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f75ff7fe640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f75f8034650 0x7f75f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f75ff7fe640 1 -- 172.21.15.72:0/2283406329 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f7720075c80 con 0x55875879b630 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772d41b640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f75f8034650 0x7f75f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587587ad980 0x5587587afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b0570 con 0x5587587ad980 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772e41d640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587587ad980 0x5587587afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772d41b640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f75f8034650 0x7f75f8036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x558758780b60 tx=0x7f77240c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772e41d640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587587ad980 0x5587587afe20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 realm 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b0980 con 0x5587587ad980 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b1220 con 0x5587587ad980 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5587587b2320 0x5587587b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b4d60 con 0x5587587b2320 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.316+0000 7f772dc1c640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5587587b2320 0x5587587b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772dc1c640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5587587b2320 0x5587587b4710 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f7730101980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f7730101980 20 searching for the correct realm 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5587587b6c40 0x5587587b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b96b0 con 0x5587587b6c40 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772d41b640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5587587b6c40 0x5587587b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772d41b640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5587587b6c40 0x5587587b9030 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772d41b640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f77240e0040 0x7f77240e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b96b0 con 0x7f77240e0040 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772e41d640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f77240e0040 0x7f77240e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772e41d640 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f77240e0040 0x7f77240e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.320+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x7f77240e0040 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x7f77240e0040 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.324+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x7f77240e0040 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.328+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x7f77240e0040 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b6c40 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587b2320 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x5587587ad980 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587587b15c0 con 0x7f77240e0040 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b55b0 con 0x5587587ad980 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b55b0 con 0x5587587ad980 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.332+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b55b0 con 0x5587587b6c40 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 zone default found 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 4 Realm: () 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 zonegroup default 2024-04-26T12:50:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587b5fd0 con 0x5587587b2320 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587bb9c0 con 0x5587587b6c40 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587bbd60 con 0x5587587b6c40 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 started sync module instance, tier type = 2024-04-26T12:50:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bae00 con 0x7f77240e0040 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94039793447456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bae00 con 0x7f77240e0040 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bc5b0 con 0x5587587ad980 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.336+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94039793447456] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.340+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.340+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94039793451536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bae00 con 0x5587587ad980 2024-04-26T12:50:14.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.340+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bcfc0 con 0x5587587b6c40 2024-04-26T12:50:14.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.340+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94039793451536] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.340+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.340+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94039793445200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bad70 con 0x5587587b6c40 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.340+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bdcc0 con 0x7f77240e0040 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94039793457440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587be3b0 con 0x7f77240e0040 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587beed0 con 0x5587587ad980 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94039793445200] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94039793457440] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94039793461664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bee90 con 0x5587587ad980 2024-04-26T12:50:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.344+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bf2c0 con 0x5587587b2320 2024-04-26T12:50:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94039793458688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587bfb60 con 0x5587587b2320 2024-04-26T12:50:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587c0520 con 0x5587587b2320 2024-04-26T12:50:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94039793461664] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94039793455968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587c0d70 con 0x5587587b2320 2024-04-26T12:50:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587c1730 con 0x5587587b2320 2024-04-26T12:50:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.348+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94039793458688] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94039793455968] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94039793469632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587c0ce0 con 0x5587587b2320 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=0 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=1 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=2 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=3 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=4 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=5 2024-04-26T12:50:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=6 2024-04-26T12:50:14.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94039793469632] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 add_watcher() i=7 2024-04-26T12:50:14.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:14.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587c4760 con 0x5587587ad980 2024-04-26T12:50:14.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94039793472128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587c1b50 con 0x5587587ad980 2024-04-26T12:50:14.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94039793472128] v33'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f75df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:14.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:14.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 5 note: GC not initialized 2024-04-26T12:50:14.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f75de7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f7730101980 20 Filter name: none 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.352+0000 7f754ffff640 20 reqs_thread_entry: start 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587e7e70 con 0x5587587ad980 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587e7990 con 0x7f77240e0040 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587ee110 con 0x5587587ad980 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94039793655200 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587587eae30 con 0x5587587ad980 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94039793461664 notify 141733920770 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f7728026410 con 0x5587587ad980 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f76117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94039793461664 notifier 4335 bl.length()=567 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f76117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f76117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify cookie 94039793655200 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f76117fa640 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f75f0003eb0 con 0x5587587ad980 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94039793655200 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f77280265e0 con 0x5587587ad980 2024-04-26T12:50:14.358 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:14.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f75df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.356+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94039793472128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x5587587ad980 2024-04-26T12:50:14.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94039793472128] v33'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94039793447456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x7f77240e0040 2024-04-26T12:50:14.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94039793447456] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f7730101980 20 remove_watcher() i=0 2024-04-26T12:50:14.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f7730101980 2 removed watcher, disabling cache 2024-04-26T12:50:14.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94039793451536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x5587587ad980 2024-04-26T12:50:14.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94039793451536] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f7730101980 20 remove_watcher() i=1 2024-04-26T12:50:14.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.360+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94039793445200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x5587587b6c40 2024-04-26T12:50:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.364+0000 7f772d41b640 1 -- 172.21.15.72:0/2283406329 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94039793445200] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77240aaac0 con 0x5587587b6c40 2024-04-26T12:50:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.364+0000 7f7730101980 20 remove_watcher() i=2 2024-04-26T12:50:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.364+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94039793457440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x7f77240e0040 2024-04-26T12:50:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.364+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94039793457440] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x7f77240e0040 2024-04-26T12:50:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.364+0000 7f7730101980 20 remove_watcher() i=3 2024-04-26T12:50:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.364+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94039793461664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x5587587ad980 2024-04-26T12:50:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.368+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94039793461664] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f772800a4d0 con 0x5587587ad980 2024-04-26T12:50:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.368+0000 7f7730101980 20 remove_watcher() i=4 2024-04-26T12:50:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.368+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94039793458688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x5587587b2320 2024-04-26T12:50:14.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.368+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94039793458688] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.368+0000 7f7730101980 20 remove_watcher() i=5 2024-04-26T12:50:14.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.368+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94039793455968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x5587587b2320 2024-04-26T12:50:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94039793455968] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 20 remove_watcher() i=6 2024-04-26T12:50:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94039793469632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587587e5ba0 con 0x5587587b2320 2024-04-26T12:50:14.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f772dc1c640 1 -- 172.21.15.72:0/2283406329 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94039793469632] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720071030 con 0x5587587b2320 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 20 remove_watcher() i=7 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5587587b2320 msgr2=0x5587587b4710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5587587b2320 0x5587587b4710 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587587ad980 msgr2=0x5587587afe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587587ad980 0x5587587afe20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f77240e0040 msgr2=0x7f77240e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f77240e0040 0x7f77240e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5587587b6c40 msgr2=0x5587587b9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5587587b6c40 0x5587587b9030 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f75f8034650 msgr2=0x7f75f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f75f8034650 0x7f75f8036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x558758780b60 tx=0x7f77240c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f772e41d640 1 -- 172.21.15.72:0/2283406329 reap_dead start 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 msgr2=0x5587587a2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x5587587a2910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7720048420 tx=0x7f772002cea0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 shutdown_connections 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/2283406329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875879b630 0x5587587a2910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 >> 172.21.15.72:0/2283406329 conn(0x558758797970 msgr2=0x558758794fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 shutdown_connections 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/2283406329 wait complete. 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7608034650 msgr2=0x7f7608036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7608034650 0x7f7608036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x558758778b80 tx=0x7f7724005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875878e7b0 msgr2=0x55875878ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875878e7b0 0x55875878ebd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7720009f90 tx=0x7f7720048370 comp rx=0 tx=0).stop 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 shutdown_connections 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7608034650 0x7f7608036b10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 --2- 172.21.15.72:0/141089394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875878e7b0 0x55875878ebd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 >> 172.21.15.72:0/141089394 conn(0x5587587835c0 msgr2=0x5587587840d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 shutdown_connections 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.372+0000 7f7730101980 1 -- 172.21.15.72:0/141089394 wait complete. 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558758779d10 msgr2=0x55875877c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558758779d10 0x55875877c100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587586836e0 msgr2=0x5587587773c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5587586836e0 0x5587587773c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55875877dc50 msgr2=0x558758780040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55875877dc50 0x558758780040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f76140346a0 msgr2=0x7f7614036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f76140346a0 0x7f7614036b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77240ae000 tx=0x7f77240a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 msgr2=0x558758770480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 --2- 172.21.15.72:0/1520424134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55875867f180 0x558758770480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7720002000 tx=0x7f7720000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f772e41d640 1 -- 172.21.15.72:0/1520424134 reap_dead start 2024-04-26T12:50:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 shutdown_connections 2024-04-26T12:50:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 >> 172.21.15.72:0/1520424134 conn(0x55875867aa50 msgr2=0x5587587649d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 shutdown_connections 2024-04-26T12:50:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.376+0000 7f7730101980 1 -- 172.21.15.72:0/1520424134 wait complete. 2024-04-26T12:50:14.382 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:14.383 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:14.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:14.383 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:14.452 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:14.452 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e98386980 1 Processor -- start 2024-04-26T12:50:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e98386980 1 -- start start 2024-04-26T12:50:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e98386980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5589f5ec59e0 0x5589f5ec7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e98386980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589f5d6c510 con 0x5589f5ec14c0 2024-04-26T12:50:14.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e98386980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5589f5d73430 con 0x5589f5ec59e0 2024-04-26T12:50:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e956a0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5589f5ec59e0 0x5589f5ec7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e95ea1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5589f5ec14c0 0x5589f5ec18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35974/0 (socket says 172.21.15.72:35974) 2024-04-26T12:50:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2069609156 learned_addr learned my addr 172.21.15.72:0/2069609156 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.452+0000 7f0e956a0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5589f5ec59e0 0x5589f5ec7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49308/0 (socket says 172.21.15.72:49308) 2024-04-26T12:50:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e956a0640 1 -- 172.21.15.72:0/2069609156 >> v1:172.21.15.29:6789/0 conn(0x5589f5ec14c0 legacy=0x5589f5ec18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e956a0640 1 -- 172.21.15.72:0/2069609156 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f5d48ae0 con 0x5589f5ec59e0 2024-04-26T12:50:14.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2069609156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec59e0 0x5589f5ec7dd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000a480 tx=0x7f0e8001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d2c694948e1cbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e94e9f640 1 -- 172.21.15.72:0/2069609156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e800b0070 con 0x5589f5ec59e0 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e94e9f640 1 -- 172.21.15.72:0/2069609156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e800ab540 con 0x5589f5ec59e0 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e94e9f640 1 -- 172.21.15.72:0/2069609156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e800ab840 con 0x5589f5ec59e0 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e98386980 1 -- 172.21.15.72:0/2069609156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec59e0 msgr2=0x5589f5ec7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e98386980 1 --2- 172.21.15.72:0/2069609156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec59e0 0x5589f5ec7dd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000a480 tx=0x7f0e8001b280 comp rx=0 tx=0).stop 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e98386980 1 -- 172.21.15.72:0/2069609156 shutdown_connections 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e98386980 1 --2- 172.21.15.72:0/2069609156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec59e0 0x5589f5ec7dd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e98386980 1 -- 172.21.15.72:0/2069609156 >> 172.21.15.72:0/2069609156 conn(0x5589f5e34bc0 msgr2=0x5589f5e34fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e98386980 1 -- 172.21.15.72:0/2069609156 shutdown_connections 2024-04-26T12:50:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.456+0000 7f0e98386980 1 -- 172.21.15.72:0/2069609156 wait complete. 2024-04-26T12:50:14.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.468+0000 7f0e98386980 1 Processor -- start 2024-04-26T12:50:14.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.468+0000 7f0e98386980 1 -- start start 2024-04-26T12:50:14.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fac610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5589f5dc2a70 con 0x5589f5ec14c0 2024-04-26T12:50:14.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49314/0 (socket says 172.21.15.72:49314) 2024-04-26T12:50:14.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 -- 172.21.15.72:0/1199791123 learned_addr learned my addr 172.21.15.72:0/1199791123 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 -- 172.21.15.72:0/1199791123 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f5facbe0 con 0x5589f5ec14c0 2024-04-26T12:50:14.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/1199791123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fac610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e880015f0 tx=0x7f0e88001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1679655a9e1e7f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0d83e07640 1 -- 172.21.15.72:0/1199791123 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88004530 con 0x5589f5ec14c0 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0d83e07640 1 -- 172.21.15.72:0/1199791123 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e880046f0 con 0x5589f5ec14c0 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0d83e07640 1 -- 172.21.15.72:0/1199791123 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88004a90 con 0x5589f5ec14c0 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- 172.21.15.72:0/1199791123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 msgr2=0x5589f5fac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 --2- 172.21.15.72:0/1199791123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fac610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e880015f0 tx=0x7f0e88001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- 172.21.15.72:0/1199791123 shutdown_connections 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 --2- 172.21.15.72:0/1199791123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fac610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- 172.21.15.72:0/1199791123 >> 172.21.15.72:0/1199791123 conn(0x5589f5e34bc0 msgr2=0x5589f5fa81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- 172.21.15.72:0/1199791123 shutdown_connections 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- 172.21.15.72:0/1199791123 wait complete. 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 Processor -- start 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- start start 2024-04-26T12:50:14.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fb38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e98386980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5589f5ecae30 con 0x5589f5ec14c0 2024-04-26T12:50:14.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fb38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fb38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49322/0 (socket says 172.21.15.72:49322) 2024-04-26T12:50:14.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2602566601 learned_addr learned my addr 172.21.15.72:0/2602566601 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.472+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f5fb3de0 con 0x5589f5ec14c0 2024-04-26T12:50:14.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fb38a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5589f5fad4a0 tx=0x7f0e88000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0d82604640 1 -- 172.21.15.72:0/2602566601 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88013760 con 0x5589f5ec14c0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589f5fb4070 con 0x5589f5ec14c0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589f5fb6cb0 con 0x5589f5ec14c0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0d82604640 1 -- 172.21.15.72:0/2602566601 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88013900 con 0x5589f5ec14c0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0d82604640 1 -- 172.21.15.72:0/2602566601 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88013be0 con 0x5589f5ec14c0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0d82604640 1 -- 172.21.15.72:0/2602566601 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e88010070 con 0x5589f5ec14c0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0d82604640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d7c034650 0x7f0d7c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0d82604640 1 -- 172.21.15.72:0/2602566601 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f0e88018070 con 0x5589f5ec14c0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d7c034650 0x7f0d7c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ec59e0 0x5589f5fba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fbae60 con 0x5589f5ec59e0 2024-04-26T12:50:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e966a2640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ec59e0 0x5589f5fba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d7c034650 0x7f0d7c036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e800ad000 tx=0x7f0e800a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e966a2640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ec59e0 0x5589f5fba840 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e966a2640 1 -- 172.21.15.72:0/2602566601 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ec59e0 2024-04-26T12:50:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fb7ed0 con 0x5589f5ec59e0 2024-04-26T12:50:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e966a2640 1 -- 172.21.15.72:0/2602566601 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ec59e0 2024-04-26T12:50:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5fbd190 0x5589f5fbf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fbfc70 con 0x5589f5fbd190 2024-04-26T12:50:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.476+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5fbd190 0x5589f5fbf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5fbd190 0x5589f5fbf580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2602566601 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5fbd190 2024-04-26T12:50:14.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fbc000 con 0x5589f5ec59e0 2024-04-26T12:50:14.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e966a2640 1 -- 172.21.15.72:0/2602566601 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ec59e0 2024-04-26T12:50:14.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5fc10d0 0x5589f5fc34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fc3bc0 con 0x5589f5fc10d0 2024-04-26T12:50:14.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5fc10d0 0x5589f5fc34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5fc10d0 0x5589f5fc34c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e956a0640 1 -- 172.21.15.72:0/2602566601 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5fc10d0 2024-04-26T12:50:14.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e98386980 1 Processor -- start 2024-04-26T12:50:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e98386980 1 -- start start 2024-04-26T12:50:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e98386980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fd1c10 0x5589f5fd2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e98386980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5589f5dc6ab0 con 0x5589f5fd1c10 2024-04-26T12:50:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fd1c10 0x5589f5fd2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fd1c10 0x5589f5fd2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49324/0 (socket says 172.21.15.72:49324) 2024-04-26T12:50:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e95ea1640 1 -- 172.21.15.72:0/3326464100 learned_addr learned my addr 172.21.15.72:0/3326464100 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e95ea1640 1 -- 172.21.15.72:0/3326464100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f5fd2570 con 0x5589f5fd1c10 2024-04-26T12:50:14.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.480+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fd1c10 0x5589f5fd2030 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0e88048420 tx=0x7f0e88029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d7b7fe640 1 -- 172.21.15.72:0/3326464100 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88038030 con 0x5589f5fd1c10 2024-04-26T12:50:14.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589f5fd3010 con 0x5589f5fd1c10 2024-04-26T12:50:14.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589f5fd34e0 con 0x5589f5fd1c10 2024-04-26T12:50:14.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d7b7fe640 1 -- 172.21.15.72:0/3326464100 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88029970 con 0x5589f5fd1c10 2024-04-26T12:50:14.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d7b7fe640 1 -- 172.21.15.72:0/3326464100 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88041420 con 0x5589f5fd1c10 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d7b7fe640 1 -- 172.21.15.72:0/3326464100 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e880415c0 con 0x5589f5fd1c10 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d7b7fe640 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d70034650 0x7f0d70036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d7b7fe640 1 -- 172.21.15.72:0/3326464100 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f0e8803c070 con 0x5589f5fd1c10 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e956a0640 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d70034650 0x7f0d70036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e98386980 1 Processor -- start 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e98386980 1 -- start start 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e956a0640 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d70034650 0x7f0d70036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5589f5fbb310 tx=0x7f0e80005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e98386980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fdf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e98386980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5589f5facf30 con 0x5589f5fdebf0 2024-04-26T12:50:14.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fdf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fdf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49332/0 (socket says 172.21.15.72:49332) 2024-04-26T12:50:14.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e95ea1640 1 -- 172.21.15.72:0/12602833 learned_addr learned my addr 172.21.15.72:0/12602833 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e95ea1640 1 -- 172.21.15.72:0/12602833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f5fdf5e0 con 0x5589f5fdebf0 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/12602833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fdf010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e8804f730 tx=0x7f0e88040960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d1f7a69e6e7393 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d797fa640 1 -- 172.21.15.72:0/12602833 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88065070 con 0x5589f5fdebf0 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d797fa640 1 -- 172.21.15.72:0/12602833 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88034600 con 0x5589f5fdebf0 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.484+0000 7f0d797fa640 1 -- 172.21.15.72:0/12602833 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88058070 con 0x5589f5fdebf0 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/12602833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 msgr2=0x5589f5fdf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 --2- 172.21.15.72:0/12602833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fdf010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e8804f730 tx=0x7f0e88040960 comp rx=0 tx=0).stop 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/12602833 shutdown_connections 2024-04-26T12:50:14.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 --2- 172.21.15.72:0/12602833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fdf010 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/12602833 >> 172.21.15.72:0/12602833 conn(0x5589f5fdaf30 msgr2=0x5589f5fd8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/12602833 shutdown_connections 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/12602833 wait complete. 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 Processor -- start 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- start start 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fe5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5589f5fdfca0 con 0x5589f5fdebf0 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fe5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e95ea1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fe5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49346/0 (socket says 172.21.15.72:49346) 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 learned_addr learned my addr 172.21.15.72:0/2005599148 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589f5fe6450 con 0x5589f5fdebf0 2024-04-26T12:50:14.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fe5f10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e88040ab0 tx=0x7f0e88039f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0d677fe640 1 -- 172.21.15.72:0/2005599148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88070020 con 0x5589f5fdebf0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589f5fe6450 con 0x5589f5fdebf0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0d677fe640 1 -- 172.21.15.72:0/2005599148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88041dd0 con 0x5589f5fdebf0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0d677fe640 1 -- 172.21.15.72:0/2005599148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e88065040 con 0x5589f5fdebf0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589f5fe68c0 con 0x5589f5fdebf0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0d677fe640 1 -- 172.21.15.72:0/2005599148 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e88073020 con 0x5589f5fdebf0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0d677fe640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d60034650 0x7f0d60036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0d677fe640 1 -- 172.21.15.72:0/2005599148 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f0e88076c40 con 0x5589f5fdebf0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d60034650 0x7f0d60036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ff1030 0x5589f5ff34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff3c20 con 0x5589f5ff1030 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.488+0000 7f0e966a2640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ff1030 0x5589f5ff34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d60034650 0x7f0d60036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e800b6fd0 tx=0x7f0e800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e966a2640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ff1030 0x5589f5ff34d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ff1030 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 realm 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4030 con 0x5589f5ff1030 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ff1030 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:14.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff48d0 con 0x5589f5ff1030 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ff1030 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ff1030 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5ff59d0 0x5589f5ff7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff8340 con 0x5589f5ff59d0 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5ff59d0 0x5589f5ff7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e95ea1640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5ff59d0 0x5589f5ff7dc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 20 searching for the correct realm 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5ffa270 0x5589f5ffc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffce00 con 0x5589f5ffa270 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5ffa270 0x5589f5ffc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5ffa270 0x5589f5ffc730 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.492+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e956a0640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0e800ab030 0x7f0e800b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffce00 con 0x7f0e800ab030 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0e800ab030 0x7f0e800b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0e800ab030 0x7f0e800b7400 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e900083f0 con 0x7f0e800ab030 2024-04-26T12:50:14.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e900083f0 con 0x5589f5ff1030 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x7f0e800ab030 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x7f0e800ab030 2024-04-26T12:50:14.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.496+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x7f0e800ab030 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0e90026040 con 0x7f0e800ab030 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.500+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x7f0e800ab030 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x7f0e800ab030 2024-04-26T12:50:14.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x7f0e800ab030 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x7f0e800ab030 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ffa270 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff59d0 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.504+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x5589f5ff1030 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff4c70 con 0x7f0e800ab030 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e90026040 con 0x7f0e800ab030 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:14.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff8b90 con 0x5589f5ff1030 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff8b90 con 0x5589f5ff1030 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e90026040 con 0x5589f5ff1030 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff8b90 con 0x5589f5ffa270 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:14.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 zone default found 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 4 Realm: () 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 zonegroup default 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ff9430 con 0x5589f5ff59d0 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffec60 con 0x5589f5ffa270 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fff000 con 0x5589f5ffa270 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 started sync module instance, tier type = 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffe100 con 0x7f0e800ab030 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90026040 con 0x7f0e800ab030 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94051026069072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffe100 con 0x7f0e800ab030 2024-04-26T12:50:14.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.508+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fff9c0 con 0x5589f5ff1030 2024-04-26T12:50:14.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.512+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94051026069072] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x7f0e800ab030 2024-04-26T12:50:14.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.512+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.512+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94051026073120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffe100 con 0x5589f5ff1030 2024-04-26T12:50:14.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.512+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f60003d0 con 0x5589f5ffa270 2024-04-26T12:50:14.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.512+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94051026073120] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94051026066512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffe070 con 0x5589f5ffa270 2024-04-26T12:50:14.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6001110 con 0x7f0e800ab030 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x7f0e800ab030 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94051026078752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f60019b0 con 0x7f0e800ab030 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f60023b0 con 0x5589f5ff1030 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94051026066512] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94051026078752] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x7f0e800ab030 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94051026077552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6001480 con 0x5589f5ff1030 2024-04-26T12:50:14.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.516+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6002c50 con 0x5589f5ff59d0 2024-04-26T12:50:14.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94051026085792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6001480 con 0x5589f5ff59d0 2024-04-26T12:50:14.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6003950 con 0x5589f5ff59d0 2024-04-26T12:50:14.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94051026077552] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94051026085792] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94051026087920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f60038c0 con 0x5589f5ff59d0 2024-04-26T12:50:14.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.520+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6004280 con 0x5589f5ff59d0 2024-04-26T12:50:14.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94051026091472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f60046a0 con 0x5589f5ff59d0 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=0 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=1 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=2 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=3 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=4 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=5 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94051026087920] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=6 2024-04-26T12:50:14.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94051026091472] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 20 add_watcher() i=7 2024-04-26T12:50:14.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:14.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f6003410 con 0x5589f5ff1030 2024-04-26T12:50:14.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.524+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94051026088976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6004b60 con 0x5589f5ff1030 2024-04-26T12:50:14.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94051026088976] v33'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0d477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:14.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 5 note: GC not initialized 2024-04-26T12:50:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0d467fc640 20 reqs_thread_entry: start 2024-04-26T12:50:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 20 Filter name: none 2024-04-26T12:50:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0cb7fff640 20 reqs_thread_entry: start 2024-04-26T12:50:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5589f602a9b0 con 0x5589f5ff1030 2024-04-26T12:50:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:14.528 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:14.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0d477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94051026088976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f60297a0 con 0x5589f5ff1030 2024-04-26T12:50:14.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94051026088976] v33'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.528+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94051026069072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f6003410 con 0x7f0e800ab030 2024-04-26T12:50:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94051026069072] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x7f0e800ab030 2024-04-26T12:50:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e98386980 20 remove_watcher() i=0 2024-04-26T12:50:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e98386980 2 removed watcher, disabling cache 2024-04-26T12:50:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94051026073120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffe630 con 0x5589f5ff1030 2024-04-26T12:50:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94051026073120] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e98386980 20 remove_watcher() i=1 2024-04-26T12:50:14.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94051026066512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5fff620 con 0x5589f5ffa270 2024-04-26T12:50:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e956a0640 1 -- 172.21.15.72:0/2005599148 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94051026066512] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e800b3040 con 0x5589f5ffa270 2024-04-26T12:50:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.532+0000 7f0e98386980 20 remove_watcher() i=2 2024-04-26T12:50:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.536+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94051026078752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffdc50 con 0x7f0e800ab030 2024-04-26T12:50:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.536+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94051026078752] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x7f0e800ab030 2024-04-26T12:50:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.536+0000 7f0e98386980 20 remove_watcher() i=3 2024-04-26T12:50:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.536+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94051026077552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffdc50 con 0x5589f5ff1030 2024-04-26T12:50:14.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.536+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94051026077552] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e90036040 con 0x5589f5ff1030 2024-04-26T12:50:14.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.536+0000 7f0e98386980 20 remove_watcher() i=4 2024-04-26T12:50:14.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.536+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94051026085792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffdc50 con 0x5589f5ff59d0 2024-04-26T12:50:14.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.540+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94051026085792] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.540+0000 7f0e98386980 20 remove_watcher() i=5 2024-04-26T12:50:14.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.540+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94051026087920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f60027a0 con 0x5589f5ff59d0 2024-04-26T12:50:14.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.540+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94051026087920] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.540+0000 7f0e98386980 20 remove_watcher() i=6 2024-04-26T12:50:14.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.540+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94051026091472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5589f5ffdc50 con 0x5589f5ff59d0 2024-04-26T12:50:14.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e95ea1640 1 -- 172.21.15.72:0/2005599148 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94051026091472] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e8801b030 con 0x5589f5ff59d0 2024-04-26T12:50:14.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 20 remove_watcher() i=7 2024-04-26T12:50:14.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5ff59d0 msgr2=0x5589f5ff7dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5ff59d0 0x5589f5ff7dc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ff1030 msgr2=0x5589f5ff34d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ff1030 0x5589f5ff34d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0e800ab030 msgr2=0x7f0e800b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f0e800ab030 0x7f0e800b7400 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5ffa270 msgr2=0x5589f5ffc730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5ffa270 0x5589f5ffc730 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d60034650 msgr2=0x7f0d60036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d60034650 0x7f0d60036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e800b6fd0 tx=0x7f0e800a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 msgr2=0x5589f5fe5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2005599148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fdebf0 0x5589f5fe5f10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e88040ab0 tx=0x7f0e88039f50 comp rx=0 tx=0).stop 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 reap_dead start 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e966a2640 1 -- 172.21.15.72:0/2005599148 reap_dead start 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 shutdown_connections 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 >> 172.21.15.72:0/2005599148 conn(0x5589f5fdaf30 msgr2=0x5589f5fd8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 shutdown_connections 2024-04-26T12:50:14.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2005599148 wait complete. 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d70034650 msgr2=0x7f0d70036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d70034650 0x7f0d70036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5589f5fbb310 tx=0x7f0e80005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fd1c10 msgr2=0x5589f5fd2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fd1c10 0x5589f5fd2030 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0e88048420 tx=0x7f0e88029840 comp rx=0 tx=0).stop 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 shutdown_connections 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d70034650 0x7f0d70036b10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/3326464100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5fd1c10 0x5589f5fd2030 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 >> 172.21.15.72:0/3326464100 conn(0x5589f5fc6a20 msgr2=0x5589f5fc7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 shutdown_connections 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/3326464100 wait complete. 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5fbd190 msgr2=0x5589f5fbf580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5589f5fbd190 0x5589f5fbf580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ec59e0 msgr2=0x5589f5fba840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5589f5ec59e0 0x5589f5fba840 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5fc10d0 msgr2=0x5589f5fc34c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5589f5fc10d0 0x5589f5fc34c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d7c034650 msgr2=0x7f0d7c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0d7c034650 0x7f0d7c036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e800ad000 tx=0x7f0e800a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 msgr2=0x5589f5fb38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 --2- 172.21.15.72:0/2602566601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5589f5ec14c0 0x5589f5fb38a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5589f5fad4a0 tx=0x7f0e88000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e966a2640 1 -- 172.21.15.72:0/2602566601 reap_dead start 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 shutdown_connections 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 >> 172.21.15.72:0/2602566601 conn(0x5589f5e34bc0 msgr2=0x5589f5fa6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 shutdown_connections 2024-04-26T12:50:14.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.544+0000 7f0e98386980 1 -- 172.21.15.72:0/2602566601 wait complete. 2024-04-26T12:50:14.552 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:14.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-26T12:50:14.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-26T12:50:14.553 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-26T12:50:14.624 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:14.624 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a70781980 1 Processor -- start 2024-04-26T12:50:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a70781980 1 -- start start 2024-04-26T12:50:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a70781980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568fe27f820 0x5568fe310310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a70781980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568fe1b8510 con 0x5568fe310850 2024-04-26T12:50:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a70781980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5568fe1bf430 con 0x5568fe27f820 2024-04-26T12:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a6e29c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568fe27f820 0x5568fe310310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a6e29c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5568fe27f820 0x5568fe310310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49348/0 (socket says 172.21.15.72:49348) 2024-04-26T12:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a6da9b640 1 --1- 172.21.15.72:0/1202432575 >> v1:172.21.15.29:6789/0 conn(0x5568fe310850 0x5568fe312c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:35990/0 (socket says 172.21.15.72:35990) 2024-04-26T12:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.624+0000 7f3a6e29c640 1 -- 172.21.15.72:0/1202432575 learned_addr learned my addr 172.21.15.72:0/1202432575 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.628+0000 7f3a6e29c640 1 -- 172.21.15.72:0/1202432575 >> v1:172.21.15.29:6789/0 conn(0x5568fe310850 legacy=0x5568fe312c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.628+0000 7f3a6e29c640 1 -- 172.21.15.72:0/1202432575 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568fe194ae0 con 0x5568fe27f820 2024-04-26T12:50:14.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.628+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/1202432575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe310310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800a5c0 tx=0x7f3a6801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816a39dcc452df87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.628+0000 7f3a6d29a640 1 -- 172.21.15.72:0/1202432575 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680a6070 con 0x5568fe27f820 2024-04-26T12:50:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.628+0000 7f3a6d29a640 1 -- 172.21.15.72:0/1202432575 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a680af070 con 0x5568fe27f820 2024-04-26T12:50:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.628+0000 7f3a6d29a640 1 -- 172.21.15.72:0/1202432575 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680aa5c0 con 0x5568fe27f820 2024-04-26T12:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.632+0000 7f3a70781980 1 -- 172.21.15.72:0/1202432575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 msgr2=0x5568fe310310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.632+0000 7f3a70781980 1 --2- 172.21.15.72:0/1202432575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe310310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800a5c0 tx=0x7f3a6801b340 comp rx=0 tx=0).stop 2024-04-26T12:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.632+0000 7f3a70781980 1 -- 172.21.15.72:0/1202432575 shutdown_connections 2024-04-26T12:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.632+0000 7f3a70781980 1 --2- 172.21.15.72:0/1202432575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe310310 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.632+0000 7f3a70781980 1 -- 172.21.15.72:0/1202432575 >> 172.21.15.72:0/1202432575 conn(0x5568fe3059f0 msgr2=0x5568fe307e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.632+0000 7f3a70781980 1 -- 172.21.15.72:0/1202432575 shutdown_connections 2024-04-26T12:50:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.632+0000 7f3a70781980 1 -- 172.21.15.72:0/1202432575 wait complete. 2024-04-26T12:50:14.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 Processor -- start 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- start start 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568fe20ea70 con 0x5568fe27f820 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49358/0 (socket says 172.21.15.72:49358) 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a6e29c640 1 -- 172.21.15.72:0/2112828613 learned_addr learned my addr 172.21.15.72:0/2112828613 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a6e29c640 1 -- 172.21.15.72:0/2112828613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568fe3f8c20 con 0x5568fe27f820 2024-04-26T12:50:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/2112828613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3f8650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3a680199f0 tx=0x7f3a68003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc21d66af2d538 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f395c608640 1 -- 172.21.15.72:0/2112828613 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680aaa00 con 0x5568fe27f820 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f395c608640 1 -- 172.21.15.72:0/2112828613 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a680aaba0 con 0x5568fe27f820 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f395c608640 1 -- 172.21.15.72:0/2112828613 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680bd3f0 con 0x5568fe27f820 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- 172.21.15.72:0/2112828613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 msgr2=0x5568fe3f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 --2- 172.21.15.72:0/2112828613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3f8650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3a680199f0 tx=0x7f3a68003030 comp rx=0 tx=0).stop 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- 172.21.15.72:0/2112828613 shutdown_connections 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 --2- 172.21.15.72:0/2112828613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3f8650 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- 172.21.15.72:0/2112828613 >> 172.21.15.72:0/2112828613 conn(0x5568fe3059f0 msgr2=0x5568fe3f41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- 172.21.15.72:0/2112828613 shutdown_connections 2024-04-26T12:50:14.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- 172.21.15.72:0/2112828613 wait complete. 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 Processor -- start 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- start start 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3ff800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.644+0000 7f3a70781980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568fe316dc0 con 0x5568fe27f820 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3ff800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49370/0 (socket says 172.21.15.72:49370) 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6e29c640 1 -- 172.21.15.72:0/3391978158 learned_addr learned my addr 172.21.15.72:0/3391978158 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6e29c640 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568fe3ffd40 con 0x5568fe27f820 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3ff800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a6801b170 tx=0x7f3a680180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f395ae05640 1 -- 172.21.15.72:0/3391978158 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680bd7c0 con 0x5568fe27f820 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568fe3fffd0 con 0x5568fe27f820 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f395ae05640 1 -- 172.21.15.72:0/3391978158 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a680bd960 con 0x5568fe27f820 2024-04-26T12:50:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568fe402c10 con 0x5568fe27f820 2024-04-26T12:50:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f395ae05640 1 -- 172.21.15.72:0/3391978158 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680bdc40 con 0x5568fe27f820 2024-04-26T12:50:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f395ae05640 1 -- 172.21.15.72:0/3391978158 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3a680ce020 con 0x5568fe27f820 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f395ae05640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f39540346a0 0x7f3954036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f395ae05640 1 -- 172.21.15.72:0/3391978158 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f3a680cc020 con 0x5568fe27f820 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f39540346a0 0x7f3954036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe310850 0x5568fe4066f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe406d10 con 0x5568fe310850 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6ea9d640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe310850 0x5568fe4066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f39540346a0 0x7f3954036b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a64000f70 tx=0x7f3a64001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6ea9d640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe310850 0x5568fe4066f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/3391978158 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe310850 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.648+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe403e30 con 0x5568fe310850 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/3391978158 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe310850 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe409040 0x5568fe40b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe40bb00 con 0x5568fe409040 2024-04-26T12:50:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe409040 0x5568fe40b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe409040 0x5568fe40b430 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6e29c640 1 -- 172.21.15.72:0/3391978158 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a680c6cd0 con 0x5568fe409040 2024-04-26T12:50:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe407ee0 con 0x5568fe310850 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/3391978158 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe310850 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe40cf40 0x5568fe40f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe40fac0 con 0x5568fe40cf40 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe40cf40 0x5568fe40f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe40cf40 0x5568fe40f330 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a6da9b640 1 -- 172.21.15.72:0/3391978158 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3a6400f6a0 con 0x5568fe40cf40 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 Processor -- start 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 -- start start 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe41db10 0x5568fe41df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.652+0000 7f3a70781980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568fe212ab0 con 0x5568fe41db10 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe41db10 0x5568fe41df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe41db10 0x5568fe41df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49382/0 (socket says 172.21.15.72:49382) 2024-04-26T12:50:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 -- 172.21.15.72:0/3050443378 learned_addr learned my addr 172.21.15.72:0/3050443378 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 -- 172.21.15.72:0/3050443378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568fe41e470 con 0x5568fe41db10 2024-04-26T12:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe41db10 0x5568fe41df30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3a680bf040 tx=0x7f3a680bc6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3953fff640 1 -- 172.21.15.72:0/3050443378 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68006760 con 0x5568fe41db10 2024-04-26T12:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568fe41ef10 con 0x5568fe41db10 2024-04-26T12:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568fe41f3e0 con 0x5568fe41db10 2024-04-26T12:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3953fff640 1 -- 172.21.15.72:0/3050443378 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a680ea070 con 0x5568fe41db10 2024-04-26T12:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3953fff640 1 -- 172.21.15.72:0/3050443378 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680e31d0 con 0x5568fe41db10 2024-04-26T12:50:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3953fff640 1 -- 172.21.15.72:0/3050443378 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3a680e3370 con 0x5568fe41db10 2024-04-26T12:50:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3953fff640 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3948034650 0x7f3948036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3953fff640 1 -- 172.21.15.72:0/3050443378 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f3a680f0ca0 con 0x5568fe41db10 2024-04-26T12:50:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3948034650 0x7f3948036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a70781980 1 Processor -- start 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a70781980 1 -- start start 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3948034650 0x7f3948036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5568fe40fec0 tx=0x7f3a6400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a70781980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe42af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a70781980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568fe3f8eb0 con 0x5568fe42aae0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe42af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe42af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49390/0 (socket says 172.21.15.72:49390) 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 -- 172.21.15.72:0/3824676425 learned_addr learned my addr 172.21.15.72:0/3824676425 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.656+0000 7f3a6e29c640 1 -- 172.21.15.72:0/3824676425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568fe42b4d0 con 0x5568fe42aae0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/3824676425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe42af00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a680e5010 tx=0x7f3a680b2ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba76749a83f1769 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3951ffb640 1 -- 172.21.15.72:0/3824676425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680e56a0 con 0x5568fe42aae0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3951ffb640 1 -- 172.21.15.72:0/3824676425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a680ff030 con 0x5568fe42aae0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3951ffb640 1 -- 172.21.15.72:0/3824676425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680b2c10 con 0x5568fe42aae0 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- 172.21.15.72:0/3824676425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 msgr2=0x5568fe42af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 --2- 172.21.15.72:0/3824676425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe42af00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a680e5010 tx=0x7f3a680b2ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- 172.21.15.72:0/3824676425 shutdown_connections 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 --2- 172.21.15.72:0/3824676425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe42af00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- 172.21.15.72:0/3824676425 >> 172.21.15.72:0/3824676425 conn(0x5568fe426e70 msgr2=0x5568fe424ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- 172.21.15.72:0/3824676425 shutdown_connections 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- 172.21.15.72:0/3824676425 wait complete. 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 Processor -- start 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- start start 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe431de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5568fe42ba40 con 0x5568fe42aae0 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe431de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a6e29c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe431de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49404/0 (socket says 172.21.15.72:49404) 2024-04-26T12:50:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 learned_addr learned my addr 172.21.15.72:0/198028690 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568fe432320 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe431de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3a680ea040 tx=0x7f3a680e9f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f393ffff640 1 -- 172.21.15.72:0/198028690 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68112070 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568fe432320 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f393ffff640 1 -- 172.21.15.72:0/198028690 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a680e7e50 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568fe432320 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.660+0000 7f393ffff640 1 -- 172.21.15.72:0/198028690 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680e5470 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f393ffff640 1 -- 172.21.15.72:0/198028690 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3a68115070 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f393ffff640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3938034650 0x7f3938036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f393ffff640 1 -- 172.21.15.72:0/198028690 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f3a6810a070 con 0x5568fe42aae0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3938034650 0x7f3938036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe43cfb0 0x5568fe43f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe43fbc0 con 0x5568fe43cfb0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6ea9d640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe43cfb0 0x5568fe43f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3938034650 0x7f3938036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c010 tx=0x7f3a64010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6ea9d640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe43cfb0 0x5568fe43f470 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 realm 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe43ffd0 con 0x5568fe43cfb0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4408a0 con 0x5568fe43cfb0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe4419a0 0x5568fe443d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe444360 con 0x5568fe4419a0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe4419a0 0x5568fe443d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6e29c640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe4419a0 0x5568fe443d90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 20 searching for the correct realm 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe4462b0 0x5568fe4486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe448db0 con 0x5568fe4462b0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.664+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe4462b0 0x5568fe4486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe4462b0 0x5568fe4486e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6da9b640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3a6401fbe0 0x7f3a6403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe448db0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3a6401fbe0 0x7f3a6403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3a6401fbe0 0x7f3a6403a3c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.668+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x7f3a6401fbe0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x7f3a6401fbe0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.672+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x7f3a6401fbe0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x7f3a6401fbe0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4462b0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.676+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe4419a0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x5568fe43cfb0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568fe440c40 con 0x7f3a6401fbe0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe444c20 con 0x5568fe43cfb0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe444c20 con 0x5568fe43cfb0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe444c20 con 0x5568fe4462b0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 zone default found 2024-04-26T12:50:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 4 Realm: () 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 zonegroup default 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4455e0 con 0x5568fe4419a0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe445180 con 0x5568fe4462b0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44b1a0 con 0x5568fe4462b0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 started sync module instance, tier type = 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.680+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44a550 con 0x7f3a6401fbe0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.684+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.684+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93909430872656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44a550 con 0x7f3a6401fbe0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.684+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44bc20 con 0x5568fe43cfb0 2024-04-26T12:50:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.684+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93909430872656] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.684+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.684+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93909430876288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44a550 con 0x5568fe43cfb0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.684+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44c630 con 0x5568fe4462b0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93909430876288] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93909430870176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44a4c0 con 0x5568fe4462b0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44d370 con 0x7f3a6401fbe0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93909430881920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44dc10 con 0x7f3a6401fbe0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44e5d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93909430870176] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.688+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93909430881920] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.692+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.692+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93909430886688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44db70 con 0x5568fe43cfb0 2024-04-26T12:50:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.692+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44e540 con 0x5568fe4419a0 2024-04-26T12:50:14.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.692+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93909430886688] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.692+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.692+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93909430884032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44dae0 con 0x5568fe4419a0 2024-04-26T12:50:14.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.692+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44f350 con 0x5568fe4419a0 2024-04-26T12:50:14.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93909430890144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44f7b0 con 0x5568fe4419a0 2024-04-26T12:50:14.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4502c0 con 0x5568fe4419a0 2024-04-26T12:50:14.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93909430884032] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93909430890144] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93909430893936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe44f2c0 con 0x5568fe4419a0 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 20 add_watcher() i=0 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 20 add_watcher() i=1 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 20 add_watcher() i=2 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 20 add_watcher() i=3 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 20 add_watcher() i=4 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 20 add_watcher() i=5 2024-04-26T12:50:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.696+0000 7f3a70781980 20 add_watcher() i=6 2024-04-26T12:50:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93909430893936] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 add_watcher() i=7 2024-04-26T12:50:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4532b0 con 0x5568fe43cfb0 2024-04-26T12:50:14.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93909430888864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe450760 con 0x5568fe43cfb0 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93909430888864] v33'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3924fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 5 note: GC not initialized 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f389f7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 Filter name: none 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f389d7fa640 20 reqs_thread_entry: start 2024-04-26T12:50:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe476b00 con 0x5568fe43cfb0 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.700+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe477570 con 0x5568fe4419a0 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe47cec0 con 0x5568fe43cfb0 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v33'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93909431077168 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4785b0 con 0x5568fe43cfb0 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 93909430886688 notify 141733920771 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f3a60018ba0 con 0x5568fe43cfb0 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3951ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 93909430886688 notifier 4349 bl.length()=678 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3951ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3951ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3951ffb640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3934003eb0 con 0x5568fe43cfb0 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify cookie 93909431077168 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 93909431077168 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3a60018d70 con 0x5568fe43cfb0 2024-04-26T12:50:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.704+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe47c930 con 0x5568fe4419a0 2024-04-26T12:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a70781980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a70781980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a70781980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93909431077168 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568fe478100 con 0x5568fe4462b0 2024-04-26T12:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== watch-notify(notify (1) cookie 93909430870176 notify 141733920768 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f3a64018040 con 0x5568fe4462b0 2024-04-26T12:50:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f39517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 93909430870176 notifier 4349 bl.length()=177 2024-04-26T12:50:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f39517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:50:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f39517fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 notify.2 [notify cookie 93909431077168 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f39517fa640 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f38a4003410 con 0x5568fe4462b0 2024-04-26T12:50:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== watch-notify(notify_complete (2) cookie 93909431077168 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568fe1b8510 con 0x5568fe4462b0 2024-04-26T12:50:14.708 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:50:14.705661Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:14.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3924fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93909430888864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4789e0 con 0x5568fe43cfb0 2024-04-26T12:50:14.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93909430888864] v33'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.708+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93909430872656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.712+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93909430872656] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.712+0000 7f3a70781980 20 remove_watcher() i=0 2024-04-26T12:50:14.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.712+0000 7f3a70781980 2 removed watcher, disabling cache 2024-04-26T12:50:14.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.712+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93909430876288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x5568fe43cfb0 2024-04-26T12:50:14.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.712+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93909430876288] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.712+0000 7f3a70781980 20 remove_watcher() i=1 2024-04-26T12:50:14.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.712+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93909430870176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x5568fe4462b0 2024-04-26T12:50:14.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a6da9b640 1 -- 172.21.15.72:0/198028690 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93909430870176] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a64037040 con 0x5568fe4462b0 2024-04-26T12:50:14.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a70781980 20 remove_watcher() i=2 2024-04-26T12:50:14.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93909430881920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93909430881920] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x7f3a6401fbe0 2024-04-26T12:50:14.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a70781980 20 remove_watcher() i=3 2024-04-26T12:50:14.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93909430886688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x5568fe43cfb0 2024-04-26T12:50:14.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93909430886688] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4d0 con 0x5568fe43cfb0 2024-04-26T12:50:14.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a70781980 20 remove_watcher() i=4 2024-04-26T12:50:14.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.716+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93909430884032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x5568fe4419a0 2024-04-26T12:50:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.720+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93909430884032] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.720+0000 7f3a70781980 20 remove_watcher() i=5 2024-04-26T12:50:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.720+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93909430890144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x5568fe4419a0 2024-04-26T12:50:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.720+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93909430890144] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.720+0000 7f3a70781980 20 remove_watcher() i=6 2024-04-26T12:50:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.720+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93909430893936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568fe4747a0 con 0x5568fe4419a0 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a6e29c640 1 -- 172.21.15.72:0/198028690 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93909430893936] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68114030 con 0x5568fe4419a0 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 20 remove_watcher() i=7 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe4419a0 msgr2=0x5568fe443d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe4419a0 0x5568fe443d90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe43cfb0 msgr2=0x5568fe43f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe43cfb0 0x5568fe43f470 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3a6401fbe0 msgr2=0x7f3a6403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3a6401fbe0 0x7f3a6403a3c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe4462b0 msgr2=0x5568fe4486e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe4462b0 0x5568fe4486e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3938034650 msgr2=0x7f3938036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3938034650 0x7f3938036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c010 tx=0x7f3a64010000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 msgr2=0x5568fe431de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/198028690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe42aae0 0x5568fe431de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3a680ea040 tx=0x7f3a680e9f30 comp rx=0 tx=0).stop 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 reap_dead start 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/198028690 reap_dead start 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 shutdown_connections 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 >> 172.21.15.72:0/198028690 conn(0x5568fe426e70 msgr2=0x5568fe4244d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 shutdown_connections 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/198028690 wait complete. 2024-04-26T12:50:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3948034650 msgr2=0x7f3948036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3948034650 0x7f3948036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5568fe40fec0 tx=0x7f3a6400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe41db10 msgr2=0x5568fe41df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe41db10 0x5568fe41df30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3a680bf040 tx=0x7f3a680bc6a0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 shutdown_connections 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3948034650 0x7f3948036b10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3050443378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe41db10 0x5568fe41df30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 >> 172.21.15.72:0/3050443378 conn(0x5568fe412920 msgr2=0x5568fe413430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 shutdown_connections 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3050443378 wait complete. 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe409040 msgr2=0x5568fe40b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5568fe409040 0x5568fe40b430 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe310850 msgr2=0x5568fe4066f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5568fe310850 0x5568fe4066f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe40cf40 msgr2=0x5568fe40f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5568fe40cf40 0x5568fe40f330 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f39540346a0 msgr2=0x7f3954036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f39540346a0 0x7f3954036b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a64000f70 tx=0x7f3a64001380 comp rx=0 tx=0).stop 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 msgr2=0x5568fe3ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 --2- 172.21.15.72:0/3391978158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5568fe27f820 0x5568fe3ff800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a6801b170 tx=0x7f3a680180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a6ea9d640 1 -- 172.21.15.72:0/3391978158 reap_dead start 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 shutdown_connections 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 >> 172.21.15.72:0/3391978158 conn(0x5568fe3059f0 msgr2=0x5568fe3f2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 shutdown_connections 2024-04-26T12:50:14.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.724+0000 7f3a70781980 1 -- 172.21.15.72:0/3391978158 wait complete. 2024-04-26T12:50:14.734 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:50:14.705661Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:14.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:14.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:14.734 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:14.814 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:14.814 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:14.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de62d7980 1 Processor -- start 2024-04-26T12:50:14.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de62d7980 1 -- start start 2024-04-26T12:50:14.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de62d7980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558e3d7fa6e0 0x558e3d7fcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de62d7980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e3d6a4510 con 0x558e3d7f6180 2024-04-26T12:50:14.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de62d7980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x558e3d6ab430 con 0x558e3d7fa6e0 2024-04-26T12:50:14.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de35f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558e3d7fa6e0 0x558e3d7fcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de3df2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x558e3d7f6180 0x558e3d7f6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36006/0 (socket says 172.21.15.72:36006) 2024-04-26T12:50:14.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de35f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558e3d7fa6e0 0x558e3d7fcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49412/0 (socket says 172.21.15.72:49412) 2024-04-26T12:50:14.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de3df2640 1 -- 172.21.15.72:0/737210636 learned_addr learned my addr 172.21.15.72:0/737210636 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:14.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de35f1640 1 -- 172.21.15.72:0/737210636 >> v1:172.21.15.29:6789/0 conn(0x558e3d7f6180 legacy=0x558e3d7f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.816+0000 7f1de35f1640 1 -- 172.21.15.72:0/737210636 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3d680ae0 con 0x558e3d7fa6e0 2024-04-26T12:50:14.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de35f1640 1 --2- 172.21.15.72:0/737210636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7fa6e0 0x558e3d7fcad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400a480 tx=0x7f1dd401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b553b11e402424 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de2df0640 1 -- 172.21.15.72:0/737210636 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dd40b0070 con 0x558e3d7fa6e0 2024-04-26T12:50:14.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de2df0640 1 -- 172.21.15.72:0/737210636 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd40ab540 con 0x558e3d7fa6e0 2024-04-26T12:50:14.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de2df0640 1 -- 172.21.15.72:0/737210636 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dd40ab840 con 0x558e3d7fa6e0 2024-04-26T12:50:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de62d7980 1 -- 172.21.15.72:0/737210636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7fa6e0 msgr2=0x558e3d7fcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de62d7980 1 --2- 172.21.15.72:0/737210636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7fa6e0 0x558e3d7fcad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400a480 tx=0x7f1dd401b280 comp rx=0 tx=0).stop 2024-04-26T12:50:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de62d7980 1 -- 172.21.15.72:0/737210636 shutdown_connections 2024-04-26T12:50:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de62d7980 1 --2- 172.21.15.72:0/737210636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7fa6e0 0x558e3d7fcad0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de62d7980 1 -- 172.21.15.72:0/737210636 >> 172.21.15.72:0/737210636 conn(0x558e3d7f1a50 msgr2=0x558e3d7f3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de62d7980 1 -- 172.21.15.72:0/737210636 shutdown_connections 2024-04-26T12:50:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.820+0000 7f1de62d7980 1 -- 172.21.15.72:0/737210636 wait complete. 2024-04-26T12:50:14.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.832+0000 7f1de62d7980 1 Processor -- start 2024-04-26T12:50:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.832+0000 7f1de62d7980 1 -- start start 2024-04-26T12:50:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.832+0000 7f1de62d7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d76af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.832+0000 7f1de62d7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e3d6faa70 con 0x558e3d7f6180 2024-04-26T12:50:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d76af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d76af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49418/0 (socket says 172.21.15.72:49418) 2024-04-26T12:50:14.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 -- 172.21.15.72:0/3402327368 learned_addr learned my addr 172.21.15.72:0/3402327368 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 -- 172.21.15.72:0/3402327368 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3d76b560 con 0x558e3d7f6180 2024-04-26T12:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 --2- 172.21.15.72:0/3402327368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d76af90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0015f0 tx=0x7f1dcc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbc38a2ff662405 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1cd1e0b640 1 -- 172.21.15.72:0/3402327368 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc004530 con 0x558e3d7f6180 2024-04-26T12:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1cd1e0b640 1 -- 172.21.15.72:0/3402327368 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0046f0 con 0x558e3d7f6180 2024-04-26T12:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1cd1e0b640 1 -- 172.21.15.72:0/3402327368 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc004a90 con 0x558e3d7f6180 2024-04-26T12:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- 172.21.15.72:0/3402327368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 msgr2=0x558e3d76af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3402327368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d76af90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0015f0 tx=0x7f1dcc001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- 172.21.15.72:0/3402327368 shutdown_connections 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3402327368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d76af90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- 172.21.15.72:0/3402327368 >> 172.21.15.72:0/3402327368 conn(0x558e3d7f1a50 msgr2=0x558e3d8dcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- 172.21.15.72:0/3402327368 shutdown_connections 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- 172.21.15.72:0/3402327368 wait complete. 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 Processor -- start 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- start start 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d8eb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e3d7ffb00 con 0x558e3d7f6180 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d8eb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d8eb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49422/0 (socket says 172.21.15.72:49422) 2024-04-26T12:50:14.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 -- 172.21.15.72:0/1763904700 learned_addr learned my addr 172.21.15.72:0/1763904700 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3d8ebe10 con 0x558e3d7f6180 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de3df2640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d8eb8d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x558e3d8e10d0 tx=0x7f1dcc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1ccbfff640 1 -- 172.21.15.72:0/1763904700 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc013760 con 0x558e3d7f6180 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3d8ec0a0 con 0x558e3d7f6180 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1ccbfff640 1 -- 172.21.15.72:0/1763904700 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc013900 con 0x558e3d7f6180 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3d8eec90 con 0x558e3d7f6180 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.836+0000 7f1ccbfff640 1 -- 172.21.15.72:0/1763904700 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc013be0 con 0x558e3d7f6180 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1ccbfff640 1 -- 172.21.15.72:0/1763904700 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1dcc010070 con 0x558e3d7f6180 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1ccbfff640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1ccc034650 0x7f1ccc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1ccbfff640 1 -- 172.21.15.72:0/1763904700 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f1dcc018070 con 0x558e3d7f6180 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de35f1640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1ccc034650 0x7f1ccc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d7fa6e0 0x558e3d8f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d8f2e40 con 0x558e3d7fa6e0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de45f3640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d7fa6e0 0x558e3d8f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de35f1640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1ccc034650 0x7f1ccc036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ad000 tx=0x7f1dd40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de45f3640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d7fa6e0 0x558e3d8f2820 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de45f3640 1 -- 172.21.15.72:0/1763904700 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d7fa6e0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d8efeb0 con 0x558e3d7fa6e0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de45f3640 1 -- 172.21.15.72:0/1763904700 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d7fa6e0 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d8f5190 0x558e3d8f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d8f7c50 con 0x558e3d8f5190 2024-04-26T12:50:14.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de3df2640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d8f5190 0x558e3d8f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.840+0000 7f1de3df2640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d8f5190 0x558e3d8f7580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de3df2640 1 -- 172.21.15.72:0/1763904700 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1dcc01b030 con 0x558e3d8f5190 2024-04-26T12:50:14.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d8f4030 con 0x558e3d7fa6e0 2024-04-26T12:50:14.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de45f3640 1 -- 172.21.15.72:0/1763904700 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d7fa6e0 2024-04-26T12:50:14.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d8f9090 0x558e3d8fb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d8fbc10 con 0x558e3d8f9090 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de35f1640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d8f9090 0x558e3d8fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de35f1640 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d8f9090 0x558e3d8fb480 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de35f1640 1 -- 172.21.15.72:0/1763904700 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d8f9090 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 Processor -- start 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 -- start start 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d909c20 0x558e3d90a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e3d6feab0 con 0x558e3d909c20 2024-04-26T12:50:14.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d909c20 0x558e3d90a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d909c20 0x558e3d90a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49424/0 (socket says 172.21.15.72:49424) 2024-04-26T12:50:14.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de3df2640 1 -- 172.21.15.72:0/3406679836 learned_addr learned my addr 172.21.15.72:0/3406679836 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de3df2640 1 -- 172.21.15.72:0/3406679836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3d90a580 con 0x558e3d909c20 2024-04-26T12:50:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de3df2640 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d909c20 0x558e3d90a040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0483f0 tx=0x7f1dcc029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1cc97fa640 1 -- 172.21.15.72:0/3406679836 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc038030 con 0x558e3d909c20 2024-04-26T12:50:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3d90b020 con 0x558e3d909c20 2024-04-26T12:50:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3d90b4f0 con 0x558e3d909c20 2024-04-26T12:50:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1cc97fa640 1 -- 172.21.15.72:0/3406679836 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc029970 con 0x558e3d909c20 2024-04-26T12:50:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.844+0000 7f1cc97fa640 1 -- 172.21.15.72:0/3406679836 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc041550 con 0x558e3d909c20 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1cc97fa640 1 -- 172.21.15.72:0/3406679836 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1dcc0416f0 con 0x558e3d909c20 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1cc97fa640 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cbc0346a0 0x7f1cbc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1cc97fa640 1 -- 172.21.15.72:0/3406679836 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f1dcc03c070 con 0x558e3d909c20 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de35f1640 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cbc0346a0 0x7f1cbc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 Processor -- start 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- start start 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d917060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e3d76b8b0 con 0x558e3d916c40 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de35f1640 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cbc0346a0 0x7f1cbc036b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ab510 tx=0x7f1dd4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d917060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d917060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49438/0 (socket says 172.21.15.72:49438) 2024-04-26T12:50:14.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 -- 172.21.15.72:0/3880214548 learned_addr learned my addr 172.21.15.72:0/3880214548 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 -- 172.21.15.72:0/3880214548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3d917630 con 0x558e3d916c40 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 --2- 172.21.15.72:0/3880214548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d917060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0046c0 tx=0x7f1dcc0406e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dd63a74ffdef76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1cc2ffd640 1 -- 172.21.15.72:0/3880214548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc065070 con 0x558e3d916c40 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1cc2ffd640 1 -- 172.21.15.72:0/3880214548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc041a50 con 0x558e3d916c40 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1cc2ffd640 1 -- 172.21.15.72:0/3880214548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc058070 con 0x558e3d916c40 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- 172.21.15.72:0/3880214548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 msgr2=0x558e3d917060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3880214548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d917060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0046c0 tx=0x7f1dcc0406e0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- 172.21.15.72:0/3880214548 shutdown_connections 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3880214548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d917060 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- 172.21.15.72:0/3880214548 >> 172.21.15.72:0/3880214548 conn(0x558e3d912f80 msgr2=0x558e3d910fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- 172.21.15.72:0/3880214548 shutdown_connections 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- 172.21.15.72:0/3880214548 wait complete. 2024-04-26T12:50:14.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 Processor -- start 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- start start 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d91df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de62d7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e3d917cf0 con 0x558e3d916c40 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d91df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d91df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49444/0 (socket says 172.21.15.72:49444) 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.848+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 learned_addr learned my addr 172.21.15.72:0/3088420721 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3d91e480 con 0x558e3d916c40 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de3df2640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d91df40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc063040 tx=0x7f1dcc033e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1cc17fa640 1 -- 172.21.15.72:0/3088420721 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc065040 con 0x558e3d916c40 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3d91e480 con 0x558e3d916c40 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3d91e480 con 0x558e3d916c40 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1cc17fa640 1 -- 172.21.15.72:0/3088420721 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc070020 con 0x558e3d916c40 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1cc17fa640 1 -- 172.21.15.72:0/3088420721 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dcc05b040 con 0x558e3d916c40 2024-04-26T12:50:14.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1cc17fa640 1 -- 172.21.15.72:0/3088420721 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1dcc034b90 con 0x558e3d916c40 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1cc17fa640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cac034650 0x7f1cac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1cc17fa640 1 -- 172.21.15.72:0/3088420721 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f1dcc071030 con 0x558e3d916c40 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de35f1640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cac034650 0x7f1cac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d928ff0 0x558e3d92b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92bbe0 con 0x558e3d928ff0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de45f3640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d928ff0 0x558e3d92b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de35f1640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cac034650 0x7f1cac036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40b6fd0 tx=0x7f1dd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de45f3640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d928ff0 0x558e3d92b490 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d928ff0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 realm 2024-04-26T12:50:14.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92bff0 con 0x558e3d928ff0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d928ff0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92c890 con 0x558e3d928ff0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d928ff0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d928ff0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d92d990 0x558e3d92fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.852+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d930300 con 0x558e3d92d990 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de3df2640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d92d990 0x558e3d92fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de3df2640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d92d990 0x558e3d92fd80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de62d7980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de62d7980 20 searching for the correct realm 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d932270 0x558e3d934730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d934e00 con 0x558e3d932270 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de35f1640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d932270 0x558e3d934730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de35f1640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d932270 0x558e3d934730 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de35f1640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1dd40ab030 0x7f1dd40b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d934e00 con 0x7f1dd40ab030 2024-04-26T12:50:14.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de45f3640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1dd40ab030 0x7f1dd40b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:14.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de45f3640 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1dd40ab030 0x7f1dd40b7400 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:14.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x7f1dd40ab030 2024-04-26T12:50:14.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.856+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc0083f0 con 0x558e3d928ff0 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x7f1dd40ab030 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x7f1dd40ab030 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x7f1dd40ab030 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ddc026040 con 0x7f1dd40ab030 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.860+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x7f1dd40ab030 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x7f1dd40ab030 2024-04-26T12:50:14.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.864+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x7f1dd40ab030 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x7f1dd40ab030 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d932270 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d92d990 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x558e3d928ff0 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558e3d92cc30 con 0x7f1dd40ab030 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ddc026040 con 0x7f1dd40ab030 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d930b50 con 0x558e3d928ff0 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d930b50 con 0x558e3d928ff0 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ddc026040 con 0x558e3d928ff0 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d930b50 con 0x558e3d932270 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 zone default found 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 4 Realm: () 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 zonegroup default 2024-04-26T12:50:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.868+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d9313f0 con 0x558e3d92d990 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d936c60 con 0x558e3d932270 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d937000 con 0x558e3d932270 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 20 started sync module instance, tier type = 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d936100 con 0x7f1dd40ab030 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc026040 con 0x7f1dd40ab030 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069406787152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d936100 con 0x7f1dd40ab030 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d9379c0 con 0x558e3d928ff0 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.872+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94069406787152] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x7f1dd40ab030 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94069406791200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d936100 con 0x558e3d928ff0 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d9383d0 con 0x558e3d932270 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94069406793504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d938c20 con 0x558e3d932270 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d9395e0 con 0x7f1dd40ab030 2024-04-26T12:50:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94069406791200] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x7f1dd40ab030 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94069406798128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d939550 con 0x7f1dd40ab030 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93a360 con 0x558e3d928ff0 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.876+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94069406793504] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94069406798128] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x7f1dd40ab030 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069406795632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d939e20 con 0x558e3d928ff0 2024-04-26T12:50:14.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93a6b0 con 0x558e3d92d990 2024-04-26T12:50:14.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94069406795632] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069406800512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93aaa0 con 0x558e3d92d990 2024-04-26T12:50:14.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.880+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93b350 con 0x558e3d92d990 2024-04-26T12:50:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94069406805568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93bb80 con 0x558e3d92d990 2024-04-26T12:50:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93c680 con 0x558e3d92d990 2024-04-26T12:50:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94069406800512] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94069406805568] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069406810480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93b5d0 con 0x558e3d92d990 2024-04-26T12:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 20 add_watcher() i=0 2024-04-26T12:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 20 add_watcher() i=1 2024-04-26T12:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 20 add_watcher() i=2 2024-04-26T12:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 20 add_watcher() i=3 2024-04-26T12:50:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 20 add_watcher() i=4 2024-04-26T12:50:14.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 20 add_watcher() i=5 2024-04-26T12:50:14.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.884+0000 7f1de62d7980 20 add_watcher() i=6 2024-04-26T12:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94069406810480] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 20 add_watcher() i=7 2024-04-26T12:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93f670 con 0x558e3d928ff0 2024-04-26T12:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94069406801632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d93cb20 con 0x558e3d928ff0 2024-04-26T12:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94069406801632] v33'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1c99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 5 note: GC not initialized 2024-04-26T12:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1c98fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 20 Filter name: none 2024-04-26T12:50:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1c127fc640 20 reqs_thread_entry: start 2024-04-26T12:50:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558e3d962930 con 0x558e3d928ff0 2024-04-26T12:50:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.888+0000 7f1de62d7980 20 rados_obj.operate() r=0 bl.length=502 2024-04-26T12:50:14.890 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:50:14.705661Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1c99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94069406801632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d961380 con 0x558e3d928ff0 2024-04-26T12:50:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94069406801632] v33'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94069406787152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d939ee0 con 0x7f1dd40ab030 2024-04-26T12:50:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94069406787152] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x7f1dd40ab030 2024-04-26T12:50:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1de62d7980 20 remove_watcher() i=0 2024-04-26T12:50:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1de62d7980 2 removed watcher, disabling cache 2024-04-26T12:50:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.892+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94069406791200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d939ee0 con 0x558e3d928ff0 2024-04-26T12:50:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94069406791200] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de62d7980 20 remove_watcher() i=1 2024-04-26T12:50:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94069406793504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d937620 con 0x558e3d932270 2024-04-26T12:50:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de35f1640 1 -- 172.21.15.72:0/3088420721 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94069406793504] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dd40b3040 con 0x558e3d932270 2024-04-26T12:50:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de62d7980 20 remove_watcher() i=2 2024-04-26T12:50:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94069406798128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d939ee0 con 0x7f1dd40ab030 2024-04-26T12:50:14.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94069406798128] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x7f1dd40ab030 2024-04-26T12:50:14.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de62d7980 20 remove_watcher() i=3 2024-04-26T12:50:14.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.896+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94069406795632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d937f20 con 0x558e3d928ff0 2024-04-26T12:50:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.900+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94069406795632] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ddc036040 con 0x558e3d928ff0 2024-04-26T12:50:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.900+0000 7f1de62d7980 20 remove_watcher() i=4 2024-04-26T12:50:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.900+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94069406800512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d939130 con 0x558e3d92d990 2024-04-26T12:50:14.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.900+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94069406800512] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.900+0000 7f1de62d7980 20 remove_watcher() i=5 2024-04-26T12:50:14.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.900+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94069406805568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d939ee0 con 0x558e3d92d990 2024-04-26T12:50:14.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94069406805568] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 20 remove_watcher() i=6 2024-04-26T12:50:14.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94069406810480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558e3d937f20 con 0x558e3d92d990 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de3df2640 1 -- 172.21.15.72:0/3088420721 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94069406810480] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dcc068070 con 0x558e3d92d990 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 20 remove_watcher() i=7 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d92d990 msgr2=0x558e3d92fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d92d990 0x558e3d92fd80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d928ff0 msgr2=0x558e3d92b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d928ff0 0x558e3d92b490 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1dd40ab030 msgr2=0x7f1dd40b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1dd40ab030 0x7f1dd40b7400 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d932270 msgr2=0x558e3d934730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d932270 0x558e3d934730 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cac034650 msgr2=0x7f1cac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cac034650 0x7f1cac036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40b6fd0 tx=0x7f1dd40a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 msgr2=0x558e3d91df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de45f3640 1 -- 172.21.15.72:0/3088420721 reap_dead start 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d91df40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc063040 tx=0x7f1dcc033e80 comp rx=0 tx=0).stop 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 shutdown_connections 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3088420721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d916c40 0x558e3d91df40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 >> 172.21.15.72:0/3088420721 conn(0x558e3d912f80 msgr2=0x558e3d9105e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 shutdown_connections 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.904+0000 7f1de62d7980 1 -- 172.21.15.72:0/3088420721 wait complete. 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cbc0346a0 msgr2=0x7f1cbc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cbc0346a0 0x7f1cbc036b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ab510 tx=0x7f1dd4005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d909c20 msgr2=0x558e3d90a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d909c20 0x558e3d90a040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0483f0 tx=0x7f1dcc029840 comp rx=0 tx=0).stop 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 shutdown_connections 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1cbc0346a0 0x7f1cbc036b60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/3406679836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d909c20 0x558e3d90a040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 >> 172.21.15.72:0/3406679836 conn(0x558e3d8fea30 msgr2=0x558e3d8ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 shutdown_connections 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/3406679836 wait complete. 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d8f5190 msgr2=0x558e3d8f7580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e3d8f5190 0x558e3d8f7580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d7fa6e0 msgr2=0x558e3d8f2820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e3d7fa6e0 0x558e3d8f2820 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d8f9090 msgr2=0x558e3d8fb480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e3d8f9090 0x558e3d8fb480 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1ccc034650 msgr2=0x7f1ccc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1ccc034650 0x7f1ccc036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ad000 tx=0x7f1dd40a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 msgr2=0x558e3d8eb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 --2- 172.21.15.72:0/1763904700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e3d7f6180 0x558e3d8eb8d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x558e3d8e10d0 tx=0x7f1dcc000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de45f3640 1 -- 172.21.15.72:0/1763904700 reap_dead start 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 shutdown_connections 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 >> 172.21.15.72:0/1763904700 conn(0x558e3d7f1a50 msgr2=0x558e3d8db9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 shutdown_connections 2024-04-26T12:50:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:14.908+0000 7f1de62d7980 1 -- 172.21.15.72:0/1763904700 wait complete. 2024-04-26T12:50:14.915 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:50:14.705661Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:14.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-26T12:50:14.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-26T12:50:14.916 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-26T12:50:14.997 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:14.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad8f5d980 1 Processor -- start 2024-04-26T12:50:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad8f5d980 1 -- start start 2024-04-26T12:50:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad8f5d980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564b8a3d67d0 0x564b8a3d8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad8f5d980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b8a27f510 con 0x564b8a3d2310 2024-04-26T12:50:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad8f5d980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564b8a286430 con 0x564b8a3d67d0 2024-04-26T12:50:14.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad6277640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564b8a3d67d0 0x564b8a3d8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad6a78640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x564b8a3d2310 0x564b8a3d26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36020/0 (socket says 172.21.15.72:36020) 2024-04-26T12:50:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad6a78640 1 -- 172.21.15.72:0/3782364131 learned_addr learned my addr 172.21.15.72:0/3782364131 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad6277640 1 -- 172.21.15.72:0/3782364131 >> v1:172.21.15.29:6789/0 conn(0x564b8a3d2310 legacy=0x564b8a3d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.000+0000 7faad6277640 1 -- 172.21.15.72:0/3782364131 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8a25bae0 con 0x564b8a3d67d0 2024-04-26T12:50:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad6277640 1 --2- 172.21.15.72:0/3782364131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a3d8bc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faacc00a480 tx=0x7faacc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732b35af66f8119c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad5a76640 1 -- 172.21.15.72:0/3782364131 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faacc0b0070 con 0x564b8a3d67d0 2024-04-26T12:50:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad5a76640 1 -- 172.21.15.72:0/3782364131 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faacc0ab540 con 0x564b8a3d67d0 2024-04-26T12:50:15.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad5a76640 1 -- 172.21.15.72:0/3782364131 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faacc0ab840 con 0x564b8a3d67d0 2024-04-26T12:50:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad8f5d980 1 -- 172.21.15.72:0/3782364131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 msgr2=0x564b8a3d8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad8f5d980 1 --2- 172.21.15.72:0/3782364131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a3d8bc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faacc00a480 tx=0x7faacc01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad8f5d980 1 -- 172.21.15.72:0/3782364131 shutdown_connections 2024-04-26T12:50:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad8f5d980 1 --2- 172.21.15.72:0/3782364131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a3d8bc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad8f5d980 1 -- 172.21.15.72:0/3782364131 >> 172.21.15.72:0/3782364131 conn(0x564b8a3cdbe0 msgr2=0x564b8a3d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad8f5d980 1 -- 172.21.15.72:0/3782364131 shutdown_connections 2024-04-26T12:50:15.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.004+0000 7faad8f5d980 1 -- 172.21.15.72:0/3782364131 wait complete. 2024-04-26T12:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.016+0000 7faad8f5d980 1 Processor -- start 2024-04-26T12:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.016+0000 7faad8f5d980 1 -- start start 2024-04-26T12:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.016+0000 7faad8f5d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d2310 0x564b8a4bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.016+0000 7faad8f5d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b8a2d5a70 con 0x564b8a3d2310 2024-04-26T12:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.016+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d2310 0x564b8a4bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.016+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d2310 0x564b8a4bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49454/0 (socket says 172.21.15.72:49454) 2024-04-26T12:50:15.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.016+0000 7faad6a78640 1 -- 172.21.15.72:0/3808576664 learned_addr learned my addr 172.21.15.72:0/3808576664 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad6a78640 1 -- 172.21.15.72:0/3808576664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8a4bda30 con 0x564b8a3d2310 2024-04-26T12:50:15.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad6a78640 1 --2- 172.21.15.72:0/3808576664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d2310 0x564b8a4bd460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faad00015f0 tx=0x7faad0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15f92902da2d0c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7fa9c4e09640 1 -- 172.21.15.72:0/3808576664 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad0004530 con 0x564b8a3d2310 2024-04-26T12:50:15.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7fa9c4e09640 1 -- 172.21.15.72:0/3808576664 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad00046f0 con 0x564b8a3d2310 2024-04-26T12:50:15.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7fa9c4e09640 1 -- 172.21.15.72:0/3808576664 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad0004a90 con 0x564b8a3d2310 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- 172.21.15.72:0/3808576664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d2310 msgr2=0x564b8a4bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 --2- 172.21.15.72:0/3808576664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d2310 0x564b8a4bd460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faad00015f0 tx=0x7faad0001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- 172.21.15.72:0/3808576664 shutdown_connections 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 --2- 172.21.15.72:0/3808576664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d2310 0x564b8a4bd460 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- 172.21.15.72:0/3808576664 >> 172.21.15.72:0/3808576664 conn(0x564b8a3cdbe0 msgr2=0x564b8a4b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- 172.21.15.72:0/3808576664 shutdown_connections 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- 172.21.15.72:0/3808576664 wait complete. 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 Processor -- start 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- start start 2024-04-26T12:50:15.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a4c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b8a3dbbf0 con 0x564b8a3d67d0 2024-04-26T12:50:15.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a4c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a4c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49468/0 (socket says 172.21.15.72:49468) 2024-04-26T12:50:15.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad6a78640 1 -- 172.21.15.72:0/2183921186 learned_addr learned my addr 172.21.15.72:0/2183921186 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad6a78640 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8a4c4e70 con 0x564b8a3d67d0 2024-04-26T12:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad6a78640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a4c4930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faad000f000 tx=0x7faad0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7fa9c3606640 1 -- 172.21.15.72:0/2183921186 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad0013760 con 0x564b8a3d67d0 2024-04-26T12:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7fa9c3606640 1 -- 172.21.15.72:0/2183921186 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0013900 con 0x564b8a3d67d0 2024-04-26T12:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8a4c5100 con 0x564b8a3d67d0 2024-04-26T12:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7fa9c3606640 1 -- 172.21.15.72:0/2183921186 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad0013be0 con 0x564b8a3d67d0 2024-04-26T12:50:15.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.020+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8a4c7d90 con 0x564b8a3d67d0 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7fa9c3606640 1 -- 172.21.15.72:0/2183921186 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faad0010070 con 0x564b8a3d67d0 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7fa9c3606640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9bc0346f0 0x7fa9bc036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7fa9c3606640 1 -- 172.21.15.72:0/2183921186 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7faad0018070 con 0x564b8a3d67d0 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad6277640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9bc0346f0 0x7fa9bc036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a4c9860 0x564b8a4cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a4cc270 con 0x564b8a4c9860 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad7279640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a4c9860 0x564b8a4cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad6277640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9bc0346f0 0x7fa9bc036bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faacc0ad000 tx=0x7faacc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad7279640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a4c9860 0x564b8a4cbc50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad7279640 1 -- 172.21.15.72:0/2183921186 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a4c9860 2024-04-26T12:50:15.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a4c8fb0 con 0x564b8a4c9860 2024-04-26T12:50:15.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad7279640 1 -- 172.21.15.72:0/2183921186 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a4c9860 2024-04-26T12:50:15.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a4ce580 0x564b8a4d0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a4d1060 con 0x564b8a4ce580 2024-04-26T12:50:15.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad6a78640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a4ce580 0x564b8a4d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.024+0000 7faad6a78640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a4ce580 0x564b8a4d0970 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6a78640 1 -- 172.21.15.72:0/2183921186 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faad001b030 con 0x564b8a4ce580 2024-04-26T12:50:15.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a4cd420 con 0x564b8a4c9860 2024-04-26T12:50:15.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad7279640 1 -- 172.21.15.72:0/2183921186 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a4c9860 2024-04-26T12:50:15.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a4d24c0 0x564b8a4d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a4d4ff0 con 0x564b8a4d24c0 2024-04-26T12:50:15.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6277640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a4d24c0 0x564b8a4d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6277640 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a4d24c0 0x564b8a4d48b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6277640 1 -- 172.21.15.72:0/2183921186 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a4d24c0 2024-04-26T12:50:15.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 Processor -- start 2024-04-26T12:50:15.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 -- start start 2024-04-26T12:50:15.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4e3040 0x564b8a4e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b8a2d9ab0 con 0x564b8a4e3040 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4e3040 0x564b8a4e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4e3040 0x564b8a4e3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49478/0 (socket says 172.21.15.72:49478) 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6a78640 1 -- 172.21.15.72:0/1900261991 learned_addr learned my addr 172.21.15.72:0/1900261991 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6a78640 1 -- 172.21.15.72:0/1900261991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8a4e39a0 con 0x564b8a4e3040 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad6a78640 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4e3040 0x564b8a4e3460 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faad0048260 tx=0x7faad0012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7fa9c0e01640 1 -- 172.21.15.72:0/1900261991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad001d350 con 0x564b8a4e3040 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7fa9c0e01640 1 -- 172.21.15.72:0/1900261991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0010b70 con 0x564b8a4e3040 2024-04-26T12:50:15.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8a4e4440 con 0x564b8a4e3040 2024-04-26T12:50:15.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7fa9c0e01640 1 -- 172.21.15.72:0/1900261991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad0010e50 con 0x564b8a4e3040 2024-04-26T12:50:15.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.028+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8a4e4910 con 0x564b8a4e3040 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7fa9c0e01640 1 -- 172.21.15.72:0/1900261991 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faad0041160 con 0x564b8a4e3040 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7fa9c0e01640 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9b00347f0 0x7fa9b0036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7fa9c0e01640 1 -- 172.21.15.72:0/1900261991 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7faad003a070 con 0x564b8a4e3040 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad6277640 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9b00347f0 0x7fa9b0036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 Processor -- start 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- start start 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad6277640 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9b00347f0 0x7fa9b0036cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x564b8a4cc700 tx=0x7faacc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b8a4bdd80 con 0x564b8a4f0070 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49490/0 (socket says 172.21.15.72:49490) 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad6a78640 1 -- 172.21.15.72:0/3120980272 learned_addr learned my addr 172.21.15.72:0/3120980272 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad6a78640 1 -- 172.21.15.72:0/3120980272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8a4f0a60 con 0x564b8a4f0070 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad6a78640 1 --2- 172.21.15.72:0/3120980272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f0490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faad0013ea0 tx=0x7faad00215d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7cae8ebd6334b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7fa9ba7fc640 1 -- 172.21.15.72:0/3120980272 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad0011400 con 0x564b8a4f0070 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7fa9ba7fc640 1 -- 172.21.15.72:0/3120980272 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0015e40 con 0x564b8a4f0070 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7fa9ba7fc640 1 -- 172.21.15.72:0/3120980272 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad003fe30 con 0x564b8a4f0070 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- 172.21.15.72:0/3120980272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 msgr2=0x564b8a4f0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 --2- 172.21.15.72:0/3120980272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f0490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faad0013ea0 tx=0x7faad00215d0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- 172.21.15.72:0/3120980272 shutdown_connections 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 --2- 172.21.15.72:0/3120980272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f0490 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- 172.21.15.72:0/3120980272 >> 172.21.15.72:0/3120980272 conn(0x564b8a4ec3b0 msgr2=0x564b8a4ea410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- 172.21.15.72:0/3120980272 shutdown_connections 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- 172.21.15.72:0/3120980272 wait complete. 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 Processor -- start 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.032+0000 7faad8f5d980 1 -- start start 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564b8a4f1120 con 0x564b8a4f0070 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad6a78640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49496/0 (socket says 172.21.15.72:49496) 2024-04-26T12:50:15.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 learned_addr learned my addr 172.21.15.72:0/4126687417 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8a4f78c0 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad6a78640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f7380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faad0012530 tx=0x7faad0017f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7fa9b8ff9640 1 -- 172.21.15.72:0/4126687417 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad006f070 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8a4f78c0 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7fa9b8ff9640 1 -- 172.21.15.72:0/4126687417 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0041db0 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7fa9b8ff9640 1 -- 172.21.15.72:0/4126687417 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad0011400 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8a4f7d90 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7fa9b8ff9640 1 -- 172.21.15.72:0/4126687417 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faad0072070 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7fa9b8ff9640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9a0034600 0x7fa9a0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7fa9b8ff9640 1 -- 172.21.15.72:0/4126687417 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7faad005a070 con 0x564b8a4f0070 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad6277640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9a0034600 0x7fa9a0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a502480 0x564b8a504940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a505090 con 0x564b8a502480 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad7279640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a502480 0x564b8a504940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad6277640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9a0034600 0x7fa9a0036ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b6fd0 tx=0x7faacc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad7279640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a502480 0x564b8a504940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a502480 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 20 realm 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a5054a0 con 0x564b8a502480 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a502480 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.036+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a505d70 con 0x564b8a502480 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a502480 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a502480 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a506e70 0x564b8a509260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a509830 con 0x564b8a506e70 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6a78640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a506e70 0x564b8a509260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6a78640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a506e70 0x564b8a509260 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 20 searching for the correct realm 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a50b780 0x564b8a50dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50e280 con 0x564b8a50b780 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6277640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a50b780 0x564b8a50dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6277640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a50b780 0x564b8a50dbb0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6277640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faacc0ab030 0x7faacc0b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50e280 con 0x7faacc0ab030 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad7279640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faacc0ab030 0x7faacc0b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad7279640 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faacc0ab030 0x7faacc0b7400 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac80083f0 con 0x7faacc0ab030 2024-04-26T12:50:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.040+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac80083f0 con 0x564b8a502480 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x7faacc0ab030 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x7faacc0ab030 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.044+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x7faacc0ab030 2024-04-26T12:50:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faac8026040 con 0x7faacc0ab030 2024-04-26T12:50:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x7faacc0ab030 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x7faacc0ab030 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.048+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x7faacc0ab030 2024-04-26T12:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x7faacc0ab030 2024-04-26T12:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a50b780 2024-04-26T12:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a506e70 2024-04-26T12:50:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x564b8a502480 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b8a506110 con 0x7faacc0ab030 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faac8026040 con 0x7faacc0ab030 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50a0f0 con 0x564b8a502480 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50a0f0 con 0x564b8a502480 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faac8026040 con 0x564b8a502480 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50a0f0 con 0x564b8a50b780 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 20 zone default found 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 4 Realm: () 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.052+0000 7faad8f5d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:15.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 zonegroup default 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50aa90 con 0x564b8a506e70 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a510170 con 0x564b8a50b780 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a5105d0 con 0x564b8a50b780 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 started sync module instance, tier type = 2024-04-26T12:50:15.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50f580 con 0x7faacc0ab030 2024-04-26T12:50:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8026040 con 0x7faacc0ab030 2024-04-26T12:50:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882443098832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50f580 con 0x7faacc0ab030 2024-04-26T12:50:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a511110 con 0x564b8a502480 2024-04-26T12:50:15.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.056+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882443098832] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x7faacc0ab030 2024-04-26T12:50:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882443103232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a50f580 con 0x564b8a502480 2024-04-26T12:50:15.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a511b50 con 0x564b8a50b780 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882443105952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a5123f0 con 0x564b8a50b780 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a512df0 con 0x7faacc0ab030 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882443103232] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x7faacc0ab030 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882443096272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a513210 con 0x7faacc0ab030 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.060+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a513ac0 con 0x564b8a502480 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882443105952] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882443096272] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x7faacc0ab030 2024-04-26T12:50:15.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882443110656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a5131c0 con 0x564b8a502480 2024-04-26T12:50:15.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a514390 con 0x564b8a506e70 2024-04-26T12:50:15.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882443110656] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.064+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882443116256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a5131c0 con 0x564b8a506e70 2024-04-26T12:50:15.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.068+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a514be0 con 0x564b8a506e70 2024-04-26T12:50:15.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.068+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.068+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882443118384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a515000 con 0x564b8a506e70 2024-04-26T12:50:15.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.068+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a515b00 con 0x564b8a506e70 2024-04-26T12:50:15.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.068+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882443116256] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.068+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882443118384] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882443108160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a515000 con 0x564b8a506e70 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=0 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=1 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=2 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=3 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=4 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=5 2024-04-26T12:50:15.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=6 2024-04-26T12:50:15.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882443108160] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 add_watcher() i=7 2024-04-26T12:50:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a518af0 con 0x564b8a502480 2024-04-26T12:50:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882443119904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a515f70 con 0x564b8a502480 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882443119904] v33'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7fa98d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 5 note: GC not initialized 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7fa907fff640 20 reqs_thread_entry: start 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 Filter name: none 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7fa905ffb640 20 reqs_thread_entry: start 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:15.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.072+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a53c2f0 con 0x564b8a502480 2024-04-26T12:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 20 rados_obj.operate() r=0 bl.length=502 2024-04-26T12:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a542980 con 0x564b8a502480 2024-04-26T12:50:15.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94882443305968 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a53e090 con 0x564b8a502480 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94882443110656 notify 141733920772 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7faac8010040 con 0x564b8a502480 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7fa9ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94882443110656 notifier 4363 bl.length()=567 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7fa9ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7fa9ba7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(64 notify.4 [notify cookie 94882443305968 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7fa9ba7fc640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa99c003eb0 con 0x564b8a502480 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94882443305968 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faac800ae20 con 0x564b8a502480 2024-04-26T12:50:15.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.076+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a5423f0 con 0x564b8a506e70 2024-04-26T12:50:15.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v33'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad8f5d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:50:15.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94882443305968 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b8a53dbe0 con 0x564b8a50b780 2024-04-26T12:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== watch-notify(notify (1) cookie 94882443105952 notify 141733920769 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7faacc0be070 con 0x564b8a50b780 2024-04-26T12:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7fa9ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94882443105952 notifier 4363 bl.length()=170 2024-04-26T12:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7fa9ba7fc640 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa99c003eb0 con 0x564b8a50b780 2024-04-26T12:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 notify.2 [notify cookie 94882443305968 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== watch-notify(notify_complete (2) cookie 94882443305968 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b8a25bae0 con 0x564b8a50b780 2024-04-26T12:50:15.079 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:15.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7fa98d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882443119904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x564b8a502480 2024-04-26T12:50:15.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94882443119904] v33'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882443098832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x7faacc0ab030 2024-04-26T12:50:15.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94882443098832] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x7faacc0ab030 2024-04-26T12:50:15.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad8f5d980 20 remove_watcher() i=0 2024-04-26T12:50:15.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad8f5d980 2 removed watcher, disabling cache 2024-04-26T12:50:15.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.080+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882443103232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x564b8a502480 2024-04-26T12:50:15.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.084+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94882443103232] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.084+0000 7faad8f5d980 20 remove_watcher() i=1 2024-04-26T12:50:15.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.084+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882443105952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x564b8a50b780 2024-04-26T12:50:15.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.084+0000 7faad6277640 1 -- 172.21.15.72:0/4126687417 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94882443105952] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc0b3040 con 0x564b8a50b780 2024-04-26T12:50:15.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.084+0000 7faad8f5d980 20 remove_watcher() i=2 2024-04-26T12:50:15.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.084+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882443096272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x7faacc0ab030 2024-04-26T12:50:15.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.088+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94882443096272] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x7faacc0ab030 2024-04-26T12:50:15.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.088+0000 7faad8f5d980 20 remove_watcher() i=3 2024-04-26T12:50:15.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.088+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882443110656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x564b8a502480 2024-04-26T12:50:15.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.088+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94882443110656] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faac8036040 con 0x564b8a502480 2024-04-26T12:50:15.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.088+0000 7faad8f5d980 20 remove_watcher() i=4 2024-04-26T12:50:15.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.088+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882443116256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x564b8a506e70 2024-04-26T12:50:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.092+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94882443116256] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.092+0000 7faad8f5d980 20 remove_watcher() i=5 2024-04-26T12:50:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.092+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882443118384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x564b8a506e70 2024-04-26T12:50:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.092+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94882443118384] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.092+0000 7faad8f5d980 20 remove_watcher() i=6 2024-04-26T12:50:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.092+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882443108160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b8a539fd0 con 0x564b8a506e70 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad6a78640 1 -- 172.21.15.72:0/4126687417 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94882443108160] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad0071030 con 0x564b8a506e70 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 20 remove_watcher() i=7 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a506e70 msgr2=0x564b8a509260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a506e70 0x564b8a509260 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a502480 msgr2=0x564b8a504940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a502480 0x564b8a504940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faacc0ab030 msgr2=0x7faacc0b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7faacc0ab030 0x7faacc0b7400 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a50b780 msgr2=0x564b8a50dbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a50b780 0x564b8a50dbb0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9a0034600 msgr2=0x7fa9a0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9a0034600 0x7fa9a0036ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b6fd0 tx=0x7faacc0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad7279640 1 -- 172.21.15.72:0/4126687417 reap_dead start 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 msgr2=0x564b8a4f7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f7380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faad0012530 tx=0x7faad0017f70 comp rx=0 tx=0).stop 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 shutdown_connections 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/4126687417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4f0070 0x564b8a4f7380 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 >> 172.21.15.72:0/4126687417 conn(0x564b8a4ec3b0 msgr2=0x564b8a4e9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 shutdown_connections 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/4126687417 wait complete. 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9b00347f0 msgr2=0x7fa9b0036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9b00347f0 0x7fa9b0036cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x564b8a4cc700 tx=0x7faacc005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4e3040 msgr2=0x564b8a4e3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4e3040 0x564b8a4e3460 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faad0048260 tx=0x7faad0012950 comp rx=0 tx=0).stop 2024-04-26T12:50:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 shutdown_connections 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9b00347f0 0x7fa9b0036cb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/1900261991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a4e3040 0x564b8a4e3460 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 >> 172.21.15.72:0/1900261991 conn(0x564b8a4d7e50 msgr2=0x564b8a4d8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 shutdown_connections 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/1900261991 wait complete. 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a4ce580 msgr2=0x564b8a4d0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564b8a4ce580 0x564b8a4d0970 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a4c9860 msgr2=0x564b8a4cbc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564b8a4c9860 0x564b8a4cbc50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a4d24c0 msgr2=0x564b8a4d48b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564b8a4d24c0 0x564b8a4d48b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9bc0346f0 msgr2=0x7fa9bc036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa9bc0346f0 0x7fa9bc036bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faacc0ad000 tx=0x7faacc0a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 msgr2=0x564b8a4c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 --2- 172.21.15.72:0/2183921186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564b8a3d67d0 0x564b8a4c4930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faad000f000 tx=0x7faad0000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad7279640 1 -- 172.21.15.72:0/2183921186 reap_dead start 2024-04-26T12:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 shutdown_connections 2024-04-26T12:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 >> 172.21.15.72:0/2183921186 conn(0x564b8a3cdbe0 msgr2=0x564b8a4b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 shutdown_connections 2024-04-26T12:50:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.096+0000 7faad8f5d980 1 -- 172.21.15.72:0/2183921186 wait complete. 2024-04-26T12:50:15.105 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:15.105 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-26T12:50:15.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-26T12:50:15.105 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-26T12:50:15.177 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:15.178 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb8ec2980 1 Processor -- start 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb8ec2980 1 -- start start 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb8ec2980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557e64c13ac0 0x557e64c15eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb8ec2980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557e64aba510 con 0x557e64b81000 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb8ec2980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x557e64ac1430 con 0x557e64c13ac0 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb61dc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557e64c13ac0 0x557e64c15eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb61dc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557e64c13ac0 0x557e64c15eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49512/0 (socket says 172.21.15.72:49512) 2024-04-26T12:50:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb61dc640 1 -- 172.21.15.72:0/4209268203 learned_addr learned my addr 172.21.15.72:0/4209268203 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb61dc640 1 -- 172.21.15.72:0/4209268203 >> v1:172.21.15.29:6789/0 conn(0x557e64b81000 legacy=0x557e64c123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.180+0000 7f8cb61dc640 1 -- 172.21.15.72:0/4209268203 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e64a96ae0 con 0x557e64c13ac0 2024-04-26T12:50:15.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/4209268203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64c13ac0 0x557e64c15eb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00a5c0 tx=0x7f8cac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b9aa273fc02c7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb59db640 1 -- 172.21.15.72:0/4209268203 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac0a6070 con 0x557e64c13ac0 2024-04-26T12:50:15.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb59db640 1 -- 172.21.15.72:0/4209268203 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac0af070 con 0x557e64c13ac0 2024-04-26T12:50:15.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb59db640 1 -- 172.21.15.72:0/4209268203 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac0aa5c0 con 0x557e64c13ac0 2024-04-26T12:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/4209268203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64c13ac0 msgr2=0x557e64c15eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/4209268203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64c13ac0 0x557e64c15eb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00a5c0 tx=0x7f8cac01b340 comp rx=0 tx=0).stop 2024-04-26T12:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/4209268203 shutdown_connections 2024-04-26T12:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/4209268203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64c13ac0 0x557e64c15eb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/4209268203 >> 172.21.15.72:0/4209268203 conn(0x557e64c07a80 msgr2=0x557e64c09ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/4209268203 shutdown_connections 2024-04-26T12:50:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.184+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/4209268203 wait complete. 2024-04-26T12:50:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb8ec2980 1 Processor -- start 2024-04-26T12:50:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb8ec2980 1 -- start start 2024-04-26T12:50:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb8ec2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64cfa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb8ec2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e64b10a70 con 0x557e64b81000 2024-04-26T12:50:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64cfa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64cfa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49514/0 (socket says 172.21.15.72:49514) 2024-04-26T12:50:15.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb69dd640 1 -- 172.21.15.72:0/3100722166 learned_addr learned my addr 172.21.15.72:0/3100722166 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb69dd640 1 -- 172.21.15.72:0/3100722166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e64cfac20 con 0x557e64b81000 2024-04-26T12:50:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/3100722166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64cfa650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b1f0 tx=0x7f8ca800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973cff896e67a0ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.196+0000 7f8ba4e09640 1 -- 172.21.15.72:0/3100722166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca800a040 con 0x557e64b81000 2024-04-26T12:50:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8ba4e09640 1 -- 172.21.15.72:0/3100722166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca800f750 con 0x557e64b81000 2024-04-26T12:50:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8ba4e09640 1 -- 172.21.15.72:0/3100722166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca800fa70 con 0x557e64b81000 2024-04-26T12:50:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3100722166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 msgr2=0x557e64cfa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/3100722166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64cfa650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b1f0 tx=0x7f8ca800b6b0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3100722166 shutdown_connections 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/3100722166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64cfa650 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3100722166 >> 172.21.15.72:0/3100722166 conn(0x557e64c07a80 msgr2=0x557e64cf61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3100722166 shutdown_connections 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3100722166 wait complete. 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 Processor -- start 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- start start 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64d018e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e64c18e50 con 0x557e64b81000 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64d018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64d018e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49528/0 (socket says 172.21.15.72:49528) 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb69dd640 1 -- 172.21.15.72:0/500081781 learned_addr learned my addr 172.21.15.72:0/500081781 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb69dd640 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e64d01e20 con 0x557e64b81000 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64d018e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b6f0 tx=0x7f8ca8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8ba3606640 1 -- 172.21.15.72:0/500081781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca8001300 con 0x557e64b81000 2024-04-26T12:50:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e64d020b0 con 0x557e64b81000 2024-04-26T12:50:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8ba3606640 1 -- 172.21.15.72:0/500081781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca801c9c0 con 0x557e64b81000 2024-04-26T12:50:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e64d04cf0 con 0x557e64b81000 2024-04-26T12:50:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8ba3606640 1 -- 172.21.15.72:0/500081781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca802c060 con 0x557e64b81000 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.200+0000 7f8ba3606640 1 -- 172.21.15.72:0/500081781 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8ca8017050 con 0x557e64b81000 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8ba3606640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b9c034650 0x7f8b9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8ba3606640 1 -- 172.21.15.72:0/500081781 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f8ca8015020 con 0x557e64b81000 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b9c034650 0x7f8b9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64c13ac0 0x557e64d08940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d08ec0 con 0x557e64c13ac0 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb71de640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64c13ac0 0x557e64d08940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b9c034650 0x7f8b9c036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0ae000 tx=0x7f8cac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb71de640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64c13ac0 0x557e64d08940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb71de640 1 -- 172.21.15.72:0/500081781 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64c13ac0 2024-04-26T12:50:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d05f10 con 0x557e64c13ac0 2024-04-26T12:50:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb71de640 1 -- 172.21.15.72:0/500081781 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64c13ac0 2024-04-26T12:50:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d0b220 0x557e64d0d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d0dce0 con 0x557e64d0b220 2024-04-26T12:50:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d0b220 0x557e64d0d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d0b220 0x557e64d0d610 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb69dd640 1 -- 172.21.15.72:0/500081781 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ca802e070 con 0x557e64d0b220 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d0a0c0 con 0x557e64c13ac0 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb71de640 1 -- 172.21.15.72:0/500081781 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64c13ac0 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d0f140 0x557e64d11530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d11c30 con 0x557e64d0f140 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.204+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d0f140 0x557e64d11530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d0f140 0x557e64d11530 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb61dc640 1 -- 172.21.15.72:0/500081781 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d0f140 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb8ec2980 1 Processor -- start 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb8ec2980 1 -- start start 2024-04-26T12:50:15.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb8ec2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d1fc80 0x557e64d200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb8ec2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e64b14ab0 con 0x557e64d1fc80 2024-04-26T12:50:15.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d1fc80 0x557e64d200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d1fc80 0x557e64d200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49530/0 (socket says 172.21.15.72:49530) 2024-04-26T12:50:15.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb69dd640 1 -- 172.21.15.72:0/1600219782 learned_addr learned my addr 172.21.15.72:0/1600219782 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb69dd640 1 -- 172.21.15.72:0/1600219782 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e64d205e0 con 0x557e64d1fc80 2024-04-26T12:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d1fc80 0x557e64d200a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c10 tx=0x7f8ca80473d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8ba0e01640 1 -- 172.21.15.72:0/1600219782 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca801a690 con 0x557e64d1fc80 2024-04-26T12:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e64d21080 con 0x557e64d1fc80 2024-04-26T12:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8ba0e01640 1 -- 172.21.15.72:0/1600219782 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca801a830 con 0x557e64d1fc80 2024-04-26T12:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8ba0e01640 1 -- 172.21.15.72:0/1600219782 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca800a2b0 con 0x557e64d1fc80 2024-04-26T12:50:15.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e64d21550 con 0x557e64d1fc80 2024-04-26T12:50:15.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.208+0000 7f8ba0e01640 1 -- 172.21.15.72:0/1600219782 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8ca8042060 con 0x557e64d1fc80 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8ba0e01640 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b90034650 0x7f8b90036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8ba0e01640 1 -- 172.21.15.72:0/1600219782 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f8ca803cc40 con 0x557e64d1fc80 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b90034650 0x7f8b90036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 Processor -- start 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- start start 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b90034650 0x7f8b90036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557e64d097d0 tx=0x7f8cac005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d2d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e64cfaf70 con 0x557e64d2cc50 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d2d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d2d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49544/0 (socket says 172.21.15.72:49544) 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 -- 172.21.15.72:0/3065197694 learned_addr learned my addr 172.21.15.72:0/3065197694 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 -- 172.21.15.72:0/3065197694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e64d2d640 con 0x557e64d2cc50 2024-04-26T12:50:15.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/3065197694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d2d070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80423b0 tx=0x7f8ca800ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f734fd8513102727 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8b9a7fc640 1 -- 172.21.15.72:0/3065197694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca8042420 con 0x557e64d2cc50 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8b9a7fc640 1 -- 172.21.15.72:0/3065197694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca8059070 con 0x557e64d2cc50 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8b9a7fc640 1 -- 172.21.15.72:0/3065197694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca8047620 con 0x557e64d2cc50 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3065197694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 msgr2=0x557e64d2d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/3065197694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d2d070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80423b0 tx=0x7f8ca800ab50 comp rx=0 tx=0).stop 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3065197694 shutdown_connections 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/3065197694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d2d070 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3065197694 >> 172.21.15.72:0/3065197694 conn(0x557e64d28f90 msgr2=0x557e64d26ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3065197694 shutdown_connections 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/3065197694 wait complete. 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 Processor -- start 2024-04-26T12:50:15.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- start start 2024-04-26T12:50:15.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d33ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb8ec2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e64d2dc70 con 0x557e64d2cc50 2024-04-26T12:50:15.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d33ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d33ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49550/0 (socket says 172.21.15.72:49550) 2024-04-26T12:50:15.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 learned_addr learned my addr 172.21.15.72:0/212770542 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.212+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e64d34400 con 0x557e64d2cc50 2024-04-26T12:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d33ec0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8031ba0 tx=0x7f8ca8008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8b98ff9640 1 -- 172.21.15.72:0/212770542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca8026390 con 0x557e64d2cc50 2024-04-26T12:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e64d34400 con 0x557e64d2cc50 2024-04-26T12:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8b98ff9640 1 -- 172.21.15.72:0/212770542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca8019840 con 0x557e64d2cc50 2024-04-26T12:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8b98ff9640 1 -- 172.21.15.72:0/212770542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ca80425e0 con 0x557e64d2cc50 2024-04-26T12:50:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e64d348d0 con 0x557e64d2cc50 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8b98ff9640 1 -- 172.21.15.72:0/212770542 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8ca803a070 con 0x557e64d2cc50 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8b98ff9640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b80034650 0x7f8b80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8b98ff9640 1 -- 172.21.15.72:0/212770542 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f8ca806ac80 con 0x557e64d2cc50 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b80034650 0x7f8b80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64d3f010 0x557e64d414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d41c00 con 0x557e64d3f010 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb71de640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64d3f010 0x557e64d414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b80034650 0x7f8b80036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557e64d12030 tx=0x7f8cac0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb71de640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64d3f010 0x557e64d414b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 realm 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42010 con 0x557e64d3f010 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d428b0 con 0x557e64d3f010 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d439b0 0x557e64d45da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d463f0 con 0x557e64d439b0 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.216+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d439b0 0x557e64d45da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb69dd640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d439b0 0x557e64d45da0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb8ec2980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb8ec2980 20 searching for the correct realm 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d482d0 0x557e64d4a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4adc0 con 0x557e64d482d0 2024-04-26T12:50:15.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d482d0 0x557e64d4a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d482d0 0x557e64d4a740 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb61dc640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8cac0e0040 0x7f8cac0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4adc0 con 0x7f8cac0e0040 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb71de640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8cac0e0040 0x7f8cac0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb71de640 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8cac0e0040 0x7f8cac0e0420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.220+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x7f8cac0e0040 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x7f8cac0e0040 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.224+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x7f8cac0e0040 2024-04-26T12:50:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.228+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x7f8cac0e0040 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d482d0 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d439b0 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x557e64d3f010 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e64d42c50 con 0x7f8cac0e0040 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:15.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d46c40 con 0x557e64d3f010 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d46c40 con 0x557e64d3f010 2024-04-26T12:50:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d46c40 con 0x557e64d482d0 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 zone default found 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 4 Realm: () 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 zonegroup default 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.232+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d475e0 con 0x557e64d439b0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4cca0 con 0x557e64d482d0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4d100 con 0x557e64d482d0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 20 started sync module instance, tier type = 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4c0c0 con 0x7f8cac0e0040 2024-04-26T12:50:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94001345906112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4c0c0 con 0x7f8cac0e0040 2024-04-26T12:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4dc10 con 0x557e64d3f010 2024-04-26T12:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94001345906112] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94001345910528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4c0c0 con 0x557e64d3f010 2024-04-26T12:50:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.236+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4e650 con 0x557e64d482d0 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.240+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94001345910528] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.240+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.240+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94001345903632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4c030 con 0x557e64d482d0 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.240+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4f3b0 con 0x7f8cac0e0040 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.240+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.240+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94001345916576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4fc50 con 0x7f8cac0e0040 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.240+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d50610 con 0x557e64d3f010 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94001345903632] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94001345916576] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94001345921376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d4fbb0 con 0x557e64d3f010 2024-04-26T12:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d50580 con 0x557e64d439b0 2024-04-26T12:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94001345921376] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94001345918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d50ee0 con 0x557e64d439b0 2024-04-26T12:50:15.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.244+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d51730 con 0x557e64d439b0 2024-04-26T12:50:15.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94001345927888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d523a0 con 0x557e64d439b0 2024-04-26T12:50:15.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d52d60 con 0x557e64d439b0 2024-04-26T12:50:15.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94001345918720] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94001345923632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d52d60 con 0x557e64d439b0 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 20 add_watcher() i=0 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 20 add_watcher() i=1 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 20 add_watcher() i=2 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 20 add_watcher() i=3 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 20 add_watcher() i=4 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 20 add_watcher() i=5 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94001345927888] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.248+0000 7f8cb8ec2980 20 add_watcher() i=6 2024-04-26T12:50:15.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94001345923632] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 add_watcher() i=7 2024-04-26T12:50:15.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:15.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d52d60 con 0x557e64d3f010 2024-04-26T12:50:15.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94001345931440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d52d40 con 0x557e64d3f010 2024-04-26T12:50:15.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94001345931440] v33'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8b6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 5 note: GC not initialized 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8ae7fff640 20 reqs_thread_entry: start 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 Filter name: none 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8ae5ffb640 20 reqs_thread_entry: start 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d79490 con 0x557e64d3f010 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d78ff0 con 0x557e64d3f010 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-26T12:50:15.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.252+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d7f8c0 con 0x557e64d3f010 2024-04-26T12:50:15.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v33'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94001346114384 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d7c450 con 0x557e64d3f010 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== watch-notify(notify (1) cookie 94001345921376 notify 141733920773 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f8cb0026410 con 0x557e64d3f010 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94001345921376 notifier 4370 bl.length()=732 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b9a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(65 notify.4 [notify cookie 94001346114384 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b9a7fc640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8b7c003eb0 con 0x557e64d3f010 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== watch-notify(notify_complete (2) cookie 94001346114384 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8cb0040040 con 0x557e64d3f010 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d7f350 con 0x557e64d3f010 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94001346114384 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e64d79f30 con 0x7f8cac0e0040 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== watch-notify(notify (1) cookie 94001345906112 notify 141733920770 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f8cb0040040 con 0x7f8cac0e0040 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94001345906112 notifier 4370 bl.length()=166 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b99ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T12:50:15.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8b99ffb640 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8aec003410 con 0x7f8cac0e0040 2024-04-26T12:50:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(68 notify.0 [notify cookie 94001346114384 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== watch-notify(notify_complete (2) cookie 94001346114384 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8cb0026780 con 0x7f8cac0e0040 2024-04-26T12:50:15.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.256+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.260 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"uqJ5bFAFt0iSNj3iq3zne2JmRj4azdAFFwqwvme1","active":true,"create_date":"2024-04-26T12:50:15.257072Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8b6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94001345931440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x557e64d3f010 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94001345931440] v33'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94001345906112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x7f8cac0e0040 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94001345906112] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8cb8ec2980 20 remove_watcher() i=0 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8cb8ec2980 2 removed watcher, disabling cache 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.260+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94001345910528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x557e64d3f010 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94001345910528] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb8ec2980 20 remove_watcher() i=1 2024-04-26T12:50:15.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94001345903632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x557e64d482d0 2024-04-26T12:50:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb61dc640 1 -- 172.21.15.72:0/212770542 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94001345903632] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cac0aaab0 con 0x557e64d482d0 2024-04-26T12:50:15.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb8ec2980 20 remove_watcher() i=2 2024-04-26T12:50:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94001345916576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x7f8cac0e0040 2024-04-26T12:50:15.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94001345916576] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x7f8cac0e0040 2024-04-26T12:50:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb8ec2980 20 remove_watcher() i=3 2024-04-26T12:50:15.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.264+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94001345921376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x557e64d3f010 2024-04-26T12:50:15.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.268+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94001345921376] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cb000a4d0 con 0x557e64d3f010 2024-04-26T12:50:15.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.268+0000 7f8cb8ec2980 20 remove_watcher() i=4 2024-04-26T12:50:15.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.268+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94001345918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x557e64d439b0 2024-04-26T12:50:15.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.268+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94001345918720] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.268+0000 7f8cb8ec2980 20 remove_watcher() i=5 2024-04-26T12:50:15.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.268+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94001345927888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x557e64d439b0 2024-04-26T12:50:15.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94001345927888] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 20 remove_watcher() i=6 2024-04-26T12:50:15.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94001345923632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e64d771c0 con 0x557e64d439b0 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb69dd640 1 -- 172.21.15.72:0/212770542 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94001345923632] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ca806f020 con 0x557e64d439b0 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 20 remove_watcher() i=7 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d439b0 msgr2=0x557e64d45da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d439b0 0x557e64d45da0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64d3f010 msgr2=0x557e64d414b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64d3f010 0x557e64d414b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8cac0e0040 msgr2=0x7f8cac0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8cac0e0040 0x7f8cac0e0420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d482d0 msgr2=0x557e64d4a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d482d0 0x557e64d4a740 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b80034650 msgr2=0x7f8b80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b80034650 0x7f8b80036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557e64d12030 tx=0x7f8cac0c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 msgr2=0x557e64d33ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb71de640 1 -- 172.21.15.72:0/212770542 reap_dead start 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d33ec0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8031ba0 tx=0x7f8ca8008ef0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 shutdown_connections 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/212770542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d2cc50 0x557e64d33ec0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 >> 172.21.15.72:0/212770542 conn(0x557e64d28f90 msgr2=0x557e64d265f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 shutdown_connections 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/212770542 wait complete. 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b90034650 msgr2=0x7f8b90036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b90034650 0x7f8b90036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557e64d097d0 tx=0x7f8cac005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d1fc80 msgr2=0x557e64d200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d1fc80 0x557e64d200a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c10 tx=0x7f8ca80473d0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 shutdown_connections 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b90034650 0x7f8b90036b10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/1600219782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64d1fc80 0x557e64d200a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 >> 172.21.15.72:0/1600219782 conn(0x557e64d14a90 msgr2=0x557e64d155a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 shutdown_connections 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/1600219782 wait complete. 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d0b220 msgr2=0x557e64d0d610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e64d0b220 0x557e64d0d610 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64c13ac0 msgr2=0x557e64d08940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e64c13ac0 0x557e64d08940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d0f140 msgr2=0x557e64d11530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e64d0f140 0x557e64d11530 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b9c034650 msgr2=0x7f8b9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8b9c034650 0x7f8b9c036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0ae000 tx=0x7f8cac0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 msgr2=0x557e64d018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 --2- 172.21.15.72:0/500081781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e64b81000 0x557e64d018e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b6f0 tx=0x7f8ca8000ee0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb71de640 1 -- 172.21.15.72:0/500081781 reap_dead start 2024-04-26T12:50:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 shutdown_connections 2024-04-26T12:50:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.272+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 >> 172.21.15.72:0/500081781 conn(0x557e64c07a80 msgr2=0x557e64cf4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.276+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 shutdown_connections 2024-04-26T12:50:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.276+0000 7f8cb8ec2980 1 -- 172.21.15.72:0/500081781 wait complete. 2024-04-26T12:50:15.283 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'uqJ5bFAFt0iSNj3iq3zne2JmRj4azdAFFwqwvme1', 'active': True, 'create_date': '2024-04-26T12:50:15.257072Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:15.283 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-26T12:50:15.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-26T12:50:15.284 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-26T12:50:15.363 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:15.363 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe764f11980 1 Processor -- start 2024-04-26T12:50:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe764f11980 1 -- start start 2024-04-26T12:50:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe764f11980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d69159e860 0x55d69162acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe764f11980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6914d7510 con 0x55d69162b200 2024-04-26T12:50:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe764f11980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55d6914de430 con 0x55d69159e860 2024-04-26T12:50:15.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe762a2c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d69159e860 0x55d69162acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe76222b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55d69162b200 0x55d69162d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36036/0 (socket says 172.21.15.72:36036) 2024-04-26T12:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe76222b640 1 -- 172.21.15.72:0/3188018710 learned_addr learned my addr 172.21.15.72:0/3188018710 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe762a2c640 1 -- 172.21.15.72:0/3188018710 >> v1:172.21.15.29:6789/0 conn(0x55d69162b200 legacy=0x55d69162d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.364+0000 7fe762a2c640 1 -- 172.21.15.72:0/3188018710 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6914b3ae0 con 0x55d69159e860 2024-04-26T12:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe762a2c640 1 --2- 172.21.15.72:0/3188018710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69162acc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe75400a480 tx=0x7fe75401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d97c481d791693 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe761a2a640 1 -- 172.21.15.72:0/3188018710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540b0070 con 0x55d69159e860 2024-04-26T12:50:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe761a2a640 1 -- 172.21.15.72:0/3188018710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540ab540 con 0x55d69159e860 2024-04-26T12:50:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe761a2a640 1 -- 172.21.15.72:0/3188018710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540ab840 con 0x55d69159e860 2024-04-26T12:50:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe764f11980 1 -- 172.21.15.72:0/3188018710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 msgr2=0x55d69162acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe764f11980 1 --2- 172.21.15.72:0/3188018710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69162acc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe75400a480 tx=0x7fe75401b280 comp rx=0 tx=0).stop 2024-04-26T12:50:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe764f11980 1 -- 172.21.15.72:0/3188018710 shutdown_connections 2024-04-26T12:50:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe764f11980 1 --2- 172.21.15.72:0/3188018710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69162acc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe764f11980 1 -- 172.21.15.72:0/3188018710 >> 172.21.15.72:0/3188018710 conn(0x55d6916249f0 msgr2=0x55d691626e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe764f11980 1 -- 172.21.15.72:0/3188018710 shutdown_connections 2024-04-26T12:50:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.368+0000 7fe764f11980 1 -- 172.21.15.72:0/3188018710 wait complete. 2024-04-26T12:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.380+0000 7fe764f11980 1 Processor -- start 2024-04-26T12:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.380+0000 7fe764f11980 1 -- start start 2024-04-26T12:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.380+0000 7fe764f11980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69171be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.380+0000 7fe764f11980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d69152da70 con 0x55d69159e860 2024-04-26T12:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69171be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69171be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49578/0 (socket says 172.21.15.72:49578) 2024-04-26T12:50:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 -- 172.21.15.72:0/3100234188 learned_addr learned my addr 172.21.15.72:0/3100234188 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 -- 172.21.15.72:0/3100234188 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69171c460 con 0x55d69159e860 2024-04-26T12:50:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 --2- 172.21.15.72:0/3100234188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69171be90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe7540ae040 tx=0x7fe754003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362cfb03ad745607 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe650e09640 1 -- 172.21.15.72:0/3100234188 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540b0040 con 0x55d69159e860 2024-04-26T12:50:15.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe650e09640 1 -- 172.21.15.72:0/3100234188 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540ab9b0 con 0x55d69159e860 2024-04-26T12:50:15.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe650e09640 1 -- 172.21.15.72:0/3100234188 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540abc90 con 0x55d69159e860 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 -- 172.21.15.72:0/3100234188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 msgr2=0x55d69171be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 --2- 172.21.15.72:0/3100234188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69171be90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe7540ae040 tx=0x7fe754003030 comp rx=0 tx=0).stop 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 -- 172.21.15.72:0/3100234188 shutdown_connections 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 --2- 172.21.15.72:0/3100234188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d69171be90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 -- 172.21.15.72:0/3100234188 >> 172.21.15.72:0/3100234188 conn(0x55d6916249f0 msgr2=0x55d691717a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 -- 172.21.15.72:0/3100234188 shutdown_connections 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 -- 172.21.15.72:0/3100234188 wait complete. 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 Processor -- start 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 -- start start 2024-04-26T12:50:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d691723020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe764f11980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d69163a600 con 0x55d69159e860 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d691723020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d691723020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49588/0 (socket says 172.21.15.72:49588) 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 -- 172.21.15.72:0/508913357 learned_addr learned my addr 172.21.15.72:0/508913357 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.384+0000 7fe762a2c640 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d691723560 con 0x55d69159e860 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe762a2c640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d691723020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe75401bb20 tx=0x7fe754018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe64f606640 1 -- 172.21.15.72:0/508913357 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540b0070 con 0x55d69159e860 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6917237f0 con 0x55d69159e860 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe64f606640 1 -- 172.21.15.72:0/508913357 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540b6870 con 0x55d69159e860 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe64f606640 1 -- 172.21.15.72:0/508913357 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540b6b50 con 0x55d69159e860 2024-04-26T12:50:15.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d691726400 con 0x55d69159e860 2024-04-26T12:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe64f606640 1 -- 172.21.15.72:0/508913357 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe7540bf3f0 con 0x55d69159e860 2024-04-26T12:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe64f606640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6480346a0 0x7fe648036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe64f606640 1 -- 172.21.15.72:0/508913357 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe7540bc070 con 0x55d69159e860 2024-04-26T12:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe76222b640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6480346a0 0x7fe648036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d69162b200 0x55d69172a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d69172a590 con 0x55d69162b200 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe76322d640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d69162b200 0x55d69172a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe76222b640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6480346a0 0x7fe648036b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe758000f70 tx=0x7fe7580012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe76322d640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d69162b200 0x55d69172a050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe76322d640 1 -- 172.21.15.72:0/508913357 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d69162b200 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691727620 con 0x55d69162b200 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe76322d640 1 -- 172.21.15.72:0/508913357 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d69162b200 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d69172c910 0x55d69172ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d69172f3f0 con 0x55d69172c910 2024-04-26T12:50:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.388+0000 7fe762a2c640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d69172c910 0x55d69172ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe762a2c640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d69172c910 0x55d69172ed00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe762a2c640 1 -- 172.21.15.72:0/508913357 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe7540b3040 con 0x55d69172c910 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d69172b7b0 con 0x55d69162b200 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe76322d640 1 -- 172.21.15.72:0/508913357 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d69162b200 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d691730850 0x55d691732c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691733380 con 0x55d691730850 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe76222b640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d691730850 0x55d691732c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe76222b640 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d691730850 0x55d691732c40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe76222b640 1 -- 172.21.15.72:0/508913357 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe75800e620 con 0x55d691730850 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe764f11980 1 Processor -- start 2024-04-26T12:50:15.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe764f11980 1 -- start start 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe764f11980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d691741410 0x55d691741830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe764f11980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d691531ab0 con 0x55d691741410 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d691741410 0x55d691741830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d691741410 0x55d691741830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49598/0 (socket says 172.21.15.72:49598) 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe762a2c640 1 -- 172.21.15.72:0/1232935484 learned_addr learned my addr 172.21.15.72:0/1232935484 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe762a2c640 1 -- 172.21.15.72:0/1232935484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d691741d70 con 0x55d691741410 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.392+0000 7fe762a2c640 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d691741410 0x55d691741830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe7540e2b90 tx=0x7fe7540b5db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe64ce01640 1 -- 172.21.15.72:0/1232935484 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540e0070 con 0x55d691741410 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe64ce01640 1 -- 172.21.15.72:0/1232935484 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe754006ce0 con 0x55d691741410 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d691742810 con 0x55d691741410 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe64ce01640 1 -- 172.21.15.72:0/1232935484 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540b5760 con 0x55d691741410 2024-04-26T12:50:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d691742ce0 con 0x55d691741410 2024-04-26T12:50:15.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe64ce01640 1 -- 172.21.15.72:0/1232935484 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe7540b5900 con 0x55d691741410 2024-04-26T12:50:15.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe64ce01640 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe63c0346a0 0x7fe63c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe64ce01640 1 -- 172.21.15.72:0/1232935484 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe7540a8070 con 0x55d691741410 2024-04-26T12:50:15.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe76222b640 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe63c0346a0 0x7fe63c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 Processor -- start 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- start start 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe76222b640 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe63c0346a0 0x7fe63c036b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe75800bf60 tx=0x7fe75800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d69174e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d69171c6f0 con 0x55d69174e430 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d69174e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d69174e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49614/0 (socket says 172.21.15.72:49614) 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe762a2c640 1 -- 172.21.15.72:0/262634231 learned_addr learned my addr 172.21.15.72:0/262634231 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe762a2c640 1 -- 172.21.15.72:0/262634231 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69174ede0 con 0x55d69174e430 2024-04-26T12:50:15.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe762a2c640 1 --2- 172.21.15.72:0/262634231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d69174e810 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7540a5fd0 tx=0x7fe7540b37e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1b18345b3944d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe6467fc640 1 -- 172.21.15.72:0/262634231 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540bebd0 con 0x55d69174e430 2024-04-26T12:50:15.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe6467fc640 1 -- 172.21.15.72:0/262634231 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540073f0 con 0x55d69174e430 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe6467fc640 1 -- 172.21.15.72:0/262634231 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540bf730 con 0x55d69174e430 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- 172.21.15.72:0/262634231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 msgr2=0x55d69174e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 --2- 172.21.15.72:0/262634231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d69174e810 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7540a5fd0 tx=0x7fe7540b37e0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- 172.21.15.72:0/262634231 shutdown_connections 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 --2- 172.21.15.72:0/262634231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d69174e810 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- 172.21.15.72:0/262634231 >> 172.21.15.72:0/262634231 conn(0x55d69174a770 msgr2=0x55d6917487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- 172.21.15.72:0/262634231 shutdown_connections 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.396+0000 7fe764f11980 1 -- 172.21.15.72:0/262634231 wait complete. 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 Processor -- start 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 -- start start 2024-04-26T12:50:15.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d6917556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d69174f4e0 con 0x55d69174e430 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d6917556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe762a2c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d6917556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49622/0 (socket says 172.21.15.72:49622) 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 learned_addr learned my addr 172.21.15.72:0/4152700555 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d691755c00 con 0x55d69174e430 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe762a2c640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d6917556c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe7540b3b60 tx=0x7fe754007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe644ff9640 1 -- 172.21.15.72:0/4152700555 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe754009420 con 0x55d69174e430 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d691755c00 con 0x55d69174e430 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe644ff9640 1 -- 172.21.15.72:0/4152700555 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540aa6f0 con 0x55d69174e430 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d691755c00 con 0x55d69174e430 2024-04-26T12:50:15.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe644ff9640 1 -- 172.21.15.72:0/4152700555 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7540b32d0 con 0x55d69174e430 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe644ff9640 1 -- 172.21.15.72:0/4152700555 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe754109030 con 0x55d69174e430 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe644ff9640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe62c034650 0x7fe62c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe644ff9640 1 -- 172.21.15.72:0/4152700555 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe754107070 con 0x55d69174e430 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe76222b640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe62c034650 0x7fe62c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d691760680 0x55d691762b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691763290 con 0x55d691760680 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe76322d640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d691760680 0x55d691762b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe76222b640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe62c034650 0x7fe62c036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55d69172aa90 tx=0x7fe758010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.400+0000 7fe76322d640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d691760680 0x55d691762b40 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 realm 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6917636a0 con 0x55d691760680 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691763f70 con 0x55d691760680 2024-04-26T12:50:15.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d691765070 0x55d691767460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691767a70 con 0x55d691765070 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe762a2c640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d691765070 0x55d691767460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe762a2c640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d691765070 0x55d691767460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 20 searching for the correct realm 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d6917699c0 0x55d69176bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d69176c4a0 con 0x55d6917699c0 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76222b640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d6917699c0 0x55d69176bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76222b640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d6917699c0 0x55d69176bdd0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76222b640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe758037040 0x7fe758036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d69176c4a0 con 0x7fe758037040 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76322d640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe758037040 0x7fe758036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.404+0000 7fe76322d640 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe758037040 0x7fe758036410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x7fe758037040 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.408+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x7fe758037040 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x7fe758037040 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.412+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x7fe758037040 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d6917699c0 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691765070 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x55d691760680 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d691764310 con 0x7fe758037040 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691768330 con 0x55d691760680 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691768330 con 0x55d691760680 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691768330 con 0x55d6917699c0 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 zone default found 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 4 Realm: () 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 zonegroup default 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.416+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691768d30 con 0x55d691765070 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6917688c0 con 0x55d6917699c0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d69176e910 con 0x55d6917699c0 2024-04-26T12:50:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 20 started sync module instance, tier type = 2024-04-26T12:50:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d69176dc40 con 0x7fe758037040 2024-04-26T12:50:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94380051849536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d69176dc40 con 0x7fe758037040 2024-04-26T12:50:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d69176f3d0 con 0x55d691760680 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94380051849536] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94380051853024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d69176dc40 con 0x55d691760680 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.420+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d69176fde0 con 0x55d6917699c0 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94380051855664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691770680 con 0x55d6917699c0 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691771080 con 0x7fe758037040 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94380051853024] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94380051847056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917714a0 con 0x7fe758037040 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691771e60 con 0x55d691760680 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.424+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94380051855664] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94380051847056] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94380051860368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917719b0 con 0x55d691760680 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691772200 con 0x55d691765070 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94380051860368] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94380051863984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691771dd0 con 0x55d691765070 2024-04-26T12:50:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.428+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691772f00 con 0x55d691765070 2024-04-26T12:50:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94380051863984] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94380051867520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691773750 con 0x55d691765070 2024-04-26T12:50:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691773fe0 con 0x55d691765070 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94380051867520] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94380051870368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917741c0 con 0x55d691765070 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 20 add_watcher() i=0 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 20 add_watcher() i=1 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 20 add_watcher() i=2 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 20 add_watcher() i=3 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 20 add_watcher() i=4 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 20 add_watcher() i=5 2024-04-26T12:50:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.432+0000 7fe764f11980 20 add_watcher() i=6 2024-04-26T12:50:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94380051870368] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 20 add_watcher() i=7 2024-04-26T12:50:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d691777590 con 0x55d691760680 2024-04-26T12:50:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94380051873968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d691774980 con 0x55d691760680 2024-04-26T12:50:15.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94380051873968] v33'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe6197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 5 note: GC not initialized 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe593fff640 20 reqs_thread_entry: start 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 20 Filter name: none 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe591ffb640 20 reqs_thread_entry: start 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d69179acc0 con 0x55d691760680 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:50:15.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:15.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:15.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.436+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917a1460 con 0x55d691760680 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe764f11980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe764f11980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe764f11980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94380052057808 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d69179cb90 con 0x55d691760680 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94380051860368 notify 141733920774 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fe75c026410 con 0x55d691760680 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe6467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94380051860368 notifier 4377 bl.length()=732 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe6467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe6467fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(64 notify.4 [notify cookie 94380052057808 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe6467fc640 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe628003eb0 con 0x55d691760680 2024-04-26T12:50:15.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94380052057808 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe75c0265e0 con 0x55d691760680 2024-04-26T12:50:15.441 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe6197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94380051873968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d69179cfc0 con 0x55d691760680 2024-04-26T12:50:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94380051873968] v33'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.440+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94380051849536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x7fe758037040 2024-04-26T12:50:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.444+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94380051849536] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.444+0000 7fe764f11980 20 remove_watcher() i=0 2024-04-26T12:50:15.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.444+0000 7fe764f11980 2 removed watcher, disabling cache 2024-04-26T12:50:15.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.444+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94380051853024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x55d691760680 2024-04-26T12:50:15.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.444+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94380051853024] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.444+0000 7fe764f11980 20 remove_watcher() i=1 2024-04-26T12:50:15.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.444+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94380051855664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x55d6917699c0 2024-04-26T12:50:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe76222b640 1 -- 172.21.15.72:0/4152700555 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94380051855664] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75800e620 con 0x55d6917699c0 2024-04-26T12:50:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe764f11980 20 remove_watcher() i=2 2024-04-26T12:50:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94380051847056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x7fe758037040 2024-04-26T12:50:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94380051847056] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x7fe758037040 2024-04-26T12:50:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe764f11980 20 remove_watcher() i=3 2024-04-26T12:50:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94380051860368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x55d691760680 2024-04-26T12:50:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94380051860368] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe75c00a4d0 con 0x55d691760680 2024-04-26T12:50:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe764f11980 20 remove_watcher() i=4 2024-04-26T12:50:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.448+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94380051863984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x55d691765070 2024-04-26T12:50:15.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.452+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94380051863984] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.452+0000 7fe764f11980 20 remove_watcher() i=5 2024-04-26T12:50:15.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.452+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94380051867520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x55d691765070 2024-04-26T12:50:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.452+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94380051867520] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.452+0000 7fe764f11980 20 remove_watcher() i=6 2024-04-26T12:50:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.452+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94380051870368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6917989b0 con 0x55d691765070 2024-04-26T12:50:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe762a2c640 1 -- 172.21.15.72:0/4152700555 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94380051870368] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7540b3040 con 0x55d691765070 2024-04-26T12:50:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 20 remove_watcher() i=7 2024-04-26T12:50:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d691765070 msgr2=0x55d691767460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d691765070 0x55d691767460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d691760680 msgr2=0x55d691762b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d691760680 0x55d691762b40 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe758037040 msgr2=0x7fe758036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe758037040 0x7fe758036410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d6917699c0 msgr2=0x55d69176bdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d6917699c0 0x55d69176bdd0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe62c034650 msgr2=0x7fe62c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe62c034650 0x7fe62c036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55d69172aa90 tx=0x7fe758010000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe76322d640 1 -- 172.21.15.72:0/4152700555 reap_dead start 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 msgr2=0x55d6917556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d6917556c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe7540b3b60 tx=0x7fe754007630 comp rx=0 tx=0).stop 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 shutdown_connections 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/4152700555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69174e430 0x55d6917556c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 >> 172.21.15.72:0/4152700555 conn(0x55d69174a770 msgr2=0x55d691747dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 shutdown_connections 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/4152700555 wait complete. 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe63c0346a0 msgr2=0x7fe63c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe63c0346a0 0x7fe63c036b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe75800bf60 tx=0x7fe75800f000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d691741410 msgr2=0x55d691741830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d691741410 0x55d691741830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe7540e2b90 tx=0x7fe7540b5db0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 shutdown_connections 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe63c0346a0 0x7fe63c036b60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/1232935484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d691741410 0x55d691741830 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 >> 172.21.15.72:0/1232935484 conn(0x55d691736220 msgr2=0x55d691736d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 shutdown_connections 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/1232935484 wait complete. 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d69172c910 msgr2=0x55d69172ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d69172c910 0x55d69172ed00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d69162b200 msgr2=0x55d69172a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d69162b200 0x55d69172a050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d691730850 msgr2=0x55d691732c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d691730850 0x55d691732c40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6480346a0 msgr2=0x7fe648036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6480346a0 0x7fe648036b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe758000f70 tx=0x7fe7580012c0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 msgr2=0x55d691723020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 --2- 172.21.15.72:0/508913357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d69159e860 0x55d691723020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe75401bb20 tx=0x7fe754018020 comp rx=0 tx=0).stop 2024-04-26T12:50:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe76322d640 1 -- 172.21.15.72:0/508913357 reap_dead start 2024-04-26T12:50:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 shutdown_connections 2024-04-26T12:50:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 >> 172.21.15.72:0/508913357 conn(0x55d6916249f0 msgr2=0x55d691716530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 shutdown_connections 2024-04-26T12:50:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.456+0000 7fe764f11980 1 -- 172.21.15.72:0/508913357 wait complete. 2024-04-26T12:50:15.465 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:15.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:15.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:15.466 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:15.537 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:15.538 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:15.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb2acc2980 1 Processor -- start 2024-04-26T12:50:15.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb2acc2980 1 -- start start 2024-04-26T12:50:15.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb2acc2980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c021687880 0x55c021715f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb2acc2980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0215c0510 con 0x55c0217164b0 2024-04-26T12:50:15.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb2acc2980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c0215c7430 con 0x55c021687880 2024-04-26T12:50:15.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb287dd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c021687880 0x55c021715f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb287dd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c021687880 0x55c021715f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49634/0 (socket says 172.21.15.72:49634) 2024-04-26T12:50:15.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb27fdc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55c0217164b0 0x55c0217188a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36048/0 (socket says 172.21.15.72:36048) 2024-04-26T12:50:15.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb287dd640 1 -- 172.21.15.72:0/2841924688 learned_addr learned my addr 172.21.15.72:0/2841924688 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb287dd640 1 -- 172.21.15.72:0/2841924688 >> v1:172.21.15.29:6789/0 conn(0x55c0217164b0 legacy=0x55c0217188a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.540+0000 7fbb287dd640 1 -- 172.21.15.72:0/2841924688 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02159cae0 con 0x55c021687880 2024-04-26T12:50:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb287dd640 1 --2- 172.21.15.72:0/2841924688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c021715f70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800a5c0 tx=0x7fbb1801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c48a7a49b0209f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb277db640 1 -- 172.21.15.72:0/2841924688 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180a6070 con 0x55c021687880 2024-04-26T12:50:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb277db640 1 -- 172.21.15.72:0/2841924688 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180af070 con 0x55c021687880 2024-04-26T12:50:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb277db640 1 -- 172.21.15.72:0/2841924688 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180aa5c0 con 0x55c021687880 2024-04-26T12:50:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2841924688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 msgr2=0x55c021715f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/2841924688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c021715f70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800a5c0 tx=0x7fbb1801b340 comp rx=0 tx=0).stop 2024-04-26T12:50:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2841924688 shutdown_connections 2024-04-26T12:50:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/2841924688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c021715f70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2841924688 >> 172.21.15.72:0/2841924688 conn(0x55c02170da50 msgr2=0x55c02170fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2841924688 shutdown_connections 2024-04-26T12:50:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.544+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2841924688 wait complete. 2024-04-26T12:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb2acc2980 1 Processor -- start 2024-04-26T12:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb2acc2980 1 -- start start 2024-04-26T12:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb2acc2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0217136d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb2acc2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c021616a70 con 0x55c021687880 2024-04-26T12:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0217136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0217136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49638/0 (socket says 172.21.15.72:49638) 2024-04-26T12:50:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb287dd640 1 -- 172.21.15.72:0/2665074505 learned_addr learned my addr 172.21.15.72:0/2665074505 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb287dd640 1 -- 172.21.15.72:0/2665074505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c021713ca0 con 0x55c021687880 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fbb287dd640 1 --2- 172.21.15.72:0/2665074505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0217136d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbb18018f70 tx=0x7fbb18003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb0613100bb8faa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fba1660c640 1 -- 172.21.15.72:0/2665074505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180aa9e0 con 0x55c021687880 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fba1660c640 1 -- 172.21.15.72:0/2665074505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180aab80 con 0x55c021687880 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.556+0000 7fba1660c640 1 -- 172.21.15.72:0/2665074505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180aae60 con 0x55c021687880 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2665074505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 msgr2=0x55c0217136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/2665074505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0217136d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbb18018f70 tx=0x7fbb18003030 comp rx=0 tx=0).stop 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2665074505 shutdown_connections 2024-04-26T12:50:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/2665074505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0217136d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2665074505 >> 172.21.15.72:0/2665074505 conn(0x55c02170da50 msgr2=0x55c0217f9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2665074505 shutdown_connections 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/2665074505 wait complete. 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 Processor -- start 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- start start 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0218077c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c02171aad0 con 0x55c021687880 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0218077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0218077c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49648/0 (socket says 172.21.15.72:49648) 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb287dd640 1 -- 172.21.15.72:0/3774154684 learned_addr learned my addr 172.21.15.72:0/3774154684 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb287dd640 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c021807d00 con 0x55c021687880 2024-04-26T12:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb287dd640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0218077c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbb1801b170 tx=0x7fbb180180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fba14e09640 1 -- 172.21.15.72:0/3774154684 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180bd7c0 con 0x55c021687880 2024-04-26T12:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c021807f90 con 0x55c021687880 2024-04-26T12:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fba14e09640 1 -- 172.21.15.72:0/3774154684 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180bd960 con 0x55c021687880 2024-04-26T12:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02180ab30 con 0x55c021687880 2024-04-26T12:50:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fba14e09640 1 -- 172.21.15.72:0/3774154684 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180bdc40 con 0x55c021687880 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fba14e09640 1 -- 172.21.15.72:0/3774154684 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbb180ce030 con 0x55c021687880 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fba14e09640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba10034650 0x7fba10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fba14e09640 1 -- 172.21.15.72:0/3774154684 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbb180cc020 con 0x55c021687880 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba10034650 0x7fba10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0217164b0 0x55c02180e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.560+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02180ece0 con 0x55c0217164b0 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb28fde640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0217164b0 0x55c02180e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba10034650 0x7fba10036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001e50 tx=0x7fbb1c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb28fde640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0217164b0 0x55c02180e670 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb28fde640 1 -- 172.21.15.72:0/3774154684 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c0217164b0 2024-04-26T12:50:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02180f5c0 con 0x55c0217164b0 2024-04-26T12:50:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb28fde640 1 -- 172.21.15.72:0/3774154684 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c0217164b0 2024-04-26T12:50:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021810ed0 0x55c021813370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c021813b00 con 0x55c021810ed0 2024-04-26T12:50:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb287dd640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021810ed0 0x55c021813370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb287dd640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021810ed0 0x55c021813370 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb287dd640 1 -- 172.21.15.72:0/3774154684 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb180c6d20 con 0x55c021810ed0 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02180fe10 con 0x55c0217164b0 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb28fde640 1 -- 172.21.15.72:0/3774154684 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c0217164b0 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c021814f60 0x55c021817350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c021817ac0 con 0x55c021814f60 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c021814f60 0x55c021817350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c021814f60 0x55c021817350 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.564+0000 7fbb27fdc640 1 -- 172.21.15.72:0/3774154684 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbb1c00f700 con 0x55c021814f60 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 Processor -- start 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 -- start start 2024-04-26T12:50:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021825b30 0x55c021825f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c02161aab0 con 0x55c021825b30 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021825b30 0x55c021825f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021825b30 0x55c021825f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49650/0 (socket says 172.21.15.72:49650) 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb287dd640 1 -- 172.21.15.72:0/991408589 learned_addr learned my addr 172.21.15.72:0/991408589 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb287dd640 1 -- 172.21.15.72:0/991408589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c021826490 con 0x55c021825b30 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb287dd640 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021825b30 0x55c021825f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb180e39f0 tx=0x7fbb180dd170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fba0dffb640 1 -- 172.21.15.72:0/991408589 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180c55a0 con 0x55c021825b30 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c021826f30 con 0x55c021825b30 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fba0dffb640 1 -- 172.21.15.72:0/991408589 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180e9070 con 0x55c021825b30 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fba0dffb640 1 -- 172.21.15.72:0/991408589 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180c5870 con 0x55c021825b30 2024-04-26T12:50:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c021827400 con 0x55c021825b30 2024-04-26T12:50:15.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fba0dffb640 1 -- 172.21.15.72:0/991408589 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbb180cf9d0 con 0x55c021825b30 2024-04-26T12:50:15.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fba0dffb640 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba00034650 0x7fba00036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fba0dffb640 1 -- 172.21.15.72:0/991408589 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbb180efca0 con 0x55c021825b30 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba00034650 0x7fba00036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 Processor -- start 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 -- start start 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba00034650 0x7fba00036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55c0218101b0 tx=0x7fbb1c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021832f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.568+0000 7fbb2acc2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c021711e00 con 0x55c021832b90 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021832f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021832f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49666/0 (socket says 172.21.15.72:49666) 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 -- 172.21.15.72:0/3211345086 learned_addr learned my addr 172.21.15.72:0/3211345086 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 -- 172.21.15.72:0/3211345086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c021833560 con 0x55c021832b90 2024-04-26T12:50:15.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 --2- 172.21.15.72:0/3211345086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021832f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbb180c8fd0 tx=0x7fbb180bcbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dc7d517be0aaf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fba077fe640 1 -- 172.21.15.72:0/3211345086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180f3070 con 0x55c021832b90 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fba077fe640 1 -- 172.21.15.72:0/3211345086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180bcd30 con 0x55c021832b90 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fba077fe640 1 -- 172.21.15.72:0/3211345086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180cfdf0 con 0x55c021832b90 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3211345086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 msgr2=0x55c021832f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3211345086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021832f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbb180c8fd0 tx=0x7fbb180bcbc0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3211345086 shutdown_connections 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3211345086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021832f90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3211345086 >> 172.21.15.72:0/3211345086 conn(0x55c02182eed0 msgr2=0x55c02182cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3211345086 shutdown_connections 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3211345086 wait complete. 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 Processor -- start 2024-04-26T12:50:15.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- start start 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021839e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c021833c40 con 0x55c021832b90 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021839e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021839e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49678/0 (socket says 172.21.15.72:49678) 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 learned_addr learned my addr 172.21.15.72:0/256947976 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02183a350 con 0x55c021832b90 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb287dd640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021839e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbb180c7a80 tx=0x7fbb180e7f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fba05ffb640 1 -- 172.21.15.72:0/256947976 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb18110070 con 0x55c021832b90 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c02183a350 con 0x55c021832b90 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fba05ffb640 1 -- 172.21.15.72:0/256947976 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180e56c0 con 0x55c021832b90 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fba05ffb640 1 -- 172.21.15.72:0/256947976 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb180c76c0 con 0x55c021832b90 2024-04-26T12:50:15.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.572+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02183a350 con 0x55c021832b90 2024-04-26T12:50:15.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fba05ffb640 1 -- 172.21.15.72:0/256947976 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbb180d20b0 con 0x55c021832b90 2024-04-26T12:50:15.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fba05ffb640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb9f8034600 0x7fb9f8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fba05ffb640 1 -- 172.21.15.72:0/256947976 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbb180cc220 con 0x55c021832b90 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb9f8034600 0x7fb9f8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c021844d70 0x55c021847210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c021847960 con 0x55c021844d70 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb28fde640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c021844d70 0x55c021847210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb9f8034600 0x7fb9f8036ac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c021817ea0 tx=0x7fbb1c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb28fde640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c021844d70 0x55c021847210 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 realm 2024-04-26T12:50:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c021847d70 con 0x55c021844d70 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c021848610 con 0x55c021844d70 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021849710 0x55c02184bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02184c080 con 0x55c021849710 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb287dd640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021849710 0x55c02184bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.576+0000 7fbb287dd640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021849710 0x55c02184bb00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb2acc2980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb2acc2980 20 searching for the correct realm 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c02184dfb0 0x55c021850470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c021850b40 con 0x55c02184dfb0 2024-04-26T12:50:15.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c02184dfb0 0x55c021850470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c02184dfb0 0x55c021850470 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb27fdc640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbb1c01fc60 0x7fbb1c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c021850b40 con 0x7fbb1c01fc60 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbb1c01fc60 0x7fbb1c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbb1c01fc60 0x7fbb1c03a3c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.580+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.584+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c02184dfb0 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021849710 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x55c021844d70 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.588+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c0218489b0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:15.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02184c8d0 con 0x55c021844d70 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02184c8d0 con 0x55c021844d70 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02184c8d0 con 0x55c02184dfb0 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 zone default found 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 4 Realm: () 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 zonegroup default 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02184d170 con 0x55c021849710 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c0218529a0 con 0x55c02184dfb0 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c021852d40 con 0x55c02184dfb0 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 started sync module instance, tier type = 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021851e40 con 0x7fbb1c01fc60 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283684455280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021851e40 con 0x7fbb1c01fc60 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.592+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c0218537d0 con 0x55c021844d70 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283684455280] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283684459168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021851e40 con 0x55c021844d70 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c0218541e0 con 0x55c02184dfb0 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283684461872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021854a80 con 0x55c02184dfb0 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c0218554a0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.596+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283684459168] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283684466576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021855890 con 0x7fbb1c01fc60 2024-04-26T12:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021856250 con 0x55c021844d70 2024-04-26T12:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283684461872] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283684466576] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283684452752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021855da0 con 0x55c021844d70 2024-04-26T12:50:15.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c0218565f0 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.600+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283684452752] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283684470176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c0218561c0 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c0218572f0 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283684476560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021857f60 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021858960 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283684470176] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.604+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283684476560] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283684473232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021857af0 con 0x55c021849710 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=0 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=1 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=2 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=3 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=4 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=5 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=6 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283684473232] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 add_watcher() i=7 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02185ba60 con 0x55c021844d70 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283684480112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021858ee0 con 0x55c021844d70 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283684480112] v33'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fb9de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.608+0000 7fbb2acc2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 5 note: GC not initialized 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fb9dd7e2640 20 reqs_thread_entry: start 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:15.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 20 Filter name: none 2024-04-26T12:50:15.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fb94effd640 20 reqs_thread_entry: start 2024-04-26T12:50:15.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c02187eba0 con 0x55c021844d70 2024-04-26T12:50:15.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:50:15.614 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fb9de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283684480112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c02187d5f0 con 0x55c021844d70 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94283684480112] v33'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283684455280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021858470 con 0x7fbb1c01fc60 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94283684455280] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 20 remove_watcher() i=0 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 2 removed watcher, disabling cache 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.612+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283684459168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021852370 con 0x55c021844d70 2024-04-26T12:50:15.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.616+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94283684459168] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.616+0000 7fbb2acc2980 20 remove_watcher() i=1 2024-04-26T12:50:15.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.616+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283684461872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021852370 con 0x55c02184dfb0 2024-04-26T12:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.616+0000 7fbb27fdc640 1 -- 172.21.15.72:0/256947976 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94283684461872] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb1c037040 con 0x55c02184dfb0 2024-04-26T12:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.616+0000 7fbb2acc2980 20 remove_watcher() i=2 2024-04-26T12:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.616+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283684466576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021853d30 con 0x7fbb1c01fc60 2024-04-26T12:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94283684466576] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x7fbb1c01fc60 2024-04-26T12:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb2acc2980 20 remove_watcher() i=3 2024-04-26T12:50:15.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283684452752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021853d30 con 0x55c021844d70 2024-04-26T12:50:15.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94283684452752] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2000a4d0 con 0x55c021844d70 2024-04-26T12:50:15.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb2acc2980 20 remove_watcher() i=4 2024-04-26T12:50:15.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283684470176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021851990 con 0x55c021849710 2024-04-26T12:50:15.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94283684470176] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb2acc2980 20 remove_watcher() i=5 2024-04-26T12:50:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.620+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283684476560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021855da0 con 0x55c021849710 2024-04-26T12:50:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94283684476560] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 20 remove_watcher() i=6 2024-04-26T12:50:15.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283684473232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c021851990 con 0x55c021849710 2024-04-26T12:50:15.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb287dd640 1 -- 172.21.15.72:0/256947976 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94283684473232] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb18112070 con 0x55c021849710 2024-04-26T12:50:15.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 20 remove_watcher() i=7 2024-04-26T12:50:15.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021849710 msgr2=0x55c02184bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021849710 0x55c02184bb00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c021844d70 msgr2=0x55c021847210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c021844d70 0x55c021847210 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbb1c01fc60 msgr2=0x7fbb1c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbb1c01fc60 0x7fbb1c03a3c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c02184dfb0 msgr2=0x55c021850470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.624+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c02184dfb0 0x55c021850470 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb9f8034600 msgr2=0x7fb9f8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb9f8034600 0x7fb9f8036ac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c021817ea0 tx=0x7fbb1c010000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 msgr2=0x55c021839e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb28fde640 1 -- 172.21.15.72:0/256947976 reap_dead start 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021839e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbb180c7a80 tx=0x7fbb180e7f40 comp rx=0 tx=0).stop 2024-04-26T12:50:15.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 shutdown_connections 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/256947976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021832b90 0x55c021839e10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 >> 172.21.15.72:0/256947976 conn(0x55c02182eed0 msgr2=0x55c02182c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 shutdown_connections 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/256947976 wait complete. 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba00034650 msgr2=0x7fba00036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba00034650 0x7fba00036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55c0218101b0 tx=0x7fbb1c00f000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021825b30 msgr2=0x55c021825f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021825b30 0x55c021825f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb180e39f0 tx=0x7fbb180dd170 comp rx=0 tx=0).stop 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 shutdown_connections 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba00034650 0x7fba00036b10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/991408589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021825b30 0x55c021825f50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 >> 172.21.15.72:0/991408589 conn(0x55c02181a940 msgr2=0x55c02181b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 shutdown_connections 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/991408589 wait complete. 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021810ed0 msgr2=0x55c021813370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c021810ed0 0x55c021813370 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0217164b0 msgr2=0x55c02180e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0217164b0 0x55c02180e670 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c021814f60 msgr2=0x55c021817350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c021814f60 0x55c021817350 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba10034650 msgr2=0x7fba10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fba10034650 0x7fba10036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001e50 tx=0x7fbb1c0013b0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 msgr2=0x55c0218077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 --2- 172.21.15.72:0/3774154684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c021687880 0x55c0218077c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbb1801b170 tx=0x7fbb180180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb28fde640 1 -- 172.21.15.72:0/3774154684 reap_dead start 2024-04-26T12:50:15.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 shutdown_connections 2024-04-26T12:50:15.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 >> 172.21.15.72:0/3774154684 conn(0x55c02170da50 msgr2=0x55c021712320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 shutdown_connections 2024-04-26T12:50:15.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.628+0000 7fbb2acc2980 1 -- 172.21.15.72:0/3774154684 wait complete. 2024-04-26T12:50:15.636 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:15.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:15.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:15.636 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:15.711 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:15.711 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:15.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f919046b980 1 Processor -- start 2024-04-26T12:50:15.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f919046b980 1 -- start start 2024-04-26T12:50:15.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f919046b980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56015f423610 0x56015f4b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f919046b980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56015f35b510 con 0x56015f424950 2024-04-26T12:50:15.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f919046b980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56015f362430 con 0x56015f423610 2024-04-26T12:50:15.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f918d785640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56015f423610 0x56015f4b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f918d785640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56015f423610 0x56015f4b72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49690/0 (socket says 172.21.15.72:49690) 2024-04-26T12:50:15.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f918d785640 1 -- 172.21.15.72:0/822274416 learned_addr learned my addr 172.21.15.72:0/822274416 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f918df86640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56015f424950 0x56015f422f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36052/0 (socket says 172.21.15.72:36052) 2024-04-26T12:50:15.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f918d785640 1 -- 172.21.15.72:0/822274416 >> v1:172.21.15.29:6789/0 conn(0x56015f424950 legacy=0x56015f422f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.712+0000 7f918d785640 1 -- 172.21.15.72:0/822274416 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015f337ae0 con 0x56015f423610 2024-04-26T12:50:15.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f918d785640 1 --2- 172.21.15.72:0/822274416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f4b72d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f918400a5c0 tx=0x7f918401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4c7990505073f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f918cf84640 1 -- 172.21.15.72:0/822274416 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91840a6070 con 0x56015f423610 2024-04-26T12:50:15.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f918cf84640 1 -- 172.21.15.72:0/822274416 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91840af070 con 0x56015f423610 2024-04-26T12:50:15.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f918cf84640 1 -- 172.21.15.72:0/822274416 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91840aa5c0 con 0x56015f423610 2024-04-26T12:50:15.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f919046b980 1 -- 172.21.15.72:0/822274416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 msgr2=0x56015f4b72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f919046b980 1 --2- 172.21.15.72:0/822274416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f4b72d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f918400a5c0 tx=0x7f918401b340 comp rx=0 tx=0).stop 2024-04-26T12:50:15.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f919046b980 1 -- 172.21.15.72:0/822274416 shutdown_connections 2024-04-26T12:50:15.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f919046b980 1 --2- 172.21.15.72:0/822274416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f4b72d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f919046b980 1 -- 172.21.15.72:0/822274416 >> 172.21.15.72:0/822274416 conn(0x56015f4a9b90 msgr2=0x56015f4abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f919046b980 1 -- 172.21.15.72:0/822274416 shutdown_connections 2024-04-26T12:50:15.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.716+0000 7f919046b980 1 -- 172.21.15.72:0/822274416 wait complete. 2024-04-26T12:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.728+0000 7f919046b980 1 Processor -- start 2024-04-26T12:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.728+0000 7f919046b980 1 -- start start 2024-04-26T12:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.728+0000 7f919046b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f59bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.728+0000 7f919046b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56015f3b1a70 con 0x56015f423610 2024-04-26T12:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f59bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f59bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49694/0 (socket says 172.21.15.72:49694) 2024-04-26T12:50:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 -- 172.21.15.72:0/3324913444 learned_addr learned my addr 172.21.15.72:0/3324913444 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 -- 172.21.15.72:0/3324913444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015f59c0a0 con 0x56015f423610 2024-04-26T12:50:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 --2- 172.21.15.72:0/3324913444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f59bad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f91880015f0 tx=0x7f9188001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74fbb7f4a013a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f907be07640 1 -- 172.21.15.72:0/3324913444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188013420 con 0x56015f423610 2024-04-26T12:50:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f907be07640 1 -- 172.21.15.72:0/3324913444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91880135e0 con 0x56015f423610 2024-04-26T12:50:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f907be07640 1 -- 172.21.15.72:0/3324913444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188013940 con 0x56015f423610 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 -- 172.21.15.72:0/3324913444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 msgr2=0x56015f59bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 --2- 172.21.15.72:0/3324913444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f59bad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f91880015f0 tx=0x7f9188001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 -- 172.21.15.72:0/3324913444 shutdown_connections 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 --2- 172.21.15.72:0/3324913444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f59bad0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 -- 172.21.15.72:0/3324913444 >> 172.21.15.72:0/3324913444 conn(0x56015f4a9b90 msgr2=0x56015f597660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 -- 172.21.15.72:0/3324913444 shutdown_connections 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 -- 172.21.15.72:0/3324913444 wait complete. 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 Processor -- start 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 -- start start 2024-04-26T12:50:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f5a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f919046b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56015f4ba300 con 0x56015f423610 2024-04-26T12:50:15.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f5a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f5a2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49700/0 (socket says 172.21.15.72:49700) 2024-04-26T12:50:15.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 -- 172.21.15.72:0/2366089493 learned_addr learned my addr 172.21.15.72:0/2366089493 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015f5a3270 con 0x56015f423610 2024-04-26T12:50:15.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.732+0000 7f918df86640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f5a2d30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9188006640 tx=0x7f9188000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f907a604640 1 -- 172.21.15.72:0/2366089493 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188022020 con 0x56015f423610 2024-04-26T12:50:15.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f907a604640 1 -- 172.21.15.72:0/2366089493 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188006320 con 0x56015f423610 2024-04-26T12:50:15.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56015f5a3500 con 0x56015f423610 2024-04-26T12:50:15.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f907a604640 1 -- 172.21.15.72:0/2366089493 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188004af0 con 0x56015f423610 2024-04-26T12:50:15.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015f5a6190 con 0x56015f423610 2024-04-26T12:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f907a604640 1 -- 172.21.15.72:0/2366089493 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9188025020 con 0x56015f423610 2024-04-26T12:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f907a604640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9074034740 0x7f9074036c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f907a604640 1 -- 172.21.15.72:0/2366089493 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f9188018030 con 0x56015f423610 2024-04-26T12:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f918d785640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9074034740 0x7f9074036c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f424950 0x56015f5a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5aa2c0 con 0x56015f424950 2024-04-26T12:50:15.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f918e787640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f424950 0x56015f5a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f918d785640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9074034740 0x7f9074036c00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91840ae000 tx=0x7f91840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f918e787640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f424950 0x56015f5a9c70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f918e787640 1 -- 172.21.15.72:0/2366089493 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91800083f0 con 0x56015f424950 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5a73b0 con 0x56015f424950 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f918e787640 1 -- 172.21.15.72:0/2366089493 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91800083f0 con 0x56015f424950 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5ac5f0 0x56015f5ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5af0d0 con 0x56015f5ac5f0 2024-04-26T12:50:15.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.736+0000 7f918df86640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5ac5f0 0x56015f5ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918df86640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5ac5f0 0x56015f5ae9e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918df86640 1 -- 172.21.15.72:0/2366089493 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f918801b070 con 0x56015f5ac5f0 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ab490 con 0x56015f424950 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918e787640 1 -- 172.21.15.72:0/2366089493 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91800083f0 con 0x56015f424950 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5b0530 0x56015f5b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5b3060 con 0x56015f5b0530 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918d785640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5b0530 0x56015f5b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918d785640 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5b0530 0x56015f5b2920 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918d785640 1 -- 172.21.15.72:0/2366089493 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5b0530 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f919046b980 1 Processor -- start 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f919046b980 1 -- start start 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f919046b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5c10f0 0x56015f5c1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f919046b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56015f3b5ab0 con 0x56015f5c10f0 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5c10f0 0x56015f5c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5c10f0 0x56015f5c1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49702/0 (socket says 172.21.15.72:49702) 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918df86640 1 -- 172.21.15.72:0/931432062 learned_addr learned my addr 172.21.15.72:0/931432062 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918df86640 1 -- 172.21.15.72:0/931432062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015f5c1a50 con 0x56015f5c10f0 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.740+0000 7f918df86640 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5c10f0 0x56015f5c1510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91880069a0 tx=0x7f9188028ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90737fe640 1 -- 172.21.15.72:0/931432062 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188041a90 con 0x56015f5c10f0 2024-04-26T12:50:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90737fe640 1 -- 172.21.15.72:0/931432062 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188041c30 con 0x56015f5c10f0 2024-04-26T12:50:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56015f5c24f0 con 0x56015f5c10f0 2024-04-26T12:50:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90737fe640 1 -- 172.21.15.72:0/931432062 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918801d550 con 0x56015f5c10f0 2024-04-26T12:50:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015f5c29c0 con 0x56015f5c10f0 2024-04-26T12:50:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90737fe640 1 -- 172.21.15.72:0/931432062 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9188010070 con 0x56015f5c10f0 2024-04-26T12:50:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90737fe640 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90680346a0 0x7f9068036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90737fe640 1 -- 172.21.15.72:0/931432062 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f918803dc30 con 0x56015f5c10f0 2024-04-26T12:50:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f918d785640 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90680346a0 0x7f9068036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f919046b980 1 Processor -- start 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f919046b980 1 -- start start 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f918d785640 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90680346a0 0x7f9068036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x56015f5aa770 tx=0x7f9184005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f919046b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f919046b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56015f59c3f0 con 0x56015f5ce0c0 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49712/0 (socket says 172.21.15.72:49712) 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f918df86640 1 -- 172.21.15.72:0/1533207085 learned_addr learned my addr 172.21.15.72:0/1533207085 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f918df86640 1 -- 172.21.15.72:0/1533207085 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015f5ceab0 con 0x56015f5ce0c0 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f918df86640 1 --2- 172.21.15.72:0/1533207085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5ce4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f918803dfd0 tx=0x7f91880266a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399d6c9db616fe12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90717fa640 1 -- 172.21.15.72:0/1533207085 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188027c90 con 0x56015f5ce0c0 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90717fa640 1 -- 172.21.15.72:0/1533207085 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918804d060 con 0x56015f5ce0c0 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.744+0000 7f90717fa640 1 -- 172.21.15.72:0/1533207085 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188048bc0 con 0x56015f5ce0c0 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/1533207085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 msgr2=0x56015f5ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 --2- 172.21.15.72:0/1533207085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5ce4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f918803dfd0 tx=0x7f91880266a0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/1533207085 shutdown_connections 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 --2- 172.21.15.72:0/1533207085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5ce4e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/1533207085 >> 172.21.15.72:0/1533207085 conn(0x56015f5ca400 msgr2=0x56015f5c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/1533207085 shutdown_connections 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/1533207085 wait complete. 2024-04-26T12:50:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 Processor -- start 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- start start 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56015f5cf130 con 0x56015f5ce0c0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f918df86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5d53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49728/0 (socket says 172.21.15.72:49728) 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 learned_addr learned my addr 172.21.15.72:0/4170245852 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015f5d58e0 con 0x56015f5ce0c0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f918df86640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5d53a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9188047150 tx=0x7f918801f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f905f7fe640 1 -- 172.21.15.72:0/4170245852 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188041730 con 0x56015f5ce0c0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56015f5d58e0 con 0x56015f5ce0c0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f905f7fe640 1 -- 172.21.15.72:0/4170245852 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188067030 con 0x56015f5ce0c0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015f5d58e0 con 0x56015f5ce0c0 2024-04-26T12:50:15.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f905f7fe640 1 -- 172.21.15.72:0/4170245852 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188071060 con 0x56015f5ce0c0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f905f7fe640 1 -- 172.21.15.72:0/4170245852 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9188027400 con 0x56015f5ce0c0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f905f7fe640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90580345b0 0x7f9058036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f905f7fe640 1 -- 172.21.15.72:0/4170245852 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f9188059030 con 0x56015f5ce0c0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f918d785640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90580345b0 0x7f9058036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f5e0330 0x56015f5e27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e2f10 con 0x56015f5e0330 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.748+0000 7f918e787640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f5e0330 0x56015f5e27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918d785640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90580345b0 0x7f9058036a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9184018f70 tx=0x7f91840c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918e787640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f5e0330 0x56015f5e27c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91800083f0 con 0x56015f5e0330 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 realm 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3320 con 0x56015f5e0330 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91800083f0 con 0x56015f5e0330 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3bc0 con 0x56015f5e0330 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91800083f0 con 0x56015f5e0330 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91800083f0 con 0x56015f5e0330 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5e4cc0 0x56015f5e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e75f0 con 0x56015f5e4cc0 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918df86640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5e4cc0 0x56015f5e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918df86640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5e4cc0 0x56015f5e70b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 20 searching for the correct realm 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5e9560 0x56015f5eba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ec0f0 con 0x56015f5e9560 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918d785640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5e9560 0x56015f5eba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918d785640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5e9560 0x56015f5eba20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918d785640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f91840e0040 0x7f91840e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ec0f0 con 0x7f91840e0040 2024-04-26T12:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918e787640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f91840e0040 0x7f91840e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.752+0000 7f918e787640 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f91840e0040 0x7f91840e0420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91800083f0 con 0x7f91840e0040 2024-04-26T12:50:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91800083f0 con 0x56015f5e0330 2024-04-26T12:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x7f91840e0040 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x7f91840e0040 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.756+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x7f91840e0040 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9180026040 con 0x7f91840e0040 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x7f91840e0040 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x7f91840e0040 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.760+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x7f91840e0040 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x7f91840e0040 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e9560 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e4cc0 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x56015f5e0330 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e3f60 con 0x7f91840e0040 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9180026040 con 0x7f91840e0040 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e7e40 con 0x56015f5e0330 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.764+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e7e40 con 0x56015f5e0330 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9180026040 con 0x56015f5e0330 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e7e40 con 0x56015f5e9560 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 zone default found 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 4 Realm: () 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:15.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 zonegroup default 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5e86e0 con 0x56015f5e4cc0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5edf50 con 0x56015f5e9560 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ee2f0 con 0x56015f5e9560 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 started sync module instance, tier type = 2024-04-26T12:50:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ed3f0 con 0x7f91840e0040 2024-04-26T12:50:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180026040 con 0x7f91840e0040 2024-04-26T12:50:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94563895007504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ed3f0 con 0x7f91840e0040 2024-04-26T12:50:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5eed20 con 0x56015f5e0330 2024-04-26T12:50:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.768+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94563895007504] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x7f91840e0040 2024-04-26T12:50:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.772+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.772+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94563895011376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ed3f0 con 0x56015f5e0330 2024-04-26T12:50:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.772+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ef760 con 0x56015f5e9560 2024-04-26T12:50:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.772+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94563895011376] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.776+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.776+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94563895004992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ed360 con 0x56015f5e9560 2024-04-26T12:50:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.776+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f04b0 con 0x7f91840e0040 2024-04-26T12:50:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x7f91840e0040 2024-04-26T12:50:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94563895017744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f0ba0 con 0x7f91840e0040 2024-04-26T12:50:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f16a0 con 0x56015f5e0330 2024-04-26T12:50:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94563895004992] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94563895017744] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x7f91840e0040 2024-04-26T12:50:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94563895021968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f1660 con 0x56015f5e0330 2024-04-26T12:50:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.780+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f1ac0 con 0x56015f5e4cc0 2024-04-26T12:50:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94563895021968] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94563895018992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f1e60 con 0x56015f5e4cc0 2024-04-26T12:50:15.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f2710 con 0x56015f5e4cc0 2024-04-26T12:50:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94563895028528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f3400 con 0x56015f5e4cc0 2024-04-26T12:50:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f3e00 con 0x56015f5e4cc0 2024-04-26T12:50:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.784+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94563895018992] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94563895028528] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94563895016272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f3400 con 0x56015f5e4cc0 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=0 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=1 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=2 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=3 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=4 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=5 2024-04-26T12:50:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=6 2024-04-26T12:50:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94563895016272] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 20 add_watcher() i=7 2024-04-26T12:50:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f6cb0 con 0x56015f5e0330 2024-04-26T12:50:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.788+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94563895030048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f4170 con 0x56015f5e0330 2024-04-26T12:50:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94563895030048] v33'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f903f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 5 note: GC not initialized 2024-04-26T12:50:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f903e7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 20 Filter name: none 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f8faffff640 20 reqs_thread_entry: start 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56015f61a020 con 0x56015f5e0330 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:50:15.792 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f903f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94563895030048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f618a70 con 0x56015f5e0330 2024-04-26T12:50:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94563895030048] v33'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.792+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94563895007504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f30f0 con 0x7f91840e0040 2024-04-26T12:50:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.796+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94563895007504] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x7f91840e0040 2024-04-26T12:50:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.796+0000 7f919046b980 20 remove_watcher() i=0 2024-04-26T12:50:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.796+0000 7f919046b980 2 removed watcher, disabling cache 2024-04-26T12:50:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.796+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94563895011376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ed8f0 con 0x56015f5e0330 2024-04-26T12:50:15.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.796+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94563895011376] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.796+0000 7f919046b980 20 remove_watcher() i=1 2024-04-26T12:50:15.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.796+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94563895004992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ee830 con 0x56015f5e9560 2024-04-26T12:50:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f918d785640 1 -- 172.21.15.72:0/4170245852 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94563895004992] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91840aaac0 con 0x56015f5e9560 2024-04-26T12:50:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f919046b980 20 remove_watcher() i=2 2024-04-26T12:50:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94563895017744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ee830 con 0x7f91840e0040 2024-04-26T12:50:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94563895017744] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x7f91840e0040 2024-04-26T12:50:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f919046b980 20 remove_watcher() i=3 2024-04-26T12:50:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94563895021968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f0110 con 0x56015f5e0330 2024-04-26T12:50:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94563895021968] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9180036040 con 0x56015f5e0330 2024-04-26T12:50:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f919046b980 20 remove_watcher() i=4 2024-04-26T12:50:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.800+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94563895018992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ee830 con 0x56015f5e4cc0 2024-04-26T12:50:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.804+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94563895018992] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.804+0000 7f919046b980 20 remove_watcher() i=5 2024-04-26T12:50:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.804+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94563895028528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5f0110 con 0x56015f5e4cc0 2024-04-26T12:50:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.804+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94563895028528] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.804+0000 7f919046b980 20 remove_watcher() i=6 2024-04-26T12:50:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.804+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94563895016272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56015f5ee830 con 0x56015f5e4cc0 2024-04-26T12:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f918df86640 1 -- 172.21.15.72:0/4170245852 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94563895016272] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918803a070 con 0x56015f5e4cc0 2024-04-26T12:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 20 remove_watcher() i=7 2024-04-26T12:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5e4cc0 msgr2=0x56015f5e70b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5e4cc0 0x56015f5e70b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f5e0330 msgr2=0x56015f5e27c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f5e0330 0x56015f5e27c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f91840e0040 msgr2=0x7f91840e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f91840e0040 0x7f91840e0420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5e9560 msgr2=0x56015f5eba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5e9560 0x56015f5eba20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90580345b0 msgr2=0x7f9058036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90580345b0 0x7f9058036a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9184018f70 tx=0x7f91840c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 msgr2=0x56015f5d53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f918e787640 1 -- 172.21.15.72:0/4170245852 reap_dead start 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5d53a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9188047150 tx=0x7f918801f0d0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 shutdown_connections 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/4170245852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5ce0c0 0x56015f5d53a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 >> 172.21.15.72:0/4170245852 conn(0x56015f5ca400 msgr2=0x56015f5c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 shutdown_connections 2024-04-26T12:50:15.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/4170245852 wait complete. 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90680346a0 msgr2=0x7f9068036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90680346a0 0x7f9068036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x56015f5aa770 tx=0x7f9184005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5c10f0 msgr2=0x56015f5c1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5c10f0 0x56015f5c1510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91880069a0 tx=0x7f9188028ea0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 shutdown_connections 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90680346a0 0x7f9068036b60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/931432062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f5c10f0 0x56015f5c1510 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 >> 172.21.15.72:0/931432062 conn(0x56015f5b5f00 msgr2=0x56015f5b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 shutdown_connections 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/931432062 wait complete. 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5ac5f0 msgr2=0x56015f5ae9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56015f5ac5f0 0x56015f5ae9e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f424950 msgr2=0x56015f5a9c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56015f424950 0x56015f5a9c70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5b0530 msgr2=0x56015f5b2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56015f5b0530 0x56015f5b2920 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9074034740 msgr2=0x7f9074036c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9074034740 0x7f9074036c00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91840ae000 tx=0x7f91840a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 msgr2=0x56015f5a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 --2- 172.21.15.72:0/2366089493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56015f423610 0x56015f5a2d30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9188006640 tx=0x7f9188000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f918e787640 1 -- 172.21.15.72:0/2366089493 reap_dead start 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 shutdown_connections 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 >> 172.21.15.72:0/2366089493 conn(0x56015f4a9b90 msgr2=0x56015f596170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 shutdown_connections 2024-04-26T12:50:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.808+0000 7f919046b980 1 -- 172.21.15.72:0/2366089493 wait complete. 2024-04-26T12:50:15.816 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:15.817 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-26T12:50:15.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-26T12:50:15.817 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-26T12:50:15.888 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbfc46c980 1 Processor -- start 2024-04-26T12:50:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbfc46c980 1 -- start start 2024-04-26T12:50:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbfc46c980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562aaeac42a0 0x562aaeac4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbfc46c980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562aae971510 con 0x562aaeac4bc0 2024-04-26T12:50:15.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbfc46c980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x562aae978430 con 0x562aaeac42a0 2024-04-26T12:50:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbf9f87640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562aaeac42a0 0x562aaeac4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbf9786640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x562aaeac4bc0 0x562aaeac5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36060/0 (socket says 172.21.15.72:36060) 2024-04-26T12:50:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbf9f87640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562aaeac42a0 0x562aaeac4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49740/0 (socket says 172.21.15.72:49740) 2024-04-26T12:50:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbf9786640 1 -- 172.21.15.72:0/579172726 learned_addr learned my addr 172.21.15.72:0/579172726 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:15.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbf9f87640 1 -- 172.21.15.72:0/579172726 >> v1:172.21.15.29:6789/0 conn(0x562aaeac4bc0 legacy=0x562aaeac5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.888+0000 7efbf9f87640 1 -- 172.21.15.72:0/579172726 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aae94dae0 con 0x562aaeac42a0 2024-04-26T12:50:15.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbf9f87640 1 --2- 172.21.15.72:0/579172726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaeac4680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efbf400a420 tx=0x7efbf401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb6095f916da797 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbf8f85640 1 -- 172.21.15.72:0/579172726 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40af070 con 0x562aaeac42a0 2024-04-26T12:50:15.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbf8f85640 1 -- 172.21.15.72:0/579172726 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40aa530 con 0x562aaeac42a0 2024-04-26T12:50:15.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbf8f85640 1 -- 172.21.15.72:0/579172726 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40aa850 con 0x562aaeac42a0 2024-04-26T12:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbfc46c980 1 -- 172.21.15.72:0/579172726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 msgr2=0x562aaeac4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbfc46c980 1 --2- 172.21.15.72:0/579172726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaeac4680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efbf400a420 tx=0x7efbf401afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbfc46c980 1 -- 172.21.15.72:0/579172726 shutdown_connections 2024-04-26T12:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbfc46c980 1 --2- 172.21.15.72:0/579172726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaeac4680 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbfc46c980 1 -- 172.21.15.72:0/579172726 >> 172.21.15.72:0/579172726 conn(0x562aaeabfb70 msgr2=0x562aaeac1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbfc46c980 1 -- 172.21.15.72:0/579172726 shutdown_connections 2024-04-26T12:50:15.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.892+0000 7efbfc46c980 1 -- 172.21.15.72:0/579172726 wait complete. 2024-04-26T12:50:15.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.904+0000 7efbfc46c980 1 Processor -- start 2024-04-26T12:50:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.904+0000 7efbfc46c980 1 -- start start 2024-04-26T12:50:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.904+0000 7efbfc46c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebafb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.904+0000 7efbfc46c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562aae9c7a70 con 0x562aaeac42a0 2024-04-26T12:50:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebafb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebafb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49742/0 (socket says 172.21.15.72:49742) 2024-04-26T12:50:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 -- 172.21.15.72:0/1411607985 learned_addr learned my addr 172.21.15.72:0/1411607985 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 -- 172.21.15.72:0/1411607985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aaebb0160 con 0x562aaeac42a0 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 --2- 172.21.15.72:0/1411607985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebafb90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efbf40ad040 tx=0x7efbf40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8b2e2b42dbfb08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efae7e07640 1 -- 172.21.15.72:0/1411607985 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40af050 con 0x562aaeac42a0 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efae7e07640 1 -- 172.21.15.72:0/1411607985 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40b0040 con 0x562aaeac42a0 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efae7e07640 1 -- 172.21.15.72:0/1411607985 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40aaca0 con 0x562aaeac42a0 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 -- 172.21.15.72:0/1411607985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 msgr2=0x562aaebafb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 --2- 172.21.15.72:0/1411607985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebafb90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efbf40ad040 tx=0x7efbf40033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 -- 172.21.15.72:0/1411607985 shutdown_connections 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 --2- 172.21.15.72:0/1411607985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebafb90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 -- 172.21.15.72:0/1411607985 >> 172.21.15.72:0/1411607985 conn(0x562aaeabfb70 msgr2=0x562aaebab720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 -- 172.21.15.72:0/1411607985 shutdown_connections 2024-04-26T12:50:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 -- 172.21.15.72:0/1411607985 wait complete. 2024-04-26T12:50:15.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 Processor -- start 2024-04-26T12:50:15.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 -- start start 2024-04-26T12:50:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebb6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbfc46c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562aaeace2a0 con 0x562aaeac42a0 2024-04-26T12:50:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebb6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebb6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49756/0 (socket says 172.21.15.72:49756) 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 -- 172.21.15.72:0/3785913631 learned_addr learned my addr 172.21.15.72:0/3785913631 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aaebb71f0 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.908+0000 7efbf9f87640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebb6cb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efbf4018c00 tx=0x7efbf4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efae6604640 1 -- 172.21.15.72:0/3785913631 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40c5070 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562aaebb7480 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efae6604640 1 -- 172.21.15.72:0/3785913631 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40b6d60 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efae6604640 1 -- 172.21.15.72:0/3785913631 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40c15f0 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aaebba110 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efae6604640 1 -- 172.21.15.72:0/3785913631 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efbf40c8070 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efae6604640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efae00346a0 0x7efae0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efae6604640 1 -- 172.21.15.72:0/3785913631 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efbf40bb070 con 0x562aaeac42a0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbf9786640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efae00346a0 0x7efae0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaeac4bc0 0x562aaebbdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebbe2a0 con 0x562aaeac4bc0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfa788640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaeac4bc0 0x562aaebbdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbf9786640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efae00346a0 0x7efae0036b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efbf0001da0 tx=0x7efbf0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfa788640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaeac4bc0 0x562aaebbdd60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfa788640 1 -- 172.21.15.72:0/3785913631 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaeac4bc0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebbeb20 con 0x562aaeac4bc0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfa788640 1 -- 172.21.15.72:0/3785913631 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaeac4bc0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebc0470 0x562aaebc2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebc3090 con 0x562aaebc0470 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbf9f87640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebc0470 0x562aaebc2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.912+0000 7efbf9f87640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebc0470 0x562aaebc2900 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9f87640 1 -- 172.21.15.72:0/3785913631 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efbf40d1070 con 0x562aaebc0470 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebbf370 con 0x562aaeac4bc0 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfa788640 1 -- 172.21.15.72:0/3785913631 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaeac4bc0 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebc44f0 0x562aaebc68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebc6fd0 con 0x562aaebc44f0 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9786640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebc44f0 0x562aaebc68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9786640 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebc44f0 0x562aaebc68e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9786640 1 -- 172.21.15.72:0/3785913631 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebc44f0 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 Processor -- start 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 -- start start 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaea3a210 0x562aaea386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562aae9cbab0 con 0x562aaea3a210 2024-04-26T12:50:15.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaea3a210 0x562aaea386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaea3a210 0x562aaea386b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49764/0 (socket says 172.21.15.72:49764) 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9f87640 1 -- 172.21.15.72:0/3479446003 learned_addr learned my addr 172.21.15.72:0/3479446003 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9f87640 1 -- 172.21.15.72:0/3479446003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aaea38bf0 con 0x562aaea3a210 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbf9f87640 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaea3a210 0x562aaea386b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efbf40b6fd0 tx=0x7efbf40a9670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efadf7fe640 1 -- 172.21.15.72:0/3479446003 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40a9940 con 0x562aaea3a210 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562aaea38e80 con 0x562aaea3a210 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aaea39350 con 0x562aaea3a210 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efadf7fe640 1 -- 172.21.15.72:0/3479446003 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40e20d0 con 0x562aaea3a210 2024-04-26T12:50:15.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.916+0000 7efadf7fe640 1 -- 172.21.15.72:0/3479446003 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40a9ae0 con 0x562aaea3a210 2024-04-26T12:50:15.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efadf7fe640 1 -- 172.21.15.72:0/3479446003 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efbf40bfa30 con 0x562aaea3a210 2024-04-26T12:50:15.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efadf7fe640 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efad4034650 0x7efad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efadf7fe640 1 -- 172.21.15.72:0/3479446003 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efbf40d6ca0 con 0x562aaea3a210 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbf9786640 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efad4034650 0x7efad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 Processor -- start 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- start start 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebe46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562aaebb03f0 con 0x562aaebe42c0 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbf9786640 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efad4034650 0x7efad4036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562aaebbb490 tx=0x7efbf000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebe46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebe46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49772/0 (socket says 172.21.15.72:49772) 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbf9f87640 1 -- 172.21.15.72:0/29535624 learned_addr learned my addr 172.21.15.72:0/29535624 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbf9f87640 1 -- 172.21.15.72:0/29535624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aaebe4cb0 con 0x562aaebe42c0 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbf9f87640 1 --2- 172.21.15.72:0/29535624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebe46e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efbf40daf90 tx=0x7efbf40d3860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08175ed64c7b375 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efadd7fa640 1 -- 172.21.15.72:0/29535624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40df370 con 0x562aaebe42c0 2024-04-26T12:50:15.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efadd7fa640 1 -- 172.21.15.72:0/29535624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40f3070 con 0x562aaebe42c0 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efadd7fa640 1 -- 172.21.15.72:0/29535624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40cab50 con 0x562aaebe42c0 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- 172.21.15.72:0/29535624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 msgr2=0x562aaebe46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 --2- 172.21.15.72:0/29535624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebe46e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efbf40daf90 tx=0x7efbf40d3860 comp rx=0 tx=0).stop 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- 172.21.15.72:0/29535624 shutdown_connections 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 --2- 172.21.15.72:0/29535624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebe46e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- 172.21.15.72:0/29535624 >> 172.21.15.72:0/29535624 conn(0x562aaebe0600 msgr2=0x562aaebde660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- 172.21.15.72:0/29535624 shutdown_connections 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- 172.21.15.72:0/29535624 wait complete. 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 Processor -- start 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- start start 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebeb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.920+0000 7efbfc46c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562aaebe5370 con 0x562aaebe42c0 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebeb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbf9f87640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebeb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49774/0 (socket says 172.21.15.72:49774) 2024-04-26T12:50:15.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 learned_addr learned my addr 172.21.15.72:0/581876440 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aaebebae0 con 0x562aaebe42c0 2024-04-26T12:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbf9f87640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebeb5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efbf40e24e0 tx=0x7efbf40cfd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efacb7fe640 1 -- 172.21.15.72:0/581876440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4108070 con 0x562aaebe42c0 2024-04-26T12:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562aaebebae0 con 0x562aaebe42c0 2024-04-26T12:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efacb7fe640 1 -- 172.21.15.72:0/581876440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40ca450 con 0x562aaebe42c0 2024-04-26T12:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efacb7fe640 1 -- 172.21.15.72:0/581876440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf40d39b0 con 0x562aaebe42c0 2024-04-26T12:50:15.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aaebebae0 con 0x562aaebe42c0 2024-04-26T12:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efacb7fe640 1 -- 172.21.15.72:0/581876440 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efbf410b070 con 0x562aaebe42c0 2024-04-26T12:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efacb7fe640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efac4034650 0x7efac4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efacb7fe640 1 -- 172.21.15.72:0/581876440 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efbf40ff030 con 0x562aaebe42c0 2024-04-26T12:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbf9786640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efac4034650 0x7efac4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaebf6730 0x562aaebf8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebf9340 con 0x562aaebf6730 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfa788640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaebf6730 0x562aaebf8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbf9786640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efac4034650 0x7efac4036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x562aaebc73d0 tx=0x7efbf0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfa788640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaebf6730 0x562aaebf8bf0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaebf6730 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 20 realm 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebf9750 con 0x562aaebf6730 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaebf6730 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.924+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebf9ff0 con 0x562aaebf6730 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaebf6730 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaebf6730 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebfb0f0 0x562aaebfd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfdb30 con 0x562aaebfb0f0 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9f87640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebfb0f0 0x562aaebfd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9f87640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebfb0f0 0x562aaebfd4e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 20 searching for the correct realm 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebffa10 0x562aaec01e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaec02500 con 0x562aaebffa10 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9786640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebffa10 0x562aaec01e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9786640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebffa10 0x562aaec01e80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9786640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efbf0037040 0x7efbf0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaec02500 con 0x7efbf0037040 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfa788640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efbf0037040 0x7efbf0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfa788640 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efbf0037040 0x7efbf0036410 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec0083f0 con 0x7efbf0037040 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.928+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec0083f0 con 0x562aaebf6730 2024-04-26T12:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x7efbf0037040 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x7efbf0037040 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.932+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x7efbf0037040 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efbec026040 con 0x7efbf0037040 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x7efbf0037040 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x7efbf0037040 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.936+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x7efbf0037040 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x7efbf0037040 2024-04-26T12:50:15.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebffa10 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebfb0f0 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x562aaebf6730 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfa390 con 0x7efbf0037040 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efbec026040 con 0x7efbf0037040 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:15.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfe380 con 0x562aaebf6730 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfe380 con 0x562aaebf6730 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efbec026040 con 0x562aaebf6730 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfe380 con 0x562aaebffa10 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 zone default found 2024-04-26T12:50:15.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 4 Realm: () 2024-04-26T12:50:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 zonegroup default 2024-04-26T12:50:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.940+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaebfedd0 con 0x562aaebfb0f0 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaec04810 con 0x562aaebffa10 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaec04bb0 con 0x562aaebffa10 2024-04-26T12:50:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 20 started sync module instance, tier type = 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec03c50 con 0x7efbf0037040 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec026040 con 0x7efbf0037040 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94741320450112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec03c50 con 0x7efbf0037040 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec05440 con 0x562aaebf6730 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.944+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94741320450112] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94741320453968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec03c50 con 0x562aaebf6730 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec05e50 con 0x562aaebffa10 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94741320456608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec066a0 con 0x562aaebffa10 2024-04-26T12:50:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec070a0 con 0x7efbf0037040 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94741320453968] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94741320447904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec07490 con 0x7efbf0037040 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.948+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec07e50 con 0x562aaebf6730 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94741320456608] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94741320447904] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94741320461232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec079a0 con 0x562aaebf6730 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec081f0 con 0x562aaebfb0f0 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94741320461232] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94741320464800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec08270 con 0x562aaebfb0f0 2024-04-26T12:50:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.952+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec08ac0 con 0x562aaebfb0f0 2024-04-26T12:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94741320464800] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94741320466128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec088a0 con 0x562aaebfb0f0 2024-04-26T12:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec093c0 con 0x562aaebfb0f0 2024-04-26T12:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94741320470160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec09830 con 0x562aaebfb0f0 2024-04-26T12:50:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 20 add_watcher() i=0 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 20 add_watcher() i=1 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 20 add_watcher() i=2 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 20 add_watcher() i=3 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 20 add_watcher() i=4 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 20 add_watcher() i=5 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94741320466128] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.956+0000 7efbfc46c980 20 add_watcher() i=6 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94741320470160] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 add_watcher() i=7 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaec09830 con 0x562aaebf6730 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94741320471424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec097a0 con 0x562aaebf6730 2024-04-26T12:50:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94741320471424] v33'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efaabfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 5 note: GC not initialized 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efaaaffd640 20 reqs_thread_entry: start 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 Filter name: none 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efaa8ff9640 20 reqs_thread_entry: start 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaec301b0 con 0x562aaebf6730 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.960+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaec30ef0 con 0x7efbf0037040 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec36bc0 con 0x562aaebf6730 2024-04-26T12:50:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v33'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94741320656528 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaec33790 con 0x562aaebf6730 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94741320461232 notify 141733920775 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7efbec010040 con 0x562aaebf6730 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efadd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94741320461232 notifier 4398 bl.length()=849 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efadd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efadd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify cookie 94741320656528 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efadd7fa640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7efabc003eb0 con 0x562aaebf6730 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94741320656528 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efbec00acf0 con 0x562aaebf6730 2024-04-26T12:50:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.964+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec36690 con 0x7efbf0037040 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfc46c980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfc46c980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfc46c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94741320656528 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562aaec312c0 con 0x7efbf0037040 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== watch-notify(notify (1) cookie 94741320450112 notify 141733920771 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7efbec00acf0 con 0x7efbf0037040 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efadd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94741320450112 notifier 4398 bl.length()=166 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efadd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efadd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(68 notify.0 [notify cookie 94741320656528 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efadd7fa640 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7efabc003eb0 con 0x7efbf0037040 2024-04-26T12:50:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== watch-notify(notify_complete (2) cookie 94741320656528 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efbec02a520 con 0x7efbf0037040 2024-04-26T12:50:15.969 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:50:15.965681Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efaabfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94741320471424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x562aaebf6730 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94741320471424] v33'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94741320450112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x7efbf0037040 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.968+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94741320450112] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.972+0000 7efbfc46c980 20 remove_watcher() i=0 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.972+0000 7efbfc46c980 2 removed watcher, disabling cache 2024-04-26T12:50:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.972+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94741320453968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x562aaebf6730 2024-04-26T12:50:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.972+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94741320453968] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.972+0000 7efbfc46c980 20 remove_watcher() i=1 2024-04-26T12:50:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.972+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94741320456608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x562aaebffa10 2024-04-26T12:50:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbf9786640 1 -- 172.21.15.72:0/581876440 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94741320456608] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf000e6c0 con 0x562aaebffa10 2024-04-26T12:50:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfc46c980 20 remove_watcher() i=2 2024-04-26T12:50:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94741320447904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x7efbf0037040 2024-04-26T12:50:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94741320447904] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x7efbf0037040 2024-04-26T12:50:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfc46c980 20 remove_watcher() i=3 2024-04-26T12:50:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94741320461232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x562aaebf6730 2024-04-26T12:50:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94741320461232] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbec036040 con 0x562aaebf6730 2024-04-26T12:50:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfc46c980 20 remove_watcher() i=4 2024-04-26T12:50:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.976+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94741320464800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x562aaebfb0f0 2024-04-26T12:50:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.980+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94741320464800] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.980+0000 7efbfc46c980 20 remove_watcher() i=5 2024-04-26T12:50:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.980+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94741320466128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x562aaebfb0f0 2024-04-26T12:50:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.980+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94741320466128] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.980+0000 7efbfc46c980 20 remove_watcher() i=6 2024-04-26T12:50:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.980+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94741320470160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562aaec2dea0 con 0x562aaebfb0f0 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbf9f87640 1 -- 172.21.15.72:0/581876440 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94741320470160] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efbf410a030 con 0x562aaebfb0f0 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 20 remove_watcher() i=7 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebfb0f0 msgr2=0x562aaebfd4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebfb0f0 0x562aaebfd4e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaebf6730 msgr2=0x562aaebf8bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaebf6730 0x562aaebf8bf0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efbf0037040 msgr2=0x7efbf0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efbf0037040 0x7efbf0036410 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebffa10 msgr2=0x562aaec01e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebffa10 0x562aaec01e80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efac4034650 msgr2=0x7efac4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efac4034650 0x7efac4036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x562aaebc73d0 tx=0x7efbf0010000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 msgr2=0x562aaebeb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfa788640 1 -- 172.21.15.72:0/581876440 reap_dead start 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebeb5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efbf40e24e0 tx=0x7efbf40cfd70 comp rx=0 tx=0).stop 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 shutdown_connections 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/581876440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaebe42c0 0x562aaebeb5a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 >> 172.21.15.72:0/581876440 conn(0x562aaebe0600 msgr2=0x562aaebde630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 shutdown_connections 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/581876440 wait complete. 2024-04-26T12:50:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efad4034650 msgr2=0x7efad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efad4034650 0x7efad4036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562aaebbb490 tx=0x7efbf000f000 comp rx=0 tx=0).stop 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaea3a210 msgr2=0x562aaea386b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaea3a210 0x562aaea386b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efbf40b6fd0 tx=0x7efbf40a9670 comp rx=0 tx=0).stop 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 shutdown_connections 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efad4034650 0x7efad4036b10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3479446003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaea3a210 0x562aaea386b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 >> 172.21.15.72:0/3479446003 conn(0x562aaebc9e70 msgr2=0x562aaebca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 shutdown_connections 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3479446003 wait complete. 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebc0470 msgr2=0x562aaebc2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562aaebc0470 0x562aaebc2900 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaeac4bc0 msgr2=0x562aaebbdd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562aaeac4bc0 0x562aaebbdd60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebc44f0 msgr2=0x562aaebc68e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562aaebc44f0 0x562aaebc68e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efae00346a0 msgr2=0x7efae0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efae00346a0 0x7efae0036b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efbf0001da0 tx=0x7efbf0001300 comp rx=0 tx=0).stop 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 msgr2=0x562aaebb6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 --2- 172.21.15.72:0/3785913631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562aaeac42a0 0x562aaebb6cb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efbf4018c00 tx=0x7efbf4019810 comp rx=0 tx=0).stop 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfa788640 1 -- 172.21.15.72:0/3785913631 reap_dead start 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 shutdown_connections 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 >> 172.21.15.72:0/3785913631 conn(0x562aaeabfb70 msgr2=0x562aaebaa230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 shutdown_connections 2024-04-26T12:50:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:15.984+0000 7efbfc46c980 1 -- 172.21.15.72:0/3785913631 wait complete. 2024-04-26T12:50:15.993 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:50:15.965681Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:15.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:50:15.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:50:15.994 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:50:16.069 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8c64d980 1 Processor -- start 2024-04-26T12:50:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8c64d980 1 -- start start 2024-04-26T12:50:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8c64d980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557749d5ba40 0x557749d5be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8c64d980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557749c07510 con 0x557749d5c360 2024-04-26T12:50:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8c64d980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x557749c0e430 con 0x557749d5ba40 2024-04-26T12:50:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8a168640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557749d5ba40 0x557749d5be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c89967640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x557749d5c360 0x557749d584b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36066/0 (socket says 172.21.15.72:36066) 2024-04-26T12:50:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c89967640 1 -- 172.21.15.72:0/3719691744 learned_addr learned my addr 172.21.15.72:0/3719691744 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8a168640 1 -- 172.21.15.72:0/3719691744 >> v1:172.21.15.29:6789/0 conn(0x557749d5c360 legacy=0x557749d584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.072+0000 7f6c8a168640 1 -- 172.21.15.72:0/3719691744 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557749be3ae0 con 0x557749d5ba40 2024-04-26T12:50:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8a168640 1 --2- 172.21.15.72:0/3719691744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749d5be20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00a420 tx=0x7f6c7c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a518cd556a452dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c89166640 1 -- 172.21.15.72:0/3719691744 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0b0070 con 0x557749d5ba40 2024-04-26T12:50:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c89166640 1 -- 172.21.15.72:0/3719691744 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0a3df0 con 0x557749d5ba40 2024-04-26T12:50:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c89166640 1 -- 172.21.15.72:0/3719691744 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0ab570 con 0x557749d5ba40 2024-04-26T12:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3719691744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 msgr2=0x557749d5be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/3719691744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749d5be20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00a420 tx=0x7f6c7c01afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3719691744 shutdown_connections 2024-04-26T12:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/3719691744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749d5be20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3719691744 >> 172.21.15.72:0/3719691744 conn(0x557749d541f0 msgr2=0x557749d56610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3719691744 shutdown_connections 2024-04-26T12:50:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.076+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3719691744 wait complete. 2024-04-26T12:50:16.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8c64d980 1 Processor -- start 2024-04-26T12:50:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8c64d980 1 -- start start 2024-04-26T12:50:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8c64d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e45ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8c64d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557749c5da70 con 0x557749d5ba40 2024-04-26T12:50:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e45ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e45ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49778/0 (socket says 172.21.15.72:49778) 2024-04-26T12:50:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8a168640 1 -- 172.21.15.72:0/3583943550 learned_addr learned my addr 172.21.15.72:0/3583943550 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8a168640 1 -- 172.21.15.72:0/3583943550 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557749e46270 con 0x557749d5ba40 2024-04-26T12:50:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8a168640 1 --2- 172.21.15.72:0/3583943550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e45ca0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00a420 tx=0x7f6c7c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6b82cbfb02f43e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6b78608640 1 -- 172.21.15.72:0/3583943550 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0b0040 con 0x557749d5ba40 2024-04-26T12:50:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6b78608640 1 -- 172.21.15.72:0/3583943550 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0ab5f0 con 0x557749d5ba40 2024-04-26T12:50:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6b78608640 1 -- 172.21.15.72:0/3583943550 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0ab910 con 0x557749d5ba40 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3583943550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 msgr2=0x557749e45ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.088+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/3583943550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e45ca0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00a420 tx=0x7f6c7c0033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3583943550 shutdown_connections 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/3583943550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e45ca0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3583943550 >> 172.21.15.72:0/3583943550 conn(0x557749d541f0 msgr2=0x557749e41830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3583943550 shutdown_connections 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- 172.21.15.72:0/3583943550 wait complete. 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 Processor -- start 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- start start 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e4cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557749d64540 con 0x557749d5ba40 2024-04-26T12:50:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e4cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e4cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49790/0 (socket says 172.21.15.72:49790) 2024-04-26T12:50:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8a168640 1 -- 172.21.15.72:0/4107115458 learned_addr learned my addr 172.21.15.72:0/4107115458 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8a168640 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557749e4d2e0 con 0x557749d5ba40 2024-04-26T12:50:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8a168640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e4cda0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007040 tx=0x7f6c7c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6b76e05640 1 -- 172.21.15.72:0/4107115458 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0b8040 con 0x557749d5ba40 2024-04-26T12:50:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557749e4d570 con 0x557749d5ba40 2024-04-26T12:50:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6b76e05640 1 -- 172.21.15.72:0/4107115458 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0a39a0 con 0x557749d5ba40 2024-04-26T12:50:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6b76e05640 1 -- 172.21.15.72:0/4107115458 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0b0040 con 0x557749d5ba40 2024-04-26T12:50:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557749e501a0 con 0x557749d5ba40 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6b76e05640 1 -- 172.21.15.72:0/4107115458 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c7c0b48c0 con 0x557749d5ba40 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6b76e05640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b70034650 0x7f6b70036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6b76e05640 1 -- 172.21.15.72:0/4107115458 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f6c7c0e3c00 con 0x557749d5ba40 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c89967640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b70034650 0x7f6b70036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749d5c360 0x557749e53df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e543c0 con 0x557749d5c360 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c8a969640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749d5c360 0x557749e53df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.092+0000 7f6c89967640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b70034650 0x7f6b70036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c80001da0 tx=0x7f6c80001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8a969640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749d5c360 0x557749e53df0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8a969640 1 -- 172.21.15.72:0/4107115458 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840083f0 con 0x557749d5c360 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e513a0 con 0x557749d5c360 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8a969640 1 -- 172.21.15.72:0/4107115458 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c840083f0 con 0x557749d5c360 2024-04-26T12:50:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e56740 0x557749e58b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e59220 con 0x557749e56740 2024-04-26T12:50:16.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8a168640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e56740 0x557749e58b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8a168640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e56740 0x557749e58b30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8a168640 1 -- 172.21.15.72:0/4107115458 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e56740 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e555e0 con 0x557749d5c360 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8a969640 1 -- 172.21.15.72:0/4107115458 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c840083f0 con 0x557749d5c360 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e5a680 0x557749e5ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e5d1b0 con 0x557749e5a680 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c89967640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e5a680 0x557749e5ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c89967640 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e5a680 0x557749e5ca70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c89967640 1 -- 172.21.15.72:0/4107115458 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e5a680 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.096+0000 7f6c8c64d980 1 Processor -- start 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 -- start start 2024-04-26T12:50:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5b360 0x557749d59800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557749c61ab0 con 0x557749d5b360 2024-04-26T12:50:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5b360 0x557749d59800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5b360 0x557749d59800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49792/0 (socket says 172.21.15.72:49792) 2024-04-26T12:50:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8a168640 1 -- 172.21.15.72:0/4105709932 learned_addr learned my addr 172.21.15.72:0/4105709932 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8a168640 1 -- 172.21.15.72:0/4105709932 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557749d59d40 con 0x557749d5b360 2024-04-26T12:50:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8a168640 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5b360 0x557749d59800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0befd0 tx=0x7f6c7c0b3f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6b6ffff640 1 -- 172.21.15.72:0/4105709932 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0e35e0 con 0x557749d5b360 2024-04-26T12:50:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557749d59fd0 con 0x557749d5b360 2024-04-26T12:50:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6b6ffff640 1 -- 172.21.15.72:0/4105709932 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0e3780 con 0x557749d5b360 2024-04-26T12:50:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6b6ffff640 1 -- 172.21.15.72:0/4105709932 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0c6560 con 0x557749d5b360 2024-04-26T12:50:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557749d5a4a0 con 0x557749d5b360 2024-04-26T12:50:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6b6ffff640 1 -- 172.21.15.72:0/4105709932 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c7c0c6700 con 0x557749d5b360 2024-04-26T12:50:16.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6b6ffff640 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b640346a0 0x7f6b64036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6b6ffff640 1 -- 172.21.15.72:0/4105709932 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f6c7c0db070 con 0x557749d5b360 2024-04-26T12:50:16.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c89967640 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b640346a0 0x7f6b64036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 Processor -- start 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 -- start start 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c89967640 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b640346a0 0x7f6b64036b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557749e548e0 tx=0x7f6c8000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.100+0000 7f6c8c64d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557749e46500 con 0x557749e7a3d0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e7a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e7a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49806/0 (socket says 172.21.15.72:49806) 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 -- 172.21.15.72:0/4216295064 learned_addr learned my addr 172.21.15.72:0/4216295064 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 -- 172.21.15.72:0/4216295064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557749e7ad80 con 0x557749e7a3d0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 --2- 172.21.15.72:0/4216295064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e7a7b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0bbd10 tx=0x7f6c7c0dd8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17088e2389359a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6b6dffb640 1 -- 172.21.15.72:0/4216295064 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0c6bc0 con 0x557749e7a3d0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6b6dffb640 1 -- 172.21.15.72:0/4216295064 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0b6bb0 con 0x557749e7a3d0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6b6dffb640 1 -- 172.21.15.72:0/4216295064 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0b6e90 con 0x557749e7a3d0 2024-04-26T12:50:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4216295064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 msgr2=0x557749e7a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4216295064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e7a7b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0bbd10 tx=0x7f6c7c0dd8e0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4216295064 shutdown_connections 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4216295064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e7a7b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4216295064 >> 172.21.15.72:0/4216295064 conn(0x557749e76710 msgr2=0x557749e74770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4216295064 shutdown_connections 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4216295064 wait complete. 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 Processor -- start 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- start start 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e816a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557749e7b480 con 0x557749e7a3d0 2024-04-26T12:50:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e816a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49814/0 (socket says 172.21.15.72:49814) 2024-04-26T12:50:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 learned_addr learned my addr 172.21.15.72:0/554492446 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557749e81be0 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8a168640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e816a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c008030 tx=0x7f6c7c0d7700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6b5bfff640 1 -- 172.21.15.72:0/554492446 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0dddf0 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557749e81be0 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6b5bfff640 1 -- 172.21.15.72:0/554492446 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0d7050 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6b5bfff640 1 -- 172.21.15.72:0/554492446 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0d7370 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.104+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557749e820b0 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6b5bfff640 1 -- 172.21.15.72:0/554492446 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c7c0ff030 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6b5bfff640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b540346a0 0x7f6b54036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6b5bfff640 1 -- 172.21.15.72:0/554492446 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f6c7c0b01e0 con 0x557749e7a3d0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c89967640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b540346a0 0x7f6b54036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749e8c7a0 0x557749e8ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e8f380 con 0x557749e8c7a0 2024-04-26T12:50:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a969640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749e8c7a0 0x557749e8ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c89967640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b540346a0 0x7f6b54036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x557749e5d5b0 tx=0x7f6c80010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a969640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749e8c7a0 0x557749e8ec30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840083f0 con 0x557749e8c7a0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 realm 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e8f790 con 0x557749e8c7a0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840083f0 con 0x557749e8c7a0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e90030 con 0x557749e8c7a0 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c840083f0 con 0x557749e8c7a0 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c840083f0 con 0x557749e8c7a0 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e91130 0x557749e93520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e93a60 con 0x557749e91130 2024-04-26T12:50:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a168640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e91130 0x557749e93520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.108+0000 7f6c8a168640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e91130 0x557749e93520 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8c64d980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8c64d980 20 searching for the correct realm 2024-04-26T12:50:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e959d0 0x557749e97e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e98560 con 0x557749e959d0 2024-04-26T12:50:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c89967640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e959d0 0x557749e97e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c89967640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e959d0 0x557749e97e90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c89967640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6c80037040 0x7f6c80036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e98560 con 0x7f6c80037040 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6c80037040 0x7f6c80036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6c80037040 0x7f6c80036410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840083f0 con 0x7f6c80037040 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840083f0 con 0x557749e8c7a0 2024-04-26T12:50:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.112+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x7f6c80037040 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x7f6c80037040 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x7f6c80037040 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c84026040 con 0x7f6c80037040 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.116+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x7f6c80037040 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x7f6c80037040 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x7f6c80037040 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x7f6c80037040 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e959d0 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e91130 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.120+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x557749e8c7a0 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557749e903d0 con 0x7f6c80037040 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84026040 con 0x7f6c80037040 2024-04-26T12:50:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e942b0 con 0x557749e8c7a0 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e942b0 con 0x557749e8c7a0 2024-04-26T12:50:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c84026040 con 0x557749e8c7a0 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e942b0 con 0x557749e959d0 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 zone default found 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 4 Realm: () 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 zonegroup default 2024-04-26T12:50:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e94b50 con 0x557749e91130 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e9a3c0 con 0x557749e959d0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749e9a760 con 0x557749e959d0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 started sync module instance, tier type = 2024-04-26T12:50:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e99860 con 0x7f6c80037040 2024-04-26T12:50:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84026040 con 0x7f6c80037040 2024-04-26T12:50:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93970829516208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e99860 con 0x7f6c80037040 2024-04-26T12:50:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.124+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9b1f0 con 0x557749e8c7a0 2024-04-26T12:50:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93970829516208] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x7f6c80037040 2024-04-26T12:50:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93970829520064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e99860 con 0x557749e8c7a0 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9bc00 con 0x557749e959d0 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93970829520064] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93970829513648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e997d0 con 0x557749e959d0 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.128+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9c950 con 0x7f6c80037040 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x7f6c80037040 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93970829526448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9d040 con 0x7f6c80037040 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9db60 con 0x557749e8c7a0 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93970829513648] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93970829526448] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x7f6c80037040 2024-04-26T12:50:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93970829530672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9db20 con 0x557749e8c7a0 2024-04-26T12:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.132+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9df50 con 0x557749e91130 2024-04-26T12:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93970829530672] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93970829527696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9e340 con 0x557749e91130 2024-04-26T12:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9ebd0 con 0x557749e91130 2024-04-26T12:50:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93970829527696] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93970829524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9e800 con 0x557749e91130 2024-04-26T12:50:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.136+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9f9b0 con 0x557749e91130 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93970829524976] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93970829538432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9f970 con 0x557749e91130 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=0 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=1 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=2 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=3 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=4 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=5 2024-04-26T12:50:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=6 2024-04-26T12:50:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93970829538432] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 20 add_watcher() i=7 2024-04-26T12:50:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749ea2e00 con 0x557749e8c7a0 2024-04-26T12:50:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.140+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93970829536688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749ea02c0 con 0x557749e8c7a0 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93970829536688] v33'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6b40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 5 note: GC not initialized 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6abb7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 20 Filter name: none 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6ab97fa640 20 reqs_thread_entry: start 2024-04-26T12:50:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557749ec61e0 con 0x557749e8c7a0 2024-04-26T12:50:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 20 rados_obj.operate() r=0 bl.length=673 2024-04-26T12:50:16.144 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:50:15.965681Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6b40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93970829536688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749ec6720 con 0x557749e8c7a0 2024-04-26T12:50:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93970829536688] v33'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.144+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93970829516208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9edb0 con 0x7f6c80037040 2024-04-26T12:50:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93970829516208] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x7f6c80037040 2024-04-26T12:50:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8c64d980 20 remove_watcher() i=0 2024-04-26T12:50:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8c64d980 2 removed watcher, disabling cache 2024-04-26T12:50:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93970829520064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9edb0 con 0x557749e8c7a0 2024-04-26T12:50:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93970829520064] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8c64d980 20 remove_watcher() i=1 2024-04-26T12:50:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93970829513648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9edb0 con 0x557749e959d0 2024-04-26T12:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c89967640 1 -- 172.21.15.72:0/554492446 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93970829513648] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8000e6c0 con 0x557749e959d0 2024-04-26T12:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8c64d980 20 remove_watcher() i=2 2024-04-26T12:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.148+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93970829526448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e993b0 con 0x7f6c80037040 2024-04-26T12:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.152+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93970829526448] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x7f6c80037040 2024-04-26T12:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.152+0000 7f6c8c64d980 20 remove_watcher() i=3 2024-04-26T12:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.152+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93970829530672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9edb0 con 0x557749e8c7a0 2024-04-26T12:50:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.152+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93970829530672] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84036040 con 0x557749e8c7a0 2024-04-26T12:50:16.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.152+0000 7f6c8c64d980 20 remove_watcher() i=4 2024-04-26T12:50:16.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.152+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93970829527696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9c5b0 con 0x557749e91130 2024-04-26T12:50:16.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.156+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93970829527696] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.156+0000 7f6c8c64d980 20 remove_watcher() i=5 2024-04-26T12:50:16.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.156+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93970829524976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e993b0 con 0x557749e91130 2024-04-26T12:50:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.156+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93970829524976] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.156+0000 7f6c8c64d980 20 remove_watcher() i=6 2024-04-26T12:50:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.156+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93970829538432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557749e9d630 con 0x557749e91130 2024-04-26T12:50:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8a168640 1 -- 172.21.15.72:0/554492446 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93970829538432] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c7c0be410 con 0x557749e91130 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 20 remove_watcher() i=7 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e91130 msgr2=0x557749e93520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e91130 0x557749e93520 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749e8c7a0 msgr2=0x557749e8ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749e8c7a0 0x557749e8ec30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6c80037040 msgr2=0x7f6c80036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6c80037040 0x7f6c80036410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e959d0 msgr2=0x557749e97e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e959d0 0x557749e97e90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b540346a0 msgr2=0x7f6b54036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b540346a0 0x7f6b54036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x557749e5d5b0 tx=0x7f6c80010000 comp rx=0 tx=0).stop 2024-04-26T12:50:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8a969640 1 -- 172.21.15.72:0/554492446 reap_dead start 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 msgr2=0x557749e816a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e816a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c008030 tx=0x7f6c7c0d7700 comp rx=0 tx=0).stop 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 shutdown_connections 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/554492446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749e7a3d0 0x557749e816a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 >> 172.21.15.72:0/554492446 conn(0x557749e76710 msgr2=0x557749e73d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 shutdown_connections 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/554492446 wait complete. 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b640346a0 msgr2=0x7f6b64036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b640346a0 0x7f6b64036b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557749e548e0 tx=0x7f6c8000f000 comp rx=0 tx=0).stop 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5b360 msgr2=0x557749d59800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5b360 0x557749d59800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0befd0 tx=0x7f6c7c0b3f10 comp rx=0 tx=0).stop 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 shutdown_connections 2024-04-26T12:50:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b640346a0 0x7f6b64036b60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4105709932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5b360 0x557749d59800 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 >> 172.21.15.72:0/4105709932 conn(0x557749e60050 msgr2=0x557749e60b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 shutdown_connections 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4105709932 wait complete. 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e56740 msgr2=0x557749e58b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557749e56740 0x557749e58b30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749d5c360 msgr2=0x557749e53df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557749d5c360 0x557749e53df0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e5a680 msgr2=0x557749e5ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557749e5a680 0x557749e5ca70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b70034650 msgr2=0x7f6b70036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6b70034650 0x7f6b70036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c80001da0 tx=0x7f6c80001300 comp rx=0 tx=0).stop 2024-04-26T12:50:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 msgr2=0x557749e4cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 --2- 172.21.15.72:0/4107115458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557749d5ba40 0x557749e4cda0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007040 tx=0x7f6c7c017d70 comp rx=0 tx=0).stop 2024-04-26T12:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8a969640 1 -- 172.21.15.72:0/4107115458 reap_dead start 2024-04-26T12:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 shutdown_connections 2024-04-26T12:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 >> 172.21.15.72:0/4107115458 conn(0x557749d541f0 msgr2=0x557749e40340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 shutdown_connections 2024-04-26T12:50:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.160+0000 7f6c8c64d980 1 -- 172.21.15.72:0/4107115458 wait complete. 2024-04-26T12:50:16.168 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:50:15.965681Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:16.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-26T12:50:16.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-26T12:50:16.169 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-26T12:50:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe57825980 1 Processor -- start 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe57825980 1 -- start start 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe57825980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e56b620880 0x55e56b622c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe57825980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e56b4c9510 con 0x55e56b61a770 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe57825980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55e56b4d0430 con 0x55e56b620880 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe54b3f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e56b620880 0x55e56b622c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe55340640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55e56b61a770 0x55e56b61ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36068/0 (socket says 172.21.15.72:36068) 2024-04-26T12:50:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe55340640 1 -- 172.21.15.72:0/866530674 learned_addr learned my addr 172.21.15.72:0/866530674 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe54b3f640 1 -- 172.21.15.72:0/866530674 >> v1:172.21.15.29:6789/0 conn(0x55e56b61a770 legacy=0x55e56b61ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.248+0000 7fbe54b3f640 1 -- 172.21.15.72:0/866530674 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56b4a5ae0 con 0x55e56b620880 2024-04-26T12:50:16.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/866530674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b620880 0x55e56b622c70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800a480 tx=0x7fbe4801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf8b05f7828a4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe47fff640 1 -- 172.21.15.72:0/866530674 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe480b0070 con 0x55e56b620880 2024-04-26T12:50:16.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe47fff640 1 -- 172.21.15.72:0/866530674 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe480ab540 con 0x55e56b620880 2024-04-26T12:50:16.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe47fff640 1 -- 172.21.15.72:0/866530674 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe480ab840 con 0x55e56b620880 2024-04-26T12:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe57825980 1 -- 172.21.15.72:0/866530674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b620880 msgr2=0x55e56b622c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe57825980 1 --2- 172.21.15.72:0/866530674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b620880 0x55e56b622c70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800a480 tx=0x7fbe4801b280 comp rx=0 tx=0).stop 2024-04-26T12:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe57825980 1 -- 172.21.15.72:0/866530674 shutdown_connections 2024-04-26T12:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe57825980 1 --2- 172.21.15.72:0/866530674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b620880 0x55e56b622c70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe57825980 1 -- 172.21.15.72:0/866530674 >> 172.21.15.72:0/866530674 conn(0x55e56b616200 msgr2=0x55e56b618620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe57825980 1 -- 172.21.15.72:0/866530674 shutdown_connections 2024-04-26T12:50:16.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.252+0000 7fbe57825980 1 -- 172.21.15.72:0/866530674 wait complete. 2024-04-26T12:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.264+0000 7fbe57825980 1 Processor -- start 2024-04-26T12:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.264+0000 7fbe57825980 1 -- start start 2024-04-26T12:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.264+0000 7fbe57825980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b7074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.264+0000 7fbe57825980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e56b51fa70 con 0x55e56b61a770 2024-04-26T12:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.264+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b7074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.264+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b7074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49830/0 (socket says 172.21.15.72:49830) 2024-04-26T12:50:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.264+0000 7fbe55340640 1 -- 172.21.15.72:0/733629147 learned_addr learned my addr 172.21.15.72:0/733629147 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe55340640 1 -- 172.21.15.72:0/733629147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56b707a70 con 0x55e56b61a770 2024-04-26T12:50:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe55340640 1 --2- 172.21.15.72:0/733629147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b7074a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c001d90 tx=0x7fbe4c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcce61c22fce0f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbd43606640 1 -- 172.21.15.72:0/733629147 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c013030 con 0x55e56b61a770 2024-04-26T12:50:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbd43606640 1 -- 172.21.15.72:0/733629147 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00e690 con 0x55e56b61a770 2024-04-26T12:50:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbd43606640 1 -- 172.21.15.72:0/733629147 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c00ea10 con 0x55e56b61a770 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 -- 172.21.15.72:0/733629147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 msgr2=0x55e56b7074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 --2- 172.21.15.72:0/733629147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b7074a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c001d90 tx=0x7fbe4c001e80 comp rx=0 tx=0).stop 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 -- 172.21.15.72:0/733629147 shutdown_connections 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 --2- 172.21.15.72:0/733629147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b7074a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 -- 172.21.15.72:0/733629147 >> 172.21.15.72:0/733629147 conn(0x55e56b616200 msgr2=0x55e56b703030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 -- 172.21.15.72:0/733629147 shutdown_connections 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 -- 172.21.15.72:0/733629147 wait complete. 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 Processor -- start 2024-04-26T12:50:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 -- start start 2024-04-26T12:50:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b70e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe57825980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e56b625c70 con 0x55e56b61a770 2024-04-26T12:50:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b70e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b70e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49842/0 (socket says 172.21.15.72:49842) 2024-04-26T12:50:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.268+0000 7fbe55340640 1 -- 172.21.15.72:0/2723868274 learned_addr learned my addr 172.21.15.72:0/2723868274 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe55340640 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56b70ec70 con 0x55e56b61a770 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe55340640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b70e730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55e56b708330 tx=0x7fbe4c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbd41e03640 1 -- 172.21.15.72:0/2723868274 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c027070 con 0x55e56b61a770 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbd41e03640 1 -- 172.21.15.72:0/2723868274 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c0198e0 con 0x55e56b61a770 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e56b70ef00 con 0x55e56b61a770 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56b711aa0 con 0x55e56b61a770 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbd41e03640 1 -- 172.21.15.72:0/2723868274 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c019c00 con 0x55e56b61a770 2024-04-26T12:50:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbd41e03640 1 -- 172.21.15.72:0/2723868274 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe4c02a070 con 0x55e56b61a770 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbd41e03640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd3c0346a0 0x7fbd3c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbd41e03640 1 -- 172.21.15.72:0/2723868274 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbe4c01f070 con 0x55e56b61a770 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd3c0346a0 0x7fbd3c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b620880 0x55e56b7155c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b715be0 con 0x55e56b620880 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe55b41640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b620880 0x55e56b7155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd3c0346a0 0x7fbd3c036b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ad000 tx=0x7fbe480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe55b41640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b620880 0x55e56b7155c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe55b41640 1 -- 172.21.15.72:0/2723868274 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b620880 2024-04-26T12:50:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b712cc0 con 0x55e56b620880 2024-04-26T12:50:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe55b41640 1 -- 172.21.15.72:0/2723868274 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b620880 2024-04-26T12:50:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b717f30 0x55e56b71a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b71a9f0 con 0x55e56b717f30 2024-04-26T12:50:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.272+0000 7fbe55340640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b717f30 0x55e56b71a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55340640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b717f30 0x55e56b71a320 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55340640 1 -- 172.21.15.72:0/2723868274 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe4c029030 con 0x55e56b717f30 2024-04-26T12:50:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b716da0 con 0x55e56b620880 2024-04-26T12:50:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55b41640 1 -- 172.21.15.72:0/2723868274 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b620880 2024-04-26T12:50:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b71be30 0x55e56b71e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b71e990 con 0x55e56b71be30 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b71be30 0x55e56b71e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b71be30 0x55e56b71e220 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe54b3f640 1 -- 172.21.15.72:0/2723868274 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe480b3040 con 0x55e56b71be30 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe57825980 1 Processor -- start 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe57825980 1 -- start start 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe57825980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b72c9c0 0x55e56b72cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe57825980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e56b523ab0 con 0x55e56b72c9c0 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b72c9c0 0x55e56b72cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b72c9c0 0x55e56b72cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49852/0 (socket says 172.21.15.72:49852) 2024-04-26T12:50:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55340640 1 -- 172.21.15.72:0/1653944153 learned_addr learned my addr 172.21.15.72:0/1653944153 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55340640 1 -- 172.21.15.72:0/1653944153 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56b72d320 con 0x55e56b72c9c0 2024-04-26T12:50:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.276+0000 7fbe55340640 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b72c9c0 0x55e56b72cde0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c048480 tx=0x7fbe4c041e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd3affd640 1 -- 172.21.15.72:0/1653944153 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c02c970 con 0x55e56b72c9c0 2024-04-26T12:50:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd3affd640 1 -- 172.21.15.72:0/1653944153 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c02cb10 con 0x55e56b72c9c0 2024-04-26T12:50:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e56b72ddc0 con 0x55e56b72c9c0 2024-04-26T12:50:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd3affd640 1 -- 172.21.15.72:0/1653944153 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c048690 con 0x55e56b72c9c0 2024-04-26T12:50:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56b72e290 con 0x55e56b72c9c0 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd3affd640 1 -- 172.21.15.72:0/1653944153 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe4c016070 con 0x55e56b72c9c0 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd3affd640 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd2c034650 0x7fbd2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd3affd640 1 -- 172.21.15.72:0/1653944153 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbe4c014070 con 0x55e56b72c9c0 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd2c034650 0x7fbd2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 Processor -- start 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- start start 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd2c034650 0x7fbd2c036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ae040 tx=0x7fbe48005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b739e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e56b707dc0 con 0x55e56b7399e0 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b739e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b739e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49864/0 (socket says 172.21.15.72:49864) 2024-04-26T12:50:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe55340640 1 -- 172.21.15.72:0/1933052603 learned_addr learned my addr 172.21.15.72:0/1933052603 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe55340640 1 -- 172.21.15.72:0/1933052603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56b73a3d0 con 0x55e56b7399e0 2024-04-26T12:50:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe55340640 1 --2- 172.21.15.72:0/1933052603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b739e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00ffd0 tx=0x7fbe4c037f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56497bca0b97857f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd38ff9640 1 -- 172.21.15.72:0/1933052603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c05f070 con 0x55e56b7399e0 2024-04-26T12:50:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd38ff9640 1 -- 172.21.15.72:0/1933052603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c041080 con 0x55e56b7399e0 2024-04-26T12:50:16.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbd38ff9640 1 -- 172.21.15.72:0/1933052603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c048b60 con 0x55e56b7399e0 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- 172.21.15.72:0/1933052603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 msgr2=0x55e56b739e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 --2- 172.21.15.72:0/1933052603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b739e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00ffd0 tx=0x7fbe4c037f10 comp rx=0 tx=0).stop 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- 172.21.15.72:0/1933052603 shutdown_connections 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 --2- 172.21.15.72:0/1933052603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b739e00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- 172.21.15.72:0/1933052603 >> 172.21.15.72:0/1933052603 conn(0x55e56b735d20 msgr2=0x55e56b733d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- 172.21.15.72:0/1933052603 shutdown_connections 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.280+0000 7fbe57825980 1 -- 172.21.15.72:0/1933052603 wait complete. 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 Processor -- start 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 -- start start 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b740c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e56b73aa70 con 0x55e56b7399e0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b740c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe55340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b740c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49868/0 (socket says 172.21.15.72:49868) 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 learned_addr learned my addr 172.21.15.72:0/759585230 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56b7411d0 con 0x55e56b7399e0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe55340640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b740c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00d010 tx=0x7fbe4c039f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbd2affd640 1 -- 172.21.15.72:0/759585230 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c06a020 con 0x55e56b7399e0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e56b7411d0 con 0x55e56b7399e0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbd2affd640 1 -- 172.21.15.72:0/759585230 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c047410 con 0x55e56b7399e0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbd2affd640 1 -- 172.21.15.72:0/759585230 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4c05f030 con 0x55e56b7399e0 2024-04-26T12:50:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56b7411d0 con 0x55e56b7399e0 2024-04-26T12:50:16.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbd2affd640 1 -- 172.21.15.72:0/759585230 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe4c06d020 con 0x55e56b7399e0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbd2affd640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd20034600 0x7fbd20036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbd2affd640 1 -- 172.21.15.72:0/759585230 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbe4c060070 con 0x55e56b7399e0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd20034600 0x7fbd20036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b74bde0 0x55e56b74e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74e9f0 con 0x55e56b74bde0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd20034600 0x7fbd20036ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55e56b71ed70 tx=0x7fbe480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.284+0000 7fbe55b41640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b74bde0 0x55e56b74e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55b41640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b74bde0 0x55e56b74e2a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 realm 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74ee00 con 0x55e56b74bde0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74f6d0 con 0x55e56b74bde0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b7507d0 0x55e56b752bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b753190 con 0x55e56b7507d0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55340640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b7507d0 0x55e56b752bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55340640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b7507d0 0x55e56b752bc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 20 searching for the correct realm 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b7550e0 0x55e56b757510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b757be0 con 0x55e56b7550e0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b7550e0 0x55e56b757510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b7550e0 0x55e56b757510 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe54b3f640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe480ab030 0x7fbe480d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b757be0 con 0x7fbe480ab030 2024-04-26T12:50:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.288+0000 7fbe55b41640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe480ab030 0x7fbe480d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe480ab030 0x7fbe480d1400 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x7fbe480ab030 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.292+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x7fbe480ab030 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x7fbe480ab030 2024-04-26T12:50:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.296+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x7fbe480ab030 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7550e0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b7507d0 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x55e56b74bde0 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56b74fa70 con 0x7fbe480ab030 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b753a50 con 0x55e56b74bde0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.300+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b753a50 con 0x55e56b74bde0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b753a50 con 0x55e56b7550e0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 zone default found 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 4 Realm: () 2024-04-26T12:50:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 zonegroup default 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b7543b0 con 0x55e56b7507d0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b759aa0 con 0x55e56b7550e0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b759f00 con 0x55e56b7550e0 2024-04-26T12:50:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 started sync module instance, tier type = 2024-04-26T12:50:16.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:16.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b758ee0 con 0x7fbe480ab030 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443838739424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b758ee0 con 0x7fbe480ab030 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75a9b0 con 0x55e56b74bde0 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.304+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443838739424] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.308+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.308+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443838744080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b758ee0 con 0x55e56b74bde0 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.308+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75b3c0 con 0x55e56b7550e0 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.308+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.308+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443838746384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75bc10 con 0x55e56b7550e0 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.308+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75c610 con 0x7fbe480ab030 2024-04-26T12:50:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.308+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443838744080] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443838736944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75ca00 con 0x7fbe480ab030 2024-04-26T12:50:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75d3c0 con 0x55e56b74bde0 2024-04-26T12:50:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443838746384] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443838736944] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443838751008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75cf10 con 0x55e56b74bde0 2024-04-26T12:50:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.312+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75d760 con 0x55e56b7507d0 2024-04-26T12:50:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443838751008] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443838754576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75d330 con 0x55e56b7507d0 2024-04-26T12:50:16.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75e460 con 0x55e56b7507d0 2024-04-26T12:50:16.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443838754576] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443838758112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75e6b0 con 0x55e56b7507d0 2024-04-26T12:50:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.316+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75f1d0 con 0x55e56b7507d0 2024-04-26T12:50:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443838762144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75f640 con 0x55e56b7507d0 2024-04-26T12:50:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=0 2024-04-26T12:50:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=1 2024-04-26T12:50:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=2 2024-04-26T12:50:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=3 2024-04-26T12:50:16.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=4 2024-04-26T12:50:16.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=5 2024-04-26T12:50:16.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443838758112] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=6 2024-04-26T12:50:16.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443838762144] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 add_watcher() i=7 2024-04-26T12:50:16.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:16.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75e140 con 0x55e56b74bde0 2024-04-26T12:50:16.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443838759168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b75f240 con 0x55e56b74bde0 2024-04-26T12:50:16.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443838759168] v33'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbd0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.320+0000 7fbe57825980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 5 note: GC not initialized 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbd0a7e4640 20 reqs_thread_entry: start 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 20 Filter name: none 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbc7bfff640 20 reqs_thread_entry: start 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b785eb0 con 0x55e56b74bde0 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 20 rados_obj.operate() r=0 bl.length=673 2024-04-26T12:50:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b78cab0 con 0x55e56b74bde0 2024-04-26T12:50:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v33'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94443838948704 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b788200 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94443838751008 notify 141733920776 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7fbe50018b90 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbd38ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94443838751008 notifier 4412 bl.length()=758 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbd38ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbd38ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(64 notify.4 [notify cookie 94443838948704 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbd38ff9640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fbd18003eb0 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94443838948704 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbe50018d60 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b78c560 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(66 foo:foo1 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-26T12:50:16.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.324+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94443838948704 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56b787d50 con 0x7fbe480ab030 2024-04-26T12:50:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== watch-notify(notify (1) cookie 94443838739424 notify 141733920772 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fbe50018d60 con 0x7fbe480ab030 2024-04-26T12:50:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbd38ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94443838739424 notifier 4412 bl.length()=159 2024-04-26T12:50:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbd38ff9640 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fbd18003eb0 con 0x7fbe480ab030 2024-04-26T12:50:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [notify cookie 94443838948704 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== watch-notify(notify_complete (2) cookie 94443838948704 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbe50040020 con 0x7fbe480ab030 2024-04-26T12:50:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.328 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:50:15.965681Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbd0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443838759168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x55e56b74bde0 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94443838759168] v33'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443838739424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x7fbe480ab030 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94443838739424] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe57825980 20 remove_watcher() i=0 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe57825980 2 removed watcher, disabling cache 2024-04-26T12:50:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.328+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443838744080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x55e56b74bde0 2024-04-26T12:50:16.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.332+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94443838744080] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.332+0000 7fbe57825980 20 remove_watcher() i=1 2024-04-26T12:50:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.332+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443838746384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x55e56b7550e0 2024-04-26T12:50:16.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.332+0000 7fbe54b3f640 1 -- 172.21.15.72:0/759585230 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94443838746384] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe480d8040 con 0x55e56b7550e0 2024-04-26T12:50:16.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.332+0000 7fbe57825980 20 remove_watcher() i=2 2024-04-26T12:50:16.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.332+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443838736944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x7fbe480ab030 2024-04-26T12:50:16.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.336+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94443838736944] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x7fbe480ab030 2024-04-26T12:50:16.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.336+0000 7fbe57825980 20 remove_watcher() i=3 2024-04-26T12:50:16.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.336+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443838751008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x55e56b74bde0 2024-04-26T12:50:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.336+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94443838751008] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5000a4d0 con 0x55e56b74bde0 2024-04-26T12:50:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.336+0000 7fbe57825980 20 remove_watcher() i=4 2024-04-26T12:50:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.336+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443838754576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x55e56b7507d0 2024-04-26T12:50:16.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.336+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94443838754576] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 20 remove_watcher() i=5 2024-04-26T12:50:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443838758112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x55e56b7507d0 2024-04-26T12:50:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94443838758112] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 20 remove_watcher() i=6 2024-04-26T12:50:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443838762144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56b783be0 con 0x55e56b7507d0 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe55340640 1 -- 172.21.15.72:0/759585230 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94443838762144] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4c04d060 con 0x55e56b7507d0 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 20 remove_watcher() i=7 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b7507d0 msgr2=0x55e56b752bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b7507d0 0x55e56b752bc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b74bde0 msgr2=0x55e56b74e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.340+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b74bde0 0x55e56b74e2a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe480ab030 msgr2=0x7fbe480d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe480ab030 0x7fbe480d1400 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b7550e0 msgr2=0x55e56b757510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b7550e0 0x55e56b757510 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd20034600 msgr2=0x7fbd20036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd20034600 0x7fbd20036ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55e56b71ed70 tx=0x7fbe480a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 msgr2=0x55e56b740c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b740c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00d010 tx=0x7fbe4c039f90 comp rx=0 tx=0).stop 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe55b41640 1 -- 172.21.15.72:0/759585230 reap_dead start 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 shutdown_connections 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/759585230 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b7399e0 0x55e56b740c90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 >> 172.21.15.72:0/759585230 conn(0x55e56b735d20 msgr2=0x55e56b733380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 shutdown_connections 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/759585230 wait complete. 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd2c034650 msgr2=0x7fbd2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd2c034650 0x7fbd2c036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ae040 tx=0x7fbe48005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b72c9c0 msgr2=0x55e56b72cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b72c9c0 0x55e56b72cde0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c048480 tx=0x7fbe4c041e80 comp rx=0 tx=0).stop 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 shutdown_connections 2024-04-26T12:50:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd2c034650 0x7fbd2c036b10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/1653944153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b72c9c0 0x55e56b72cde0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 >> 172.21.15.72:0/1653944153 conn(0x55e56b7217d0 msgr2=0x55e56b7222e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 shutdown_connections 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/1653944153 wait complete. 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b717f30 msgr2=0x55e56b71a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e56b717f30 0x55e56b71a320 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b620880 msgr2=0x55e56b7155c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e56b620880 0x55e56b7155c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b71be30 msgr2=0x55e56b71e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e56b71be30 0x55e56b71e220 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd3c0346a0 msgr2=0x7fbd3c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd3c0346a0 0x7fbd3c036b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ad000 tx=0x7fbe480a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 msgr2=0x55e56b70e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 --2- 172.21.15.72:0/2723868274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e56b61a770 0x55e56b70e730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55e56b708330 tx=0x7fbe4c000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe55b41640 1 -- 172.21.15.72:0/2723868274 reap_dead start 2024-04-26T12:50:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 shutdown_connections 2024-04-26T12:50:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 >> 172.21.15.72:0/2723868274 conn(0x55e56b616200 msgr2=0x55e56b701b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 shutdown_connections 2024-04-26T12:50:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.344+0000 7fbe57825980 1 -- 172.21.15.72:0/2723868274 wait complete. 2024-04-26T12:50:16.355 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:50:15.965681Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:16.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-26T12:50:16.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-26T12:50:16.355 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-26T12:50:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00da07980 1 Processor -- start 2024-04-26T12:50:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00da07980 1 -- start start 2024-04-26T12:50:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00da07980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561967ea9a90 0x561967eabe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00da07980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561967d50510 con 0x561967e17880 2024-04-26T12:50:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00da07980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x561967d57430 con 0x561967ea9a90 2024-04-26T12:50:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00ad21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561967ea9a90 0x561967eabe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00ad21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x561967ea9a90 0x561967eabe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49878/0 (socket says 172.21.15.72:49878) 2024-04-26T12:50:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00b522640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x561967e17880 0x561967ea8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36078/0 (socket says 172.21.15.72:36078) 2024-04-26T12:50:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00ad21640 1 -- 172.21.15.72:0/162679767 learned_addr learned my addr 172.21.15.72:0/162679767 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00ad21640 1 -- 172.21.15.72:0/162679767 >> v1:172.21.15.29:6789/0 conn(0x561967e17880 legacy=0x561967ea8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.432+0000 7fb00ad21640 1 -- 172.21.15.72:0/162679767 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561967d2cae0 con 0x561967ea9a90 2024-04-26T12:50:16.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00ad21640 1 --2- 172.21.15.72:0/162679767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967ea9a90 0x561967eabe80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb00000a5c0 tx=0x7fb00001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c81202a510360 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00a520640 1 -- 172.21.15.72:0/162679767 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0000a6070 con 0x561967ea9a90 2024-04-26T12:50:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00a520640 1 -- 172.21.15.72:0/162679767 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0000af070 con 0x561967ea9a90 2024-04-26T12:50:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00a520640 1 -- 172.21.15.72:0/162679767 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0000aa5c0 con 0x561967ea9a90 2024-04-26T12:50:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00da07980 1 -- 172.21.15.72:0/162679767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967ea9a90 msgr2=0x561967eabe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00da07980 1 --2- 172.21.15.72:0/162679767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967ea9a90 0x561967eabe80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb00000a5c0 tx=0x7fb00001b340 comp rx=0 tx=0).stop 2024-04-26T12:50:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00da07980 1 -- 172.21.15.72:0/162679767 shutdown_connections 2024-04-26T12:50:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00da07980 1 --2- 172.21.15.72:0/162679767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967ea9a90 0x561967eabe80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00da07980 1 -- 172.21.15.72:0/162679767 >> 172.21.15.72:0/162679767 conn(0x561967e9da50 msgr2=0x561967e9fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00da07980 1 -- 172.21.15.72:0/162679767 shutdown_connections 2024-04-26T12:50:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.436+0000 7fb00da07980 1 -- 172.21.15.72:0/162679767 wait complete. 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00da07980 1 Processor -- start 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00da07980 1 -- start start 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00da07980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f90620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00da07980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561967da6a70 con 0x561967e17880 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f90620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f90620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49888/0 (socket says 172.21.15.72:49888) 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00b522640 1 -- 172.21.15.72:0/386919490 learned_addr learned my addr 172.21.15.72:0/386919490 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00b522640 1 -- 172.21.15.72:0/386919490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561967f90bf0 con 0x561967e17880 2024-04-26T12:50:16.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.448+0000 7fb00b522640 1 --2- 172.21.15.72:0/386919490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f90620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb004001690 tx=0x7fb004001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36f4c78d251d1d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7faef960a640 1 -- 172.21.15.72:0/386919490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004003460 con 0x561967e17880 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7faef960a640 1 -- 172.21.15.72:0/386919490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb004003600 con 0x561967e17880 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7faef960a640 1 -- 172.21.15.72:0/386919490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004003920 con 0x561967e17880 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- 172.21.15.72:0/386919490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 msgr2=0x561967f90620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 --2- 172.21.15.72:0/386919490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f90620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb004001690 tx=0x7fb004001b50 comp rx=0 tx=0).stop 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- 172.21.15.72:0/386919490 shutdown_connections 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 --2- 172.21.15.72:0/386919490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f90620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- 172.21.15.72:0/386919490 >> 172.21.15.72:0/386919490 conn(0x561967e9da50 msgr2=0x561967f8c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- 172.21.15.72:0/386919490 shutdown_connections 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- 172.21.15.72:0/386919490 wait complete. 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 Processor -- start 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- start start 2024-04-26T12:50:16.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f97820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561967eaee20 con 0x561967e17880 2024-04-26T12:50:16.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f97820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f97820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49902/0 (socket says 172.21.15.72:49902) 2024-04-26T12:50:16.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00b522640 1 -- 172.21.15.72:0/2896815252 learned_addr learned my addr 172.21.15.72:0/2896815252 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00b522640 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561967f97d60 con 0x561967e17880 2024-04-26T12:50:16.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00b522640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f97820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb004000f90 tx=0x7fb004001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7faef7e07640 1 -- 172.21.15.72:0/2896815252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004022020 con 0x561967e17880 2024-04-26T12:50:16.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561967f97ff0 con 0x561967e17880 2024-04-26T12:50:16.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7faef7e07640 1 -- 172.21.15.72:0/2896815252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb004006840 con 0x561967e17880 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7faef7e07640 1 -- 172.21.15.72:0/2896815252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb00401e800 con 0x561967e17880 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.452+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561967f9ac30 con 0x561967e17880 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7faef7e07640 1 -- 172.21.15.72:0/2896815252 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb004025020 con 0x561967e17880 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7faef7e07640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faef0034600 0x7faef0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7faef7e07640 1 -- 172.21.15.72:0/2896815252 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fb004049bb0 con 0x561967e17880 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faef0034600 0x7faef0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967ea9a90 0x561967f9e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967f9edc0 con 0x561967ea9a90 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00bd23640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967ea9a90 0x561967f9e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faef0034600 0x7faef0036ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0000ae000 tx=0x7fb0000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00bd23640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967ea9a90 0x561967f9e880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00bd23640 1 -- 172.21.15.72:0/2896815252 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc0083f0 con 0x561967ea9a90 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967f9be50 con 0x561967ea9a90 2024-04-26T12:50:16.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00bd23640 1 -- 172.21.15.72:0/2896815252 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faffc0083f0 con 0x561967ea9a90 2024-04-26T12:50:16.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fa10f0 0x561967fa34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fa3bb0 con 0x561967fa10f0 2024-04-26T12:50:16.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00b522640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fa10f0 0x561967fa34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00b522640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fa10f0 0x561967fa34e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00b522640 1 -- 172.21.15.72:0/2896815252 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb00401b040 con 0x561967fa10f0 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967f9ff90 con 0x561967ea9a90 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00bd23640 1 -- 172.21.15.72:0/2896815252 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faffc0083f0 con 0x561967ea9a90 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fa5010 0x561967fa7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fa7b00 con 0x561967fa5010 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.456+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fa5010 0x561967fa7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fa5010 0x561967fa7400 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00ad21640 1 -- 172.21.15.72:0/2896815252 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fa5010 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00da07980 1 Processor -- start 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00da07980 1 -- start start 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00da07980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fb5b90 0x561967fb5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00da07980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561967daaab0 con 0x561967fb5b90 2024-04-26T12:50:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fb5b90 0x561967fb5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fb5b90 0x561967fb5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49910/0 (socket says 172.21.15.72:49910) 2024-04-26T12:50:16.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00b522640 1 -- 172.21.15.72:0/2699642799 learned_addr learned my addr 172.21.15.72:0/2699642799 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00b522640 1 -- 172.21.15.72:0/2699642799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561967fb64f0 con 0x561967fb5b90 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00b522640 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fb5b90 0x561967fb5fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb004006810 tx=0x7fb00401df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7faef5602640 1 -- 172.21.15.72:0/2699642799 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004040070 con 0x561967fb5b90 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561967fb6f90 con 0x561967fb5b90 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7faef5602640 1 -- 172.21.15.72:0/2699642799 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0040288f0 con 0x561967fb5b90 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7faef5602640 1 -- 172.21.15.72:0/2699642799 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004028bd0 con 0x561967fb5b90 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561967fb7460 con 0x561967fb5b90 2024-04-26T12:50:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7faef5602640 1 -- 172.21.15.72:0/2699642799 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb004041260 con 0x561967fb5b90 2024-04-26T12:50:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7faef5602640 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faee4034650 0x7faee4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7faef5602640 1 -- 172.21.15.72:0/2699642799 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fb0040047a0 con 0x561967fb5b90 2024-04-26T12:50:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.460+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faee4034650 0x7faee4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 Processor -- start 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- start start 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faee4034650 0x7faee4036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x561967f9f6a0 tx=0x7fb000005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561967f90ee0 con 0x561967fc2b10 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49926/0 (socket says 172.21.15.72:49926) 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 -- 172.21.15.72:0/3469939508 learned_addr learned my addr 172.21.15.72:0/3469939508 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 -- 172.21.15.72:0/3469939508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561967fc3500 con 0x561967fc2b10 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 --2- 172.21.15.72:0/3469939508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc2f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb00401eef0 tx=0x7fb0040274c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1299b6020891f74f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7faeeeffd640 1 -- 172.21.15.72:0/3469939508 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004028d70 con 0x561967fc2b10 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7faeeeffd640 1 -- 172.21.15.72:0/3469939508 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb004028030 con 0x561967fc2b10 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7faeeeffd640 1 -- 172.21.15.72:0/3469939508 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004041980 con 0x561967fc2b10 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- 172.21.15.72:0/3469939508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 msgr2=0x561967fc2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 --2- 172.21.15.72:0/3469939508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc2f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb00401eef0 tx=0x7fb0040274c0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- 172.21.15.72:0/3469939508 shutdown_connections 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 --2- 172.21.15.72:0/3469939508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc2f30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- 172.21.15.72:0/3469939508 >> 172.21.15.72:0/3469939508 conn(0x561967fbeea0 msgr2=0x561967fbcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- 172.21.15.72:0/3469939508 shutdown_connections 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- 172.21.15.72:0/3469939508 wait complete. 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 Processor -- start 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- start start 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561967fc3a70 con 0x561967fc2b10 2024-04-26T12:50:16.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49938/0 (socket says 172.21.15.72:49938) 2024-04-26T12:50:16.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 learned_addr learned my addr 172.21.15.72:0/2589350608 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561967fca3f0 con 0x561967fc2b10 2024-04-26T12:50:16.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00b522640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc9eb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb004012b90 tx=0x7fb0040043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7faeed7fa640 1 -- 172.21.15.72:0/2589350608 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004004030 con 0x561967fc2b10 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561967fca3f0 con 0x561967fc2b10 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7faeed7fa640 1 -- 172.21.15.72:0/2589350608 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0040041d0 con 0x561967fc2b10 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.464+0000 7faeed7fa640 1 -- 172.21.15.72:0/2589350608 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb004027960 con 0x561967fc2b10 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561967fca3f0 con 0x561967fc2b10 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7faeed7fa640 1 -- 172.21.15.72:0/2589350608 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb004027b00 con 0x561967fc2b10 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7faeed7fa640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faed4034650 0x7faed4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7faeed7fa640 1 -- 172.21.15.72:0/2589350608 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fb004058150 con 0x561967fc2b10 2024-04-26T12:50:16.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faed4034650 0x7faed4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967fd4df0 0x561967fd7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fd79e0 con 0x561967fd4df0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00bd23640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967fd4df0 0x561967fd7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faed4034650 0x7faed4036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x561967fa7f00 tx=0x7fb0000c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00bd23640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967fd4df0 0x561967fd7290 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc0083f0 con 0x561967fd4df0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 realm 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fd7df0 con 0x561967fd4df0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc0083f0 con 0x561967fd4df0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:16.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8690 con 0x561967fd4df0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc0083f0 con 0x561967fd4df0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faffc0083f0 con 0x561967fd4df0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fd9790 0x561967fdbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fdc1d0 con 0x561967fd9790 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.468+0000 7fb00b522640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fd9790 0x561967fdbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00b522640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fd9790 0x561967fdbb80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00da07980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00da07980 20 searching for the correct realm 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fde0b0 0x561967fe0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fe0ba0 con 0x561967fde0b0 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fde0b0 0x561967fe0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fde0b0 0x561967fe0520 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00ad21640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fb0000e0040 0x7fb0000e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fe0ba0 con 0x7fb0000e0040 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fb0000e0040 0x7fb0000e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fb0000e0040 0x7fb0000e0420 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc0083f0 con 0x7fb0000e0040 2024-04-26T12:50:16.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc0083f0 con 0x561967fd4df0 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.472+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x7fb0000e0040 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x7fb0000e0040 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x7fb0000e0040 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faffc026040 con 0x7fb0000e0040 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.476+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x7fb0000e0040 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x7fb0000e0040 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.480+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x7fb0000e0040 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x7fb0000e0040 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fde0b0 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd9790 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x561967fd4df0 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561967fd8a30 con 0x7fb0000e0040 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc026040 con 0x7fb0000e0040 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fdca20 con 0x561967fd4df0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fdca20 con 0x561967fd4df0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faffc026040 con 0x561967fd4df0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fdca20 con 0x561967fde0b0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 zone default found 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 4 Realm: () 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 zonegroup default 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.484+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fdd3c0 con 0x561967fd9790 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fe2a80 con 0x561967fde0b0 2024-04-26T12:50:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fe2ee0 con 0x561967fde0b0 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 20 started sync module instance, tier type = 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe1ea0 con 0x7fb0000e0040 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc026040 con 0x7fb0000e0040 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667118879680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe1ea0 con 0x7fb0000e0040 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe3a40 con 0x561967fd4df0 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667118879680] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x7fb0000e0040 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667118884112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe1ea0 con 0x561967fd4df0 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.488+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe4450 con 0x561967fde0b0 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667118886816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe4cf0 con 0x561967fde0b0 2024-04-26T12:50:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe5730 con 0x7fb0000e0040 2024-04-26T12:50:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667118884112] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x7fb0000e0040 2024-04-26T12:50:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667118891520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe5b20 con 0x7fb0000e0040 2024-04-26T12:50:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe64e0 con 0x561967fd4df0 2024-04-26T12:50:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667118886816] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.492+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667118891520] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x7fb0000e0040 2024-04-26T12:50:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.496+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.496+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667118877168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe6030 con 0x561967fd4df0 2024-04-26T12:50:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.496+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe6d80 con 0x561967fd9790 2024-04-26T12:50:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.496+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667118877168] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.496+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.496+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667118897360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe6030 con 0x561967fd9790 2024-04-26T12:50:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.496+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe75d0 con 0x561967fd9790 2024-04-26T12:50:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667118897360] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667118889024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe7e20 con 0x561967fd9790 2024-04-26T12:50:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe8670 con 0x561967fd9790 2024-04-26T12:50:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667118904256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe8e50 con 0x561967fd9790 2024-04-26T12:50:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 20 add_watcher() i=0 2024-04-26T12:50:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 20 add_watcher() i=1 2024-04-26T12:50:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 20 add_watcher() i=2 2024-04-26T12:50:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 20 add_watcher() i=3 2024-04-26T12:50:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 20 add_watcher() i=4 2024-04-26T12:50:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 20 add_watcher() i=5 2024-04-26T12:50:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667118889024] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.500+0000 7fb00da07980 20 add_watcher() i=6 2024-04-26T12:50:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667118904256] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 20 add_watcher() i=7 2024-04-26T12:50:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561967fe7970 con 0x561967fd4df0 2024-04-26T12:50:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667118901616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561967fe9390 con 0x561967fd4df0 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667118901616] v33'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7faec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 5 note: GC not initialized 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7faec0fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 20 Filter name: none 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fae3a7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56196800f750 con 0x561967fd4df0 2024-04-26T12:50:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 20 rados_obj.operate() r=0 bl.length=582 2024-04-26T12:50:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.504+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561968015d40 con 0x561967fd4df0 2024-04-26T12:50:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94667119089584 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561968011700 con 0x561967fd4df0 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94667118877168 notify 141733920777 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7faffc010040 con 0x561967fd4df0 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7faeeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94667118877168 notifier 4419 bl.length()=732 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7faeeeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7faeeeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(64 notify.4 [notify cookie 94667119089584 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7faeeeffd640 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7faed0003eb0 con 0x561967fd4df0 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94667119089584 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faffc00ab50 con 0x561967fd4df0 2024-04-26T12:50:16.508 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:50:15.965681Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7faec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667118901616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x561967fd4df0 2024-04-26T12:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94667118901616] v33'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667118879680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x7fb0000e0040 2024-04-26T12:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94667118879680] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x7fb0000e0040 2024-04-26T12:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 20 remove_watcher() i=0 2024-04-26T12:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 2 removed watcher, disabling cache 2024-04-26T12:50:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.508+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667118884112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x561967fd4df0 2024-04-26T12:50:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.512+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94667118884112] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.512+0000 7fb00da07980 20 remove_watcher() i=1 2024-04-26T12:50:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.512+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667118886816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x561967fde0b0 2024-04-26T12:50:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.512+0000 7fb00ad21640 1 -- 172.21.15.72:0/2589350608 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94667118886816] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0000aaab0 con 0x561967fde0b0 2024-04-26T12:50:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.512+0000 7fb00da07980 20 remove_watcher() i=2 2024-04-26T12:50:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.512+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667118891520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x7fb0000e0040 2024-04-26T12:50:16.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.516+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94667118891520] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x7fb0000e0040 2024-04-26T12:50:16.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.516+0000 7fb00da07980 20 remove_watcher() i=3 2024-04-26T12:50:16.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.516+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667118877168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x561967fd4df0 2024-04-26T12:50:16.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.516+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94667118877168] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc036040 con 0x561967fd4df0 2024-04-26T12:50:16.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.516+0000 7fb00da07980 20 remove_watcher() i=4 2024-04-26T12:50:16.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.516+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667118897360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x561967fd9790 2024-04-26T12:50:16.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.520+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94667118897360] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.520+0000 7fb00da07980 20 remove_watcher() i=5 2024-04-26T12:50:16.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.520+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667118889024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x561967fd9790 2024-04-26T12:50:16.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.520+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94667118889024] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.520+0000 7fb00da07980 20 remove_watcher() i=6 2024-04-26T12:50:16.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.520+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667118904256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56196800d480 con 0x561967fd9790 2024-04-26T12:50:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00b522640 1 -- 172.21.15.72:0/2589350608 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94667118904256] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb004039070 con 0x561967fd9790 2024-04-26T12:50:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 20 remove_watcher() i=7 2024-04-26T12:50:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fd9790 msgr2=0x561967fdbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fd9790 0x561967fdbb80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967fd4df0 msgr2=0x561967fd7290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967fd4df0 0x561967fd7290 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fb0000e0040 msgr2=0x7fb0000e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fb0000e0040 0x7fb0000e0420 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fde0b0 msgr2=0x561967fe0520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fde0b0 0x561967fe0520 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faed4034650 msgr2=0x7faed4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faed4034650 0x7faed4036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x561967fa7f00 tx=0x7fb0000c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 msgr2=0x561967fc9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00bd23640 1 -- 172.21.15.72:0/2589350608 reap_dead start 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc9eb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb004012b90 tx=0x7fb0040043c0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 shutdown_connections 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2589350608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fc2b10 0x561967fc9eb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 >> 172.21.15.72:0/2589350608 conn(0x561967fbeea0 msgr2=0x561967fbc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 shutdown_connections 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2589350608 wait complete. 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faee4034650 msgr2=0x7faee4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faee4034650 0x7faee4036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x561967f9f6a0 tx=0x7fb000005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fb5b90 msgr2=0x561967fb5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fb5b90 0x561967fb5fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb004006810 tx=0x7fb00401df00 comp rx=0 tx=0).stop 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 shutdown_connections 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faee4034650 0x7faee4036b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2699642799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967fb5b90 0x561967fb5fb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 >> 172.21.15.72:0/2699642799 conn(0x561967faa9a0 msgr2=0x561967fab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 shutdown_connections 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2699642799 wait complete. 2024-04-26T12:50:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fa10f0 msgr2=0x561967fa34e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561967fa10f0 0x561967fa34e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967ea9a90 msgr2=0x561967f9e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561967ea9a90 0x561967f9e880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fa5010 msgr2=0x561967fa7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561967fa5010 0x561967fa7400 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faef0034600 msgr2=0x7faef0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faef0034600 0x7faef0036ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0000ae000 tx=0x7fb0000a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 msgr2=0x561967f97820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 --2- 172.21.15.72:0/2896815252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561967e17880 0x561967f97820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb004000f90 tx=0x7fb004001260 comp rx=0 tx=0).stop 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00bd23640 1 -- 172.21.15.72:0/2896815252 reap_dead start 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 shutdown_connections 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 >> 172.21.15.72:0/2896815252 conn(0x561967e9da50 msgr2=0x561967f8acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 shutdown_connections 2024-04-26T12:50:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.524+0000 7fb00da07980 1 -- 172.21.15.72:0/2896815252 wait complete. 2024-04-26T12:50:16.532 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:50:15.965681Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:16.533 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-26T12:50:16.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-26T12:50:16.533 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-26T12:50:16.607 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:16.607 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:16.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f54367ac980 1 Processor -- start 2024-04-26T12:50:16.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f54367ac980 1 -- start start 2024-04-26T12:50:16.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f54367ac980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5560ea671a10 0x5560ea673e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f54367ac980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560ea518510 con 0x5560ea5defd0 2024-04-26T12:50:16.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f54367ac980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5560ea51f430 con 0x5560ea671a10 2024-04-26T12:50:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f5433ac6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5560ea671a10 0x5560ea673e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f54342c7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5560ea5defd0 0x5560ea6702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36088/0 (socket says 172.21.15.72:36088) 2024-04-26T12:50:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f5433ac6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5560ea671a10 0x5560ea673e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49954/0 (socket says 172.21.15.72:49954) 2024-04-26T12:50:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f54342c7640 1 -- 172.21.15.72:0/1231307565 learned_addr learned my addr 172.21.15.72:0/1231307565 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f5433ac6640 1 -- 172.21.15.72:0/1231307565 >> v1:172.21.15.29:6789/0 conn(0x5560ea5defd0 legacy=0x5560ea6702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.608+0000 7f5433ac6640 1 -- 172.21.15.72:0/1231307565 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ea4f4ae0 con 0x5560ea671a10 2024-04-26T12:50:16.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f5433ac6640 1 --2- 172.21.15.72:0/1231307565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea671a10 0x5560ea673e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f542800a420 tx=0x7f542801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3e010fba78f33a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54332c5640 1 -- 172.21.15.72:0/1231307565 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54280af070 con 0x5560ea671a10 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54332c5640 1 -- 172.21.15.72:0/1231307565 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54280aa530 con 0x5560ea671a10 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54332c5640 1 -- 172.21.15.72:0/1231307565 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54280aa850 con 0x5560ea671a10 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54367ac980 1 -- 172.21.15.72:0/1231307565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea671a10 msgr2=0x5560ea673e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54367ac980 1 --2- 172.21.15.72:0/1231307565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea671a10 0x5560ea673e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f542800a420 tx=0x7f542801afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54367ac980 1 -- 172.21.15.72:0/1231307565 shutdown_connections 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54367ac980 1 --2- 172.21.15.72:0/1231307565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea671a10 0x5560ea673e00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54367ac980 1 -- 172.21.15.72:0/1231307565 >> 172.21.15.72:0/1231307565 conn(0x5560ea665a10 msgr2=0x5560ea667e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54367ac980 1 -- 172.21.15.72:0/1231307565 shutdown_connections 2024-04-26T12:50:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.612+0000 7f54367ac980 1 -- 172.21.15.72:0/1231307565 wait complete. 2024-04-26T12:50:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 Processor -- start 2024-04-26T12:50:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- start start 2024-04-26T12:50:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea7586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560ea56ea70 con 0x5560ea5defd0 2024-04-26T12:50:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea7586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea7586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49960/0 (socket says 172.21.15.72:49960) 2024-04-26T12:50:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 -- 172.21.15.72:0/1850693192 learned_addr learned my addr 172.21.15.72:0/1850693192 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 -- 172.21.15.72:0/1850693192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ea758cb0 con 0x5560ea5defd0 2024-04-26T12:50:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 --2- 172.21.15.72:0/1850693192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea7586e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5424001e20 tx=0x7f542400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5e4fc53618f498 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f532260c640 1 -- 172.21.15.72:0/1850693192 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5424012020 con 0x5560ea5defd0 2024-04-26T12:50:16.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f532260c640 1 -- 172.21.15.72:0/1850693192 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f542400e7c0 con 0x5560ea5defd0 2024-04-26T12:50:16.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f532260c640 1 -- 172.21.15.72:0/1850693192 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f542400eb00 con 0x5560ea5defd0 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- 172.21.15.72:0/1850693192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 msgr2=0x5560ea7586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 --2- 172.21.15.72:0/1850693192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea7586e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5424001e20 tx=0x7f542400b790 comp rx=0 tx=0).stop 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- 172.21.15.72:0/1850693192 shutdown_connections 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 --2- 172.21.15.72:0/1850693192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea7586e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- 172.21.15.72:0/1850693192 >> 172.21.15.72:0/1850693192 conn(0x5560ea665a10 msgr2=0x5560ea754270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- 172.21.15.72:0/1850693192 shutdown_connections 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- 172.21.15.72:0/1850693192 wait complete. 2024-04-26T12:50:16.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 Processor -- start 2024-04-26T12:50:16.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- start start 2024-04-26T12:50:16.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea75f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54367ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560ea676e00 con 0x5560ea5defd0 2024-04-26T12:50:16.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea75f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea75f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49964/0 (socket says 172.21.15.72:49964) 2024-04-26T12:50:16.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.628+0000 7f54342c7640 1 -- 172.21.15.72:0/2392519803 learned_addr learned my addr 172.21.15.72:0/2392519803 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54342c7640 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ea75fef0 con 0x5560ea5defd0 2024-04-26T12:50:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54342c7640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea75f9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5424001e20 tx=0x7f5424000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5320e09640 1 -- 172.21.15.72:0/2392519803 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5424012030 con 0x5560ea5defd0 2024-04-26T12:50:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5320e09640 1 -- 172.21.15.72:0/2392519803 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5424001480 con 0x5560ea5defd0 2024-04-26T12:50:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560ea760180 con 0x5560ea5defd0 2024-04-26T12:50:16.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5320e09640 1 -- 172.21.15.72:0/2392519803 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f542401a940 con 0x5560ea5defd0 2024-04-26T12:50:16.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ea762d60 con 0x5560ea5defd0 2024-04-26T12:50:16.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5320e09640 1 -- 172.21.15.72:0/2392519803 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5424015020 con 0x5560ea5defd0 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5320e09640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f531c0346a0 0x7f531c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5320e09640 1 -- 172.21.15.72:0/2392519803 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f5424020030 con 0x5560ea5defd0 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5433ac6640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f531c0346a0 0x7f531c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea671a10 0x5560ea766840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea766e90 con 0x5560ea671a10 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5434ac8640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea671a10 0x5560ea766840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5433ac6640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f531c0346a0 0x7f531c036b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54280ac000 tx=0x7f54280a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5434ac8640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea671a10 0x5560ea766840 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5434ac8640 1 -- 172.21.15.72:0/2392519803 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea671a10 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea763f80 con 0x5560ea671a10 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f5434ac8640 1 -- 172.21.15.72:0/2392519803 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea671a10 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.632+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea769230 0x5560ea76b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea76bcf0 con 0x5560ea769230 2024-04-26T12:50:16.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54342c7640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea769230 0x5560ea76b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54342c7640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea769230 0x5560ea76b620 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54342c7640 1 -- 172.21.15.72:0/2392519803 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5424008030 con 0x5560ea769230 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7680d0 con 0x5560ea671a10 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f5434ac8640 1 -- 172.21.15.72:0/2392519803 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea671a10 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea76d130 0x5560ea76f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea76fcb0 con 0x5560ea76d130 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f5433ac6640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea76d130 0x5560ea76f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f5433ac6640 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea76d130 0x5560ea76f520 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f5433ac6640 1 -- 172.21.15.72:0/2392519803 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54280b2070 con 0x5560ea76d130 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 Processor -- start 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 -- start start 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea77dcc0 0x5560ea77e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54367ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560ea572ab0 con 0x5560ea77dcc0 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea77dcc0 0x5560ea77e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea77dcc0 0x5560ea77e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49968/0 (socket says 172.21.15.72:49968) 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.636+0000 7f54342c7640 1 -- 172.21.15.72:0/54412761 learned_addr learned my addr 172.21.15.72:0/54412761 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54342c7640 1 -- 172.21.15.72:0/54412761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ea77e620 con 0x5560ea77dcc0 2024-04-26T12:50:16.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54342c7640 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea77dcc0 0x5560ea77e0e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f542400c510 tx=0x7f5424016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5319ffb640 1 -- 172.21.15.72:0/54412761 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5424042170 con 0x5560ea77dcc0 2024-04-26T12:50:16.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5319ffb640 1 -- 172.21.15.72:0/54412761 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54240163b0 con 0x5560ea77dcc0 2024-04-26T12:50:16.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560ea77f0c0 con 0x5560ea77dcc0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5319ffb640 1 -- 172.21.15.72:0/54412761 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5424017c50 con 0x5560ea77dcc0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ea77f590 con 0x5560ea77dcc0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5319ffb640 1 -- 172.21.15.72:0/54412761 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5424009070 con 0x5560ea77dcc0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5319ffb640 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f530c0347f0 0x7f530c036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5319ffb640 1 -- 172.21.15.72:0/54412761 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f5424038070 con 0x5560ea77dcc0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5433ac6640 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f530c0347f0 0x7f530c036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54367ac980 1 Processor -- start 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54367ac980 1 -- start start 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f5433ac6640 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f530c0347f0 0x7f530c036cb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5428000f90 tx=0x7f5428005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54367ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea78b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54367ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560ea759000 con 0x5560ea78acc0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea78b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea78b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49974/0 (socket says 172.21.15.72:49974) 2024-04-26T12:50:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54342c7640 1 -- 172.21.15.72:0/586895275 learned_addr learned my addr 172.21.15.72:0/586895275 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54342c7640 1 -- 172.21.15.72:0/586895275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ea78b6b0 con 0x5560ea78acc0 2024-04-26T12:50:16.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f54342c7640 1 --2- 172.21.15.72:0/586895275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea78b0e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f542401a740 tx=0x7f542402d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e2adcde67701b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.640+0000 7f53137fe640 1 -- 172.21.15.72:0/586895275 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5424048d30 con 0x5560ea78acc0 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f53137fe640 1 -- 172.21.15.72:0/586895275 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f542400d3e0 con 0x5560ea78acc0 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f53137fe640 1 -- 172.21.15.72:0/586895275 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5424030500 con 0x5560ea78acc0 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- 172.21.15.72:0/586895275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 msgr2=0x5560ea78b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 --2- 172.21.15.72:0/586895275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea78b0e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f542401a740 tx=0x7f542402d4b0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- 172.21.15.72:0/586895275 shutdown_connections 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 --2- 172.21.15.72:0/586895275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea78b0e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- 172.21.15.72:0/586895275 >> 172.21.15.72:0/586895275 conn(0x5560ea787000 msgr2=0x5560ea785060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- 172.21.15.72:0/586895275 shutdown_connections 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- 172.21.15.72:0/586895275 wait complete. 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 Processor -- start 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- start start 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea791fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5560ea78bd50 con 0x5560ea78acc0 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea791fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54342c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea791fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49990/0 (socket says 172.21.15.72:49990) 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 learned_addr learned my addr 172.21.15.72:0/1174821196 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ea7924e0 con 0x5560ea78acc0 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54342c7640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea791fa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5424017fd0 tx=0x7f54240251d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f5311ffb640 1 -- 172.21.15.72:0/1174821196 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f542403de60 con 0x5560ea78acc0 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560ea7924e0 con 0x5560ea78acc0 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f5311ffb640 1 -- 172.21.15.72:0/1174821196 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5424066070 con 0x5560ea78acc0 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f5311ffb640 1 -- 172.21.15.72:0/1174821196 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5424030bd0 con 0x5560ea78acc0 2024-04-26T12:50:16.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ea7924e0 con 0x5560ea78acc0 2024-04-26T12:50:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f5311ffb640 1 -- 172.21.15.72:0/1174821196 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f542405d040 con 0x5560ea78acc0 2024-04-26T12:50:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f5311ffb640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5304034650 0x7f5304036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f5311ffb640 1 -- 172.21.15.72:0/1174821196 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f542405b020 con 0x5560ea78acc0 2024-04-26T12:50:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.644+0000 7f5433ac6640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5304034650 0x7f5304036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea79d100 0x5560ea79f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea79fcf0 con 0x5560ea79d100 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5434ac8640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea79d100 0x5560ea79f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5433ac6640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5304034650 0x7f5304036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f542801b010 tx=0x7f54280b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5434ac8640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea79d100 0x5560ea79f5a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea79d100 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 realm 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0100 con 0x5560ea79d100 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea79d100 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a09a0 con 0x5560ea79d100 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea79d100 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea79d100 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea79d100 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea7a1aa0 0x5560ea7a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a4530 con 0x5560ea7a1aa0 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54342c7640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea7a1aa0 0x5560ea7a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54342c7640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea7a1aa0 0x5560ea7a3e90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 20 searching for the correct realm 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea7a6410 0x5560ea7a8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a8f00 con 0x5560ea7a6410 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5433ac6640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea7a6410 0x5560ea7a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.648+0000 7f5433ac6640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea7a6410 0x5560ea7a8880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5433ac6640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f54280cc040 0x7f54280d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a8f00 con 0x7f54280cc040 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f54280cc040 0x7f54280d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f54280cc040 0x7f54280d9410 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c0083f0 con 0x7f54280cc040 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea7a1aa0 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea79d100 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c0083f0 con 0x5560ea79d100 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea79d100 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea7a1aa0 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea7a1aa0 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x7f54280cc040 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x7f54280cc040 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea7a6410 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.652+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea79d100 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea7a1aa0 2024-04-26T12:50:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea79d100 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x7f54280cc040 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f542c026040 con 0x7f54280cc040 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a0d40 con 0x5560ea7a6410 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a6410 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a6410 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a6410 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea79d100 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea79d100 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.656+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a6410 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x7f54280cc040 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x7f54280cc040 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea79d100 2024-04-26T12:50:16.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a6410 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x7f54280cc040 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x7f54280cc040 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a6410 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x5560ea79d100 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.660+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f54280e6040 con 0x7f54280cc040 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f542c026040 con 0x7f54280cc040 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:16.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a4d80 con 0x5560ea79d100 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a4d80 con 0x5560ea79d100 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f542c026040 con 0x5560ea79d100 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a4d80 con 0x5560ea7a6410 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 zone default found 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 4 Realm: () 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 zonegroup default 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7a5720 con 0x5560ea7a1aa0 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7aade0 con 0x5560ea7a6410 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7ab270 con 0x5560ea7a6410 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 started sync module instance, tier type = 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7aa200 con 0x7f54280cc040 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c026040 con 0x7f54280cc040 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874739128096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7aa200 con 0x7f54280cc040 2024-04-26T12:50:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.664+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7abd50 con 0x5560ea79d100 2024-04-26T12:50:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874739128096] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874739132480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7aa200 con 0x5560ea79d100 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7ac760 con 0x5560ea7a6410 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874739132480] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874739125584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7aa170 con 0x5560ea7a6410 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.668+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7ad530 con 0x7f54280cc040 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874739138560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7addd0 con 0x7f54280cc040 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7ae7d0 con 0x5560ea79d100 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874739138560] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874739125584] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874739137360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7ad8d0 con 0x5560ea79d100 2024-04-26T12:50:16.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7af070 con 0x5560ea7a1aa0 2024-04-26T12:50:16.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.672+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874739137360] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874739145664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7ad8d0 con 0x5560ea7a1aa0 2024-04-26T12:50:16.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7af8c0 con 0x5560ea7a1aa0 2024-04-26T12:50:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874739145664] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874739147792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7afce0 con 0x5560ea7a1aa0 2024-04-26T12:50:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7b06a0 con 0x5560ea7a1aa0 2024-04-26T12:50:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874739151344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7b0ac0 con 0x5560ea7a1aa0 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 20 add_watcher() i=0 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 20 add_watcher() i=1 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 20 add_watcher() i=2 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 20 add_watcher() i=3 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.676+0000 7f54367ac980 20 add_watcher() i=4 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 add_watcher() i=5 2024-04-26T12:50:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874739147792] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 add_watcher() i=6 2024-04-26T12:50:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874739151344] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 add_watcher() i=7 2024-04-26T12:50:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7b0ac0 con 0x5560ea79d100 2024-04-26T12:50:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874739152400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7b0a30 con 0x5560ea79d100 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874739152400] v33'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f52ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 5 note: GC not initialized 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f52e97e2640 20 reqs_thread_entry: start 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 Filter name: none 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f525affd640 20 reqs_thread_entry: start 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.680+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d7310 con 0x5560ea79d100 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:16.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7dd9e0 con 0x5560ea79d100 2024-04-26T12:50:16.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93874739336336 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d9190 con 0x5560ea79d100 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 93874739137360 notify 141733920778 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f542c010040 con 0x5560ea79d100 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f53137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 93874739137360 notifier 4426 bl.length()=567 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f53137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f53137fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(64 notify.4 [notify cookie 93874739336336 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f53137fe640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f52f8003eb0 con 0x5560ea79d100 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 93874739336336 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f542c00ada0 con 0x5560ea79d100 2024-04-26T12:50:16.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.684+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7dd490 con 0x7f54280cc040 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 foo:foo2 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f54367ac980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93874739336336 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d8ce0 con 0x7f54280cc040 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== watch-notify(notify (1) cookie 93874739128096 notify 141733920773 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f542c00ada0 con 0x7f54280cc040 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f53137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 93874739128096 notifier 4426 bl.length()=159 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(67 notify.0 [notify cookie 93874739336336 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f53137fe640 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f52f8003eb0 con 0x7f54280cc040 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== watch-notify(notify_complete (2) cookie 93874739336336 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f542c02a720 con 0x7f54280cc040 2024-04-26T12:50:16.688 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:16.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f52ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874739152400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x5560ea79d100 2024-04-26T12:50:16.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93874739152400] v33'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874739128096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x7f54280cc040 2024-04-26T12:50:16.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.688+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93874739128096] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f54367ac980 20 remove_watcher() i=0 2024-04-26T12:50:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f54367ac980 2 removed watcher, disabling cache 2024-04-26T12:50:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874739132480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x5560ea79d100 2024-04-26T12:50:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93874739132480] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f54367ac980 20 remove_watcher() i=1 2024-04-26T12:50:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874739125584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x5560ea7a6410 2024-04-26T12:50:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f5433ac6640 1 -- 172.21.15.72:0/1174821196 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93874739125584] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54280d7070 con 0x5560ea7a6410 2024-04-26T12:50:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f54367ac980 20 remove_watcher() i=2 2024-04-26T12:50:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.692+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874739138560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x7f54280cc040 2024-04-26T12:50:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.696+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93874739138560] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x7f54280cc040 2024-04-26T12:50:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.696+0000 7f54367ac980 20 remove_watcher() i=3 2024-04-26T12:50:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.696+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874739137360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x5560ea79d100 2024-04-26T12:50:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.696+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93874739137360] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f542c036040 con 0x5560ea79d100 2024-04-26T12:50:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.696+0000 7f54367ac980 20 remove_watcher() i=4 2024-04-26T12:50:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.696+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874739145664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.700+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93874739145664] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.700+0000 7f54367ac980 20 remove_watcher() i=5 2024-04-26T12:50:16.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.700+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874739147792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.700+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93874739147792] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.700+0000 7f54367ac980 20 remove_watcher() i=6 2024-04-26T12:50:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.700+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874739151344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ea7d5040 con 0x5560ea7a1aa0 2024-04-26T12:50:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54342c7640 1 -- 172.21.15.72:0/1174821196 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93874739151344] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5424008030 con 0x5560ea7a1aa0 2024-04-26T12:50:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 20 remove_watcher() i=7 2024-04-26T12:50:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea7a1aa0 msgr2=0x5560ea7a3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea7a1aa0 0x5560ea7a3e90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea79d100 msgr2=0x5560ea79f5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea79d100 0x5560ea79f5a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f54280cc040 msgr2=0x7f54280d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f54280cc040 0x7f54280d9410 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea7a6410 msgr2=0x5560ea7a8880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea7a6410 0x5560ea7a8880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5304034650 msgr2=0x7f5304036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5304034650 0x7f5304036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f542801b010 tx=0x7f54280b8040 comp rx=0 tx=0).stop 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f5434ac8640 1 -- 172.21.15.72:0/1174821196 reap_dead start 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 msgr2=0x5560ea791fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea791fa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5424017fd0 tx=0x7f54240251d0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 shutdown_connections 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/1174821196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea78acc0 0x5560ea791fa0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 >> 172.21.15.72:0/1174821196 conn(0x5560ea787000 msgr2=0x5560ea784660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 shutdown_connections 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/1174821196 wait complete. 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f530c0347f0 msgr2=0x7f530c036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f530c0347f0 0x7f530c036cb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5428000f90 tx=0x7f5428005d90 comp rx=0 tx=0).stop 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea77dcc0 msgr2=0x5560ea77e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea77dcc0 0x5560ea77e0e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f542400c510 tx=0x7f5424016b00 comp rx=0 tx=0).stop 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 shutdown_connections 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f530c0347f0 0x7f530c036cb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/54412761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea77dcc0 0x5560ea77e0e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 >> 172.21.15.72:0/54412761 conn(0x5560ea772ad0 msgr2=0x5560ea7735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 shutdown_connections 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/54412761 wait complete. 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea769230 msgr2=0x5560ea76b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5560ea769230 0x5560ea76b620 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea671a10 msgr2=0x5560ea766840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5560ea671a10 0x5560ea766840 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea76d130 msgr2=0x5560ea76f520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5560ea76d130 0x5560ea76f520 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f531c0346a0 msgr2=0x7f531c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f531c0346a0 0x7f531c036b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54280ac000 tx=0x7f54280a5000 comp rx=0 tx=0).stop 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 msgr2=0x5560ea75f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 --2- 172.21.15.72:0/2392519803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5560ea5defd0 0x5560ea75f9b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5424001e20 tx=0x7f5424000ee0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f5434ac8640 1 -- 172.21.15.72:0/2392519803 reap_dead start 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 shutdown_connections 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 >> 172.21.15.72:0/2392519803 conn(0x5560ea665a10 msgr2=0x5560ea752d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 shutdown_connections 2024-04-26T12:50:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.704+0000 7f54367ac980 1 -- 172.21.15.72:0/2392519803 wait complete. 2024-04-26T12:50:16.712 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:16.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:50:16.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:50:16.713 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-26T12:50:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7ca9cd980 1 Processor -- start 2024-04-26T12:50:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7ca9cd980 1 -- start start 2024-04-26T12:50:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7ca9cd980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5569efb5c7c0 0x5569efb5ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7ca9cd980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5569efa05510 con 0x5569efb58300 2024-04-26T12:50:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7ca9cd980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5569efa0c430 con 0x5569efb5c7c0 2024-04-26T12:50:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7c7ce7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5569efb5c7c0 0x5569efb5ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7c84e8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5569efb58300 0x5569efb586e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36098/0 (socket says 172.21.15.72:36098) 2024-04-26T12:50:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.780+0000 7fc7c84e8640 1 -- 172.21.15.72:0/2810852581 learned_addr learned my addr 172.21.15.72:0/2810852581 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c74e6640 1 -- 172.21.15.72:0/2810852581 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012546554 0 0) 0x5569efa05510 con 0x5569efb58300 2024-04-26T12:50:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c74e6640 1 -- 172.21.15.72:0/2810852581 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7b0001e20 con 0x5569efb58300 2024-04-26T12:50:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/2810852581 >> v1:172.21.15.29:6789/0 conn(0x5569efb58300 legacy=0x5569efb586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/2810852581 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ef9e1ae0 con 0x5569efb5c7c0 2024-04-26T12:50:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/2810852581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb5c7c0 0x5569efb5ebb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00a480 tx=0x7fc7bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11db99ea093d8f9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c74e6640 1 -- 172.21.15.72:0/2810852581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc0b0070 con 0x5569efb5c7c0 2024-04-26T12:50:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c74e6640 1 -- 172.21.15.72:0/2810852581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0ab540 con 0x5569efb5c7c0 2024-04-26T12:50:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7c74e6640 1 -- 172.21.15.72:0/2810852581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc0ab820 con 0x5569efb5c7c0 2024-04-26T12:50:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2810852581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb5c7c0 msgr2=0x5569efb5ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/2810852581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb5c7c0 0x5569efb5ebb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00a480 tx=0x7fc7bc01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2810852581 shutdown_connections 2024-04-26T12:50:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/2810852581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb5c7c0 0x5569efb5ebb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2810852581 >> 172.21.15.72:0/2810852581 conn(0x5569efb53bd0 msgr2=0x5569efb55ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2810852581 shutdown_connections 2024-04-26T12:50:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.784+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2810852581 wait complete. 2024-04-26T12:50:16.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 Processor -- start 2024-04-26T12:50:16.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- start start 2024-04-26T12:50:16.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5569efa5ba70 con 0x5569efb58300 2024-04-26T12:50:16.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:49994/0 (socket says 172.21.15.72:49994) 2024-04-26T12:50:16.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7c84e8640 1 -- 172.21.15.72:0/2189489668 learned_addr learned my addr 172.21.15.72:0/2189489668 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7c84e8640 1 -- 172.21.15.72:0/2189489668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569efc437b0 con 0x5569efb58300 2024-04-26T12:50:16.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/2189489668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc431e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8001dc0 tx=0x7fc7b800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4015556570df29e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc6b660c640 1 -- 172.21.15.72:0/2189489668 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8012020 con 0x5569efb58300 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc6b660c640 1 -- 172.21.15.72:0/2189489668 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b800e7c0 con 0x5569efb58300 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc6b660c640 1 -- 172.21.15.72:0/2189489668 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b800eb40 con 0x5569efb58300 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2189489668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 msgr2=0x5569efc431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/2189489668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc431e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8001dc0 tx=0x7fc7b800b6d0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2189489668 shutdown_connections 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/2189489668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc431e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2189489668 >> 172.21.15.72:0/2189489668 conn(0x5569efb53bd0 msgr2=0x5569efc3ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2189489668 shutdown_connections 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/2189489668 wait complete. 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 Processor -- start 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- start start 2024-04-26T12:50:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc4a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7ca9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5569efb61be0 con 0x5569efb58300 2024-04-26T12:50:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.800+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc4a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc4a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50006/0 (socket says 172.21.15.72:50006) 2024-04-26T12:50:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c84e8640 1 -- 172.21.15.72:0/1118035156 learned_addr learned my addr 172.21.15.72:0/1118035156 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c84e8640 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569efc4aa10 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc4a4d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5569efc44070 tx=0x7fc7b8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc6b4e09640 1 -- 172.21.15.72:0/1118035156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8012030 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569efc4aca0 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc6b4e09640 1 -- 172.21.15.72:0/1118035156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8001440 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc6b4e09640 1 -- 172.21.15.72:0/1118035156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b801aaf0 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569efc4d8e0 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc6b4e09640 1 -- 172.21.15.72:0/1118035156 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc7b8015020 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc6b4e09640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6b0034650 0x7fc6b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc6b4e09640 1 -- 172.21.15.72:0/1118035156 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fc7b8020030 con 0x5569efb58300 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6b0034650 0x7fc6b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efb5c7c0 0x5569efc51440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc51a60 con 0x5569efb5c7c0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c8ce9640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efb5c7c0 0x5569efc51440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6b0034650 0x7fc6b0036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0ad000 tx=0x7fc7bc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c8ce9640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efb5c7c0 0x5569efc51440 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/1118035156 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efb5c7c0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc4eb00 con 0x5569efb5c7c0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/1118035156 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efb5c7c0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc53db0 0x5569efc561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.804+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc56870 con 0x5569efc53db0 2024-04-26T12:50:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc53db0 0x5569efc561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc53db0 0x5569efc561a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c84e8640 1 -- 172.21.15.72:0/1118035156 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7b8008030 con 0x5569efc53db0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc52c50 con 0x5569efb5c7c0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/1118035156 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efb5c7c0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc57cb0 0x5569efc5a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc5a830 con 0x5569efc57cb0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc57cb0 0x5569efc5a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc57cb0 0x5569efc5a0a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/1118035156 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7bc0b3040 con 0x5569efc57cb0 2024-04-26T12:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7ca9cd980 1 Processor -- start 2024-04-26T12:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7ca9cd980 1 -- start start 2024-04-26T12:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7ca9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569eface250 0x5569efacc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7ca9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5569efa5fab0 con 0x5569eface250 2024-04-26T12:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569eface250 0x5569efacc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569eface250 0x5569efacc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50010/0 (socket says 172.21.15.72:50010) 2024-04-26T12:50:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.808+0000 7fc7c84e8640 1 -- 172.21.15.72:0/3739031685 learned_addr learned my addr 172.21.15.72:0/3739031685 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c84e8640 1 -- 172.21.15.72:0/3739031685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569efaccc30 con 0x5569eface250 2024-04-26T12:50:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569eface250 0x5569efacc6f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80485b0 tx=0x7fc7b800db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc6adffb640 1 -- 172.21.15.72:0/3739031685 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b801adc0 con 0x5569eface250 2024-04-26T12:50:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc6adffb640 1 -- 172.21.15.72:0/3739031685 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8017c50 con 0x5569eface250 2024-04-26T12:50:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569efaccf20 con 0x5569eface250 2024-04-26T12:50:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc6adffb640 1 -- 172.21.15.72:0/3739031685 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8041c10 con 0x5569eface250 2024-04-26T12:50:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569efacd3f0 con 0x5569eface250 2024-04-26T12:50:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc6adffb640 1 -- 172.21.15.72:0/3739031685 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc7b8009070 con 0x5569eface250 2024-04-26T12:50:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc6adffb640 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6a0034650 0x7fc6a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc6adffb640 1 -- 172.21.15.72:0/3739031685 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fc7b8005050 con 0x5569eface250 2024-04-26T12:50:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6a0034650 0x7fc6a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7ca9cd980 1 Processor -- start 2024-04-26T12:50:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7ca9cd980 1 -- start start 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6a0034650 0x7fc6a0036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc017e90 tx=0x7fc7bc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7ca9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc77f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7ca9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5569efc43b00 con 0x5569efc77b10 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc77f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc77f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50026/0 (socket says 172.21.15.72:50026) 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c84e8640 1 -- 172.21.15.72:0/3715585760 learned_addr learned my addr 172.21.15.72:0/3715585760 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.812+0000 7fc7c84e8640 1 -- 172.21.15.72:0/3715585760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569efc78500 con 0x5569efc77b10 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/3715585760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc77f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8016db0 tx=0x7fc7b8041db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496c2ee49545cd76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc6a77fe640 1 -- 172.21.15.72:0/3715585760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80445d0 con 0x5569efc77b10 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc6a77fe640 1 -- 172.21.15.72:0/3715585760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8019dd0 con 0x5569efc77b10 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc6a77fe640 1 -- 172.21.15.72:0/3715585760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b804c450 con 0x5569efc77b10 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3715585760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 msgr2=0x5569efc77f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/3715585760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc77f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8016db0 tx=0x7fc7b8041db0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3715585760 shutdown_connections 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/3715585760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc77f30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3715585760 >> 172.21.15.72:0/3715585760 conn(0x5569efc73e50 msgr2=0x5569efc71eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3715585760 shutdown_connections 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3715585760 wait complete. 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 Processor -- start 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- start start 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc7ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5569efc78b30 con 0x5569efc77b10 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc7ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7c84e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc7ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50032/0 (socket says 172.21.15.72:50032) 2024-04-26T12:50:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 learned_addr learned my addr 172.21.15.72:0/4282077186 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569efc7f2c0 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc7ed80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8051040 tx=0x7fc7b8041b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc6a5ffb640 1 -- 172.21.15.72:0/4282077186 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80443f0 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569efc7f2c0 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc6a5ffb640 1 -- 172.21.15.72:0/4282077186 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8016710 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc6a5ffb640 1 -- 172.21.15.72:0/4282077186 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80420c0 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.816+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569efc7f2c0 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc6a5ffb640 1 -- 172.21.15.72:0/4282077186 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc7b8011170 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc6a5ffb640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc698034600 0x7fc698036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc6a5ffb640 1 -- 172.21.15.72:0/4282077186 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fc7b8066070 con 0x5569efc77b10 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc698034600 0x7fc698036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efc89de0 0x5569efc8c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8c9d0 con 0x5569efc89de0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c8ce9640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efc89de0 0x5569efc8c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc698034600 0x7fc698036ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0acfd0 tx=0x7fc7bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c8ce9640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efc89de0 0x5569efc8c280 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 realm 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8cde0 con 0x5569efc89de0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8d680 con 0x5569efc89de0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc8e780 0x5569efc90b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc910f0 con 0x5569efc8e780 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc8e780 0x5569efc90b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c84e8640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc8e780 0x5569efc90b70 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 20 searching for the correct realm 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc93020 0x5569efc954b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc95b80 con 0x5569efc93020 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.820+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc93020 0x5569efc954b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc93020 0x5569efc954b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c7ce7640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc7bc0dd040 0x7fc7bc0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc95b80 con 0x7fc7bc0dd040 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc7bc0dd040 0x7fc7bc0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc7bc0dd040 0x7fc7bc0cf430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x7fc7bc0dd040 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.824+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x7fc7bc0dd040 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.828+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x7fc7bc0dd040 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x7fc7bc0dd040 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc93020 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc8e780 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.832+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x5569efc89de0 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5569efc8da20 con 0x7fc7bc0dd040 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc91940 con 0x5569efc89de0 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc91940 con 0x5569efc89de0 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc91940 con 0x5569efc93020 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 zone default found 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 4 Realm: () 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 zonegroup default 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc921e0 con 0x5569efc8e780 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc979e0 con 0x5569efc93020 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc97d80 con 0x5569efc93020 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 started sync module instance, tier type = 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc96e80 con 0x7fc7bc0dd040 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93913482884048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc96e80 con 0x7fc7bc0dd040 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.836+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc98740 con 0x5569efc89de0 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.840+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93913482884048] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.840+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.840+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93913482888096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc96e80 con 0x5569efc89de0 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.840+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc99150 con 0x5569efc93020 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93913482888096] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93913482881488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc96df0 con 0x5569efc93020 2024-04-26T12:50:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc99e50 con 0x7fc7bc0dd040 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93913482894000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9a520 con 0x7fc7bc0dd040 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9b040 con 0x5569efc89de0 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93913482881488] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93913482894000] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93913482898192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9b000 con 0x5569efc89de0 2024-04-26T12:50:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.844+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9b430 con 0x5569efc8e780 2024-04-26T12:50:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93913482898192] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93913482892528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9b820 con 0x5569efc8e780 2024-04-26T12:50:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9c0b0 con 0x5569efc8e780 2024-04-26T12:50:16.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93913482892528] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93913482895216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9bce0 con 0x5569efc8e780 2024-04-26T12:50:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.848+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9ce90 con 0x5569efc8e780 2024-04-26T12:50:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93913482905952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9d300 con 0x5569efc8e780 2024-04-26T12:50:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=0 2024-04-26T12:50:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=1 2024-04-26T12:50:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=2 2024-04-26T12:50:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=3 2024-04-26T12:50:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=4 2024-04-26T12:50:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=5 2024-04-26T12:50:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93913482895216] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=6 2024-04-26T12:50:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93913482905952] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 20 add_watcher() i=7 2024-04-26T12:50:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9d300 con 0x5569efc89de0 2024-04-26T12:50:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.852+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93913482907216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efc9d270 con 0x5569efc89de0 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93913482907216] v33'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc67e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 5 note: GC not initialized 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc67d7e2640 20 reqs_thread_entry: start 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 Filter name: none 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc5eeffd640 20 reqs_thread_entry: start 2024-04-26T12:50:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc3720 con 0x5569efc89de0 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc4110 con 0x5569efc89de0 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc5120 con 0x7fc7bc0dd040 2024-04-26T12:50:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc67e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93913482907216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x5569efc89de0 2024-04-26T12:50:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93913482907216] v33'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.856+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93913482884048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.860+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93913482884048] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.860+0000 7fc7ca9cd980 20 remove_watcher() i=0 2024-04-26T12:50:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.860+0000 7fc7ca9cd980 2 removed watcher, disabling cache 2024-04-26T12:50:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.860+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93913482888096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x5569efc89de0 2024-04-26T12:50:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.860+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93913482888096] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.860+0000 7fc7ca9cd980 20 remove_watcher() i=1 2024-04-26T12:50:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.860+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93913482881488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x5569efc93020 2024-04-26T12:50:16.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7c7ce7640 1 -- 172.21.15.72:0/4282077186 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93913482881488] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc0ca030 con 0x5569efc93020 2024-04-26T12:50:16.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7ca9cd980 20 remove_watcher() i=2 2024-04-26T12:50:16.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93913482894000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93913482894000] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x7fc7bc0dd040 2024-04-26T12:50:16.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7ca9cd980 20 remove_watcher() i=3 2024-04-26T12:50:16.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93913482898192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x5569efc89de0 2024-04-26T12:50:16.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93913482898192] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c000a4d0 con 0x5569efc89de0 2024-04-26T12:50:16.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7ca9cd980 20 remove_watcher() i=4 2024-04-26T12:50:16.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.864+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93913482892528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x5569efc8e780 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.868+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93913482892528] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.868+0000 7fc7ca9cd980 20 remove_watcher() i=5 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.868+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93913482895216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x5569efc8e780 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.868+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93913482895216] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.868+0000 7fc7ca9cd980 20 remove_watcher() i=6 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.868+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93913482905952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5569efcc14b0 con 0x5569efc8e780 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7c84e8640 1 -- 172.21.15.72:0/4282077186 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93913482905952] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803f020 con 0x5569efc8e780 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 20 remove_watcher() i=7 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc8e780 msgr2=0x5569efc90b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc8e780 0x5569efc90b70 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efc89de0 msgr2=0x5569efc8c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efc89de0 0x5569efc8c280 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc7bc0dd040 msgr2=0x7fc7bc0cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc7bc0dd040 0x7fc7bc0cf430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc93020 msgr2=0x5569efc954b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc93020 0x5569efc954b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc698034600 msgr2=0x7fc698036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc698034600 0x7fc698036ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0acfd0 tx=0x7fc7bc0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 msgr2=0x5569efc7ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/4282077186 reap_dead start 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc7ed80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8051040 tx=0x7fc7b8041b40 comp rx=0 tx=0).stop 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 shutdown_connections 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/4282077186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efc77b10 0x5569efc7ed80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 >> 172.21.15.72:0/4282077186 conn(0x5569efc73e50 msgr2=0x5569efc714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 shutdown_connections 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/4282077186 wait complete. 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6a0034650 msgr2=0x7fc6a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6a0034650 0x7fc6a0036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc017e90 tx=0x7fc7bc005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569eface250 msgr2=0x5569efacc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569eface250 0x5569efacc6f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80485b0 tx=0x7fc7b800db30 comp rx=0 tx=0).stop 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 shutdown_connections 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6a0034650 0x7fc6a0036b10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/3739031685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569eface250 0x5569efacc6f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 >> 172.21.15.72:0/3739031685 conn(0x5569efc5d690 msgr2=0x5569efc5e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 shutdown_connections 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/3739031685 wait complete. 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc53db0 msgr2=0x5569efc561a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5569efc53db0 0x5569efc561a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efb5c7c0 msgr2=0x5569efc51440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5569efb5c7c0 0x5569efc51440 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc57cb0 msgr2=0x5569efc5a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5569efc57cb0 0x5569efc5a0a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6b0034650 msgr2=0x7fc6b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc6b0034650 0x7fc6b0036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0ad000 tx=0x7fc7bc0a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 msgr2=0x5569efc4a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 --2- 172.21.15.72:0/1118035156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5569efb58300 0x5569efc4a4d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5569efc44070 tx=0x7fc7b8000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7c8ce9640 1 -- 172.21.15.72:0/1118035156 reap_dead start 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 shutdown_connections 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 >> 172.21.15.72:0/1118035156 conn(0x5569efb53bd0 msgr2=0x5569efc3d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 shutdown_connections 2024-04-26T12:50:16.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.872+0000 7fc7ca9cd980 1 -- 172.21.15.72:0/1118035156 wait complete. 2024-04-26T12:50:16.882 INFO:teuthology.orchestra.run.smithi072.stdout:[] 2024-04-26T12:50:16.883 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:50:16.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-26T12:50:16.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-26T12:50:16.883 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-26T12:50:16.958 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:16.958 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:16.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcd9f3980 1 Processor -- start 2024-04-26T12:50:16.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcd9f3980 1 -- start start 2024-04-26T12:50:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcd9f3980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55616079d9f0 0x55616079fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcd9f3980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556160644510 con 0x5561607994e0 2024-04-26T12:50:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcd9f3980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55616064b430 con 0x55616079d9f0 2024-04-26T12:50:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcad0d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55616079d9f0 0x55616079fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcad0d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55616079d9f0 0x55616079fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50034/0 (socket says 172.21.15.72:50034) 2024-04-26T12:50:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcad0d640 1 -- 172.21.15.72:0/1788764323 learned_addr learned my addr 172.21.15.72:0/1788764323 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcad0d640 1 -- 172.21.15.72:0/1788764323 >> v1:172.21.15.29:6789/0 conn(0x5561607994e0 legacy=0x5561607998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.960+0000 7efdcad0d640 1 -- 172.21.15.72:0/1788764323 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556160620ae0 con 0x55616079d9f0 2024-04-26T12:50:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcad0d640 1 --2- 172.21.15.72:0/1788764323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55616079d9f0 0x55616079fde0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00a4e0 tx=0x7efdbc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b341f43491988d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdca50c640 1 -- 172.21.15.72:0/1788764323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc0aa540 con 0x55616079d9f0 2024-04-26T12:50:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdca50c640 1 -- 172.21.15.72:0/1788764323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdbc0aa6e0 con 0x55616079d9f0 2024-04-26T12:50:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdca50c640 1 -- 172.21.15.72:0/1788764323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc0aaa40 con 0x55616079d9f0 2024-04-26T12:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1788764323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55616079d9f0 msgr2=0x55616079fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/1788764323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55616079d9f0 0x55616079fde0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00a4e0 tx=0x7efdbc01b090 comp rx=0 tx=0).stop 2024-04-26T12:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1788764323 shutdown_connections 2024-04-26T12:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/1788764323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55616079d9f0 0x55616079fde0 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00a4e0 tx=0x7efdbc01b090 comp rx=0 tx=0).stop 2024-04-26T12:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1788764323 >> 172.21.15.72:0/1788764323 conn(0x55616070cbc0 msgr2=0x55616070cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1788764323 shutdown_connections 2024-04-26T12:50:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.964+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1788764323 wait complete. 2024-04-26T12:50:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.976+0000 7efdcd9f3980 1 Processor -- start 2024-04-26T12:50:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.976+0000 7efdcd9f3980 1 -- start start 2024-04-26T12:50:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.976+0000 7efdcd9f3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x556160884750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.976+0000 7efdcd9f3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55616069aa70 con 0x5561607994e0 2024-04-26T12:50:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.976+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x556160884750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.976+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x556160884750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50050/0 (socket says 172.21.15.72:50050) 2024-04-26T12:50:16.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.976+0000 7efdcb50e640 1 -- 172.21.15.72:0/2887462542 learned_addr learned my addr 172.21.15.72:0/2887462542 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcb50e640 1 -- 172.21.15.72:0/2887462542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556160884d20 con 0x5561607994e0 2024-04-26T12:50:16.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcb50e640 1 --2- 172.21.15.72:0/2887462542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x556160884750 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001ea0 tx=0x7efdc000b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c2830a3f4b270 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efcb960a640 1 -- 172.21.15.72:0/2887462542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc000a040 con 0x5561607994e0 2024-04-26T12:50:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efcb960a640 1 -- 172.21.15.72:0/2887462542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc000f620 con 0x5561607994e0 2024-04-26T12:50:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efcb960a640 1 -- 172.21.15.72:0/2887462542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc000f890 con 0x5561607994e0 2024-04-26T12:50:16.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2887462542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 msgr2=0x556160884750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2887462542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x556160884750 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001ea0 tx=0x7efdc000b680 comp rx=0 tx=0).stop 2024-04-26T12:50:16.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2887462542 shutdown_connections 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2887462542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x556160884750 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2887462542 >> 172.21.15.72:0/2887462542 conn(0x55616070cbc0 msgr2=0x556160880240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2887462542 shutdown_connections 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2887462542 wait complete. 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 Processor -- start 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 -- start start 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x55616088ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcd9f3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5561607a2e10 con 0x5561607994e0 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x55616088ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x55616088ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50052/0 (socket says 172.21.15.72:50052) 2024-04-26T12:50:16.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcb50e640 1 -- 172.21.15.72:0/2233210834 learned_addr learned my addr 172.21.15.72:0/2233210834 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcb50e640 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55616088bf40 con 0x5561607994e0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efdcb50e640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x55616088ba00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001fd0 tx=0x7efdc0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.980+0000 7efcb7e07640 1 -- 172.21.15.72:0/2233210834 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0001520 con 0x5561607994e0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55616088c1d0 con 0x5561607994e0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efcb7e07640 1 -- 172.21.15.72:0/2233210834 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc001ca10 con 0x5561607994e0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efcb7e07640 1 -- 172.21.15.72:0/2233210834 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc001cd50 con 0x5561607994e0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55616088ee10 con 0x5561607994e0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efcb7e07640 1 -- 172.21.15.72:0/2233210834 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdc0017050 con 0x5561607994e0 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efcb7e07640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efcb0034650 0x7efcb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efcb7e07640 1 -- 172.21.15.72:0/2233210834 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efdc0015020 con 0x5561607994e0 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcad0d640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efcb0034650 0x7efcb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556160890a50 0x556160892e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556160893380 con 0x556160890a50 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcbd0f640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556160890a50 0x556160892e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcad0d640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efcb0034650 0x7efcb0036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0ab000 tx=0x7efdbc0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcbd0f640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556160890a50 0x556160892e40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcbd0f640 1 -- 172.21.15.72:0/2233210834 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x556160890a50 2024-04-26T12:50:16.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556160890030 con 0x556160890a50 2024-04-26T12:50:16.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcbd0f640 1 -- 172.21.15.72:0/2233210834 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdc40083f0 con 0x556160890a50 2024-04-26T12:50:16.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608956d0 0x556160897ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608981b0 con 0x5561608956d0 2024-04-26T12:50:16.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcb50e640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608956d0 0x556160897ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.984+0000 7efdcb50e640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608956d0 0x556160897ac0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcb50e640 1 -- 172.21.15.72:0/2233210834 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efdc002e070 con 0x5561608956d0 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556160894570 con 0x556160890a50 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcbd0f640 1 -- 172.21.15.72:0/2233210834 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdc40083f0 con 0x556160890a50 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556160899610 0x55616089ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55616089c140 con 0x556160899610 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcad0d640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556160899610 0x55616089ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcad0d640 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556160899610 0x55616089ba00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcad0d640 1 -- 172.21.15.72:0/2233210834 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efdbc0aaab0 con 0x556160899610 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 Processor -- start 2024-04-26T12:50:16.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 -- start start 2024-04-26T12:50:16.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608aa190 0x5561608aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55616069eab0 con 0x5561608aa190 2024-04-26T12:50:16.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608aa190 0x5561608aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608aa190 0x5561608aa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50060/0 (socket says 172.21.15.72:50060) 2024-04-26T12:50:16.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcb50e640 1 -- 172.21.15.72:0/2753611289 learned_addr learned my addr 172.21.15.72:0/2753611289 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcb50e640 1 -- 172.21.15.72:0/2753611289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561608aaaf0 con 0x5561608aa190 2024-04-26T12:50:16.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcb50e640 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608aa190 0x5561608aa5b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efdc001dfd0 tx=0x7efdc0018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efcb5602640 1 -- 172.21.15.72:0/2753611289 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0013130 con 0x5561608aa190 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efcb5602640 1 -- 172.21.15.72:0/2753611289 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc00132d0 con 0x5561608aa190 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561608ab590 con 0x5561608aa190 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efcb5602640 1 -- 172.21.15.72:0/2753611289 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc00135b0 con 0x5561608aa190 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.988+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561608aba60 con 0x5561608aa190 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efcb5602640 1 -- 172.21.15.72:0/2753611289 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdc0041bd0 con 0x5561608aa190 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efcb5602640 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efca4034650 0x7efca4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efcb5602640 1 -- 172.21.15.72:0/2753611289 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efdc0033070 con 0x5561608aa190 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcad0d640 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efca4034650 0x7efca4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 Processor -- start 2024-04-26T12:50:16.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- start start 2024-04-26T12:50:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcad0d640 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efca4034650 0x7efca4036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x556160893850 tx=0x7efdbc005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556160885070 con 0x5561608b7190 2024-04-26T12:50:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50076/0 (socket says 172.21.15.72:50076) 2024-04-26T12:50:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcb50e640 1 -- 172.21.15.72:0/1761104709 learned_addr learned my addr 172.21.15.72:0/1761104709 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:16.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcb50e640 1 -- 172.21.15.72:0/1761104709 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561608b7b80 con 0x5561608b7190 2024-04-26T12:50:16.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcb50e640 1 --2- 172.21.15.72:0/1761104709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608b75b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efdc003f4e0 tx=0x7efdc003f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6345464124fd8ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efcaeffd640 1 -- 172.21.15.72:0/1761104709 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0029de0 con 0x5561608b7190 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efcaeffd640 1 -- 172.21.15.72:0/1761104709 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc00138b0 con 0x5561608b7190 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efcaeffd640 1 -- 172.21.15.72:0/1761104709 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0027430 con 0x5561608b7190 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1761104709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 msgr2=0x5561608b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/1761104709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608b75b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efdc003f4e0 tx=0x7efdc003f720 comp rx=0 tx=0).stop 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1761104709 shutdown_connections 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/1761104709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608b75b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1761104709 >> 172.21.15.72:0/1761104709 conn(0x5561608b3520 msgr2=0x5561608b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1761104709 shutdown_connections 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- 172.21.15.72:0/1761104709 wait complete. 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 Processor -- start 2024-04-26T12:50:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- start start 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608be4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.992+0000 7efdcd9f3980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5561608b8270 con 0x5561608b7190 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608be4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcb50e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608be4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50090/0 (socket says 172.21.15.72:50090) 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 learned_addr learned my addr 172.21.15.72:0/3236433988 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561608be9f0 con 0x5561608b7190 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcb50e640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608be4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efdc003f4e0 tx=0x7efdc000cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efcad7fa640 1 -- 172.21.15.72:0/3236433988 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0070070 con 0x5561608b7190 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561608be9f0 con 0x5561608b7190 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efcad7fa640 1 -- 172.21.15.72:0/3236433988 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc003fc50 con 0x5561608b7190 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561608be9f0 con 0x5561608b7190 2024-04-26T12:50:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efcad7fa640 1 -- 172.21.15.72:0/3236433988 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0007150 con 0x5561608b7190 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efcad7fa640 1 -- 172.21.15.72:0/3236433988 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdc0048b60 con 0x5561608b7190 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efcad7fa640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc94034650 0x7efc94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efcad7fa640 1 -- 172.21.15.72:0/3236433988 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efdc0068070 con 0x5561608b7190 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcad0d640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc94034650 0x7efc94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5561608c9420 0x5561608cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608cc010 con 0x5561608c9420 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcbd0f640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5561608c9420 0x5561608cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcad0d640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc94034650 0x7efc94036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00a4e0 tx=0x7efdbc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcbd0f640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5561608c9420 0x5561608cb8c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x5561608c9420 2024-04-26T12:50:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 20 realm 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608cc420 con 0x5561608c9420 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x5561608c9420 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:16.996+0000 7efdcd9f3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608cccc0 con 0x5561608c9420 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x5561608c9420 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608c9420 2024-04-26T12:50:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdc40083f0 con 0x5561608c9420 2024-04-26T12:50:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608cddc0 0x5561608d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608d06f0 con 0x5561608cddc0 2024-04-26T12:50:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcb50e640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608cddc0 0x5561608d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcb50e640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608cddc0 0x5561608d01b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 20 searching for the correct realm 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5561608d2660 0x5561608d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608d51f0 con 0x5561608d2660 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcad0d640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5561608d2660 0x5561608d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcad0d640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5561608d2660 0x5561608d4b20 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcad0d640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efdbc0ce040 0x7efdbc0db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608d51f0 con 0x7efdbc0ce040 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcbd0f640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efdbc0ce040 0x7efdbc0db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcbd0f640 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efdbc0ce040 0x7efdbc0db410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x7efdbc0ce040 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.000+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608cddc0 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608c9420 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x5561608c9420 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608c9420 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608cddc0 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608cddc0 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x7efdbc0ce040 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x7efdbc0ce040 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608d2660 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608c9420 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608cddc0 2024-04-26T12:50:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608c9420 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x7efdbc0ce040 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efdc4026040 con 0x7efdbc0ce040 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.004+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5561608cd060 con 0x5561608d2660 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608d2660 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608cddc0 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608d2660 2024-04-26T12:50:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608d2660 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608c9420 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608c9420 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608cddc0 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608d2660 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x7efdbc0ce040 2024-04-26T12:50:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x7efdbc0ce040 2024-04-26T12:50:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608c9420 2024-04-26T12:50:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.008+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608cddc0 2024-04-26T12:50:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608d2660 2024-04-26T12:50:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608cddc0 2024-04-26T12:50:17.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x7efdbc0ce040 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x7efdbc0ce040 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608d2660 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608cddc0 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x5561608c9420 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efdbc0e8040 con 0x7efdbc0ce040 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4026040 con 0x7efdbc0ce040 2024-04-26T12:50:17.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608d0f40 con 0x5561608c9420 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608d0f40 con 0x5561608c9420 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdc4026040 con 0x5561608c9420 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608d0f40 con 0x5561608d2660 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 zone default found 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 4 Realm: () 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 zonegroup default 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.012+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608d17e0 con 0x5561608cddc0 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608d7050 con 0x5561608d2660 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608d73f0 con 0x5561608d2660 2024-04-26T12:50:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 20 started sync module instance, tier type = 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d64f0 con 0x7efdbc0ce040 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4026040 con 0x7efdbc0ce040 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93876720069104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d64f0 con 0x7efdbc0ce040 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d7e40 con 0x5561608c9420 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.016+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93876720069104] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdbc0ce040 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93876720073008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d64f0 con 0x5561608c9420 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d8850 con 0x5561608d2660 2024-04-26T12:50:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93876720075680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d90f0 con 0x5561608d2660 2024-04-26T12:50:17.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d9ab0 con 0x7efdbc0ce040 2024-04-26T12:50:17.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93876720073008] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdbc0ce040 2024-04-26T12:50:17.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93876720080384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d9a20 con 0x7efdbc0ce040 2024-04-26T12:50:17.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.020+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608da800 con 0x5561608c9420 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93876720080384] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdbc0ce040 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93876720075680] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93876720077888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608da2c0 con 0x5561608c9420 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608dab50 con 0x5561608cddc0 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93876720077888] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93876720082336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608da670 con 0x5561608cddc0 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.024+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608db560 con 0x5561608cddc0 2024-04-26T12:50:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93876720087216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608db980 con 0x5561608cddc0 2024-04-26T12:50:17.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608dc3c0 con 0x5561608cddc0 2024-04-26T12:50:17.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93876720082336] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93876720087216] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93876720090768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608db510 con 0x5561608cddc0 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 20 add_watcher() i=0 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 20 add_watcher() i=1 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 20 add_watcher() i=2 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 20 add_watcher() i=3 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 20 add_watcher() i=4 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 20 add_watcher() i=5 2024-04-26T12:50:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.028+0000 7efdcd9f3980 20 add_watcher() i=6 2024-04-26T12:50:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93876720090768] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 add_watcher() i=7 2024-04-26T12:50:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561608df4c0 con 0x5561608c9420 2024-04-26T12:50:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93876720083392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608dc940 con 0x5561608c9420 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93876720083392] v33'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 5 note: GC not initialized 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efc80fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 Filter name: none 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efbfa7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561609026b0 con 0x5561608c9420 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561609030a0 con 0x5561608c9420 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5561609040b0 con 0x7efdbc0ce040 2024-04-26T12:50:17.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.032+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdbc0ce040 2024-04-26T12:50:17.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93876720083392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608e1a70 con 0x5561608c9420 2024-04-26T12:50:17.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93876720083392] v33'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93876720069104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608da1c0 con 0x7efdbc0ce040 2024-04-26T12:50:17.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93876720069104] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdbc0ce040 2024-04-26T12:50:17.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efdcd9f3980 20 remove_watcher() i=0 2024-04-26T12:50:17.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efdcd9f3980 2 removed watcher, disabling cache 2024-04-26T12:50:17.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.036+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93876720073008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608da1c0 con 0x5561608c9420 2024-04-26T12:50:17.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93876720073008] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcd9f3980 20 remove_watcher() i=1 2024-04-26T12:50:17.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93876720075680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608da1c0 con 0x5561608d2660 2024-04-26T12:50:17.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcad0d640 1 -- 172.21.15.72:0/3236433988 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93876720075680] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdbc0d9070 con 0x5561608d2660 2024-04-26T12:50:17.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcd9f3980 20 remove_watcher() i=2 2024-04-26T12:50:17.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93876720080384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d83a0 con 0x7efdbc0ce040 2024-04-26T12:50:17.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93876720080384] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdbc0ce040 2024-04-26T12:50:17.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcd9f3980 20 remove_watcher() i=3 2024-04-26T12:50:17.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.040+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93876720077888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608da1c0 con 0x5561608c9420 2024-04-26T12:50:17.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.044+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93876720077888] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x5561608c9420 2024-04-26T12:50:17.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.044+0000 7efdcd9f3980 20 remove_watcher() i=4 2024-04-26T12:50:17.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.044+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93876720082336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d9600 con 0x5561608cddc0 2024-04-26T12:50:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.044+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93876720082336] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.044+0000 7efdcd9f3980 20 remove_watcher() i=5 2024-04-26T12:50:17.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.044+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93876720087216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d83a0 con 0x5561608cddc0 2024-04-26T12:50:17.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.048+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93876720087216] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.048+0000 7efdcd9f3980 20 remove_watcher() i=6 2024-04-26T12:50:17.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.048+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93876720090768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5561608d9600 con 0x5561608cddc0 2024-04-26T12:50:17.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.048+0000 7efdcb50e640 1 -- 172.21.15.72:0/3236433988 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93876720090768] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc002e070 con 0x5561608cddc0 2024-04-26T12:50:17.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.048+0000 7efdcd9f3980 20 remove_watcher() i=7 2024-04-26T12:50:17.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.048+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608cddc0 msgr2=0x5561608d01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608cddc0 0x5561608d01b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5561608c9420 msgr2=0x5561608cb8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5561608c9420 0x5561608cb8c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efdbc0ce040 msgr2=0x7efdbc0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efdbc0ce040 0x7efdbc0db410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5561608d2660 msgr2=0x5561608d4b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5561608d2660 0x5561608d4b20 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc94034650 msgr2=0x7efc94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc94034650 0x7efc94036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00a4e0 tx=0x7efdbc0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 msgr2=0x5561608be4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcbd0f640 1 -- 172.21.15.72:0/3236433988 reap_dead start 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608be4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efdc003f4e0 tx=0x7efdc000cfd0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 shutdown_connections 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/3236433988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608b7190 0x5561608be4b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 >> 172.21.15.72:0/3236433988 conn(0x5561608b3520 msgr2=0x5561608b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 shutdown_connections 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/3236433988 wait complete. 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efca4034650 msgr2=0x7efca4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efca4034650 0x7efca4036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x556160893850 tx=0x7efdbc005e50 comp rx=0 tx=0).stop 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608aa190 msgr2=0x5561608aa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608aa190 0x5561608aa5b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efdc001dfd0 tx=0x7efdc0018d50 comp rx=0 tx=0).stop 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 shutdown_connections 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efca4034650 0x7efca4036b10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2753611289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561608aa190 0x5561608aa5b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 >> 172.21.15.72:0/2753611289 conn(0x55616089efa0 msgr2=0x55616089fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 shutdown_connections 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2753611289 wait complete. 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608956d0 msgr2=0x556160897ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5561608956d0 0x556160897ac0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556160890a50 msgr2=0x556160892e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556160890a50 0x556160892e40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556160899610 msgr2=0x55616089ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556160899610 0x55616089ba00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efcb0034650 msgr2=0x7efcb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efcb0034650 0x7efcb0036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0ab000 tx=0x7efdbc0a5000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 msgr2=0x55616088ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 --2- 172.21.15.72:0/2233210834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5561607994e0 0x55616088ba00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001fd0 tx=0x7efdc0000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcbd0f640 1 -- 172.21.15.72:0/2233210834 reap_dead start 2024-04-26T12:50:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 shutdown_connections 2024-04-26T12:50:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 >> 172.21.15.72:0/2233210834 conn(0x55616070cbc0 msgr2=0x55616087ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 shutdown_connections 2024-04-26T12:50:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.052+0000 7efdcd9f3980 1 -- 172.21.15.72:0/2233210834 wait complete. 2024-04-26T12:50:17.060 INFO:teuthology.orchestra.run.smithi072.stdout:[] 2024-04-26T12:50:17.060 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:50:17.080 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-26T12:50:17.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-26T12:50:17.080 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-26T12:50:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab548d9980 1 Processor -- start 2024-04-26T12:50:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab548d9980 1 -- start start 2024-04-26T12:50:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab548d9980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5628b3f1d950 0x5628b3f1bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab548d9980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628b3e54510 con 0x5628b3f1c440 2024-04-26T12:50:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab548d9980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5628b3e5b430 con 0x5628b3f1d950 2024-04-26T12:50:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab523f4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5628b3f1d950 0x5628b3f1bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab523f4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5628b3f1d950 0x5628b3f1bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50104/0 (socket says 172.21.15.72:50104) 2024-04-26T12:50:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab523f4640 1 -- 172.21.15.72:0/2200705379 learned_addr learned my addr 172.21.15.72:0/2200705379 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab523f4640 1 -- 172.21.15.72:0/2200705379 >> v1:172.21.15.29:6789/0 conn(0x5628b3f1c440 legacy=0x5628b3faf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.132+0000 7fab523f4640 1 -- 172.21.15.72:0/2200705379 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b3e30ae0 con 0x5628b3f1d950 2024-04-26T12:50:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab523f4640 1 --2- 172.21.15.72:0/2200705379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1d950 0x5628b3f1bf00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00a5c0 tx=0x7fab3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da274261265549f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab513f2640 1 -- 172.21.15.72:0/2200705379 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0a6070 con 0x5628b3f1d950 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab513f2640 1 -- 172.21.15.72:0/2200705379 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0af070 con 0x5628b3f1d950 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab513f2640 1 -- 172.21.15.72:0/2200705379 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0aa5c0 con 0x5628b3f1d950 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab548d9980 1 -- 172.21.15.72:0/2200705379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1d950 msgr2=0x5628b3f1bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab548d9980 1 --2- 172.21.15.72:0/2200705379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1d950 0x5628b3f1bf00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00a5c0 tx=0x7fab3c01b340 comp rx=0 tx=0).stop 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab548d9980 1 -- 172.21.15.72:0/2200705379 shutdown_connections 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab548d9980 1 --2- 172.21.15.72:0/2200705379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1d950 0x5628b3f1bf00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab548d9980 1 -- 172.21.15.72:0/2200705379 >> 172.21.15.72:0/2200705379 conn(0x5628b3fa2b90 msgr2=0x5628b3fa4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab548d9980 1 -- 172.21.15.72:0/2200705379 shutdown_connections 2024-04-26T12:50:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.136+0000 7fab548d9980 1 -- 172.21.15.72:0/2200705379 wait complete. 2024-04-26T12:50:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 Processor -- start 2024-04-26T12:50:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- start start 2024-04-26T12:50:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b4094d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5628b3eaaa70 con 0x5628b3f1c440 2024-04-26T12:50:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b4094d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b4094d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50106/0 (socket says 172.21.15.72:50106) 2024-04-26T12:50:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab523f4640 1 -- 172.21.15.72:0/3578567733 learned_addr learned my addr 172.21.15.72:0/3578567733 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab523f4640 1 -- 172.21.15.72:0/3578567733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b40952e0 con 0x5628b3f1c440 2024-04-26T12:50:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab523f4640 1 --2- 172.21.15.72:0/3578567733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b4094d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0199f0 tx=0x7fab3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb6cb6654ecf35f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7faa40608640 1 -- 172.21.15.72:0/3578567733 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0aaa00 con 0x5628b3f1c440 2024-04-26T12:50:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7faa40608640 1 -- 172.21.15.72:0/3578567733 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0aaba0 con 0x5628b3f1c440 2024-04-26T12:50:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7faa40608640 1 -- 172.21.15.72:0/3578567733 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0bd3f0 con 0x5628b3f1c440 2024-04-26T12:50:17.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- 172.21.15.72:0/3578567733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 msgr2=0x5628b4094d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 --2- 172.21.15.72:0/3578567733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b4094d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0199f0 tx=0x7fab3c003030 comp rx=0 tx=0).stop 2024-04-26T12:50:17.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- 172.21.15.72:0/3578567733 shutdown_connections 2024-04-26T12:50:17.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 --2- 172.21.15.72:0/3578567733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b4094d10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- 172.21.15.72:0/3578567733 >> 172.21.15.72:0/3578567733 conn(0x5628b3fa2b90 msgr2=0x5628b40908a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- 172.21.15.72:0/3578567733 shutdown_connections 2024-04-26T12:50:17.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- 172.21.15.72:0/3578567733 wait complete. 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 Processor -- start 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- start start 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b409be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.152+0000 7fab548d9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5628b3fb34d0 con 0x5628b3f1c440 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b409be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b409be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50114/0 (socket says 172.21.15.72:50114) 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab523f4640 1 -- 172.21.15.72:0/573842736 learned_addr learned my addr 172.21.15.72:0/573842736 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab523f4640 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b409c350 con 0x5628b3f1c440 2024-04-26T12:50:17.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab523f4640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b409be10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fab3c01b170 tx=0x7fab3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7faa3ee05640 1 -- 172.21.15.72:0/573842736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0bd7c0 con 0x5628b3f1c440 2024-04-26T12:50:17.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7faa3ee05640 1 -- 172.21.15.72:0/573842736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0bd960 con 0x5628b3f1c440 2024-04-26T12:50:17.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7faa3ee05640 1 -- 172.21.15.72:0/573842736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0bdc40 con 0x5628b3f1c440 2024-04-26T12:50:17.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628b409c5e0 con 0x5628b3f1c440 2024-04-26T12:50:17.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b409f210 con 0x5628b3f1c440 2024-04-26T12:50:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7faa3ee05640 1 -- 172.21.15.72:0/573842736 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab3c0ce020 con 0x5628b3f1c440 2024-04-26T12:50:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7faa3ee05640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa38034650 0x7faa38036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7faa3ee05640 1 -- 172.21.15.72:0/573842736 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fab3c0cc020 con 0x5628b3f1c440 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab51bf3640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa38034650 0x7faa38036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b3f1d950 0x5628b40a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40a33a0 con 0x5628b3f1d950 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab52bf5640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b3f1d950 0x5628b40a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab51bf3640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa38034650 0x7faa38036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab44001570 tx=0x7fab440066d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.156+0000 7fab52bf5640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b3f1d950 0x5628b40a2d30 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab52bf5640 1 -- 172.21.15.72:0/573842736 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b3f1d950 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40a3cb0 con 0x5628b3f1d950 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab52bf5640 1 -- 172.21.15.72:0/573842736 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b3f1d950 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40a5600 0x5628b40a7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40a8220 con 0x5628b40a5600 2024-04-26T12:50:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab523f4640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40a5600 0x5628b40a7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab523f4640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40a5600 0x5628b40a7a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab523f4640 1 -- 172.21.15.72:0/573842736 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab3c0c6cd0 con 0x5628b40a5600 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40a4500 con 0x5628b3f1d950 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab52bf5640 1 -- 172.21.15.72:0/573842736 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b3f1d950 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40a9680 0x5628b40aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ac1b0 con 0x5628b40a9680 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab51bf3640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40a9680 0x5628b40aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab51bf3640 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40a9680 0x5628b40aba70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab51bf3640 1 -- 172.21.15.72:0/573842736 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab4400f030 con 0x5628b40a9680 2024-04-26T12:50:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 Processor -- start 2024-04-26T12:50:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 -- start start 2024-04-26T12:50:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40ba240 0x5628b40ba660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.160+0000 7fab548d9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5628b3eaeab0 con 0x5628b40ba240 2024-04-26T12:50:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40ba240 0x5628b40ba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40ba240 0x5628b40ba660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50118/0 (socket says 172.21.15.72:50118) 2024-04-26T12:50:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab523f4640 1 -- 172.21.15.72:0/290602086 learned_addr learned my addr 172.21.15.72:0/290602086 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab523f4640 1 -- 172.21.15.72:0/290602086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b40baba0 con 0x5628b40ba240 2024-04-26T12:50:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab523f4640 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40ba240 0x5628b40ba660 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0a6fd0 tx=0x7fab3c0cf370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7faa37fff640 1 -- 172.21.15.72:0/290602086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0de230 con 0x5628b40ba240 2024-04-26T12:50:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7faa37fff640 1 -- 172.21.15.72:0/290602086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0e9070 con 0x5628b40ba240 2024-04-26T12:50:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7faa37fff640 1 -- 172.21.15.72:0/290602086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0bcd20 con 0x5628b40ba240 2024-04-26T12:50:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628b40bb640 con 0x5628b40ba240 2024-04-26T12:50:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b40bbb10 con 0x5628b40ba240 2024-04-26T12:50:17.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7faa37fff640 1 -- 172.21.15.72:0/290602086 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab3c0c6480 con 0x5628b40ba240 2024-04-26T12:50:17.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7faa37fff640 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa2c034650 0x7faa2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7faa37fff640 1 -- 172.21.15.72:0/290602086 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fab3c0efca0 con 0x5628b40ba240 2024-04-26T12:50:17.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab51bf3640 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa2c034650 0x7faa2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab548d9980 1 Processor -- start 2024-04-26T12:50:17.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab548d9980 1 -- start start 2024-04-26T12:50:17.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab51bf3640 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa2c034650 0x7faa2c036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5628b40a85f0 tx=0x7fab44011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab548d9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.164+0000 7fab548d9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5628b4095570 con 0x5628b40c7210 2024-04-26T12:50:17.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50132/0 (socket says 172.21.15.72:50132) 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 -- 172.21.15.72:0/2195009302 learned_addr learned my addr 172.21.15.72:0/2195009302 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 -- 172.21.15.72:0/2195009302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b40c7c00 con 0x5628b40c7210 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 --2- 172.21.15.72:0/2195009302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40c7630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0d0460 tx=0x7fab3c0bcf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb1666946b150c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7faa35ffb640 1 -- 172.21.15.72:0/2195009302 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0cf600 con 0x5628b40c7210 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7faa35ffb640 1 -- 172.21.15.72:0/2195009302 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0cceb0 con 0x5628b40c7210 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7faa35ffb640 1 -- 172.21.15.72:0/2195009302 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0c7590 con 0x5628b40c7210 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- 172.21.15.72:0/2195009302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 msgr2=0x5628b40c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 --2- 172.21.15.72:0/2195009302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40c7630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0d0460 tx=0x7fab3c0bcf90 comp rx=0 tx=0).stop 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- 172.21.15.72:0/2195009302 shutdown_connections 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 --2- 172.21.15.72:0/2195009302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40c7630 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- 172.21.15.72:0/2195009302 >> 172.21.15.72:0/2195009302 conn(0x5628b40c35e0 msgr2=0x5628b40c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- 172.21.15.72:0/2195009302 shutdown_connections 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- 172.21.15.72:0/2195009302 wait complete. 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 Processor -- start 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- start start 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5628b40c81d0 con 0x5628b40c7210 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50138/0 (socket says 172.21.15.72:50138) 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 learned_addr learned my addr 172.21.15.72:0/698303836 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b40cea60 con 0x5628b40c7210 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab523f4640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40ce520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0de3f0 tx=0x7fab3c0d4fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7faa23fff640 1 -- 172.21.15.72:0/698303836 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c113070 con 0x5628b40c7210 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7faa23fff640 1 -- 172.21.15.72:0/698303836 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0e5880 con 0x5628b40c7210 2024-04-26T12:50:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628b40cea60 con 0x5628b40c7210 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7faa23fff640 1 -- 172.21.15.72:0/698303836 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c0cf600 con 0x5628b40c7210 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.168+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b40ceed0 con 0x5628b40c7210 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7faa23fff640 1 -- 172.21.15.72:0/698303836 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab3c116070 con 0x5628b40c7210 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7faa23fff640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa1c034650 0x7faa1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7faa23fff640 1 -- 172.21.15.72:0/698303836 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fab3c0ff070 con 0x5628b40c7210 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab51bf3640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa1c034650 0x7faa1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b40d9480 0x5628b40db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dc070 con 0x5628b40d9480 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab52bf5640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b40d9480 0x5628b40db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab51bf3640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa1c034650 0x7faa1c036b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5628b40a3c80 tx=0x7fab44012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab52bf5640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b40d9480 0x5628b40db920 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b40d9480 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 realm 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dc480 con 0x5628b40d9480 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b40d9480 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dcd20 con 0x5628b40d9480 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b40d9480 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b40d9480 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40dde20 0x5628b40e0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e0790 con 0x5628b40dde20 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab523f4640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40dde20 0x5628b40e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.172+0000 7fab523f4640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40dde20 0x5628b40e0210 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab548d9980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab548d9980 20 searching for the correct realm 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40e26c0 0x5628b40e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e5220 con 0x5628b40e26c0 2024-04-26T12:50:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab51bf3640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40e26c0 0x5628b40e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab51bf3640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40e26c0 0x5628b40e4b50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44021040 con 0x5628b40e26c0 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab51bf3640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fab44013040 0x7fab44032970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e5220 con 0x7fab44013040 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fab44013040 0x7fab44032970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fab44013040 0x7fab44032970 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c0083f0 con 0x7fab44013040 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c0083f0 con 0x5628b40d9480 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.176+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x7fab44013040 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x7fab44013040 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44021040 con 0x5628b40e26c0 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x7fab44013040 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab4c026040 con 0x7fab44013040 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.180+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x7fab44013040 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x7fab44013040 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.184+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x7fab44013040 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x7fab44013040 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40e26c0 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40dde20 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x5628b40d9480 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b40dd0c0 con 0x7fab44013040 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4c026040 con 0x7fab44013040 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e0fe0 con 0x5628b40d9480 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e0fe0 con 0x5628b40d9480 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab4c026040 con 0x5628b40d9480 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e0fe0 con 0x5628b40e26c0 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 zone default found 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 4 Realm: () 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 zonegroup default 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e1880 con 0x5628b40dde20 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e7080 con 0x5628b40e26c0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.188+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e7420 con 0x5628b40e26c0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 20 started sync module instance, tier type = 2024-04-26T12:50:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e6520 con 0x7fab44013040 2024-04-26T12:50:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c026040 con 0x7fab44013040 2024-04-26T12:50:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732819524128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e6520 con 0x7fab44013040 2024-04-26T12:50:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e7e90 con 0x5628b40d9480 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732819524128] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x7fab44013040 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732819528064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e6520 con 0x5628b40d9480 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.192+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e88a0 con 0x5628b40e26c0 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732819528064] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732819521648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e6490 con 0x5628b40e26c0 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e9650 con 0x7fab44013040 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x7fab44013040 2024-04-26T12:50:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732819534144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e9ef0 con 0x7fab44013040 2024-04-26T12:50:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ea8f0 con 0x5628b40d9480 2024-04-26T12:50:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.196+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732819521648] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732819534144] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x7fab44013040 2024-04-26T12:50:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732819532944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e99c0 con 0x5628b40d9480 2024-04-26T12:50:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40eb190 con 0x5628b40dde20 2024-04-26T12:50:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732819532944] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732819541216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e99c0 con 0x5628b40dde20 2024-04-26T12:50:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.200+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40eb9e0 con 0x5628b40dde20 2024-04-26T12:50:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732819543344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ebe00 con 0x5628b40dde20 2024-04-26T12:50:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732819541216] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ea440 con 0x5628b40dde20 2024-04-26T12:50:17.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732819543344] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732819544400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ebd70 con 0x5628b40dde20 2024-04-26T12:50:17.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 20 add_watcher() i=0 2024-04-26T12:50:17.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 20 add_watcher() i=1 2024-04-26T12:50:17.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 20 add_watcher() i=2 2024-04-26T12:50:17.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 20 add_watcher() i=3 2024-04-26T12:50:17.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 20 add_watcher() i=4 2024-04-26T12:50:17.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 20 add_watcher() i=5 2024-04-26T12:50:17.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.204+0000 7fab548d9980 20 add_watcher() i=6 2024-04-26T12:50:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732819544400] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 20 add_watcher() i=7 2024-04-26T12:50:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ef8a0 con 0x5628b40d9480 2024-04-26T12:50:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732819547072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ecd30 con 0x5628b40d9480 2024-04-26T12:50:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732819547072] v33'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7faa08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 5 note: GC not initialized 2024-04-26T12:50:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fa9837fe640 20 reqs_thread_entry: start 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 20 Filter name: none 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fa9817fa640 20 reqs_thread_entry: start 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.208+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b4112b60 con 0x5628b40d9480 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b4113550 con 0x5628b40d9480 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b4114560 con 0x7fab44013040 2024-04-26T12:50:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fab4c036040 con 0x7fab44013040 2024-04-26T12:50:17.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7faa08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732819547072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40f1ef0 con 0x5628b40d9480 2024-04-26T12:50:17.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94732819547072] v33'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732819524128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ec3c0 con 0x7fab44013040 2024-04-26T12:50:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94732819524128] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x7fab44013040 2024-04-26T12:50:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 20 remove_watcher() i=0 2024-04-26T12:50:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 2 removed watcher, disabling cache 2024-04-26T12:50:17.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.212+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732819528064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ec3c0 con 0x5628b40d9480 2024-04-26T12:50:17.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.216+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94732819528064] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.216+0000 7fab548d9980 20 remove_watcher() i=1 2024-04-26T12:50:17.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.216+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732819521648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e7980 con 0x5628b40e26c0 2024-04-26T12:50:17.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.216+0000 7fab51bf3640 1 -- 172.21.15.72:0/698303836 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94732819521648] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab44041040 con 0x5628b40e26c0 2024-04-26T12:50:17.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.216+0000 7fab548d9980 20 remove_watcher() i=2 2024-04-26T12:50:17.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.216+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732819534144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ec3c0 con 0x7fab44013040 2024-04-26T12:50:17.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.220+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94732819534144] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x7fab44013040 2024-04-26T12:50:17.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.220+0000 7fab548d9980 20 remove_watcher() i=3 2024-04-26T12:50:17.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.220+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732819532944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e6070 con 0x5628b40d9480 2024-04-26T12:50:17.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.220+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94732819532944] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4c036040 con 0x5628b40d9480 2024-04-26T12:50:17.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.220+0000 7fab548d9980 20 remove_watcher() i=4 2024-04-26T12:50:17.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.220+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732819541216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ec3c0 con 0x5628b40dde20 2024-04-26T12:50:17.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.224+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94732819541216] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.224+0000 7fab548d9980 20 remove_watcher() i=5 2024-04-26T12:50:17.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.224+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732819543344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40e6070 con 0x5628b40dde20 2024-04-26T12:50:17.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.224+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94732819543344] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.224+0000 7fab548d9980 20 remove_watcher() i=6 2024-04-26T12:50:17.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.224+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732819544400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b40ec3c0 con 0x5628b40dde20 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab523f4640 1 -- 172.21.15.72:0/698303836 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94732819544400] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c115030 con 0x5628b40dde20 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 20 remove_watcher() i=7 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40dde20 msgr2=0x5628b40e0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40dde20 0x5628b40e0210 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b40d9480 msgr2=0x5628b40db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b40d9480 0x5628b40db920 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fab44013040 msgr2=0x7fab44032970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fab44013040 0x7fab44032970 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40e26c0 msgr2=0x5628b40e4b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40e26c0 0x5628b40e4b50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa1c034650 msgr2=0x7faa1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa1c034650 0x7faa1c036b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5628b40a3c80 tx=0x7fab44012000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 msgr2=0x5628b40ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40ce520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0de3f0 tx=0x7fab3c0d4fc0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab52bf5640 1 -- 172.21.15.72:0/698303836 reap_dead start 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 shutdown_connections 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/698303836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40c7210 0x5628b40ce520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 >> 172.21.15.72:0/698303836 conn(0x5628b40c35e0 msgr2=0x5628b40c0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 shutdown_connections 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/698303836 wait complete. 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa2c034650 msgr2=0x7faa2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa2c034650 0x7faa2c036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5628b40a85f0 tx=0x7fab44011000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40ba240 msgr2=0x5628b40ba660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40ba240 0x5628b40ba660 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0a6fd0 tx=0x7fab3c0cf370 comp rx=0 tx=0).stop 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 shutdown_connections 2024-04-26T12:50:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa2c034650 0x7faa2c036b10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/290602086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b40ba240 0x5628b40ba660 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 >> 172.21.15.72:0/290602086 conn(0x5628b40af050 msgr2=0x5628b40afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 shutdown_connections 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/290602086 wait complete. 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40a5600 msgr2=0x5628b40a7a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5628b40a5600 0x5628b40a7a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b3f1d950 msgr2=0x5628b40a2d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5628b3f1d950 0x5628b40a2d30 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40a9680 msgr2=0x5628b40aba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5628b40a9680 0x5628b40aba70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa38034650 msgr2=0x7faa38036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7faa38034650 0x7faa38036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab44001570 tx=0x7fab440066d0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 msgr2=0x5628b409be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 --2- 172.21.15.72:0/573842736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5628b3f1c440 0x5628b409be10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fab3c01b170 tx=0x7fab3c0180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab52bf5640 1 -- 172.21.15.72:0/573842736 reap_dead start 2024-04-26T12:50:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 shutdown_connections 2024-04-26T12:50:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 >> 172.21.15.72:0/573842736 conn(0x5628b3fa2b90 msgr2=0x5628b408f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 shutdown_connections 2024-04-26T12:50:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.228+0000 7fab548d9980 1 -- 172.21.15.72:0/573842736 wait complete. 2024-04-26T12:50:17.237 INFO:teuthology.orchestra.run.smithi072.stdout:["myfoo"] 2024-04-26T12:50:17.237 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-26T12:50:17.241 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.241 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-26T12:50:17.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-26T12:50:17.242 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-26T12:50:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f7146df1980 1 Processor -- start 2024-04-26T12:50:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f7146df1980 1 -- start start 2024-04-26T12:50:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f7146df1980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c587e2e060 0x55c587e2c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f7146df1980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c587d65510 con 0x55c587e2cba0 2024-04-26T12:50:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f7146df1980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c587d6c430 con 0x55c587e2e060 2024-04-26T12:50:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f714490c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c587e2e060 0x55c587e2c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f714490c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c587e2e060 0x55c587e2c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50152/0 (socket says 172.21.15.72:50152) 2024-04-26T12:50:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.308+0000 7f714490c640 1 -- 172.21.15.72:0/501824914 learned_addr learned my addr 172.21.15.72:0/501824914 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f714490c640 1 -- 172.21.15.72:0/501824914 >> v1:172.21.15.29:6789/0 conn(0x55c587e2cba0 legacy=0x55c587ec02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f714490c640 1 -- 172.21.15.72:0/501824914 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c587d41ae0 con 0x55c587e2e060 2024-04-26T12:50:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f714490c640 1 --2- 172.21.15.72:0/501824914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2e060 0x55c587e2c660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f713400a4e0 tx=0x7f713401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814a3c56dc5804aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f714390a640 1 -- 172.21.15.72:0/501824914 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340aa540 con 0x55c587e2e060 2024-04-26T12:50:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f714390a640 1 -- 172.21.15.72:0/501824914 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71340aa6e0 con 0x55c587e2e060 2024-04-26T12:50:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f714390a640 1 -- 172.21.15.72:0/501824914 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340aaa40 con 0x55c587e2e060 2024-04-26T12:50:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f7146df1980 1 -- 172.21.15.72:0/501824914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2e060 msgr2=0x55c587e2c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f7146df1980 1 --2- 172.21.15.72:0/501824914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2e060 0x55c587e2c660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f713400a4e0 tx=0x7f713401b090 comp rx=0 tx=0).stop 2024-04-26T12:50:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f7146df1980 1 -- 172.21.15.72:0/501824914 shutdown_connections 2024-04-26T12:50:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f7146df1980 1 --2- 172.21.15.72:0/501824914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2e060 0x55c587e2c660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f7146df1980 1 -- 172.21.15.72:0/501824914 >> 172.21.15.72:0/501824914 conn(0x55c587eb3bc0 msgr2=0x55c587eb5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f7146df1980 1 -- 172.21.15.72:0/501824914 shutdown_connections 2024-04-26T12:50:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.312+0000 7f7146df1980 1 -- 172.21.15.72:0/501824914 wait complete. 2024-04-26T12:50:17.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 Processor -- start 2024-04-26T12:50:17.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 -- start start 2024-04-26T12:50:17.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587fa5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c587dbba70 con 0x55c587e2cba0 2024-04-26T12:50:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587fa5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587fa5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50160/0 (socket says 172.21.15.72:50160) 2024-04-26T12:50:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f714490c640 1 -- 172.21.15.72:0/2684333798 learned_addr learned my addr 172.21.15.72:0/2684333798 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f714490c640 1 -- 172.21.15.72:0/2684333798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c587fa62b0 con 0x55c587e2cba0 2024-04-26T12:50:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f714490c640 1 --2- 172.21.15.72:0/2684333798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587fa5ce0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7134018cc0 tx=0x7f71340033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cef3f448ac1008 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7032e0d640 1 -- 172.21.15.72:0/2684333798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340b9070 con 0x55c587e2cba0 2024-04-26T12:50:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7032e0d640 1 -- 172.21.15.72:0/2684333798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71340aab50 con 0x55c587e2cba0 2024-04-26T12:50:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7032e0d640 1 -- 172.21.15.72:0/2684333798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340aae50 con 0x55c587e2cba0 2024-04-26T12:50:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 -- 172.21.15.72:0/2684333798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 msgr2=0x55c587fa5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 --2- 172.21.15.72:0/2684333798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587fa5ce0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7134018cc0 tx=0x7f71340033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 -- 172.21.15.72:0/2684333798 shutdown_connections 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 --2- 172.21.15.72:0/2684333798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587fa5ce0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 -- 172.21.15.72:0/2684333798 >> 172.21.15.72:0/2684333798 conn(0x55c587eb3bc0 msgr2=0x55c587fa1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 -- 172.21.15.72:0/2684333798 shutdown_connections 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.328+0000 7f7146df1980 1 -- 172.21.15.72:0/2684333798 wait complete. 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 Processor -- start 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 -- start start 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587face00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c587ec44d0 con 0x55c587e2cba0 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587face00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587face00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50162/0 (socket says 172.21.15.72:50162) 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714490c640 1 -- 172.21.15.72:0/3829339822 learned_addr learned my addr 172.21.15.72:0/3829339822 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714490c640 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c587fad340 con 0x55c587e2cba0 2024-04-26T12:50:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714490c640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587face00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7134018cc0 tx=0x7f7134017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f703160a640 1 -- 172.21.15.72:0/3829339822 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340b9070 con 0x55c587e2cba0 2024-04-26T12:50:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f703160a640 1 -- 172.21.15.72:0/3829339822 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71340c7410 con 0x55c587e2cba0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c587fad5d0 con 0x55c587e2cba0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f703160a640 1 -- 172.21.15.72:0/3829339822 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340c7710 con 0x55c587e2cba0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c587fb0230 con 0x55c587e2cba0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f703160a640 1 -- 172.21.15.72:0/3829339822 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f71340b3040 con 0x55c587e2cba0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f703160a640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f702c034650 0x7f702c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f703160a640 1 -- 172.21.15.72:0/3829339822 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f71340c4070 con 0x55c587e2cba0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714410b640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f702c034650 0x7f702c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587e2e060 0x55c587fb3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fb43c0 con 0x55c587e2e060 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714510d640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587e2e060 0x55c587fb3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714410b640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f702c034650 0x7f702c036b10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7138000f70 tx=0x7f7138001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.332+0000 7f714510d640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587e2e060 0x55c587fb3d50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714510d640 1 -- 172.21.15.72:0/3829339822 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587e2e060 2024-04-26T12:50:17.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fb4ca0 con 0x55c587e2e060 2024-04-26T12:50:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714510d640 1 -- 172.21.15.72:0/3829339822 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587e2e060 2024-04-26T12:50:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587fb65b0 0x55c587fb8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fb91e0 con 0x55c587fb65b0 2024-04-26T12:50:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714490c640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587fb65b0 0x55c587fb8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714490c640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587fb65b0 0x55c587fb8a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714490c640 1 -- 172.21.15.72:0/3829339822 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f71340cd060 con 0x55c587fb65b0 2024-04-26T12:50:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fb54f0 con 0x55c587e2e060 2024-04-26T12:50:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714510d640 1 -- 172.21.15.72:0/3829339822 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587e2e060 2024-04-26T12:50:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587fba640 0x55c587fbca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fbd1a0 con 0x55c587fba640 2024-04-26T12:50:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714410b640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587fba640 0x55c587fbca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714410b640 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587fba640 0x55c587fbca30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f714410b640 1 -- 172.21.15.72:0/3829339822 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f713800d040 con 0x55c587fba640 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 Processor -- start 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 -- start start 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fcb210 0x55c587fcb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.336+0000 7f7146df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c587dbfab0 con 0x55c587fcb210 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fcb210 0x55c587fcb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fcb210 0x55c587fcb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50168/0 (socket says 172.21.15.72:50168) 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 -- 172.21.15.72:0/1473476537 learned_addr learned my addr 172.21.15.72:0/1473476537 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 -- 172.21.15.72:0/1473476537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c587fcbb70 con 0x55c587fcb210 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fcb210 0x55c587fcb630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f71340aab20 tx=0x7f71340c6820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f702a7fc640 1 -- 172.21.15.72:0/1473476537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340b3b80 con 0x55c587fcb210 2024-04-26T12:50:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c587fcc610 con 0x55c587fcb210 2024-04-26T12:50:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c587fccae0 con 0x55c587fcb210 2024-04-26T12:50:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f702a7fc640 1 -- 172.21.15.72:0/1473476537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71340b3d20 con 0x55c587fcb210 2024-04-26T12:50:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f702a7fc640 1 -- 172.21.15.72:0/1473476537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340e4b00 con 0x55c587fcb210 2024-04-26T12:50:17.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f702a7fc640 1 -- 172.21.15.72:0/1473476537 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f71340e4ca0 con 0x55c587fcb210 2024-04-26T12:50:17.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f702a7fc640 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f701c034650 0x7f701c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f702a7fc640 1 -- 172.21.15.72:0/1473476537 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f71340e3040 con 0x55c587fcb210 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714410b640 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f701c034650 0x7f701c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f7146df1980 1 Processor -- start 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f7146df1980 1 -- start start 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714410b640 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f701c034650 0x7f701c036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55c587fb9580 tx=0x7f7138006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f7146df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fd8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f7146df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c587fa6540 con 0x55c587fd8030 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fd8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fd8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50176/0 (socket says 172.21.15.72:50176) 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.340+0000 7f714490c640 1 -- 172.21.15.72:0/1950413991 learned_addr learned my addr 172.21.15.72:0/1950413991 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f714490c640 1 -- 172.21.15.72:0/1950413991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c587fd8a20 con 0x55c587fd8030 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f714490c640 1 --2- 172.21.15.72:0/1950413991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fd8450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f71340edaf0 tx=0x7f71340e19a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6c170a3b0a8066 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f701bfff640 1 -- 172.21.15.72:0/1950413991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340e40c0 con 0x55c587fd8030 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f701bfff640 1 -- 172.21.15.72:0/1950413991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71340f2070 con 0x55c587fd8030 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f701bfff640 1 -- 172.21.15.72:0/1950413991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340da380 con 0x55c587fd8030 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- 172.21.15.72:0/1950413991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 msgr2=0x55c587fd8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 --2- 172.21.15.72:0/1950413991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fd8450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f71340edaf0 tx=0x7f71340e19a0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- 172.21.15.72:0/1950413991 shutdown_connections 2024-04-26T12:50:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 --2- 172.21.15.72:0/1950413991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fd8450 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- 172.21.15.72:0/1950413991 >> 172.21.15.72:0/1950413991 conn(0x55c587fd4370 msgr2=0x55c587fd23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- 172.21.15.72:0/1950413991 shutdown_connections 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- 172.21.15.72:0/1950413991 wait complete. 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 Processor -- start 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- start start 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fdf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c587fd9050 con 0x55c587fd8030 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fdf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f714490c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fdf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50192/0 (socket says 172.21.15.72:50192) 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 learned_addr learned my addr 172.21.15.72:0/3432774213 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c587fdf820 con 0x55c587fd8030 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f714490c640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fdf2e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f71340edfd0 tx=0x7f71340e4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f701a7fc640 1 -- 172.21.15.72:0/3432774213 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7134107070 con 0x55c587fd8030 2024-04-26T12:50:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f701a7fc640 1 -- 172.21.15.72:0/3432774213 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71340c7ba0 con 0x55c587fd8030 2024-04-26T12:50:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f701a7fc640 1 -- 172.21.15.72:0/3432774213 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71340db7b0 con 0x55c587fd8030 2024-04-26T12:50:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c587fdf820 con 0x55c587fd8030 2024-04-26T12:50:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.344+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c587fdf820 con 0x55c587fd8030 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f701a7fc640 1 -- 172.21.15.72:0/3432774213 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7134100040 con 0x55c587fd8030 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f701a7fc640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7010034650 0x7f7010036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f701a7fc640 1 -- 172.21.15.72:0/3432774213 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f71340fe020 con 0x55c587fd8030 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714410b640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7010034650 0x7f7010036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587fea3d0 0x55c587fec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fecfe0 con 0x55c587fea3d0 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714510d640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587fea3d0 0x55c587fec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714410b640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7010034650 0x7f7010036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7138010fd0 tx=0x7f7138011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714510d640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587fea3d0 0x55c587fec890 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 realm 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fed3f0 con 0x55c587fea3d0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fedc90 con 0x55c587fea3d0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587feed90 0x55c587ff1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff1700 con 0x55c587feed90 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714490c640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587feed90 0x55c587ff1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714490c640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587feed90 0x55c587ff1180 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 20 searching for the correct realm 2024-04-26T12:50:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587ff3630 0x55c587ff5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff6190 con 0x55c587ff3630 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.348+0000 7f714410b640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587ff3630 0x55c587ff5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714410b640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587ff3630 0x55c587ff5ac0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714410b640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f713800f3d0 0x7f713800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff6190 con 0x7f713800f3d0 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f713800f3d0 0x7f713800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f713800f3d0 0x7f713800f7f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x7f713800f3d0 2024-04-26T12:50:17.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.352+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x7f713800f3d0 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f713c0083f0 con 0x7f713800f3d0 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.356+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x7f713800f3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x7f713800f3d0 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.360+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c0083f0 con 0x7f713800f3d0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff1f50 con 0x55c587fea3d0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff1f50 con 0x55c587fea3d0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f713c0083f0 con 0x55c587fea3d0 2024-04-26T12:50:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff1f50 con 0x55c587ff3630 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 zone default found 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 4 Realm: () 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 zonegroup default 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff27f0 con 0x55c587feed90 2024-04-26T12:50:17.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff7ff0 con 0x55c587ff3630 2024-04-26T12:50:17.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff8390 con 0x55c587ff3630 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 started sync module instance, tier type = 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.364+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff7490 con 0x7f713800f3d0 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.368+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c0083f0 con 0x7f713800f3d0 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.368+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94306878585264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff7490 con 0x7f713800f3d0 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.368+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff8d90 con 0x55c587fea3d0 2024-04-26T12:50:17.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.368+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94306878585264] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.368+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.368+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94306878589088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff7490 con 0x55c587fea3d0 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.368+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x55c587ff3630 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94306878589088] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94306878582752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff7400 con 0x55c587ff3630 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffa530 con 0x7f713800f3d0 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94306878595136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffa460 con 0x7f713800f3d0 2024-04-26T12:50:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffb3f0 con 0x55c587fea3d0 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94306878595136] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94306878582752] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94306878593936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffaf40 con 0x55c587fea3d0 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.372+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffbc90 con 0x55c587feed90 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.376+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.376+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94306878601184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffaf40 con 0x55c587feed90 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.376+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.376+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94306878593936] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94306878601184] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94306878597328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffd2a0 con 0x55c587feed90 2024-04-26T12:50:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffd640 con 0x55c587feed90 2024-04-26T12:50:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94306878597328] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94306878606704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffd640 con 0x55c587feed90 2024-04-26T12:50:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 20 add_watcher() i=0 2024-04-26T12:50:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 20 add_watcher() i=1 2024-04-26T12:50:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 20 add_watcher() i=2 2024-04-26T12:50:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 20 add_watcher() i=3 2024-04-26T12:50:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 20 add_watcher() i=4 2024-04-26T12:50:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 20 add_watcher() i=5 2024-04-26T12:50:17.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.380+0000 7f7146df1980 20 add_watcher() i=6 2024-04-26T12:50:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94306878606704] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 20 add_watcher() i=7 2024-04-26T12:50:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c588000a40 con 0x55c587fea3d0 2024-04-26T12:50:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94306878608224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffdf30 con 0x55c587fea3d0 2024-04-26T12:50:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94306878608224] v33'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f6ffafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 5 note: GC not initialized 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f6ff9fe3640 20 reqs_thread_entry: start 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 20 Filter name: none 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f6f6b7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c5880237f0 con 0x55c587ff3630 2024-04-26T12:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x55c587ff3630 2024-04-26T12:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x55c587fea3d0 2024-04-26T12:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v33'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.384+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587fea3d0 2024-04-26T12:50:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587feed90 2024-04-26T12:50:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587ff3630 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.388+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587ff3630 2024-04-26T12:50:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x7f713800f3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(80 [pgnls start_epoch 33 out=148b] v33'3 uv3 ondisk = 1) ==== 144+0+148 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587fea3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587fea3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587ff3630 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x7f713800f3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587fea3d0 2024-04-26T12:50:17.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.392+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587ff3630 2024-04-26T12:50:17.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x7f713800f3d0 2024-04-26T12:50:17.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587feed90 2024-04-26T12:50:17.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587fea3d0 2024-04-26T12:50:17.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x55c587ff3630 2024-04-26T12:50:17.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c587ffc9d0 con 0x7f713800f3d0 2024-04-26T12:50:17.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f7146df1980 20 RGWRados::pool_iterate: got myfoo 2024-04-26T12:50:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f7146df1980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f6ffafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.396+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94306878608224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x55c587fea3d0 2024-04-26T12:50:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94306878608224] v33'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94306878585264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x7f713800f3d0 2024-04-26T12:50:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94306878585264] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f7146df1980 20 remove_watcher() i=0 2024-04-26T12:50:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f7146df1980 2 removed watcher, disabling cache 2024-04-26T12:50:17.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94306878589088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x55c587fea3d0 2024-04-26T12:50:17.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94306878589088] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f7146df1980 20 remove_watcher() i=1 2024-04-26T12:50:17.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.400+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94306878582752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587fee030 con 0x55c587ff3630 2024-04-26T12:50:17.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.404+0000 7f714410b640 1 -- 172.21.15.72:0/3432774213 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94306878582752] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138036040 con 0x55c587ff3630 2024-04-26T12:50:17.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.404+0000 7f7146df1980 20 remove_watcher() i=2 2024-04-26T12:50:17.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.404+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94306878595136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x7f713800f3d0 2024-04-26T12:50:17.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.404+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94306878595136] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x7f713800f3d0 2024-04-26T12:50:17.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.404+0000 7f7146df1980 20 remove_watcher() i=3 2024-04-26T12:50:17.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.404+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94306878593936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x55c587fea3d0 2024-04-26T12:50:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.408+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94306878593936] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c035040 con 0x55c587fea3d0 2024-04-26T12:50:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.408+0000 7f7146df1980 20 remove_watcher() i=4 2024-04-26T12:50:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.408+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94306878601184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff97a0 con 0x55c587feed90 2024-04-26T12:50:17.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.408+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94306878601184] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.408+0000 7f7146df1980 20 remove_watcher() i=5 2024-04-26T12:50:17.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.408+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94306878597328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff6fe0 con 0x55c587feed90 2024-04-26T12:50:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94306878597328] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 20 remove_watcher() i=6 2024-04-26T12:50:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94306878606704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c587ff9b90 con 0x55c587feed90 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f714490c640 1 -- 172.21.15.72:0/3432774213 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94306878606704] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340e1070 con 0x55c587feed90 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 20 remove_watcher() i=7 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587feed90 msgr2=0x55c587ff1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587feed90 0x55c587ff1180 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587fea3d0 msgr2=0x55c587fec890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587fea3d0 0x55c587fec890 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f713800f3d0 msgr2=0x7f713800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f713800f3d0 0x7f713800f7f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587ff3630 msgr2=0x55c587ff5ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587ff3630 0x55c587ff5ac0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7010034650 msgr2=0x7f7010036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7010034650 0x7f7010036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7138010fd0 tx=0x7f7138011000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 msgr2=0x55c587fdf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3432774213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fd8030 0x55c587fdf2e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f71340edfd0 tx=0x7f71340e4f90 comp rx=0 tx=0).stop 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 reap_dead start 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f714510d640 1 -- 172.21.15.72:0/3432774213 reap_dead start 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 shutdown_connections 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 >> 172.21.15.72:0/3432774213 conn(0x55c587fd4370 msgr2=0x55c587fd19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 shutdown_connections 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3432774213 wait complete. 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f701c034650 msgr2=0x7f701c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f701c034650 0x7f701c036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55c587fb9580 tx=0x7f7138006000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fcb210 msgr2=0x55c587fcb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fcb210 0x55c587fcb630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f71340aab20 tx=0x7f71340c6820 comp rx=0 tx=0).stop 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 shutdown_connections 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f701c034650 0x7f701c036b10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/1473476537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587fcb210 0x55c587fcb630 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 >> 172.21.15.72:0/1473476537 conn(0x55c587fc0020 msgr2=0x55c587fc0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 shutdown_connections 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/1473476537 wait complete. 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587fb65b0 msgr2=0x55c587fb8a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c587fb65b0 0x55c587fb8a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587e2e060 msgr2=0x55c587fb3d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c587e2e060 0x55c587fb3d50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587fba640 msgr2=0x55c587fbca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.412+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c587fba640 0x55c587fbca30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f702c034650 msgr2=0x7f702c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f702c034650 0x7f702c036b10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7138000f70 tx=0x7f7138001420 comp rx=0 tx=0).stop 2024-04-26T12:50:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 msgr2=0x55c587face00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 --2- 172.21.15.72:0/3829339822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c587e2cba0 0x55c587face00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7134018cc0 tx=0x7f7134017e30 comp rx=0 tx=0).stop 2024-04-26T12:50:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f714510d640 1 -- 172.21.15.72:0/3829339822 reap_dead start 2024-04-26T12:50:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 shutdown_connections 2024-04-26T12:50:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 >> 172.21.15.72:0/3829339822 conn(0x55c587eb3bc0 msgr2=0x55c587fa0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 shutdown_connections 2024-04-26T12:50:17.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.416+0000 7f7146df1980 1 -- 172.21.15.72:0/3829339822 wait complete. 2024-04-26T12:50:17.422 INFO:teuthology.orchestra.run.smithi072.stdout:["myfoo"] 2024-04-26T12:50:17.423 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-26T12:50:17.439 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.457 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.470 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.515 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-26T12:50:17.578 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.647 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.721 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:17.722 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:50:17.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:50:17.722 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T12:50:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde400c980 1 Processor -- start 2024-04-26T12:50:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde400c980 1 -- start start 2024-04-26T12:50:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde400c980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5619928a8030 0x561992936f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde400c980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619927e1510 con 0x561992937490 2024-04-26T12:50:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde400c980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5619927e8430 con 0x5619928a8030 2024-04-26T12:50:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde1b27640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5619928a8030 0x561992936f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde1326640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x561992937490 0x561992939880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36142/0 (socket says 172.21.15.72:36142) 2024-04-26T12:50:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde1b27640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5619928a8030 0x561992936f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50202/0 (socket says 172.21.15.72:50202) 2024-04-26T12:50:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.760+0000 7fbde1326640 1 -- 172.21.15.72:0/1075422008 learned_addr learned my addr 172.21.15.72:0/1075422008 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde1b27640 1 -- 172.21.15.72:0/1075422008 >> v1:172.21.15.29:6789/0 conn(0x561992937490 legacy=0x561992939880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde1b27640 1 -- 172.21.15.72:0/1075422008 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619927bdae0 con 0x5619928a8030 2024-04-26T12:50:17.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde1b27640 1 --2- 172.21.15.72:0/1075422008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992936f50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a480 tx=0x7fbdcc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a961191625ea3d4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde0b25640 1 -- 172.21.15.72:0/1075422008 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0b0070 con 0x5619928a8030 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde0b25640 1 -- 172.21.15.72:0/1075422008 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0ab540 con 0x5619928a8030 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde0b25640 1 -- 172.21.15.72:0/1075422008 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0ab840 con 0x5619928a8030 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde400c980 1 -- 172.21.15.72:0/1075422008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 msgr2=0x561992936f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde400c980 1 --2- 172.21.15.72:0/1075422008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992936f50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a480 tx=0x7fbdcc01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde400c980 1 -- 172.21.15.72:0/1075422008 shutdown_connections 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde400c980 1 --2- 172.21.15.72:0/1075422008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992936f50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde400c980 1 -- 172.21.15.72:0/1075422008 >> 172.21.15.72:0/1075422008 conn(0x56199292ea70 msgr2=0x561992930e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde400c980 1 -- 172.21.15.72:0/1075422008 shutdown_connections 2024-04-26T12:50:17.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.764+0000 7fbde400c980 1 -- 172.21.15.72:0/1075422008 wait complete. 2024-04-26T12:50:17.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.780+0000 7fbde400c980 1 Processor -- start 2024-04-26T12:50:17.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.780+0000 7fbde400c980 1 -- start start 2024-04-26T12:50:17.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.780+0000 7fbde400c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a1f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.780+0000 7fbde400c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561992837a70 con 0x5619928a8030 2024-04-26T12:50:17.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.780+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a1f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.780+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a1f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50214/0 (socket says 172.21.15.72:50214) 2024-04-26T12:50:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.780+0000 7fbde1b27640 1 -- 172.21.15.72:0/2779738013 learned_addr learned my addr 172.21.15.72:0/2779738013 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde1b27640 1 -- 172.21.15.72:0/2779738013 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561992a1fab0 con 0x5619928a8030 2024-04-26T12:50:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde1b27640 1 --2- 172.21.15.72:0/2779738013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a1f4e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0ae040 tx=0x7fbdcc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db77239367a834be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbccfe07640 1 -- 172.21.15.72:0/2779738013 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0b0040 con 0x5619928a8030 2024-04-26T12:50:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbccfe07640 1 -- 172.21.15.72:0/2779738013 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0ab9d0 con 0x5619928a8030 2024-04-26T12:50:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbccfe07640 1 -- 172.21.15.72:0/2779738013 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0abcf0 con 0x5619928a8030 2024-04-26T12:50:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 -- 172.21.15.72:0/2779738013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 msgr2=0x561992a1f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 --2- 172.21.15.72:0/2779738013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a1f4e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0ae040 tx=0x7fbdcc003030 comp rx=0 tx=0).stop 2024-04-26T12:50:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 -- 172.21.15.72:0/2779738013 shutdown_connections 2024-04-26T12:50:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 --2- 172.21.15.72:0/2779738013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a1f4e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 -- 172.21.15.72:0/2779738013 >> 172.21.15.72:0/2779738013 conn(0x56199292ea70 msgr2=0x561992a1b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 -- 172.21.15.72:0/2779738013 shutdown_connections 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 -- 172.21.15.72:0/2779738013 wait complete. 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 Processor -- start 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 -- start start 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a266e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde400c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56199293bab0 con 0x5619928a8030 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a266e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50230/0 (socket says 172.21.15.72:50230) 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde1b27640 1 -- 172.21.15.72:0/399929908 learned_addr learned my addr 172.21.15.72:0/399929908 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde1b27640 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561992a26c20 con 0x5619928a8030 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.784+0000 7fbde1b27640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a266e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc01b2c0 tx=0x7fbdcc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbcce604640 1 -- 172.21.15.72:0/399929908 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0b0050 con 0x5619928a8030 2024-04-26T12:50:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbcce604640 1 -- 172.21.15.72:0/399929908 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0b6870 con 0x5619928a8030 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561992a26eb0 con 0x5619928a8030 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbcce604640 1 -- 172.21.15.72:0/399929908 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0b6b50 con 0x5619928a8030 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561992a29aa0 con 0x5619928a8030 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbcce604640 1 -- 172.21.15.72:0/399929908 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbdcc0b7420 con 0x5619928a8030 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbcce604640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcc80346a0 0x7fbcc8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbcce604640 1 -- 172.21.15.72:0/399929908 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbdcc0bc070 con 0x5619928a8030 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde1326640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcc80346a0 0x7fbcc8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992937490 0x561992a2d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a2dbf0 con 0x561992937490 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde2328640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992937490 0x561992a2d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde1326640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcc80346a0 0x7fbcc8036b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4000f70 tx=0x7fbdd40012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde2328640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992937490 0x561992a2d580 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde2328640 1 -- 172.21.15.72:0/399929908 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992937490 2024-04-26T12:50:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a2acc0 con 0x561992937490 2024-04-26T12:50:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde2328640 1 -- 172.21.15.72:0/399929908 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992937490 2024-04-26T12:50:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a2ff70 0x561992a32360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a32a50 con 0x561992a2ff70 2024-04-26T12:50:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.788+0000 7fbde1b27640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a2ff70 0x561992a32360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1b27640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a2ff70 0x561992a32360 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1b27640 1 -- 172.21.15.72:0/399929908 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a2ff70 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a2ee10 con 0x561992937490 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde2328640 1 -- 172.21.15.72:0/399929908 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992937490 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a33eb0 0x561992a362a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a369e0 con 0x561992a33eb0 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1326640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a33eb0 0x561992a362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1326640 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a33eb0 0x561992a362a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1326640 1 -- 172.21.15.72:0/399929908 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a33eb0 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde400c980 1 Processor -- start 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde400c980 1 -- start start 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde400c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992934ad0 0x561992932f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde400c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56199283bab0 con 0x561992934ad0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992934ad0 0x561992932f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992934ad0 0x561992932f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50242/0 (socket says 172.21.15.72:50242) 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1b27640 1 -- 172.21.15.72:0/883250343 learned_addr learned my addr 172.21.15.72:0/883250343 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.792+0000 7fbde1b27640 1 -- 172.21.15.72:0/883250343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619929334b0 con 0x561992934ad0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde1b27640 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992934ad0 0x561992932f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0ae040 tx=0x7fbdcc0c9460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbcc77fe640 1 -- 172.21.15.72:0/883250343 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0b4b90 con 0x561992934ad0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbcc77fe640 1 -- 172.21.15.72:0/883250343 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0e9070 con 0x561992934ad0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561992933740 con 0x561992934ad0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561992933740 con 0x561992934ad0 2024-04-26T12:50:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbcc77fe640 1 -- 172.21.15.72:0/883250343 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0c9730 con 0x561992934ad0 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbcc77fe640 1 -- 172.21.15.72:0/883250343 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbdcc0c98d0 con 0x561992934ad0 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbcc77fe640 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcbc034650 0x7fbcbc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbcc77fe640 1 -- 172.21.15.72:0/883250343 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbdcc0df050 con 0x561992934ad0 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde1326640 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcbc034650 0x7fbcbc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde400c980 1 Processor -- start 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde400c980 1 -- start start 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde400c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a53e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde400c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561992a1fd40 con 0x561992a53a90 2024-04-26T12:50:17.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde1326640 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcbc034650 0x7fbcbc036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400bf60 tx=0x7fbdd400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a53e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a53e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50258/0 (socket says 172.21.15.72:50258) 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde1b27640 1 -- 172.21.15.72:0/2530851201 learned_addr learned my addr 172.21.15.72:0/2530851201 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.796+0000 7fbde1b27640 1 -- 172.21.15.72:0/2530851201 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561992a54440 con 0x561992a53a90 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde1b27640 1 --2- 172.21.15.72:0/2530851201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a53e70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0f0030 tx=0x7fbdcc0eeef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958f5aff9703714f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbcc57fa640 1 -- 172.21.15.72:0/2530851201 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0be530 con 0x561992a53a90 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbcc57fa640 1 -- 172.21.15.72:0/2530851201 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0e40b0 con 0x561992a53a90 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbcc57fa640 1 -- 172.21.15.72:0/2530851201 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0be350 con 0x561992a53a90 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- 172.21.15.72:0/2530851201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 msgr2=0x561992a53e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 --2- 172.21.15.72:0/2530851201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a53e70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0f0030 tx=0x7fbdcc0eeef0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- 172.21.15.72:0/2530851201 shutdown_connections 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 --2- 172.21.15.72:0/2530851201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a53e70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- 172.21.15.72:0/2530851201 >> 172.21.15.72:0/2530851201 conn(0x561992a4fdd0 msgr2=0x561992a4de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- 172.21.15.72:0/2530851201 shutdown_connections 2024-04-26T12:50:17.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- 172.21.15.72:0/2530851201 wait complete. 2024-04-26T12:50:17.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 Processor -- start 2024-04-26T12:50:17.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- start start 2024-04-26T12:50:17.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a5ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561992a54b40 con 0x561992a53a90 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a5ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde1b27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a5ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50270/0 (socket says 172.21.15.72:50270) 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 learned_addr learned my addr 172.21.15.72:0/1247295644 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561992a5b2a0 con 0x561992a53a90 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde1b27640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a5ad60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0befd0 tx=0x7fbdcc0c4f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbcb37fe640 1 -- 172.21.15.72:0/1247295644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0be350 con 0x561992a53a90 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561992a5b2a0 con 0x561992a53a90 2024-04-26T12:50:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbcb37fe640 1 -- 172.21.15.72:0/1247295644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0bfe50 con 0x561992a53a90 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbcb37fe640 1 -- 172.21.15.72:0/1247295644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0be530 con 0x561992a53a90 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.800+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561992a5b710 con 0x561992a53a90 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbcb37fe640 1 -- 172.21.15.72:0/1247295644 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbdcc115060 con 0x561992a53a90 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbcb37fe640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcac0345b0 0x7fbcac036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbcb37fe640 1 -- 172.21.15.72:0/1247295644 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fbdcc0a8070 con 0x561992a53a90 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde1326640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcac0345b0 0x7fbcac036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992a65c10 0x561992a680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a68820 con 0x561992a65c10 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde2328640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992a65c10 0x561992a680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde1326640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcac0345b0 0x7fbcac036a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x561992a2e0f0 tx=0x7fbdd4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde2328640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992a65c10 0x561992a680d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 realm 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a68c30 con 0x561992a65c10 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a694d0 con 0x561992a65c10 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a6a5d0 0x561992a6c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a6cf40 con 0x561992a6a5d0 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde1b27640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a6a5d0 0x561992a6c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.804+0000 7fbde1b27640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a6a5d0 0x561992a6c9c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde400c980 20 searching for the correct realm 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a6eeb0 0x561992a71370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a71a40 con 0x561992a6eeb0 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1326640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a6eeb0 0x561992a71370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1326640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a6eeb0 0x561992a71370 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1326640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbdd4037040 0x7fbdd4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a71a40 con 0x7fbdd4037040 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbdd4037040 0x7fbdd4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbdd4037040 0x7fbdd4036410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.808+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x7fbdd4037040 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x7fbdd4037040 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.812+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x7fbdd4037040 2024-04-26T12:50:17.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.816+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x7fbdd4037040 2024-04-26T12:50:17.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6eeb0 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a6a5d0 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x561992a65c10 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561992a69870 con 0x7fbdd4037040 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde400c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde400c980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde400c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde400c980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde400c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:17.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.820+0000 7fbde400c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a6d790 con 0x561992a65c10 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a6d790 con 0x561992a65c10 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a6d790 con 0x561992a6eeb0 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 zone default found 2024-04-26T12:50:17.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 4 Realm: () 2024-04-26T12:50:17.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:17.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:17.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:17.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 zonegroup default 2024-04-26T12:50:17.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a6e030 con 0x561992a6a5d0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a738a0 con 0x561992a6eeb0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a73c40 con 0x561992a6eeb0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 started sync module instance, tier type = 2024-04-26T12:50:17.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:17.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a72d40 con 0x7fbdd4037040 2024-04-26T12:50:17.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667834602080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a72d40 con 0x7fbdd4037040 2024-04-26T12:50:17.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.824+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a746b0 con 0x561992a65c10 2024-04-26T12:50:17.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.828+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667834602080] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.828+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.828+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667834605952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a72d40 con 0x561992a65c10 2024-04-26T12:50:17.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.828+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a750c0 con 0x561992a6eeb0 2024-04-26T12:50:17.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667834605952] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667834608656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a75460 con 0x561992a6eeb0 2024-04-26T12:50:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a75e20 con 0x7fbdd4037040 2024-04-26T12:50:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667834612384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a766c0 con 0x7fbdd4037040 2024-04-26T12:50:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a77080 con 0x561992a65c10 2024-04-26T12:50:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667834608656] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.832+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667834612384] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.836+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.836+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667834616784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a76ff0 con 0x561992a65c10 2024-04-26T12:50:17.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.836+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a76610 con 0x561992a6a5d0 2024-04-26T12:50:17.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.836+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667834616784] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.836+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.836+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667834614112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a77920 con 0x561992a6a5d0 2024-04-26T12:50:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.836+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a78170 con 0x561992a6a5d0 2024-04-26T12:50:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667834623248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a78de0 con 0x561992a6a5d0 2024-04-26T12:50:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a79850 con 0x561992a6a5d0 2024-04-26T12:50:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667834614112] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667834623248] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667834626848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a78970 con 0x561992a6a5d0 2024-04-26T12:50:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 20 add_watcher() i=0 2024-04-26T12:50:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 20 add_watcher() i=1 2024-04-26T12:50:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 20 add_watcher() i=2 2024-04-26T12:50:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 20 add_watcher() i=3 2024-04-26T12:50:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 20 add_watcher() i=4 2024-04-26T12:50:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 20 add_watcher() i=5 2024-04-26T12:50:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.840+0000 7fbde400c980 20 add_watcher() i=6 2024-04-26T12:50:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667834626848] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 20 add_watcher() i=7 2024-04-26T12:50:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a7c950 con 0x561992a65c10 2024-04-26T12:50:17.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667834618912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a79dd0 con 0x561992a65c10 2024-04-26T12:50:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667834618912] v33'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbc8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 5 note: GC not initialized 2024-04-26T12:50:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbc8a7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.844+0000 7fbde400c980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 Filter name: none 2024-04-26T12:50:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbc03fff640 20 reqs_thread_entry: start 2024-04-26T12:50:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992a9fe80 con 0x7fbdd4037040 2024-04-26T12:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aa07b0 con 0x7fbdd4037040 2024-04-26T12:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(63 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:17.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aa07f0 con 0x7fbdd4037040 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aa1ed0 con 0x7fbdd4037040 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(65 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 4.39 4:9c6c5753:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aa14f0 con 0x561992a6eeb0 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 4.5 4:a34a0678:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aa6a40 con 0x561992a6eeb0 2024-04-26T12:50:17.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 4.2 4:43d66ddb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aa9430 con 0x561992a65c10 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 4.9 4:91fcabb3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aabdf0 con 0x561992a65c10 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 4.26 4:66c705c7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aae6e0 con 0x561992a6a5d0 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 4.2 4:42690739:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992ab14c0 con 0x561992a65c10 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 4.c 4:31d931f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992aabdf0 con 0x561992a65c10 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 4.7 4:e183a031:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992ab6280 con 0x561992a6a5d0 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 4.1e 4:788778d7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992ab8af0 con 0x561992a6a5d0 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:75 4.13 4:c9844179:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992abb890 con 0x7fbdd4037040 2024-04-26T12:50:17.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 4.22 4:454d4585:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561992ab8af0 con 0x561992a65c10 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(72 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(69 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(71 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(75 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.848+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbc8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:17.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667834618912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x561992a65c10 2024-04-26T12:50:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94667834618912] v33'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667834602080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x7fbdd4037040 2024-04-26T12:50:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94667834602080] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbde400c980 20 remove_watcher() i=0 2024-04-26T12:50:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbde400c980 2 removed watcher, disabling cache 2024-04-26T12:50:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.852+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667834605952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x561992a65c10 2024-04-26T12:50:17.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.856+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94667834605952] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.856+0000 7fbde400c980 20 remove_watcher() i=1 2024-04-26T12:50:17.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.856+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667834608656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x561992a6eeb0 2024-04-26T12:50:17.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.856+0000 7fbde1326640 1 -- 172.21.15.72:0/1247295644 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94667834608656] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd400e620 con 0x561992a6eeb0 2024-04-26T12:50:17.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.856+0000 7fbde400c980 20 remove_watcher() i=2 2024-04-26T12:50:17.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.856+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667834612384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x7fbdd4037040 2024-04-26T12:50:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.860+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94667834612384] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x7fbdd4037040 2024-04-26T12:50:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.860+0000 7fbde400c980 20 remove_watcher() i=3 2024-04-26T12:50:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.860+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667834616784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x561992a65c10 2024-04-26T12:50:17.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.860+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94667834616784] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbddc00a4d0 con 0x561992a65c10 2024-04-26T12:50:17.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.860+0000 7fbde400c980 20 remove_watcher() i=4 2024-04-26T12:50:17.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.860+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667834614112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x561992a6a5d0 2024-04-26T12:50:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.864+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94667834614112] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.864+0000 7fbde400c980 20 remove_watcher() i=5 2024-04-26T12:50:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.864+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667834623248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x561992a6a5d0 2024-04-26T12:50:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.864+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94667834623248] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.864+0000 7fbde400c980 20 remove_watcher() i=6 2024-04-26T12:50:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.864+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667834626848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561992a9d840 con 0x561992a6a5d0 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde1b27640 1 -- 172.21.15.72:0/1247295644 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94667834626848] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c7020 con 0x561992a6a5d0 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 20 remove_watcher() i=7 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a6a5d0 msgr2=0x561992a6c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a6a5d0 0x561992a6c9c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992a65c10 msgr2=0x561992a680d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992a65c10 0x561992a680d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbdd4037040 msgr2=0x7fbdd4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbdd4037040 0x7fbdd4036410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a6eeb0 msgr2=0x561992a71370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a6eeb0 0x561992a71370 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcac0345b0 msgr2=0x7fbcac036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcac0345b0 0x7fbcac036a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x561992a2e0f0 tx=0x7fbdd4010000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 msgr2=0x561992a5ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde2328640 1 -- 172.21.15.72:0/1247295644 reap_dead start 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a5ad60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0befd0 tx=0x7fbdcc0c4f10 comp rx=0 tx=0).stop 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 shutdown_connections 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/1247295644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992a53a90 0x561992a5ad60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 >> 172.21.15.72:0/1247295644 conn(0x561992a4fdd0 msgr2=0x561992a4d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 shutdown_connections 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/1247295644 wait complete. 2024-04-26T12:50:17.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcbc034650 msgr2=0x7fbcbc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcbc034650 0x7fbcbc036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400bf60 tx=0x7fbdd400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992934ad0 msgr2=0x561992932f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992934ad0 0x561992932f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0ae040 tx=0x7fbdcc0c9460 comp rx=0 tx=0).stop 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 shutdown_connections 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcbc034650 0x7fbcbc036b10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/883250343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561992934ad0 0x561992932f70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 >> 172.21.15.72:0/883250343 conn(0x561992a39880 msgr2=0x561992a3a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 shutdown_connections 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/883250343 wait complete. 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a2ff70 msgr2=0x561992a32360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561992a2ff70 0x561992a32360 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992937490 msgr2=0x561992a2d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561992937490 0x561992a2d580 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a33eb0 msgr2=0x561992a362a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561992a33eb0 0x561992a362a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcc80346a0 msgr2=0x7fbcc8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbcc80346a0 0x7fbcc8036b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4000f70 tx=0x7fbdd40012c0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 msgr2=0x561992a266e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 --2- 172.21.15.72:0/399929908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5619928a8030 0x561992a266e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc01b2c0 tx=0x7fbdcc018020 comp rx=0 tx=0).stop 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde2328640 1 -- 172.21.15.72:0/399929908 reap_dead start 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 shutdown_connections 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 >> 172.21.15.72:0/399929908 conn(0x56199292ea70 msgr2=0x561992a19b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 shutdown_connections 2024-04-26T12:50:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.868+0000 7fbde400c980 1 -- 172.21.15.72:0/399929908 wait complete. 2024-04-26T12:50:17.880 INFO:teuthology.orchestra.run.smithi072.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f52412b2-0d18-4618-9944-7ddcdd8afe97","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","marker":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:50:17.074322Z","creation_time":"2024-04-26T12:50:17.070930Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T12:50:17.881 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:50:17.074322Z', 'creation_time': '2024-04-26T12:50:17.070930Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:50:17.881 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:50:17.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:50:17.881 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-26T12:50:17.957 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:17.957 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f178c46a980 1 Processor -- start 2024-04-26T12:50:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f178c46a980 1 -- start start 2024-04-26T12:50:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f178c46a980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a5d2580180 0x55a5d2580560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f178c46a980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5d242e510 con 0x55a5d2580aa0 2024-04-26T12:50:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f178c46a980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a5d2435430 con 0x55a5d2580180 2024-04-26T12:50:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f1789f85640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a5d2580180 0x55a5d2580560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f1789f85640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a5d2580180 0x55a5d2580560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50278/0 (socket says 172.21.15.72:50278) 2024-04-26T12:50:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f1789f85640 1 -- 172.21.15.72:0/3986505729 learned_addr learned my addr 172.21.15.72:0/3986505729 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f1789784640 1 --1- 172.21.15.72:0/3986505729 >> v1:172.21.15.29:6789/0 conn(0x55a5d2580aa0 0x55a5d25814b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36146/0 (socket says 172.21.15.72:36146) 2024-04-26T12:50:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f1789f85640 1 -- 172.21.15.72:0/3986505729 >> v1:172.21.15.29:6789/0 conn(0x55a5d2580aa0 legacy=0x55a5d25814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.960+0000 7f1789f85640 1 -- 172.21.15.72:0/3986505729 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d240aae0 con 0x55a5d2580180 2024-04-26T12:50:17.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f1789f85640 1 --2- 172.21.15.72:0/3986505729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2580560 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f177c00a4e0 tx=0x7f177c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8aed306b8bd648 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f1788f83640 1 -- 172.21.15.72:0/3986505729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0aa540 con 0x55a5d2580180 2024-04-26T12:50:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f1788f83640 1 -- 172.21.15.72:0/3986505729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0aa6e0 con 0x55a5d2580180 2024-04-26T12:50:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f1788f83640 1 -- 172.21.15.72:0/3986505729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0aaa40 con 0x55a5d2580180 2024-04-26T12:50:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f178c46a980 1 -- 172.21.15.72:0/3986505729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 msgr2=0x55a5d2580560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f178c46a980 1 --2- 172.21.15.72:0/3986505729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2580560 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f177c00a4e0 tx=0x7f177c01b090 comp rx=0 tx=0).stop 2024-04-26T12:50:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f178c46a980 1 -- 172.21.15.72:0/3986505729 shutdown_connections 2024-04-26T12:50:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f178c46a980 1 --2- 172.21.15.72:0/3986505729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2580560 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f178c46a980 1 -- 172.21.15.72:0/3986505729 >> 172.21.15.72:0/3986505729 conn(0x55a5d257ba50 msgr2=0x55a5d257de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f178c46a980 1 -- 172.21.15.72:0/3986505729 shutdown_connections 2024-04-26T12:50:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.964+0000 7f178c46a980 1 -- 172.21.15.72:0/3986505729 wait complete. 2024-04-26T12:50:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 Processor -- start 2024-04-26T12:50:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 -- start start 2024-04-26T12:50:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d266ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a5d2484a70 con 0x55a5d2580180 2024-04-26T12:50:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d266ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d266ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50280/0 (socket says 172.21.15.72:50280) 2024-04-26T12:50:17.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1789f85640 1 -- 172.21.15.72:0/1655644466 learned_addr learned my addr 172.21.15.72:0/1655644466 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1789f85640 1 -- 172.21.15.72:0/1655644466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d266c010 con 0x55a5d2580180 2024-04-26T12:50:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1789f85640 1 --2- 172.21.15.72:0/1655644466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d266ba40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f177c017ca0 tx=0x7f177c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311d49e0af45f212 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1677e07640 1 -- 172.21.15.72:0/1655644466 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0b9070 con 0x55a5d2580180 2024-04-26T12:50:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1677e07640 1 -- 172.21.15.72:0/1655644466 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0aaa80 con 0x55a5d2580180 2024-04-26T12:50:17.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f1677e07640 1 -- 172.21.15.72:0/1655644466 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0aad60 con 0x55a5d2580180 2024-04-26T12:50:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 -- 172.21.15.72:0/1655644466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 msgr2=0x55a5d266ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 --2- 172.21.15.72:0/1655644466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d266ba40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f177c017ca0 tx=0x7f177c0033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 -- 172.21.15.72:0/1655644466 shutdown_connections 2024-04-26T12:50:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 --2- 172.21.15.72:0/1655644466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d266ba40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 -- 172.21.15.72:0/1655644466 >> 172.21.15.72:0/1655644466 conn(0x55a5d257ba50 msgr2=0x55a5d26675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 -- 172.21.15.72:0/1655644466 shutdown_connections 2024-04-26T12:50:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.980+0000 7f178c46a980 1 -- 172.21.15.72:0/1655644466 wait complete. 2024-04-26T12:50:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 Processor -- start 2024-04-26T12:50:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 -- start start 2024-04-26T12:50:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2672b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a5d258a220 con 0x55a5d2580180 2024-04-26T12:50:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2672b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2672b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50296/0 (socket says 172.21.15.72:50296) 2024-04-26T12:50:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1789f85640 1 -- 172.21.15.72:0/3947663155 learned_addr learned my addr 172.21.15.72:0/3947663155 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1789f85640 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d26730c0 con 0x55a5d2580180 2024-04-26T12:50:17.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1789f85640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2672b80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f177c017ca0 tx=0x7f177c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1676604640 1 -- 172.21.15.72:0/3947663155 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0b9070 con 0x55a5d2580180 2024-04-26T12:50:17.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d2673350 con 0x55a5d2580180 2024-04-26T12:50:17.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1676604640 1 -- 172.21.15.72:0/3947663155 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0c7410 con 0x55a5d2580180 2024-04-26T12:50:17.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1676604640 1 -- 172.21.15.72:0/3947663155 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0c7730 con 0x55a5d2580180 2024-04-26T12:50:17.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d2675f90 con 0x55a5d2580180 2024-04-26T12:50:17.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1676604640 1 -- 172.21.15.72:0/3947663155 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f177c0b3040 con 0x55a5d2580180 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1676604640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1670034650 0x7f1670036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1676604640 1 -- 172.21.15.72:0/3947663155 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f177c0c4070 con 0x55a5d2580180 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f1789784640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1670034650 0x7f1670036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d2580aa0 0x55a5d2679ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d267a140 con 0x55a5d2580aa0 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.984+0000 7f178a786640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d2580aa0 0x55a5d2679ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f1789784640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1670034650 0x7f1670036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1774000f70 tx=0x7f1774001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178a786640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d2580aa0 0x55a5d2679ad0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178a786640 1 -- 172.21.15.72:0/3947663155 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d2580aa0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26771b0 con 0x55a5d2580aa0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178a786640 1 -- 172.21.15.72:0/3947663155 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d2580aa0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d267c470 0x55a5d267e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d267ef50 con 0x55a5d267c470 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f1789f85640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d267c470 0x55a5d267e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f1789f85640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d267c470 0x55a5d267e860 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f1789f85640 1 -- 172.21.15.72:0/3947663155 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f177c0cd060 con 0x55a5d267c470 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d267b2e0 con 0x55a5d2580aa0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178a786640 1 -- 172.21.15.72:0/3947663155 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d2580aa0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26803b0 0x55a5d26827a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d2682ea0 con 0x55a5d26803b0 2024-04-26T12:50:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f1789784640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26803b0 0x55a5d26827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.988+0000 7f1789784640 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26803b0 0x55a5d26827a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f1789784640 1 -- 172.21.15.72:0/3947663155 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f177400f6a0 con 0x55a5d26803b0 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f178c46a980 1 Processor -- start 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f178c46a980 1 -- start start 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f178c46a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2690f30 0x55a5d2691350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f178c46a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a5d2488ab0 con 0x55a5d2690f30 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2690f30 0x55a5d2691350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2690f30 0x55a5d2691350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50306/0 (socket says 172.21.15.72:50306) 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f1789f85640 1 -- 172.21.15.72:0/3950463359 learned_addr learned my addr 172.21.15.72:0/3950463359 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f1789f85640 1 -- 172.21.15.72:0/3950463359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d2691890 con 0x55a5d2690f30 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f1789f85640 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2690f30 0x55a5d2691350 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f177c0e2f10 tx=0x7f177c0c6820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f166f7fe640 1 -- 172.21.15.72:0/3950463359 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0b3970 con 0x55a5d2690f30 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d2692330 con 0x55a5d2690f30 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d2692800 con 0x55a5d2690f30 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f166f7fe640 1 -- 172.21.15.72:0/3950463359 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0b3b10 con 0x55a5d2690f30 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f166f7fe640 1 -- 172.21.15.72:0/3950463359 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0b3df0 con 0x55a5d2690f30 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f166f7fe640 1 -- 172.21.15.72:0/3950463359 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f177c0eb060 con 0x55a5d2690f30 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f166f7fe640 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f16640345b0 0x7f1664036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f166f7fe640 1 -- 172.21.15.72:0/3950463359 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f177c0df030 con 0x55a5d2690f30 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.992+0000 7f1789784640 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f16640345b0 0x7f1664036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 Processor -- start 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- start start 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d24f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a5d266c2a0 con 0x55a5d24f4fd0 2024-04-26T12:50:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789784640 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f16640345b0 0x7f1664036a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a5d267a5f0 tx=0x7f177400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d24f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d24f53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50312/0 (socket says 172.21.15.72:50312) 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 -- 172.21.15.72:0/1166207801 learned_addr learned my addr 172.21.15.72:0/1166207801 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 -- 172.21.15.72:0/1166207801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d24f5980 con 0x55a5d24f4fd0 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 --2- 172.21.15.72:0/1166207801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d24f53b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f177c0b4570 tx=0x7f177c0b4660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce3d0f66dc8ea0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f166d7fa640 1 -- 172.21.15.72:0/1166207801 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0fc020 con 0x55a5d24f4fd0 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f166d7fa640 1 -- 172.21.15.72:0/1166207801 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0bda50 con 0x55a5d24f4fd0 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f166d7fa640 1 -- 172.21.15.72:0/1166207801 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0f3040 con 0x55a5d24f4fd0 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- 172.21.15.72:0/1166207801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 msgr2=0x55a5d24f53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 --2- 172.21.15.72:0/1166207801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d24f53b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f177c0b4570 tx=0x7f177c0b4660 comp rx=0 tx=0).stop 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- 172.21.15.72:0/1166207801 shutdown_connections 2024-04-26T12:50:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 --2- 172.21.15.72:0/1166207801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d24f53b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- 172.21.15.72:0/1166207801 >> 172.21.15.72:0/1166207801 conn(0x55a5d269a290 msgr2=0x55a5d26982f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- 172.21.15.72:0/1166207801 shutdown_connections 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- 172.21.15.72:0/1166207801 wait complete. 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 Processor -- start 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- start start 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d269f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f178c46a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a5d269ff50 con 0x55a5d24f4fd0 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d269f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d269f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50316/0 (socket says 172.21.15.72:50316) 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 learned_addr learned my addr 172.21.15.72:0/4196505666 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:17.996+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d269de30 con 0x55a5d24f4fd0 2024-04-26T12:50:18.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f1789f85640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d269f710 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f177c0a9020 tx=0x7f177c0a8fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f165b7fe640 1 -- 172.21.15.72:0/4196505666 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0bbaf0 con 0x55a5d24f4fd0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f165b7fe640 1 -- 172.21.15.72:0/4196505666 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0bbc90 con 0x55a5d24f4fd0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d269de30 con 0x55a5d24f4fd0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f165b7fe640 1 -- 172.21.15.72:0/4196505666 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c0dd130 con 0x55a5d24f4fd0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d269de30 con 0x55a5d24f4fd0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f165b7fe640 1 -- 172.21.15.72:0/4196505666 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f177c0ff020 con 0x55a5d24f4fd0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f165b7fe640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1654034650 0x7f1654036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f165b7fe640 1 -- 172.21.15.72:0/4196505666 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f177c116c30 con 0x55a5d24f4fd0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f1789784640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1654034650 0x7f1654036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d26b3460 0x55a5d26b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b6050 con 0x55a5d26b3460 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178a786640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d26b3460 0x55a5d26b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f1789784640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1654034650 0x7f1654036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f177400c010 tx=0x7f1774010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178a786640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d26b3460 0x55a5d26b5900 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d26b3460 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 realm 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b6460 con 0x55a5d26b3460 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d26b3460 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b6d00 con 0x55a5d26b3460 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d26b3460 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.000+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d26b3460 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d26b7e00 0x55a5d26ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26ba770 con 0x55a5d26b7e00 2024-04-26T12:50:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789f85640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d26b7e00 0x55a5d26ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789f85640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d26b7e00 0x55a5d26ba1f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 20 searching for the correct realm 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26bc6a0 0x55a5d26beb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26bf230 con 0x55a5d26bc6a0 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789784640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26bc6a0 0x55a5d26beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789784640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26bc6a0 0x55a5d26beb60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789784640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f177401fbe0 0x7f177403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26bf230 con 0x7f177401fbe0 2024-04-26T12:50:18.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178a786640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f177401fbe0 0x7f177403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178a786640 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f177401fbe0 0x7f177403a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17840083f0 con 0x7f177401fbe0 2024-04-26T12:50:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.004+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17840083f0 con 0x55a5d26b3460 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x7f177401fbe0 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x7f177401fbe0 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.008+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x7f177401fbe0 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1784026040 con 0x7f177401fbe0 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.012+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x7f177401fbe0 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x7f177401fbe0 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x7f177401fbe0 2024-04-26T12:50:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x7f177401fbe0 2024-04-26T12:50:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.016+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x55a5d26b3460 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26b70a0 con 0x7f177401fbe0 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784026040 con 0x7f177401fbe0 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:18.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26bafc0 con 0x55a5d26b3460 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26bafc0 con 0x55a5d26b3460 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1784026040 con 0x55a5d26b3460 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26bafc0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 zone default found 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 4 Realm: () 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 zonegroup default 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26bb860 con 0x55a5d26b7e00 2024-04-26T12:50:18.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c1090 con 0x55a5d26bc6a0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c1430 con 0x55a5d26bc6a0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 started sync module instance, tier type = 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:18.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.020+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c0530 con 0x7f177401fbe0 2024-04-26T12:50:18.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.024+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784026040 con 0x7f177401fbe0 2024-04-26T12:50:18.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.024+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94170688260656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c0530 con 0x7f177401fbe0 2024-04-26T12:50:18.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.024+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c1df0 con 0x55a5d26b3460 2024-04-26T12:50:18.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.024+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94170688260656] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.024+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.024+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94170688264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c0530 con 0x55a5d26b3460 2024-04-26T12:50:18.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.024+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c2800 con 0x55a5d26bc6a0 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94170688264784] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94170688258176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c04a0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c3500 con 0x7f177401fbe0 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94170688270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c3da0 con 0x7f177401fbe0 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c4760 con 0x55a5d26b3460 2024-04-26T12:50:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.028+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94170688258176] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94170688270720] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94170688275120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c3d10 con 0x55a5d26b3460 2024-04-26T12:50:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c46d0 con 0x55a5d26b7e00 2024-04-26T12:50:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94170688275120] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94170688272784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c5000 con 0x55a5d26b7e00 2024-04-26T12:50:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.032+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c5850 con 0x55a5d26b7e00 2024-04-26T12:50:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94170688272784] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94170688279968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c6070 con 0x55a5d26b7e00 2024-04-26T12:50:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c4b90 con 0x55a5d26b7e00 2024-04-26T12:50:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94170688279968] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94170688277392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c6660 con 0x55a5d26b7e00 2024-04-26T12:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 20 add_watcher() i=0 2024-04-26T12:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 20 add_watcher() i=1 2024-04-26T12:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 20 add_watcher() i=2 2024-04-26T12:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 20 add_watcher() i=3 2024-04-26T12:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 20 add_watcher() i=4 2024-04-26T12:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 20 add_watcher() i=5 2024-04-26T12:50:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.036+0000 7f178c46a980 20 add_watcher() i=6 2024-04-26T12:50:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.040+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94170688277392] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.040+0000 7f178c46a980 20 add_watcher() i=7 2024-04-26T12:50:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.040+0000 7f178c46a980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.040+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c9a90 con 0x55a5d26b3460 2024-04-26T12:50:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.040+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.040+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94170688281280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c6fb0 con 0x55a5d26b3460 2024-04-26T12:50:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.040+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94170688281280] v33'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f163b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 5 note: GC not initialized 2024-04-26T12:50:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f163a7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 Filter name: none 2024-04-26T12:50:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f15abfff640 20 reqs_thread_entry: start 2024-04-26T12:50:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26ecdf0 con 0x55a5d26b3460 2024-04-26T12:50:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26ed7e0 con 0x55a5d26b3460 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26ee7f0 con 0x7f177401fbe0 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv15 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26ebf40 con 0x7f177401fbe0 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26ee7b0 con 0x7f177401fbe0 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(66 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 4.39 4:9c6c5753:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26ee210 con 0x55a5d26bc6a0 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 4.5 4:a34a0678:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26f3100 con 0x55a5d26bc6a0 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 4.2 4:43d66ddb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26f5a50 con 0x55a5d26b3460 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 4.9 4:91fcabb3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26f8560 con 0x55a5d26b3460 2024-04-26T12:50:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 4.26 4:66c705c7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26fb0a0 con 0x55a5d26b7e00 2024-04-26T12:50:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 4.2 4:42690739:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26fdab0 con 0x55a5d26b3460 2024-04-26T12:50:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 4.c 4:31d931f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d27004c0 con 0x55a5d26b3460 2024-04-26T12:50:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 4.7 4:e183a031:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d2702ed0 con 0x55a5d26b7e00 2024-04-26T12:50:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 4.1e 4:788778d7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d2705920 con 0x55a5d26b7e00 2024-04-26T12:50:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:76 4.13 4:c9844179:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d2708790 con 0x7f177401fbe0 2024-04-26T12:50:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:77 4.22 4:454d4585:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5d270b600 con 0x55a5d26b3460 2024-04-26T12:50:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(70 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(73 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(72 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(76 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.044+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(77 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.048+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(71 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.048+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.048+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.048+0000 7f163b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.048+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94170688281280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d2702ed0 con 0x55a5d26b3460 2024-04-26T12:50:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.048+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94170688281280] v33'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.048+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94170688260656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c5ac0 con 0x7f177401fbe0 2024-04-26T12:50:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.052+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94170688260656] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.052+0000 7f178c46a980 20 remove_watcher() i=0 2024-04-26T12:50:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.052+0000 7f178c46a980 2 removed watcher, disabling cache 2024-04-26T12:50:18.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.052+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94170688264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c98d0 con 0x55a5d26b3460 2024-04-26T12:50:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.052+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94170688264784] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.052+0000 7f178c46a980 20 remove_watcher() i=1 2024-04-26T12:50:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.052+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94170688258176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c98d0 con 0x55a5d26bc6a0 2024-04-26T12:50:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f1789784640 1 -- 172.21.15.72:0/4196505666 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94170688258176] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1774037040 con 0x55a5d26bc6a0 2024-04-26T12:50:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178c46a980 20 remove_watcher() i=2 2024-04-26T12:50:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94170688270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c98d0 con 0x7f177401fbe0 2024-04-26T12:50:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94170688270720] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x7f177401fbe0 2024-04-26T12:50:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178c46a980 20 remove_watcher() i=3 2024-04-26T12:50:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94170688275120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c98d0 con 0x55a5d26b3460 2024-04-26T12:50:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94170688275120] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784036040 con 0x55a5d26b3460 2024-04-26T12:50:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178c46a980 20 remove_watcher() i=4 2024-04-26T12:50:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.056+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94170688272784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c42b0 con 0x55a5d26b7e00 2024-04-26T12:50:18.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.060+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94170688272784] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.060+0000 7f178c46a980 20 remove_watcher() i=5 2024-04-26T12:50:18.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.060+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94170688279968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c98d0 con 0x55a5d26b7e00 2024-04-26T12:50:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94170688279968] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c0f6040 con 0x55a5d26b7e00 2024-04-26T12:50:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 20 remove_watcher() i=6 2024-04-26T12:50:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94170688277392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5d26c42b0 con 0x55a5d26b7e00 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f1789f85640 1 -- 172.21.15.72:0/4196505666 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94170688277392] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177c13a040 con 0x55a5d26b7e00 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 20 remove_watcher() i=7 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d26b7e00 msgr2=0x55a5d26ba1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d26b7e00 0x55a5d26ba1f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d26b3460 msgr2=0x55a5d26b5900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d26b3460 0x55a5d26b5900 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f177401fbe0 msgr2=0x7f177403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f177401fbe0 0x7f177403a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26bc6a0 msgr2=0x55a5d26beb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26bc6a0 0x55a5d26beb60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1654034650 msgr2=0x7f1654036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1654034650 0x7f1654036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f177400c010 tx=0x7f1774010000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 msgr2=0x55a5d269f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178a786640 1 -- 172.21.15.72:0/4196505666 reap_dead start 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d269f710 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f177c0a9020 tx=0x7f177c0a8fb0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 shutdown_connections 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/4196505666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d24f4fd0 0x55a5d269f710 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 >> 172.21.15.72:0/4196505666 conn(0x55a5d269a290 msgr2=0x55a5d26978f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 shutdown_connections 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/4196505666 wait complete. 2024-04-26T12:50:18.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f16640345b0 msgr2=0x7f1664036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f16640345b0 0x7f1664036a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a5d267a5f0 tx=0x7f177400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2690f30 msgr2=0x55a5d2691350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2690f30 0x55a5d2691350 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f177c0e2f10 tx=0x7f177c0c6820 comp rx=0 tx=0).stop 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 shutdown_connections 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f16640345b0 0x7f1664036a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 --2- 172.21.15.72:0/3950463359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2690f30 0x55a5d2691350 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 >> 172.21.15.72:0/3950463359 conn(0x55a5d2685d40 msgr2=0x55a5d2686850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 shutdown_connections 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.064+0000 7f178c46a980 1 -- 172.21.15.72:0/3950463359 wait complete. 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d267c470 msgr2=0x55a5d267e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a5d267c470 0x55a5d267e860 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d2580aa0 msgr2=0x55a5d2679ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a5d2580aa0 0x55a5d2679ad0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26803b0 msgr2=0x55a5d26827a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a5d26803b0 0x55a5d26827a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1670034650 msgr2=0x7f1670036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1670034650 0x7f1670036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1774000f70 tx=0x7f1774001380 comp rx=0 tx=0).stop 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 msgr2=0x55a5d2672b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 --2- 172.21.15.72:0/3947663155 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a5d2580180 0x55a5d2672b80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f177c017ca0 tx=0x7f177c017e30 comp rx=0 tx=0).stop 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178a786640 1 -- 172.21.15.72:0/3947663155 reap_dead start 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 shutdown_connections 2024-04-26T12:50:18.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 >> 172.21.15.72:0/3947663155 conn(0x55a5d257ba50 msgr2=0x55a5d26660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 shutdown_connections 2024-04-26T12:50:18.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.068+0000 7f178c46a980 1 -- 172.21.15.72:0/3947663155 wait complete. 2024-04-26T12:50:18.077 INFO:teuthology.orchestra.run.smithi072.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f52412b2-0d18-4618-9944-7ddcdd8afe97","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","marker":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:50:17.074322Z","creation_time":"2024-04-26T12:50:17.070930Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-04-26T12:50:18.077 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:50:17.074322Z', 'creation_time': '2024-04-26T12:50:17.070930Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-26T12:50:18.085 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:50:18.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:50:18.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:50:18.086 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T12:50:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147e35c980 1 Processor -- start 2024-04-26T12:50:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147e35c980 1 -- start start 2024-04-26T12:50:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147e35c980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a51232e4c0 0x55a51232e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147e35c980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5121d9510 con 0x55a51232ede0 2024-04-26T12:50:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147e35c980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a5121e0430 con 0x55a51232e4c0 2024-04-26T12:50:18.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147be77640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a51232e4c0 0x55a51232e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147b676640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55a51232ede0 0x55a51232f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36150/0 (socket says 172.21.15.72:36150) 2024-04-26T12:50:18.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147b676640 1 -- 172.21.15.72:0/2809726900 learned_addr learned my addr 172.21.15.72:0/2809726900 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:18.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147be77640 1 -- 172.21.15.72:0/2809726900 >> v1:172.21.15.29:6789/0 conn(0x55a51232ede0 legacy=0x55a51232f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.156+0000 7f147be77640 1 -- 172.21.15.72:0/2809726900 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5121b5ae0 con 0x55a51232e4c0 2024-04-26T12:50:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147be77640 1 --2- 172.21.15.72:0/2809726900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a51232e8a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f146c00a420 tx=0x7f146c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f7cdafbde39092 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147ae75640 1 -- 172.21.15.72:0/2809726900 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0af070 con 0x55a51232e4c0 2024-04-26T12:50:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147ae75640 1 -- 172.21.15.72:0/2809726900 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c0aa530 con 0x55a51232e4c0 2024-04-26T12:50:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147ae75640 1 -- 172.21.15.72:0/2809726900 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0aa850 con 0x55a51232e4c0 2024-04-26T12:50:18.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147e35c980 1 -- 172.21.15.72:0/2809726900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 msgr2=0x55a51232e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147e35c980 1 --2- 172.21.15.72:0/2809726900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a51232e8a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f146c00a420 tx=0x7f146c01afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147e35c980 1 -- 172.21.15.72:0/2809726900 shutdown_connections 2024-04-26T12:50:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147e35c980 1 --2- 172.21.15.72:0/2809726900 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a51232e8a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147e35c980 1 -- 172.21.15.72:0/2809726900 >> 172.21.15.72:0/2809726900 conn(0x55a5122a1bc0 msgr2=0x55a5122a1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147e35c980 1 -- 172.21.15.72:0/2809726900 shutdown_connections 2024-04-26T12:50:18.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.160+0000 7f147e35c980 1 -- 172.21.15.72:0/2809726900 wait complete. 2024-04-26T12:50:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147e35c980 1 Processor -- start 2024-04-26T12:50:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147e35c980 1 -- start start 2024-04-26T12:50:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147e35c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512419d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147e35c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a51222fa70 con 0x55a51232e4c0 2024-04-26T12:50:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512419d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512419d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50334/0 (socket says 172.21.15.72:50334) 2024-04-26T12:50:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147be77640 1 -- 172.21.15.72:0/617908227 learned_addr learned my addr 172.21.15.72:0/617908227 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.176+0000 7f147be77640 1 -- 172.21.15.72:0/617908227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51241a2f0 con 0x55a51232e4c0 2024-04-26T12:50:18.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147be77640 1 --2- 172.21.15.72:0/617908227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512419d20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f146c00a420 tx=0x7f146c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7204c026e3b53d79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f1369e0b640 1 -- 172.21.15.72:0/617908227 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0af050 con 0x55a51232e4c0 2024-04-26T12:50:18.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f1369e0b640 1 -- 172.21.15.72:0/617908227 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c0b0040 con 0x55a51232e4c0 2024-04-26T12:50:18.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f1369e0b640 1 -- 172.21.15.72:0/617908227 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0aac60 con 0x55a51232e4c0 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- 172.21.15.72:0/617908227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 msgr2=0x55a512419d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 --2- 172.21.15.72:0/617908227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512419d20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f146c00a420 tx=0x7f146c0033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- 172.21.15.72:0/617908227 shutdown_connections 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 --2- 172.21.15.72:0/617908227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512419d20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- 172.21.15.72:0/617908227 >> 172.21.15.72:0/617908227 conn(0x55a5122a1bc0 msgr2=0x55a5124158b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- 172.21.15.72:0/617908227 shutdown_connections 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- 172.21.15.72:0/617908227 wait complete. 2024-04-26T12:50:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 Processor -- start 2024-04-26T12:50:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- start start 2024-04-26T12:50:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512420e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a512338520 con 0x55a51232e4c0 2024-04-26T12:50:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512420e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512420e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50336/0 (socket says 172.21.15.72:50336) 2024-04-26T12:50:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147be77640 1 -- 172.21.15.72:0/878761841 learned_addr learned my addr 172.21.15.72:0/878761841 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147be77640 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a512421380 con 0x55a51232e4c0 2024-04-26T12:50:18.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147be77640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512420e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f146c01b010 tx=0x7f146c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f1363fff640 1 -- 172.21.15.72:0/878761841 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0c5030 con 0x55a51232e4c0 2024-04-26T12:50:18.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f1363fff640 1 -- 172.21.15.72:0/878761841 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c0c15b0 con 0x55a51232e4c0 2024-04-26T12:50:18.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a512421610 con 0x55a51232e4c0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f1363fff640 1 -- 172.21.15.72:0/878761841 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0c1890 con 0x55a51232e4c0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.180+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a512424220 con 0x55a51232e4c0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f1363fff640 1 -- 172.21.15.72:0/878761841 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f146c0c8070 con 0x55a51232e4c0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f1363fff640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1364034650 0x7f1364036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f1363fff640 1 -- 172.21.15.72:0/878761841 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f146c0c6070 con 0x55a51232e4c0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147b676640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1364034650 0x7f1364036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51232ede0 0x55a512427e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124283b0 con 0x55a51232ede0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147c678640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51232ede0 0x55a512427e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147b676640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1364034650 0x7f1364036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1464001da0 tx=0x7f1464001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147c678640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51232ede0 0x55a512427e70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147c678640 1 -- 172.21.15.72:0/878761841 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14740083f0 con 0x55a51232ede0 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512428cc0 con 0x55a51232ede0 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147c678640 1 -- 172.21.15.72:0/878761841 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14740083f0 con 0x55a51232ede0 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a51242a610 0x55a51242caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a51242d230 con 0x55a51242a610 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147be77640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a51242a610 0x55a51242caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.184+0000 7f147be77640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a51242a610 0x55a51242caa0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147be77640 1 -- 172.21.15.72:0/878761841 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f146c0b2070 con 0x55a51242a610 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512429510 con 0x55a51232ede0 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147c678640 1 -- 172.21.15.72:0/878761841 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14740083f0 con 0x55a51232ede0 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a51242e690 0x55a512430a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124311c0 con 0x55a51242e690 2024-04-26T12:50:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147b676640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a51242e690 0x55a512430a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147b676640 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a51242e690 0x55a512430a80 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147b676640 1 -- 172.21.15.72:0/878761841 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f146400e6c0 con 0x55a51242e690 2024-04-26T12:50:18.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 Processor -- start 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 -- start start 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51243f250 0x55a51243f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a512233ab0 con 0x55a51243f250 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51243f250 0x55a51243f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51243f250 0x55a51243f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50344/0 (socket says 172.21.15.72:50344) 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147be77640 1 -- 172.21.15.72:0/2531102343 learned_addr learned my addr 172.21.15.72:0/2531102343 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147be77640 1 -- 172.21.15.72:0/2531102343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51243fbb0 con 0x55a51243f250 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147be77640 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51243f250 0x55a51243f670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f146c0e3940 tx=0x7f146c0bfdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f13617fa640 1 -- 172.21.15.72:0/2531102343 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0bf660 con 0x55a51243f250 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f13617fa640 1 -- 172.21.15.72:0/2531102343 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c0bf800 con 0x55a51243f250 2024-04-26T12:50:18.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a512440650 con 0x55a51243f250 2024-04-26T12:50:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.188+0000 7f13617fa640 1 -- 172.21.15.72:0/2531102343 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0e2200 con 0x55a51243f250 2024-04-26T12:50:18.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a512440650 con 0x55a51243f250 2024-04-26T12:50:18.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f13617fa640 1 -- 172.21.15.72:0/2531102343 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f146c0e23a0 con 0x55a51243f250 2024-04-26T12:50:18.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f13617fa640 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1354034650 0x7f1354036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f13617fa640 1 -- 172.21.15.72:0/2531102343 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f146c0dd070 con 0x55a51243f250 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147b676640 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1354034650 0x7f1354036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147e35c980 1 Processor -- start 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147e35c980 1 -- start start 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147e35c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a51244c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147e35c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a51241a580 con 0x55a51244c070 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147b676640 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1354034650 0x7f1354036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a51242d600 tx=0x7f146400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a51244c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a51244c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50360/0 (socket says 172.21.15.72:50360) 2024-04-26T12:50:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147be77640 1 -- 172.21.15.72:0/1793289041 learned_addr learned my addr 172.21.15.72:0/1793289041 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147be77640 1 -- 172.21.15.72:0/1793289041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51244ca20 con 0x55a51244c070 2024-04-26T12:50:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147be77640 1 --2- 172.21.15.72:0/1793289041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a51244c450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f146c0d6fd0 tx=0x7f146c0a9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7408430044ae5ee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f135affd640 1 -- 172.21.15.72:0/1793289041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0a4e10 con 0x55a51244c070 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f135affd640 1 -- 172.21.15.72:0/1793289041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c0e3650 con 0x55a51244c070 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f135affd640 1 -- 172.21.15.72:0/1793289041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0c5300 con 0x55a51244c070 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.192+0000 7f147e35c980 1 -- 172.21.15.72:0/1793289041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 msgr2=0x55a51244c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 --2- 172.21.15.72:0/1793289041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a51244c450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f146c0d6fd0 tx=0x7f146c0a9f60 comp rx=0 tx=0).stop 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- 172.21.15.72:0/1793289041 shutdown_connections 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 --2- 172.21.15.72:0/1793289041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a51244c450 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- 172.21.15.72:0/1793289041 >> 172.21.15.72:0/1793289041 conn(0x55a5124483b0 msgr2=0x55a512446410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- 172.21.15.72:0/1793289041 shutdown_connections 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- 172.21.15.72:0/1793289041 wait complete. 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 Processor -- start 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- start start 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a5124533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a51244d120 con 0x55a51244c070 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a5124533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147be77640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a5124533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50366/0 (socket says 172.21.15.72:50366) 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 learned_addr learned my addr 172.21.15.72:0/744771360 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a512453920 con 0x55a51244c070 2024-04-26T12:50:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147be77640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a5124533e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f146c0c1a90 tx=0x7f146c0cb1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f13597fa640 1 -- 172.21.15.72:0/744771360 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c10c070 con 0x55a51244c070 2024-04-26T12:50:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f13597fa640 1 -- 172.21.15.72:0/744771360 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c101040 con 0x55a51244c070 2024-04-26T12:50:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a512453920 con 0x55a51244c070 2024-04-26T12:50:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f13597fa640 1 -- 172.21.15.72:0/744771360 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f146c0c0b00 con 0x55a51244c070 2024-04-26T12:50:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a512453920 con 0x55a51244c070 2024-04-26T12:50:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f13597fa640 1 -- 172.21.15.72:0/744771360 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f146c10f070 con 0x55a51244c070 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f13597fa640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1344034600 0x7f1344036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f13597fa640 1 -- 172.21.15.72:0/744771360 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f146c0bb070 con 0x55a51244c070 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147b676640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1344034600 0x7f1344036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.196+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51245e420 0x55a5124608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512461000 con 0x55a51245e420 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147c678640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51245e420 0x55a5124608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147b676640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1344034600 0x7f1344036ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55a512428c90 tx=0x7f1464010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147c678640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51245e420 0x55a5124608b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14740083f0 con 0x55a51245e420 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 realm 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512461410 con 0x55a51245e420 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14740083f0 con 0x55a51245e420 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512461cb0 con 0x55a51245e420 2024-04-26T12:50:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14740083f0 con 0x55a51245e420 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14740083f0 con 0x55a51245e420 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a512462db0 0x55a5124651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512465720 con 0x55a512462db0 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147be77640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a512462db0 0x55a5124651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147be77640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a512462db0 0x55a5124651a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 20 searching for the correct realm 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a512467650 0x55a512469ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a51246a1b0 con 0x55a512467650 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.200+0000 7f147b676640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a512467650 0x55a512469ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147b676640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a512467650 0x55a512469ae0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147b676640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1464037040 0x7f1464036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a51246a1b0 con 0x7f1464037040 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1464037040 0x7f1464036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1464037040 0x7f1464036410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14740083f0 con 0x7f1464037040 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14740083f0 con 0x55a51245e420 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.204+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x7f1464037040 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x7f1464037040 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x7f1464037040 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1474026040 con 0x7f1464037040 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.208+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x7f1464037040 2024-04-26T12:50:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x7f1464037040 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.212+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x7f1464037040 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x7f1464037040 2024-04-26T12:50:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512467650 2024-04-26T12:50:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a512462db0 2024-04-26T12:50:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x55a51245e420 2024-04-26T12:50:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a512462050 con 0x7f1464037040 2024-04-26T12:50:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1474026040 con 0x7f1464037040 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512465f70 con 0x55a51245e420 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512465f70 con 0x55a51245e420 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1474026040 con 0x55a51245e420 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512465f70 con 0x55a512467650 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 zone default found 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 4 Realm: () 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 zonegroup default 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.216+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512466810 con 0x55a512462db0 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a51246c010 con 0x55a512467650 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a51246c3b0 con 0x55a512467650 2024-04-26T12:50:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 20 started sync module instance, tier type = 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246b4b0 con 0x7f1464037040 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474026040 con 0x7f1464037040 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94167464589824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246b4b0 con 0x7f1464037040 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246ce50 con 0x55a51245e420 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.220+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94167464589824] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474036040 con 0x7f1464037040 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.224+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474036040 con 0x55a51245e420 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.224+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94167464593760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246b4b0 con 0x55a51245e420 2024-04-26T12:50:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.224+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246d890 con 0x55a512467650 2024-04-26T12:50:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.224+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.224+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94167464596448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246e0e0 con 0x55a512467650 2024-04-26T12:50:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.224+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246eae0 con 0x7f1464037040 2024-04-26T12:50:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.224+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94167464593760] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474036040 con 0x55a51245e420 2024-04-26T12:50:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474036040 con 0x7f1464037040 2024-04-26T12:50:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94167464587264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246eed0 con 0x7f1464037040 2024-04-26T12:50:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246f890 con 0x55a51245e420 2024-04-26T12:50:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94167464596448] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94167464587264] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474036040 con 0x7f1464037040 2024-04-26T12:50:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474036040 con 0x55a51245e420 2024-04-26T12:50:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94167464601072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246f3e0 con 0x55a51245e420 2024-04-26T12:50:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.228+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246fc30 con 0x55a512462db0 2024-04-26T12:50:18.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94167464601072] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474036040 con 0x55a51245e420 2024-04-26T12:50:18.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94167464604640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a51246f800 con 0x55a512462db0 2024-04-26T12:50:18.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512470930 con 0x55a512462db0 2024-04-26T12:50:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94167464611024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5124715a0 con 0x55a512462db0 2024-04-26T12:50:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512471e70 con 0x55a512462db0 2024-04-26T12:50:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.232+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94167464604640] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94167464611024] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94167464607696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a5124715a0 con 0x55a512462db0 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=0 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=1 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=2 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=3 2024-04-26T12:50:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=4 2024-04-26T12:50:18.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=5 2024-04-26T12:50:18.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=6 2024-04-26T12:50:18.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94167464607696] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 20 add_watcher() i=7 2024-04-26T12:50:18.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:18.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.236+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124715a0 con 0x55a51245e420 2024-04-26T12:50:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1474036040 con 0x55a51245e420 2024-04-26T12:50:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94167464612080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512471510 con 0x55a51245e420 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94167464612080] v33'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1474036040 con 0x55a51245e420 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f1331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 5 note: GC not initialized 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f1330fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 Filter name: none 2024-04-26T12:50:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f12aa7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512498620 con 0x7f1464037040 2024-04-26T12:50:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1474036040 con 0x7f1464037040 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512498f50 con 0x7f1464037040 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(63 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1474036040 con 0x7f1464037040 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.240+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512498f90 con 0x7f1464037040 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1474036040 con 0x7f1464037040 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a51249a630 con 0x7f1464037040 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(65 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1474036040 con 0x7f1464037040 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 4.39 4:9c6c5753:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a512499bc0 con 0x55a512467650 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 4.5 4:a34a0678:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a51249f1a0 con 0x55a512467650 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 4.2 4:43d66ddb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124a1ad0 con 0x55a51245e420 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 4.9 4:91fcabb3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124a47d0 con 0x55a51245e420 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 4.26 4:66c705c7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124a74c0 con 0x55a512462db0 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 4.2 4:42690739:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124a9d30 con 0x55a51245e420 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 4.c 4:31d931f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124aca50 con 0x55a51245e420 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 4.7 4:e183a031:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124af890 con 0x55a512462db0 2024-04-26T12:50:18.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 4.1e 4:788778d7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124a1ad0 con 0x55a512462db0 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:75 4.13 4:c9844179:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124af890 con 0x7f1464037040 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 4.22 4:454d4585:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a5124a9d30 con 0x55a51245e420 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(68 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(69 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(72 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(71 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5 [call out=124b] v0'0 uv4 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(74 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(76 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.244+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(75 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1474041060 con 0x7f1464037040 2024-04-26T12:50:18.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f1331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94167464612080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x55a51245e420 2024-04-26T12:50:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94167464612080] v33'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94167464589824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x7f1464037040 2024-04-26T12:50:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94167464589824] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474041060 con 0x7f1464037040 2024-04-26T12:50:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f147e35c980 20 remove_watcher() i=0 2024-04-26T12:50:18.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f147e35c980 2 removed watcher, disabling cache 2024-04-26T12:50:18.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.248+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94167464593760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x55a51245e420 2024-04-26T12:50:18.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.252+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94167464593760] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.252+0000 7f147e35c980 20 remove_watcher() i=1 2024-04-26T12:50:18.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.252+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94167464596448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x55a512467650 2024-04-26T12:50:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.252+0000 7f147b676640 1 -- 172.21.15.72:0/744771360 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94167464596448] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146400e6c0 con 0x55a512467650 2024-04-26T12:50:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.252+0000 7f147e35c980 20 remove_watcher() i=2 2024-04-26T12:50:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.252+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94167464587264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x7f1464037040 2024-04-26T12:50:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.256+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94167464587264] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474041060 con 0x7f1464037040 2024-04-26T12:50:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.256+0000 7f147e35c980 20 remove_watcher() i=3 2024-04-26T12:50:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.256+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94167464601072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x55a51245e420 2024-04-26T12:50:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.256+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94167464601072] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1474041060 con 0x55a51245e420 2024-04-26T12:50:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.256+0000 7f147e35c980 20 remove_watcher() i=4 2024-04-26T12:50:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.256+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94167464604640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x55a512462db0 2024-04-26T12:50:18.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.260+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94167464604640] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.260+0000 7f147e35c980 20 remove_watcher() i=5 2024-04-26T12:50:18.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.260+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94167464611024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x55a512462db0 2024-04-26T12:50:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.260+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94167464611024] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.260+0000 7f147e35c980 20 remove_watcher() i=6 2024-04-26T12:50:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.260+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94167464607696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a512488d50 con 0x55a512462db0 2024-04-26T12:50:18.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147be77640 1 -- 172.21.15.72:0/744771360 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94167464607696] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f146c10e030 con 0x55a512462db0 2024-04-26T12:50:18.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 20 remove_watcher() i=7 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a512462db0 msgr2=0x55a5124651a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a512462db0 0x55a5124651a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51245e420 msgr2=0x55a5124608b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51245e420 0x55a5124608b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1464037040 msgr2=0x7f1464036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1464037040 0x7f1464036410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a512467650 msgr2=0x55a512469ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a512467650 0x55a512469ae0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1344034600 msgr2=0x7f1344036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1344034600 0x7f1344036ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55a512428c90 tx=0x7f1464010000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 msgr2=0x55a5124533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147c678640 1 -- 172.21.15.72:0/744771360 reap_dead start 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a5124533e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f146c0c1a90 tx=0x7f146c0cb1c0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 shutdown_connections 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/744771360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51244c070 0x55a5124533e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 >> 172.21.15.72:0/744771360 conn(0x55a5124483b0 msgr2=0x55a512445a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 shutdown_connections 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/744771360 wait complete. 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1354034650 msgr2=0x7f1354036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1354034650 0x7f1354036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a51242d600 tx=0x7f146400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51243f250 msgr2=0x55a51243f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51243f250 0x55a51243f670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f146c0e3940 tx=0x7f146c0bfdb0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 shutdown_connections 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1354034650 0x7f1354036b10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/2531102343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51243f250 0x55a51243f670 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 >> 172.21.15.72:0/2531102343 conn(0x55a512434060 msgr2=0x55a512434b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 shutdown_connections 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/2531102343 wait complete. 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a51242a610 msgr2=0x55a51242caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a51242a610 0x55a51242caa0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51232ede0 msgr2=0x55a512427e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a51232ede0 0x55a512427e70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a51242e690 msgr2=0x55a512430a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a51242e690 0x55a512430a80 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1364034650 msgr2=0x7f1364036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1364034650 0x7f1364036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1464001da0 tx=0x7f1464001300 comp rx=0 tx=0).stop 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 msgr2=0x55a512420e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 --2- 172.21.15.72:0/878761841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a51232e4c0 0x55a512420e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f146c01b010 tx=0x7f146c019810 comp rx=0 tx=0).stop 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147c678640 1 -- 172.21.15.72:0/878761841 reap_dead start 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 shutdown_connections 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 >> 172.21.15.72:0/878761841 conn(0x55a5122a1bc0 msgr2=0x55a5124143c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 shutdown_connections 2024-04-26T12:50:18.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.264+0000 7f147e35c980 1 -- 172.21.15.72:0/878761841 wait complete. 2024-04-26T12:50:18.275 INFO:teuthology.orchestra.run.smithi072.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f52412b2-0d18-4618-9944-7ddcdd8afe97","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","marker":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:50:17.074322Z","creation_time":"2024-04-26T12:50:17.070930Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T12:50:18.275 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:50:17.074322Z', 'creation_time': '2024-04-26T12:50:17.070930Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:50:18.275 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-26T12:50:18.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-26T12:50:18.276 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-26T12:50:18.351 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:18.351 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd4f7c980 1 Processor -- start 2024-04-26T12:50:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd4f7c980 1 -- start start 2024-04-26T12:50:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd4f7c980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5615a4383710 0x5615a4385b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd4f7c980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5615a422d510 con 0x5615a437f1b0 2024-04-26T12:50:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd4f7c980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5615a4234430 con 0x5615a4383710 2024-04-26T12:50:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd2296640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5615a4383710 0x5615a4385b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd2a97640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5615a437f1b0 0x5615a437f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36152/0 (socket says 172.21.15.72:36152) 2024-04-26T12:50:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd2a97640 1 -- 172.21.15.72:0/142169146 learned_addr learned my addr 172.21.15.72:0/142169146 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd2296640 1 -- 172.21.15.72:0/142169146 >> v1:172.21.15.29:6789/0 conn(0x5615a437f1b0 legacy=0x5615a437f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.352+0000 7efcd2296640 1 -- 172.21.15.72:0/142169146 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a4209ae0 con 0x5615a4383710 2024-04-26T12:50:18.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd2296640 1 --2- 172.21.15.72:0/142169146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4383710 0x5615a4385b00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00a480 tx=0x7efcbc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c040c090b556a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd1a95640 1 -- 172.21.15.72:0/142169146 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc0b0070 con 0x5615a4383710 2024-04-26T12:50:18.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd1a95640 1 -- 172.21.15.72:0/142169146 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc0ab540 con 0x5615a4383710 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd1a95640 1 -- 172.21.15.72:0/142169146 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc0ab840 con 0x5615a4383710 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd4f7c980 1 -- 172.21.15.72:0/142169146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4383710 msgr2=0x5615a4385b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/142169146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4383710 0x5615a4385b00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00a480 tx=0x7efcbc01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd4f7c980 1 -- 172.21.15.72:0/142169146 shutdown_connections 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/142169146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4383710 0x5615a4385b00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd4f7c980 1 -- 172.21.15.72:0/142169146 >> 172.21.15.72:0/142169146 conn(0x5615a437aa80 msgr2=0x5615a437cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd4f7c980 1 -- 172.21.15.72:0/142169146 shutdown_connections 2024-04-26T12:50:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.356+0000 7efcd4f7c980 1 -- 172.21.15.72:0/142169146 wait complete. 2024-04-26T12:50:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd4f7c980 1 Processor -- start 2024-04-26T12:50:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd4f7c980 1 -- start start 2024-04-26T12:50:18.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd4f7c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a446b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd4f7c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615a4283a70 con 0x5615a437f1b0 2024-04-26T12:50:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a446b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a446b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50374/0 (socket says 172.21.15.72:50374) 2024-04-26T12:50:18.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd2a97640 1 -- 172.21.15.72:0/3321413173 learned_addr learned my addr 172.21.15.72:0/3321413173 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd2a97640 1 -- 172.21.15.72:0/3321413173 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a446bae0 con 0x5615a437f1b0 2024-04-26T12:50:18.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.372+0000 7efcd2a97640 1 --2- 172.21.15.72:0/3321413173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a446b510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efcc40017b0 tx=0x7efcc4001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12069377935d1b2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efbc0e09640 1 -- 172.21.15.72:0/3321413173 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4016070 con 0x5615a437f1b0 2024-04-26T12:50:18.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efbc0e09640 1 -- 172.21.15.72:0/3321413173 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc4004530 con 0x5615a437f1b0 2024-04-26T12:50:18.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efbc0e09640 1 -- 172.21.15.72:0/3321413173 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4004870 con 0x5615a437f1b0 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3321413173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 msgr2=0x5615a446b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3321413173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a446b510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efcc40017b0 tx=0x7efcc4001c70 comp rx=0 tx=0).stop 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3321413173 shutdown_connections 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3321413173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a446b510 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3321413173 >> 172.21.15.72:0/3321413173 conn(0x5615a437aa80 msgr2=0x5615a44670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3321413173 shutdown_connections 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3321413173 wait complete. 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 Processor -- start 2024-04-26T12:50:18.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- start start 2024-04-26T12:50:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a4472770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615a4386b20 con 0x5615a437f1b0 2024-04-26T12:50:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a4472770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a4472770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50390/0 (socket says 172.21.15.72:50390) 2024-04-26T12:50:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd2a97640 1 -- 172.21.15.72:0/3613463499 learned_addr learned my addr 172.21.15.72:0/3613463499 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd2a97640 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a4472cb0 con 0x5615a437f1b0 2024-04-26T12:50:18.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd2a97640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a4472770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efcc4000f90 tx=0x7efcc4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efbbf606640 1 -- 172.21.15.72:0/3613463499 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4020070 con 0x5615a437f1b0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615a4472f40 con 0x5615a437f1b0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efbbf606640 1 -- 172.21.15.72:0/3613463499 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc4011400 con 0x5615a437f1b0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efbbf606640 1 -- 172.21.15.72:0/3613463499 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4016040 con 0x5615a437f1b0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.376+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a4475b30 con 0x5615a437f1b0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efbbf606640 1 -- 172.21.15.72:0/3613463499 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efcc4023070 con 0x5615a437f1b0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efbbf606640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbb80346a0 0x7efbb8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efbbf606640 1 -- 172.21.15.72:0/3613463499 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efcc40491e0 con 0x5615a437f1b0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd2296640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbb80346a0 0x7efbb8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a4383710 0x5615a4479780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a4479cc0 con 0x5615a4383710 2024-04-26T12:50:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd3298640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a4383710 0x5615a4479780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd2296640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbb80346a0 0x7efbb8036b60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0ad000 tx=0x7efcbc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd3298640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a4383710 0x5615a4479780 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd3298640 1 -- 172.21.15.72:0/3613463499 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a4383710 2024-04-26T12:50:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a4476d50 con 0x5615a4383710 2024-04-26T12:50:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd3298640 1 -- 172.21.15.72:0/3613463499 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a4383710 2024-04-26T12:50:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a447c000 0x5615a447e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a447eae0 con 0x5615a447c000 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd2a97640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a447c000 0x5615a447e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.380+0000 7efcd2a97640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a447c000 0x5615a447e3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2a97640 1 -- 172.21.15.72:0/3613463499 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efcc402c070 con 0x5615a447c000 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a447aea0 con 0x5615a4383710 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd3298640 1 -- 172.21.15.72:0/3613463499 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a4383710 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a447ff40 0x5615a4482330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a4482a70 con 0x5615a447ff40 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2296640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a447ff40 0x5615a4482330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2296640 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a447ff40 0x5615a4482330 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2296640 1 -- 172.21.15.72:0/3613463499 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efcbc0b3040 con 0x5615a447ff40 2024-04-26T12:50:18.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 Processor -- start 2024-04-26T12:50:18.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 -- start start 2024-04-26T12:50:18.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4490a50 0x5615a4490e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615a4287ab0 con 0x5615a4490a50 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4490a50 0x5615a4490e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4490a50 0x5615a4490e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50402/0 (socket says 172.21.15.72:50402) 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2a97640 1 -- 172.21.15.72:0/3995247603 learned_addr learned my addr 172.21.15.72:0/3995247603 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2a97640 1 -- 172.21.15.72:0/3995247603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a44913b0 con 0x5615a4490a50 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd2a97640 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4490a50 0x5615a4490e70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efcc4047560 tx=0x7efcc40462d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efbbce01640 1 -- 172.21.15.72:0/3995247603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc402a040 con 0x5615a4490a50 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615a4491e50 con 0x5615a4490a50 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efbbce01640 1 -- 172.21.15.72:0/3995247603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc402da10 con 0x5615a4490a50 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efbbce01640 1 -- 172.21.15.72:0/3995247603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc402a420 con 0x5615a4490a50 2024-04-26T12:50:18.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.384+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a4492320 con 0x5615a4490a50 2024-04-26T12:50:18.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efbbce01640 1 -- 172.21.15.72:0/3995247603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efcc40116e0 con 0x5615a4490a50 2024-04-26T12:50:18.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efbbce01640 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbac034650 0x7efbac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efbbce01640 1 -- 172.21.15.72:0/3995247603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efcc4035070 con 0x5615a4490a50 2024-04-26T12:50:18.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd2296640 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbac034650 0x7efbac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 Processor -- start 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 -- start start 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a4388c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615a446be30 con 0x5615a4388800 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd2296640 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbac034650 0x7efbac036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0ae040 tx=0x7efcbc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a4388c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a4388c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50408/0 (socket says 172.21.15.72:50408) 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd2a97640 1 -- 172.21.15.72:0/986363690 learned_addr learned my addr 172.21.15.72:0/986363690 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd2a97640 1 -- 172.21.15.72:0/986363690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a4387050 con 0x5615a4388800 2024-04-26T12:50:18.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd2a97640 1 --2- 172.21.15.72:0/986363690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a4388c20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efcc403a040 tx=0x7efcc402de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a135610a6a18dd70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efbb67fc640 1 -- 172.21.15.72:0/986363690 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4027080 con 0x5615a4388800 2024-04-26T12:50:18.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efbb67fc640 1 -- 172.21.15.72:0/986363690 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc4025450 con 0x5615a4388800 2024-04-26T12:50:18.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efbb67fc640 1 -- 172.21.15.72:0/986363690 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4023860 con 0x5615a4388800 2024-04-26T12:50:18.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 -- 172.21.15.72:0/986363690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 msgr2=0x5615a4388c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/986363690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a4388c20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efcc403a040 tx=0x7efcc402de60 comp rx=0 tx=0).stop 2024-04-26T12:50:18.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 -- 172.21.15.72:0/986363690 shutdown_connections 2024-04-26T12:50:18.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/986363690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a4388c20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.388+0000 7efcd4f7c980 1 -- 172.21.15.72:0/986363690 >> 172.21.15.72:0/986363690 conn(0x5615a4499d90 msgr2=0x5615a4497df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 -- 172.21.15.72:0/986363690 shutdown_connections 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 -- 172.21.15.72:0/986363690 wait complete. 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 Processor -- start 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 -- start start 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a44a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615a4387460 con 0x5615a4388800 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a44a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd2a97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a44a6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50414/0 (socket says 172.21.15.72:50414) 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 learned_addr learned my addr 172.21.15.72:0/2208314467 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a44a7450 con 0x5615a4388800 2024-04-26T12:50:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd2a97640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a44a6f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efcc403a040 tx=0x7efcc4010f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efbb4ff9640 1 -- 172.21.15.72:0/2208314467 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4061040 con 0x5615a4388800 2024-04-26T12:50:18.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efbb4ff9640 1 -- 172.21.15.72:0/2208314467 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc4023d50 con 0x5615a4388800 2024-04-26T12:50:18.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615a44a7450 con 0x5615a4388800 2024-04-26T12:50:18.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efbb4ff9640 1 -- 172.21.15.72:0/2208314467 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4026a60 con 0x5615a4388800 2024-04-26T12:50:18.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a44a7450 con 0x5615a4388800 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efbb4ff9640 1 -- 172.21.15.72:0/2208314467 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efcc406e020 con 0x5615a4388800 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efbb4ff9640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efb9c034600 0x7efb9c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efbb4ff9640 1 -- 172.21.15.72:0/2208314467 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7efcc406c020 con 0x5615a4388800 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd2296640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efb9c034600 0x7efb9c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a44b1fe0 0x5615a44b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.392+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b4bd0 con 0x5615a44b1fe0 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd3298640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a44b1fe0 0x5615a44b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd2296640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efb9c034600 0x7efb9c036ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000c10 tx=0x7efcbc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd3298640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a44b1fe0 0x5615a44b4480 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a44b1fe0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 realm 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b4fe0 con 0x5615a44b1fe0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a44b1fe0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5880 con 0x5615a44b1fe0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a44b1fe0 2024-04-26T12:50:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b1fe0 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a44b1fe0 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a44b6980 0x5615a44b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b92f0 con 0x5615a44b6980 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd2a97640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a44b6980 0x5615a44b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd2a97640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a44b6980 0x5615a44b8d70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 20 searching for the correct realm 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a44bb220 0x5615a44bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bdd80 con 0x5615a44bb220 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.396+0000 7efcd2296640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a44bb220 0x5615a44bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2296640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a44bb220 0x5615a44bd6b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2296640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efcbc0ce040 0x7efcbc0db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bdd80 con 0x7efcbc0ce040 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efcbc0ce040 0x7efcbc0db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efcbc0ce040 0x7efcbc0db410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc0083f0 con 0x7efcbc0ce040 2024-04-26T12:50:18.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b6980 2024-04-26T12:50:18.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b1fe0 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc0083f0 con 0x5615a44b1fe0 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b1fe0 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b6980 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.400+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b6980 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x7efcbc0ce040 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x7efcbc0ce040 2024-04-26T12:50:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44bb220 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b1fe0 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b6980 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44b1fe0 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x7efcbc0ce040 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efccc026040 con 0x7efcbc0ce040 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b5c20 con 0x5615a44bb220 2024-04-26T12:50:18.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44bb220 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b6980 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.404+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44bb220 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44bb220 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b1fe0 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b1fe0 2024-04-26T12:50:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b6980 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44bb220 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x7efcbc0ce040 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x7efcbc0ce040 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b1fe0 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b6980 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44bb220 2024-04-26T12:50:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.408+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b6980 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x7efcbc0ce040 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x7efcbc0ce040 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44bb220 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b6980 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x5615a44b1fe0 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7efcbc0e8040 con 0x7efcbc0ce040 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efccc026040 con 0x7efcbc0ce040 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b9b40 con 0x5615a44b1fe0 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b9b40 con 0x5615a44b1fe0 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efccc026040 con 0x5615a44b1fe0 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44b9b40 con 0x5615a44bb220 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 zone default found 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 4 Realm: () 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 zonegroup default 2024-04-26T12:50:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.412+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44ba3e0 con 0x5615a44b6980 2024-04-26T12:50:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bfbe0 con 0x5615a44bb220 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bff80 con 0x5615a44bb220 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 20 started sync module instance, tier type = 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:18.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bf080 con 0x7efcbc0ce040 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc026040 con 0x7efcbc0ce040 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94650950741248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bf740 con 0x7efcbc0ce040 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c09a0 con 0x5615a44b1fe0 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.416+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94650950741248] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.420+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.420+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94650950747280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bf700 con 0x5615a44b1fe0 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.420+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c13b0 con 0x5615a44bb220 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.420+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94650950747280] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.420+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.420+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94650950742608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44bf670 con 0x5615a44bb220 2024-04-26T12:50:18.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.420+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c2100 con 0x7efcbc0ce040 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94650950753360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c2070 con 0x7efcbc0ce040 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c3040 con 0x5615a44b1fe0 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94650950742608] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94650950753360] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94650950757136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c3000 con 0x5615a44b1fe0 2024-04-26T12:50:18.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.424+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c3430 con 0x5615a44b6980 2024-04-26T12:50:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94650950757136] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94650950755488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c37d0 con 0x5615a44b6980 2024-04-26T12:50:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c4080 con 0x5615a44b6980 2024-04-26T12:50:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94650950755488] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94650950761328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c1880 con 0x5615a44b6980 2024-04-26T12:50:18.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.428+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c4e60 con 0x5615a44b6980 2024-04-26T12:50:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94650950761328] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94650950764848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c4e20 con 0x5615a44b6980 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=0 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=1 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=2 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=3 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=4 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=5 2024-04-26T12:50:18.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=6 2024-04-26T12:50:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94650950764848] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 20 add_watcher() i=7 2024-04-26T12:50:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c82b0 con 0x5615a44b1fe0 2024-04-26T12:50:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.432+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94650950763104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c5770 con 0x5615a44b1fe0 2024-04-26T12:50:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94650950763104] v33'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efb897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 5 note: GC not initialized 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efb03fff640 20 reqs_thread_entry: start 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 Filter name: none 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efb01ffb640 20 reqs_thread_entry: start 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44eb630 con 0x5615a44b1fe0 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44ecb80 con 0x7efcbc0ce040 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv15 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44ecb80 con 0x7efcbc0ce040 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:65 4.39 4:9c6c5753:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44ee5f0 con 0x5615a44bb220 2024-04-26T12:50:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 4.5 4:a34a0678:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f12a0 con 0x5615a44bb220 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 4.2 4:43d66ddb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f3fd0 con 0x5615a44b1fe0 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 4.9 4:91fcabb3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f12a0 con 0x5615a44b1fe0 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 4.26 4:66c705c7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f91b0 con 0x5615a44b6980 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 4.2 4:42690739:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44fbaf0 con 0x5615a44b1fe0 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 4.c 4:31d931f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f91b0 con 0x5615a44b1fe0 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 4.7 4:e183a031:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a4500bd0 con 0x5615a44b6980 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 4.1e 4:788778d7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a4503930 con 0x5615a44b6980 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 4.13 4:c9844179:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a4506650 con 0x7efcbc0ce040 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.436+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 4.22 4:454d4585:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a4508ec0 con 0x5615a44b1fe0 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(65 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(66 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(67 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(75 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(70 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5 [call out=124b] v0'0 uv4 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(71 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(74 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f9130 con 0x7efcbc0ce040 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(76 foo.buckets [call] v33'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.440+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f9130 con 0x7efcbc0ce040 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(77 foo.buckets [call] v33'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd4f7c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f9130 con 0x5615a44b1fe0 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd4f7c980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615a44f9130 con 0x7efcbc0ce040 2024-04-26T12:50:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv17 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efb897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.444+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94650950763104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x5615a44b1fe0 2024-04-26T12:50:18.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94650950763104] v33'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94650950741248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x7efcbc0ce040 2024-04-26T12:50:18.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94650950741248] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd4f7c980 20 remove_watcher() i=0 2024-04-26T12:50:18.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd4f7c980 2 removed watcher, disabling cache 2024-04-26T12:50:18.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94650950747280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x5615a44b1fe0 2024-04-26T12:50:18.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94650950747280] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd4f7c980 20 remove_watcher() i=1 2024-04-26T12:50:18.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.448+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94650950742608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x5615a44bb220 2024-04-26T12:50:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.452+0000 7efcd2296640 1 -- 172.21.15.72:0/2208314467 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94650950742608] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcbc0d9070 con 0x5615a44bb220 2024-04-26T12:50:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.452+0000 7efcd4f7c980 20 remove_watcher() i=2 2024-04-26T12:50:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.452+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94650950753360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x7efcbc0ce040 2024-04-26T12:50:18.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.452+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94650950753360] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x7efcbc0ce040 2024-04-26T12:50:18.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.452+0000 7efcd4f7c980 20 remove_watcher() i=3 2024-04-26T12:50:18.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.452+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94650950757136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x5615a44b1fe0 2024-04-26T12:50:18.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.456+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94650950757136] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efccc036040 con 0x5615a44b1fe0 2024-04-26T12:50:18.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.456+0000 7efcd4f7c980 20 remove_watcher() i=4 2024-04-26T12:50:18.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.456+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94650950755488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x5615a44b6980 2024-04-26T12:50:18.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.456+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94650950755488] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.456+0000 7efcd4f7c980 20 remove_watcher() i=5 2024-04-26T12:50:18.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.456+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94650950761328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x5615a44b6980 2024-04-26T12:50:18.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94650950761328] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 20 remove_watcher() i=6 2024-04-26T12:50:18.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94650950764848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615a44c8170 con 0x5615a44b6980 2024-04-26T12:50:18.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd2a97640 1 -- 172.21.15.72:0/2208314467 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94650950764848] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcc402c070 con 0x5615a44b6980 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 20 remove_watcher() i=7 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a44b6980 msgr2=0x5615a44b8d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a44b6980 0x5615a44b8d70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a44b1fe0 msgr2=0x5615a44b4480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a44b1fe0 0x5615a44b4480 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efcbc0ce040 msgr2=0x7efcbc0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efcbc0ce040 0x7efcbc0db410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a44bb220 msgr2=0x5615a44bd6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a44bb220 0x5615a44bd6b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efb9c034600 msgr2=0x7efb9c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efb9c034600 0x7efb9c036ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000c10 tx=0x7efcbc0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 msgr2=0x5615a44a6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd3298640 1 -- 172.21.15.72:0/2208314467 reap_dead start 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.460+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a44a6f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efcc403a040 tx=0x7efcc4010f80 comp rx=0 tx=0).stop 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 shutdown_connections 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/2208314467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4388800 0x5615a44a6f10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 >> 172.21.15.72:0/2208314467 conn(0x5615a4499d90 msgr2=0x5615a4497dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 shutdown_connections 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/2208314467 wait complete. 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbac034650 msgr2=0x7efbac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbac034650 0x7efbac036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0ae040 tx=0x7efcbc005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4490a50 msgr2=0x5615a4490e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4490a50 0x5615a4490e70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efcc4047560 tx=0x7efcc40462d0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 shutdown_connections 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbac034650 0x7efbac036b10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3995247603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a4490a50 0x5615a4490e70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 >> 172.21.15.72:0/3995247603 conn(0x5615a4485890 msgr2=0x5615a44863a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 shutdown_connections 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3995247603 wait complete. 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a447c000 msgr2=0x5615a447e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615a447c000 0x5615a447e3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a4383710 msgr2=0x5615a4479780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615a4383710 0x5615a4479780 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a447ff40 msgr2=0x5615a4482330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615a447ff40 0x5615a4482330 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbb80346a0 msgr2=0x7efbb8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efbb80346a0 0x7efbb8036b60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0ad000 tx=0x7efcbc0a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 msgr2=0x5615a4472770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 --2- 172.21.15.72:0/3613463499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615a437f1b0 0x5615a4472770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efcc4000f90 tx=0x7efcc4001260 comp rx=0 tx=0).stop 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd3298640 1 -- 172.21.15.72:0/3613463499 reap_dead start 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 shutdown_connections 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 >> 172.21.15.72:0/3613463499 conn(0x5615a437aa80 msgr2=0x5615a4465bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 shutdown_connections 2024-04-26T12:50:18.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.464+0000 7efcd4f7c980 1 -- 172.21.15.72:0/3613463499 wait complete. 2024-04-26T12:50:18.474 INFO:teuthology.orchestra.run.smithi072.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-04-26T12:50:18.444598Z","last_stats_update":"2024-04-26T12:50:18.442419Z"} 2024-04-26T12:50:18.475 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-26T12:50:18.444598Z', 'last_stats_update': '2024-04-26T12:50:18.442419Z'} 2024-04-26T12:50:18.481 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:18.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-26T12:50:18.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-26T12:50:18.482 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-26T12:50:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9acb791980 1 Processor -- start 2024-04-26T12:50:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9acb791980 1 -- start start 2024-04-26T12:50:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9acb791980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea36c68620 0x55ea36cfc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9acb791980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea36ba0510 con 0x55ea36c69960 2024-04-26T12:50:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9acb791980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ea36ba7430 con 0x55ea36c68620 2024-04-26T12:50:18.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9ac8aab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea36c68620 0x55ea36cfc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9ac8aab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea36c68620 0x55ea36cfc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50416/0 (socket says 172.21.15.72:50416) 2024-04-26T12:50:18.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9ac92ac640 1 --1- 172.21.15.72:0/1247390277 >> v1:172.21.15.29:6789/0 conn(0x55ea36c69960 0x55ea36c67f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36164/0 (socket says 172.21.15.72:36164) 2024-04-26T12:50:18.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9ac8aab640 1 -- 172.21.15.72:0/1247390277 learned_addr learned my addr 172.21.15.72:0/1247390277 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9ac8aab640 1 -- 172.21.15.72:0/1247390277 >> v1:172.21.15.29:6789/0 conn(0x55ea36c69960 legacy=0x55ea36c67f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.556+0000 7f9ac8aab640 1 -- 172.21.15.72:0/1247390277 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea36b7cae0 con 0x55ea36c68620 2024-04-26T12:50:18.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/1247390277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36cfc2e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000a5c0 tx=0x7f9ac001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea47de287f9fae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9abbfff640 1 -- 172.21.15.72:0/1247390277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac00a6070 con 0x55ea36c68620 2024-04-26T12:50:18.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9abbfff640 1 -- 172.21.15.72:0/1247390277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac00af070 con 0x55ea36c68620 2024-04-26T12:50:18.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9abbfff640 1 -- 172.21.15.72:0/1247390277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac00aa5c0 con 0x55ea36c68620 2024-04-26T12:50:18.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9acb791980 1 -- 172.21.15.72:0/1247390277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 msgr2=0x55ea36cfc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9acb791980 1 --2- 172.21.15.72:0/1247390277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36cfc2e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000a5c0 tx=0x7f9ac001b340 comp rx=0 tx=0).stop 2024-04-26T12:50:18.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9acb791980 1 -- 172.21.15.72:0/1247390277 shutdown_connections 2024-04-26T12:50:18.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9acb791980 1 --2- 172.21.15.72:0/1247390277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36cfc2e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9acb791980 1 -- 172.21.15.72:0/1247390277 >> 172.21.15.72:0/1247390277 conn(0x55ea36ceeba0 msgr2=0x55ea36cf0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9acb791980 1 -- 172.21.15.72:0/1247390277 shutdown_connections 2024-04-26T12:50:18.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.560+0000 7f9acb791980 1 -- 172.21.15.72:0/1247390277 wait complete. 2024-04-26T12:50:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9acb791980 1 Processor -- start 2024-04-26T12:50:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9acb791980 1 -- start start 2024-04-26T12:50:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9acb791980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9acb791980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea36bf6a70 con 0x55ea36c68620 2024-04-26T12:50:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50428/0 (socket says 172.21.15.72:50428) 2024-04-26T12:50:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9ac92ac640 1 -- 172.21.15.72:0/1860363999 learned_addr learned my addr 172.21.15.72:0/1860363999 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.576+0000 7f9ac92ac640 1 -- 172.21.15.72:0/1860363999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea36de10e0 con 0x55ea36c68620 2024-04-26T12:50:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/1860363999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de0b10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40015f0 tx=0x7f9ac4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbd601134e832c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f99b7606640 1 -- 172.21.15.72:0/1860363999 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4013420 con 0x55ea36c68620 2024-04-26T12:50:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f99b7606640 1 -- 172.21.15.72:0/1860363999 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac40135e0 con 0x55ea36c68620 2024-04-26T12:50:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f99b7606640 1 -- 172.21.15.72:0/1860363999 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4013940 con 0x55ea36c68620 2024-04-26T12:50:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- 172.21.15.72:0/1860363999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 msgr2=0x55ea36de0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 --2- 172.21.15.72:0/1860363999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de0b10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40015f0 tx=0x7f9ac4001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- 172.21.15.72:0/1860363999 shutdown_connections 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 --2- 172.21.15.72:0/1860363999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de0b10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- 172.21.15.72:0/1860363999 >> 172.21.15.72:0/1860363999 conn(0x55ea36ceeba0 msgr2=0x55ea36ddc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- 172.21.15.72:0/1860363999 shutdown_connections 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- 172.21.15.72:0/1860363999 wait complete. 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 Processor -- start 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- start start 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea36cff310 con 0x55ea36c68620 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50432/0 (socket says 172.21.15.72:50432) 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9ac92ac640 1 -- 172.21.15.72:0/3334563073 learned_addr learned my addr 172.21.15.72:0/3334563073 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9ac92ac640 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea36de8300 con 0x55ea36c68620 2024-04-26T12:50:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de7dc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006640 tx=0x7f9ac4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f99b5e03640 1 -- 172.21.15.72:0/3334563073 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4022020 con 0x55ea36c68620 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f99b5e03640 1 -- 172.21.15.72:0/3334563073 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac4006320 con 0x55ea36c68620 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea36de8590 con 0x55ea36c68620 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f99b5e03640 1 -- 172.21.15.72:0/3334563073 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4004af0 con 0x55ea36c68620 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.580+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea36deb1d0 con 0x55ea36c68620 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f99b5e03640 1 -- 172.21.15.72:0/3334563073 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9ac4025020 con 0x55ea36c68620 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f99b5e03640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99b0034650 0x7f99b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f99b5e03640 1 -- 172.21.15.72:0/3334563073 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f9ac4018030 con 0x55ea36c68620 2024-04-26T12:50:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99b0034650 0x7f99b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36c69960 0x55ea36deed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36def350 con 0x55ea36c69960 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac9aad640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36c69960 0x55ea36deed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99b0034650 0x7f99b0036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00ae000 tx=0x7f9ac00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac9aad640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36c69960 0x55ea36deed10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac9aad640 1 -- 172.21.15.72:0/3334563073 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36c69960 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36dec3f0 con 0x55ea36c69960 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac9aad640 1 -- 172.21.15.72:0/3334563073 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36c69960 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36df1680 0x55ea36df3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36df4140 con 0x55ea36df1680 2024-04-26T12:50:18.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36df1680 0x55ea36df3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.584+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36df1680 0x55ea36df3a70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac92ac640 1 -- 172.21.15.72:0/3334563073 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ac401b070 con 0x55ea36df1680 2024-04-26T12:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36df0520 con 0x55ea36c69960 2024-04-26T12:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac9aad640 1 -- 172.21.15.72:0/3334563073 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36c69960 2024-04-26T12:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36df5580 0x55ea36df7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36df8100 con 0x55ea36df5580 2024-04-26T12:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36df5580 0x55ea36df7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36df5580 0x55ea36df7970 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac8aab640 1 -- 172.21.15.72:0/3334563073 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36df5580 2024-04-26T12:50:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 Processor -- start 2024-04-26T12:50:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 -- start start 2024-04-26T12:50:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e06150 0x55ea36e06570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea36bfaab0 con 0x55ea36e06150 2024-04-26T12:50:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e06150 0x55ea36e06570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e06150 0x55ea36e06570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50440/0 (socket says 172.21.15.72:50440) 2024-04-26T12:50:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac92ac640 1 -- 172.21.15.72:0/2333372499 learned_addr learned my addr 172.21.15.72:0/2333372499 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac92ac640 1 -- 172.21.15.72:0/2333372499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea36e06ab0 con 0x55ea36e06150 2024-04-26T12:50:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e06150 0x55ea36e06570 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4014fd0 tx=0x7f9ac4005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f99aeffd640 1 -- 172.21.15.72:0/2333372499 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac401db60 con 0x55ea36e06150 2024-04-26T12:50:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea36e07550 con 0x55ea36e06150 2024-04-26T12:50:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f99aeffd640 1 -- 172.21.15.72:0/2333372499 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac401dd00 con 0x55ea36e06150 2024-04-26T12:50:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f99aeffd640 1 -- 172.21.15.72:0/2333372499 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac401e3f0 con 0x55ea36e06150 2024-04-26T12:50:18.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.588+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea36e07a20 con 0x55ea36e06150 2024-04-26T12:50:18.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f99aeffd640 1 -- 172.21.15.72:0/2333372499 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9ac4046040 con 0x55ea36e06150 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f99aeffd640 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99a00346a0 0x7f99a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f99aeffd640 1 -- 172.21.15.72:0/2333372499 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f9ac404fc30 con 0x55ea36e06150 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99a00346a0 0x7f99a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9acb791980 1 Processor -- start 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9acb791980 1 -- start start 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99a00346a0 0x7f99a0036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ac001b380 tx=0x7f9ac0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9acb791980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e13570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9acb791980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea36de1430 con 0x55ea36e13150 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e13570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e13570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50452/0 (socket says 172.21.15.72:50452) 2024-04-26T12:50:18.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9ac92ac640 1 -- 172.21.15.72:0/1280472140 learned_addr learned my addr 172.21.15.72:0/1280472140 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9ac92ac640 1 -- 172.21.15.72:0/1280472140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea36e13b40 con 0x55ea36e13150 2024-04-26T12:50:18.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/1280472140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e13570 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4048fd0 tx=0x7f9ac40056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e1921d6afcb185 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f99acff9640 1 -- 172.21.15.72:0/1280472140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4062070 con 0x55ea36e13150 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f99acff9640 1 -- 172.21.15.72:0/1280472140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac4048580 con 0x55ea36e13150 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.592+0000 7f99acff9640 1 -- 172.21.15.72:0/1280472140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4059040 con 0x55ea36e13150 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- 172.21.15.72:0/1280472140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 msgr2=0x55ea36e13570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 --2- 172.21.15.72:0/1280472140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e13570 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4048fd0 tx=0x7f9ac40056b0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- 172.21.15.72:0/1280472140 shutdown_connections 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 --2- 172.21.15.72:0/1280472140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e13570 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- 172.21.15.72:0/1280472140 >> 172.21.15.72:0/1280472140 conn(0x55ea36e0f490 msgr2=0x55ea36e0d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- 172.21.15.72:0/1280472140 shutdown_connections 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- 172.21.15.72:0/1280472140 wait complete. 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 Processor -- start 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- start start 2024-04-26T12:50:18.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e1a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea36e14200 con 0x55ea36e13150 2024-04-26T12:50:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e1a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9ac92ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e1a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50466/0 (socket says 172.21.15.72:50466) 2024-04-26T12:50:18.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 learned_addr learned my addr 172.21.15.72:0/800650115 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea36e1aa00 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e1a4c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4024fb0 tx=0x7f9ac4024f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f999effd640 1 -- 172.21.15.72:0/800650115 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac406a020 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea36e1aa00 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f999effd640 1 -- 172.21.15.72:0/800650115 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac4041f80 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea36e1aa00 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f999effd640 1 -- 172.21.15.72:0/800650115 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ac4062040 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f999effd640 1 -- 172.21.15.72:0/800650115 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9ac406d020 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f999effd640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9994034650 0x7f9994036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.596+0000 7f999effd640 1 -- 172.21.15.72:0/800650115 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f9ac402b260 con 0x55ea36e13150 2024-04-26T12:50:18.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9994034650 0x7f9994036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36e255e0 0x55ea36e27aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e281f0 con 0x55ea36e255e0 2024-04-26T12:50:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac9aad640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36e255e0 0x55ea36e27aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9994034650 0x7f9994036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55ea36df8500 tx=0x7f9ac00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac9aad640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36e255e0 0x55ea36e27aa0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36e255e0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 realm 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e28600 con 0x55ea36e255e0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36e255e0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e28ed0 con 0x55ea36e255e0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36e255e0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36e255e0 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36e29fd0 0x55ea36e2c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e2c9d0 con 0x55ea36e29fd0 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36e29fd0 0x55ea36e2c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac92ac640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36e29fd0 0x55ea36e2c3c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 20 searching for the correct realm 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36e2e920 0x55ea36e30d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e31400 con 0x55ea36e2e920 2024-04-26T12:50:18.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.600+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36e2e920 0x55ea36e30d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36e2e920 0x55ea36e30d30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac8aab640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9ac00e0040 0x7f9ac00e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e31400 con 0x7f9ac00e0040 2024-04-26T12:50:18.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9ac00e0040 0x7f9ac00e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9ac00e0040 0x7f9ac00e0420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc0083f0 con 0x7f9ac00e0040 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc0083f0 con 0x55ea36e255e0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.604+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x7f9ac00e0040 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x7f9ac00e0040 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x7f9ac00e0040 2024-04-26T12:50:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9abc026040 con 0x7f9ac00e0040 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.608+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x7f9ac00e0040 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x7f9ac00e0040 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.612+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x7f9ac00e0040 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x7f9ac00e0040 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e2e920 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e29fd0 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x55ea36e255e0 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e29270 con 0x7f9ac00e0040 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9abc026040 con 0x7f9ac00e0040 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:18.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e2d290 con 0x55ea36e255e0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e2d290 con 0x55ea36e255e0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9abc026040 con 0x55ea36e255e0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e2d290 con 0x55ea36e2e920 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 zone default found 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 4 Realm: () 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 zonegroup default 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.616+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e2dbd0 con 0x55ea36e29fd0 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e33290 con 0x55ea36e2e920 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e33720 con 0x55ea36e2e920 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 20 started sync module instance, tier type = 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e32700 con 0x7f9ac00e0040 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc026040 con 0x7f9ac00e0040 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94464431565824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e32700 con 0x7f9ac00e0040 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e341e0 con 0x55ea36e255e0 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.620+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94464431565824] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.624+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.624+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94464431570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e32700 con 0x55ea36e255e0 2024-04-26T12:50:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.624+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e34bf0 con 0x55ea36e2e920 2024-04-26T12:50:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.624+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94464431570128] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.624+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.624+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94464431563344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e32670 con 0x55ea36e2e920 2024-04-26T12:50:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.624+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e358f0 con 0x7f9ac00e0040 2024-04-26T12:50:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94464431576400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e36190 con 0x7f9ac00e0040 2024-04-26T12:50:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e36b50 con 0x55ea36e255e0 2024-04-26T12:50:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94464431563344] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94464431576400] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94464431580832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e36ac0 con 0x55ea36e255e0 2024-04-26T12:50:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.628+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e360e0 con 0x55ea36e29fd0 2024-04-26T12:50:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94464431583040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e37810 con 0x55ea36e29fd0 2024-04-26T12:50:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e381d0 con 0x55ea36e29fd0 2024-04-26T12:50:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94464431580832] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94464431583040] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94464431586592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e38570 con 0x55ea36e29fd0 2024-04-26T12:50:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.632+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e38dc0 con 0x55ea36e29fd0 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94464431589200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e39180 con 0x55ea36e29fd0 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=0 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=1 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=2 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=3 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=4 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=5 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94464431586592] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=6 2024-04-26T12:50:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94464431589200] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 20 add_watcher() i=7 2024-04-26T12:50:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e35c30 con 0x55ea36e255e0 2024-04-26T12:50:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.636+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94464431578160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e396d0 con 0x55ea36e255e0 2024-04-26T12:50:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94464431578160] v33'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f997f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 5 note: GC not initialized 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f997e7e4640 20 reqs_thread_entry: start 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 Filter name: none 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f98effff640 20 reqs_thread_entry: start 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5f9c0 con 0x55ea36e255e0 2024-04-26T12:50:18.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e61aa0 con 0x7f9ac00e0040 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e632b0 con 0x7f9ac00e0040 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T12:50:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.640+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e669d0 con 0x7f9ac00e0040 2024-04-26T12:50:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(65 foo.buckets [call] v33'18 uv18 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-26T12:50:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e65b60 con 0x7f9ac00e0040 2024-04-26T12:50:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-26T12:50:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.644+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e66720 con 0x7f9ac00e0040 2024-04-26T12:50:18.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'19 uv19 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9acb791980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:50:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9acb791980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9acb791980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:50:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94464431776176 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e68290 con 0x55ea36e29fd0 2024-04-26T12:50:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== watch-notify(notify (1) cookie 94464431586592 notify 141733920770 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55ea36e07550 con 0x55ea36e29fd0 2024-04-26T12:50:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f99acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94464431586592 notifier 4489 bl.length()=338 2024-04-26T12:50:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f99acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:50:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f99acff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(68 notify.6 [notify cookie 94464431776176 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f99acff9640 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f998c003eb0 con 0x55ea36e29fd0 2024-04-26T12:50:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.648+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== watch-notify(notify_complete (2) cookie 94464431776176 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea36e06ab0 con 0x55ea36e29fd0 2024-04-26T12:50:18.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f997f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94464431578160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x55ea36e255e0 2024-04-26T12:50:18.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94464431578160] v33'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94464431565824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x7f9ac00e0040 2024-04-26T12:50:18.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94464431565824] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f9acb791980 20 remove_watcher() i=0 2024-04-26T12:50:18.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f9acb791980 2 removed watcher, disabling cache 2024-04-26T12:50:18.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.652+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94464431570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x55ea36e255e0 2024-04-26T12:50:18.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.656+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94464431570128] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.656+0000 7f9acb791980 20 remove_watcher() i=1 2024-04-26T12:50:18.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.656+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94464431563344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x55ea36e2e920 2024-04-26T12:50:18.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.656+0000 7f9ac8aab640 1 -- 172.21.15.72:0/800650115 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94464431563344] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac00aaac0 con 0x55ea36e2e920 2024-04-26T12:50:18.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.656+0000 7f9acb791980 20 remove_watcher() i=2 2024-04-26T12:50:18.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.656+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94464431576400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x7f9ac00e0040 2024-04-26T12:50:18.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.660+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94464431576400] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x7f9ac00e0040 2024-04-26T12:50:18.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.660+0000 7f9acb791980 20 remove_watcher() i=3 2024-04-26T12:50:18.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.660+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94464431580832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x55ea36e255e0 2024-04-26T12:50:18.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.660+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94464431580832] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9abc036040 con 0x55ea36e255e0 2024-04-26T12:50:18.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.660+0000 7f9acb791980 20 remove_watcher() i=4 2024-04-26T12:50:18.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.660+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94464431583040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x55ea36e29fd0 2024-04-26T12:50:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.664+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94464431583040] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.664+0000 7f9acb791980 20 remove_watcher() i=5 2024-04-26T12:50:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.664+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94464431586592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x55ea36e29fd0 2024-04-26T12:50:18.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.664+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94464431586592] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.664+0000 7f9acb791980 20 remove_watcher() i=6 2024-04-26T12:50:18.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.664+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94464431589200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ea36e5d6f0 con 0x55ea36e29fd0 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9ac92ac640 1 -- 172.21.15.72:0/800650115 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94464431589200] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403a070 con 0x55ea36e29fd0 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 20 remove_watcher() i=7 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36e29fd0 msgr2=0x55ea36e2c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36e29fd0 0x55ea36e2c3c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36e255e0 msgr2=0x55ea36e27aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36e255e0 0x55ea36e27aa0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9ac00e0040 msgr2=0x7f9ac00e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9ac00e0040 0x7f9ac00e0420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36e2e920 msgr2=0x55ea36e30d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36e2e920 0x55ea36e30d30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9994034650 msgr2=0x7f9994036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9994034650 0x7f9994036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55ea36df8500 tx=0x7f9ac00c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 reap_dead start 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 msgr2=0x55ea36e1a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/800650115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e13150 0x55ea36e1a4c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4024fb0 tx=0x7f9ac4024f20 comp rx=0 tx=0).stop 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9ac9aad640 1 -- 172.21.15.72:0/800650115 reap_dead start 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 shutdown_connections 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 >> 172.21.15.72:0/800650115 conn(0x55ea36e0f490 msgr2=0x55ea36e0d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 shutdown_connections 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/800650115 wait complete. 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99a00346a0 msgr2=0x7f99a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99a00346a0 0x7f99a0036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ac001b380 tx=0x7f9ac0005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e06150 msgr2=0x55ea36e06570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e06150 0x55ea36e06570 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4014fd0 tx=0x7f9ac4005340 comp rx=0 tx=0).stop 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 shutdown_connections 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99a00346a0 0x7f99a0036b60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/2333372499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36e06150 0x55ea36e06570 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 >> 172.21.15.72:0/2333372499 conn(0x55ea36dfaf60 msgr2=0x55ea36dfba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 shutdown_connections 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/2333372499 wait complete. 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36df1680 msgr2=0x55ea36df3a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea36df1680 0x55ea36df3a70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36c69960 msgr2=0x55ea36deed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea36c69960 0x55ea36deed10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36df5580 msgr2=0x55ea36df7970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea36df5580 0x55ea36df7970 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99b0034650 msgr2=0x7f99b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f99b0034650 0x7f99b0036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00ae000 tx=0x7f9ac00a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 msgr2=0x55ea36de7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 --2- 172.21.15.72:0/3334563073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea36c68620 0x55ea36de7dc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006640 tx=0x7f9ac4000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9ac9aad640 1 -- 172.21.15.72:0/3334563073 reap_dead start 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 shutdown_connections 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 >> 172.21.15.72:0/3334563073 conn(0x55ea36ceeba0 msgr2=0x55ea36ddb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 shutdown_connections 2024-04-26T12:50:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.668+0000 7f9acb791980 1 -- 172.21.15.72:0/3334563073 wait complete. 2024-04-26T12:50:18.680 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:50:18.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:50:18.680 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-26T12:50:18.768 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:18.769 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.768+0000 7fd61c5e0980 1 Processor -- start 2024-04-26T12:50:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.768+0000 7fd61c5e0980 1 -- start start 2024-04-26T12:50:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd61c5e0980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5616683f8520 0x5616683f8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd61c5e0980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616682a3510 con 0x5616683f8e40 2024-04-26T12:50:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd61c5e0980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5616682aa430 con 0x5616683f8520 2024-04-26T12:50:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd6198fa640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5616683f8e40 0x5616683f9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36172/0 (socket says 172.21.15.72:36172) 2024-04-26T12:50:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd61a0fb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5616683f8520 0x5616683f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd6198fa640 1 -- 172.21.15.72:0/472575126 learned_addr learned my addr 172.21.15.72:0/472575126 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd61a0fb640 1 -- 172.21.15.72:0/472575126 >> v1:172.21.15.29:6789/0 conn(0x5616683f8e40 legacy=0x5616683f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.772+0000 7fd61a0fb640 1 -- 172.21.15.72:0/472575126 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166827fae0 con 0x5616683f8520 2024-04-26T12:50:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/472575126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616683f8900 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00a480 tx=0x7fd60c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242512196afaae99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd6190f9640 1 -- 172.21.15.72:0/472575126 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0b0070 con 0x5616683f8520 2024-04-26T12:50:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd6190f9640 1 -- 172.21.15.72:0/472575126 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c0ab540 con 0x5616683f8520 2024-04-26T12:50:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd6190f9640 1 -- 172.21.15.72:0/472575126 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0ab840 con 0x5616683f8520 2024-04-26T12:50:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61c5e0980 1 -- 172.21.15.72:0/472575126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 msgr2=0x5616683f8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/472575126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616683f8900 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00a480 tx=0x7fd60c01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61c5e0980 1 -- 172.21.15.72:0/472575126 shutdown_connections 2024-04-26T12:50:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/472575126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616683f8900 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61c5e0980 1 -- 172.21.15.72:0/472575126 >> 172.21.15.72:0/472575126 conn(0x56166836bc00 msgr2=0x56166836c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61c5e0980 1 -- 172.21.15.72:0/472575126 shutdown_connections 2024-04-26T12:50:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.776+0000 7fd61c5e0980 1 -- 172.21.15.72:0/472575126 wait complete. 2024-04-26T12:50:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 Processor -- start 2024-04-26T12:50:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 -- start start 2024-04-26T12:50:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5616682f9a70 con 0x5616683f8520 2024-04-26T12:50:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684e3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50484/0 (socket says 172.21.15.72:50484) 2024-04-26T12:50:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3311721568 learned_addr learned my addr 172.21.15.72:0/3311721568 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3311721568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616684e43d0 con 0x5616683f8520 2024-04-26T12:50:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/3311721568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684e3e00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ae040 tx=0x7fd60c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30367518cdaa58fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd508608640 1 -- 172.21.15.72:0/3311721568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0b0040 con 0x5616683f8520 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd508608640 1 -- 172.21.15.72:0/3311721568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c0ab9b0 con 0x5616683f8520 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd508608640 1 -- 172.21.15.72:0/3311721568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0abc90 con 0x5616683f8520 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3311721568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 msgr2=0x5616684e3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3311721568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684e3e00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ae040 tx=0x7fd60c003030 comp rx=0 tx=0).stop 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3311721568 shutdown_connections 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3311721568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684e3e00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3311721568 >> 172.21.15.72:0/3311721568 conn(0x56166836bc00 msgr2=0x5616684df990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3311721568 shutdown_connections 2024-04-26T12:50:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.792+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3311721568 wait complete. 2024-04-26T12:50:18.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 Processor -- start 2024-04-26T12:50:18.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 -- start start 2024-04-26T12:50:18.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561668402570 con 0x5616683f8520 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684eaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50486/0 (socket says 172.21.15.72:50486) 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61a0fb640 1 -- 172.21.15.72:0/2356266513 learned_addr learned my addr 172.21.15.72:0/2356266513 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61a0fb640 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616684eb440 con 0x5616683f8520 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684eaf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd60c01bb20 tx=0x7fd60c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd506e05640 1 -- 172.21.15.72:0/2356266513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0c5070 con 0x5616683f8520 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd506e05640 1 -- 172.21.15.72:0/2356266513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c0b6970 con 0x5616683f8520 2024-04-26T12:50:18.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616684eb6d0 con 0x5616683f8520 2024-04-26T12:50:18.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd506e05640 1 -- 172.21.15.72:0/2356266513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0b0050 con 0x5616683f8520 2024-04-26T12:50:18.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616684ee300 con 0x5616683f8520 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd506e05640 1 -- 172.21.15.72:0/2356266513 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd60c0c8070 con 0x5616683f8520 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd506e05640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd5000346a0 0x7fd500036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd506e05640 1 -- 172.21.15.72:0/2356266513 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fd60c0bc070 con 0x5616683f8520 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd6198fa640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd5000346a0 0x7fd500036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5616683f8e40 0x5616684f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616684f23e0 con 0x5616683f8e40 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.796+0000 7fd61a8fc640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5616683f8e40 0x5616684f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd6198fa640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd5000346a0 0x7fd500036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd610001da0 tx=0x7fd610001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61a8fc640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5616683f8e40 0x5616684f1de0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61a8fc640 1 -- 172.21.15.72:0/2356266513 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x5616683f8e40 2024-04-26T12:50:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616684f2c80 con 0x5616683f8e40 2024-04-26T12:50:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61a8fc640 1 -- 172.21.15.72:0/2356266513 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd61400a4d0 con 0x5616683f8e40 2024-04-26T12:50:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5616684f45d0 0x5616684f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616684f71f0 con 0x5616684f45d0 2024-04-26T12:50:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5616684f45d0 0x5616684f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5616684f45d0 0x5616684f6a60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61a0fb640 1 -- 172.21.15.72:0/2356266513 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd60c0c7030 con 0x5616684f45d0 2024-04-26T12:50:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616684f34d0 con 0x5616683f8e40 2024-04-26T12:50:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61a8fc640 1 -- 172.21.15.72:0/2356266513 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd61400a4d0 con 0x5616683f8e40 2024-04-26T12:50:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5616684f8650 0x5616684faa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616684fb180 con 0x5616684f8650 2024-04-26T12:50:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd6198fa640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5616684f8650 0x5616684faa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.800+0000 7fd6198fa640 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5616684f8650 0x5616684faa40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd6198fa640 1 -- 172.21.15.72:0/2356266513 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd61000e6c0 con 0x5616684f8650 2024-04-26T12:50:18.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61c5e0980 1 Processor -- start 2024-04-26T12:50:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61c5e0980 1 -- start start 2024-04-26T12:50:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61c5e0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616685091f0 0x561668509610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61c5e0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5616682fdab0 con 0x5616685091f0 2024-04-26T12:50:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616685091f0 0x561668509610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616685091f0 0x561668509610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50498/0 (socket says 172.21.15.72:50498) 2024-04-26T12:50:18.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61a0fb640 1 -- 172.21.15.72:0/1000548026 learned_addr learned my addr 172.21.15.72:0/1000548026 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61a0fb640 1 -- 172.21.15.72:0/1000548026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561668509b50 con 0x5616685091f0 2024-04-26T12:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616685091f0 0x561668509610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0c5040 tx=0x7fd60c0aacb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd4fffff640 1 -- 172.21.15.72:0/1000548026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0d5040 con 0x5616685091f0 2024-04-26T12:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd4fffff640 1 -- 172.21.15.72:0/1000548026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c0ad210 con 0x5616685091f0 2024-04-26T12:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56166850a5f0 con 0x5616685091f0 2024-04-26T12:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd4fffff640 1 -- 172.21.15.72:0/1000548026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0aa3b0 con 0x5616685091f0 2024-04-26T12:50:18.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166850aac0 con 0x5616685091f0 2024-04-26T12:50:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd4fffff640 1 -- 172.21.15.72:0/1000548026 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd60c0d8070 con 0x5616685091f0 2024-04-26T12:50:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd4fffff640 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4f40346a0 0x7fd4f4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd4fffff640 1 -- 172.21.15.72:0/1000548026 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fd60c0a8070 con 0x5616685091f0 2024-04-26T12:50:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.804+0000 7fd6198fa640 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4f40346a0 0x7fd4f4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 Processor -- start 2024-04-26T12:50:18.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- start start 2024-04-26T12:50:18.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x5616685165e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd6198fa640 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4f40346a0 0x7fd4f4036b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5616684ef680 tx=0x7fd61000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5616684e4660 con 0x561668516200 2024-04-26T12:50:18.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x5616685165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x5616685165e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50512/0 (socket says 172.21.15.72:50512) 2024-04-26T12:50:18.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3869183911 learned_addr learned my addr 172.21.15.72:0/3869183911 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3869183911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561668516bb0 con 0x561668516200 2024-04-26T12:50:18.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/3869183911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x5616685165e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0bcff0 tx=0x7fd60c0e0530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b29d97c2464a58a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd4fdffb640 1 -- 172.21.15.72:0/3869183911 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0d2e30 con 0x561668516200 2024-04-26T12:50:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd4fdffb640 1 -- 172.21.15.72:0/3869183911 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c0e01b0 con 0x561668516200 2024-04-26T12:50:18.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd4fdffb640 1 -- 172.21.15.72:0/3869183911 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0ca440 con 0x561668516200 2024-04-26T12:50:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3869183911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 msgr2=0x5616685165e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3869183911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x5616685165e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0bcff0 tx=0x7fd60c0e0530 comp rx=0 tx=0).stop 2024-04-26T12:50:18.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3869183911 shutdown_connections 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3869183911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x5616685165e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3869183911 >> 172.21.15.72:0/3869183911 conn(0x561668512540 msgr2=0x5616685105a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3869183911 shutdown_connections 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3869183911 wait complete. 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 Processor -- start 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- start start 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x56166851d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61c5e0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5616685172b0 con 0x561668516200 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x56166851d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x56166851d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50516/0 (socket says 172.21.15.72:50516) 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.808+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 learned_addr learned my addr 172.21.15.72:0/3660988712 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166851da60 con 0x561668516200 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x56166851d520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0e4800 tx=0x7fd60c0bcef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd4ebfff640 1 -- 172.21.15.72:0/3660988712 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c10f070 con 0x561668516200 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd4ebfff640 1 -- 172.21.15.72:0/3660988712 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c0b5a10 con 0x561668516200 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56166851da60 con 0x561668516200 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd4ebfff640 1 -- 172.21.15.72:0/3660988712 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c0b5cf0 con 0x561668516200 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166851da60 con 0x561668516200 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd4ebfff640 1 -- 172.21.15.72:0/3660988712 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd60c112070 con 0x561668516200 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd4ebfff640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4e40346a0 0x7fd4e4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd4ebfff640 1 -- 172.21.15.72:0/3660988712 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fd60c106030 con 0x561668516200 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd6198fa640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4e40346a0 0x7fd4e4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561668528610 0x56166852aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56166852b220 con 0x561668528610 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61a8fc640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561668528610 0x56166852aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd6198fa640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4e40346a0 0x7fd4e4036b60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5616684fb560 tx=0x7fd610010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61a8fc640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561668528610 0x56166852aad0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 realm 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56166852b630 con 0x561668528610 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56166852bf00 con 0x561668528610 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.812+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56166852d000 0x56166852f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56166852fa00 con 0x56166852d000 2024-04-26T12:50:18.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56166852d000 0x56166852f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61a0fb640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56166852d000 0x56166852f3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 20 searching for the correct realm 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561668531950 0x561668533d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561668534430 con 0x561668531950 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd6198fa640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561668531950 0x561668533d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd6198fa640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561668531950 0x561668533d60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd6198fa640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd610037040 0x7fd610036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561668534430 con 0x7fd610037040 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61a8fc640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd610037040 0x7fd610036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.816+0000 7fd61a8fc640 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd610037040 0x7fd610036410 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x7fd610037040 2024-04-26T12:50:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.820+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x7fd610037040 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.824+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x7fd610037040 2024-04-26T12:50:18.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x7fd610037040 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668531950 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.828+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x56166852d000 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x561668528610 2024-04-26T12:50:18.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56166852c2a0 con 0x7fd610037040 2024-04-26T12:50:18.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:18.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616685302c0 con 0x561668528610 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616685302c0 con 0x561668528610 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616685302c0 con 0x561668531950 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 zone default found 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 4 Realm: () 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 zonegroup default 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561668530c20 con 0x56166852d000 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616685362f0 con 0x561668531950 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616685367c0 con 0x561668531950 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 started sync module instance, tier type = 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.832+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668535730 con 0x7fd610037040 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.836+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.836+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94654239562800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668535730 con 0x7fd610037040 2024-04-26T12:50:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.836+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616685372c0 con 0x561668528610 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.836+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94654239562800] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.836+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.836+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94654239567248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668535730 con 0x561668528610 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.836+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668537cd0 con 0x561668531950 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94654239567248] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94654239560320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616685356a0 con 0x561668531950 2024-04-26T12:50:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668538aa0 con 0x7fd610037040 2024-04-26T12:50:18.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94654239573360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668539340 con 0x7fd610037040 2024-04-26T12:50:18.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668539d40 con 0x561668528610 2024-04-26T12:50:18.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94654239560320] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.840+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94654239573360] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.844+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.844+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94654239572160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668538e40 con 0x561668528610 2024-04-26T12:50:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.844+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56166853a5e0 con 0x56166852d000 2024-04-26T12:50:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.844+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.844+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94654239580464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668538e40 con 0x56166852d000 2024-04-26T12:50:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.844+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56166853b360 con 0x56166852d000 2024-04-26T12:50:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.844+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94654239572160] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94654239580464] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94654239578192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56166853ae30 con 0x56166852d000 2024-04-26T12:50:18.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56166853b940 con 0x56166852d000 2024-04-26T12:50:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94654239578192] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94654239583072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56166853b940 con 0x56166852d000 2024-04-26T12:50:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 20 add_watcher() i=0 2024-04-26T12:50:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 20 add_watcher() i=1 2024-04-26T12:50:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 20 add_watcher() i=2 2024-04-26T12:50:18.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 20 add_watcher() i=3 2024-04-26T12:50:18.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 20 add_watcher() i=4 2024-04-26T12:50:18.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 20 add_watcher() i=5 2024-04-26T12:50:18.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.848+0000 7fd61c5e0980 20 add_watcher() i=6 2024-04-26T12:50:18.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94654239583072] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 add_watcher() i=7 2024-04-26T12:50:18.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:18.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56166853ec00 con 0x561668528610 2024-04-26T12:50:18.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94654239585792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56166853bed0 con 0x561668528610 2024-04-26T12:50:18.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94654239585792] v33'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd4d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:18.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 5 note: GC not initialized 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd44b7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 Filter name: none 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd4497fa640 20 reqs_thread_entry: start 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616685625a0 con 0x56166852d000 2024-04-26T12:50:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.852+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561668560be0 con 0x56166852d000 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:50:18.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616685614b0 con 0x56166852d000 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94654239739904 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561668565b90 con 0x56166852d000 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== watch-notify(notify (1) cookie 94654239580464 notify 141733920771 ret 0) ==== 598+0+0 (crc 0 0 0) 0x561668561ff0 con 0x56166852d000 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd4fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94654239580464 notifier 4496 bl.length()=556 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd4fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:50:18.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd4fdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:18.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd4fdffb640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd4e0003eb0 con 0x56166852d000 2024-04-26T12:50:18.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.856+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(65 notify.5 [notify cookie 94654239739904 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== watch-notify(notify_complete (2) cookie 94654239739904 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561668509b50 con 0x56166852d000 2024-04-26T12:50:18.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668561460 con 0x56166852d000 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61c5e0980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61c5e0980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61c5e0980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94654239739824 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561668566040 con 0x561668531950 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== watch-notify(notify (1) cookie 94654239560320 notify 141733920770 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fd610041040 con 0x561668531950 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd4fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94654239560320 notifier 4496 bl.length()=177 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd4fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 notify.2 [notify cookie 94654239739824 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd4fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd4fd7fa640 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd450003410 con 0x561668531950 2024-04-26T12:50:18.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== watch-notify(notify_complete (2) cookie 94654239739824 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5616682a3510 con 0x561668531950 2024-04-26T12:50:18.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.860+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.862 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:50:18.857924Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:18.857907Z","tags":[],"group_ids":[]} 2024-04-26T12:50:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd4d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94654239585792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x561668528610 2024-04-26T12:50:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94654239585792] v33'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94654239562800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x7fd610037040 2024-04-26T12:50:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94654239562800] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd61c5e0980 20 remove_watcher() i=0 2024-04-26T12:50:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd61c5e0980 2 removed watcher, disabling cache 2024-04-26T12:50:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.864+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94654239567248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x561668528610 2024-04-26T12:50:18.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.868+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94654239567248] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.868+0000 7fd61c5e0980 20 remove_watcher() i=1 2024-04-26T12:50:18.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.868+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94654239560320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x561668531950 2024-04-26T12:50:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.868+0000 7fd6198fa640 1 -- 172.21.15.72:0/3660988712 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94654239560320] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61000e6c0 con 0x561668531950 2024-04-26T12:50:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.868+0000 7fd61c5e0980 20 remove_watcher() i=2 2024-04-26T12:50:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.868+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94654239573360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x7fd610037040 2024-04-26T12:50:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.872+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94654239573360] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x7fd610037040 2024-04-26T12:50:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.872+0000 7fd61c5e0980 20 remove_watcher() i=3 2024-04-26T12:50:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.872+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94654239572160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x561668528610 2024-04-26T12:50:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.872+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94654239572160] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd61400a4d0 con 0x561668528610 2024-04-26T12:50:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.872+0000 7fd61c5e0980 20 remove_watcher() i=4 2024-04-26T12:50:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.872+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94654239580464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x56166852d000 2024-04-26T12:50:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.876+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94654239580464] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.876+0000 7fd61c5e0980 20 remove_watcher() i=5 2024-04-26T12:50:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.876+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94654239578192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x56166852d000 2024-04-26T12:50:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.876+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94654239578192] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.876+0000 7fd61c5e0980 20 remove_watcher() i=6 2024-04-26T12:50:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.876+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94654239583072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561668560240 con 0x56166852d000 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61a0fb640 1 -- 172.21.15.72:0/3660988712 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94654239583072] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c111030 con 0x56166852d000 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 20 remove_watcher() i=7 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56166852d000 msgr2=0x56166852f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56166852d000 0x56166852f3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561668528610 msgr2=0x56166852aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561668528610 0x56166852aad0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd610037040 msgr2=0x7fd610036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd610037040 0x7fd610036410 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561668531950 msgr2=0x561668533d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561668531950 0x561668533d60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4e40346a0 msgr2=0x7fd4e4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4e40346a0 0x7fd4e4036b60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5616684fb560 tx=0x7fd610010000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 msgr2=0x56166851d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/3660988712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561668516200 0x56166851d520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0e4800 tx=0x7fd60c0bcef0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 reap_dead start 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61a8fc640 1 -- 172.21.15.72:0/3660988712 reap_dead start 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 shutdown_connections 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 >> 172.21.15.72:0/3660988712 conn(0x561668512540 msgr2=0x561668510570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 shutdown_connections 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/3660988712 wait complete. 2024-04-26T12:50:18.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4f40346a0 msgr2=0x7fd4f4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4f40346a0 0x7fd4f4036b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5616684ef680 tx=0x7fd61000f000 comp rx=0 tx=0).stop 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616685091f0 msgr2=0x561668509610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616685091f0 0x561668509610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0c5040 tx=0x7fd60c0aacb0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 shutdown_connections 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd4f40346a0 0x7fd4f4036b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/1000548026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616685091f0 0x561668509610 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 >> 172.21.15.72:0/1000548026 conn(0x5616684fe000 msgr2=0x5616684feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 shutdown_connections 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/1000548026 wait complete. 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5616684f45d0 msgr2=0x5616684f6a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5616684f45d0 0x5616684f6a60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5616683f8e40 msgr2=0x5616684f1de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5616683f8e40 0x5616684f1de0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5616684f8650 msgr2=0x5616684faa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5616684f8650 0x5616684faa40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd5000346a0 msgr2=0x7fd500036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd5000346a0 0x7fd500036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd610001da0 tx=0x7fd610001300 comp rx=0 tx=0).stop 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 msgr2=0x5616684eaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 --2- 172.21.15.72:0/2356266513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5616683f8520 0x5616684eaf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd60c01bb20 tx=0x7fd60c018020 comp rx=0 tx=0).stop 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61a8fc640 1 -- 172.21.15.72:0/2356266513 reap_dead start 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 shutdown_connections 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 >> 172.21.15.72:0/2356266513 conn(0x56166836bc00 msgr2=0x5616684de4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 shutdown_connections 2024-04-26T12:50:18.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.880+0000 7fd61c5e0980 1 -- 172.21.15.72:0/2356266513 wait complete. 2024-04-26T12:50:18.891 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:50:18.857924Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:18.857907Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:18.898 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:50:18.904 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:18.904 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-26T12:50:18.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-26T12:50:18.905 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-26T12:50:18.934 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:18.934 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:18.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108e1de980 1 Processor -- start 2024-04-26T12:50:18.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108e1de980 1 -- start start 2024-04-26T12:50:18.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108e1de980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5571d4c73880 0x5571d4d01f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108e1de980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571d4bac510 con 0x5571d4d024b0 2024-04-26T12:50:18.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108e1de980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5571d4bb3430 con 0x5571d4c73880 2024-04-26T12:50:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108bcf9640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5571d4c73880 0x5571d4d01f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108b4f8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5571d4d024b0 0x5571d4d048a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36188/0 (socket says 172.21.15.72:36188) 2024-04-26T12:50:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108b4f8640 1 -- 172.21.15.72:0/154183385 learned_addr learned my addr 172.21.15.72:0/154183385 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108bcf9640 1 -- 172.21.15.72:0/154183385 >> v1:172.21.15.29:6789/0 conn(0x5571d4d024b0 legacy=0x5571d4d048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.936+0000 7f108bcf9640 1 -- 172.21.15.72:0/154183385 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d4b88ae0 con 0x5571d4c73880 2024-04-26T12:50:18.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108bcf9640 1 --2- 172.21.15.72:0/154183385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4d01f70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f107c00a480 tx=0x7f107c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa41ea3171e7c2a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108acf7640 1 -- 172.21.15.72:0/154183385 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0b0070 con 0x5571d4c73880 2024-04-26T12:50:18.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108acf7640 1 -- 172.21.15.72:0/154183385 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0ab540 con 0x5571d4c73880 2024-04-26T12:50:18.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108acf7640 1 -- 172.21.15.72:0/154183385 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0ab840 con 0x5571d4c73880 2024-04-26T12:50:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108e1de980 1 -- 172.21.15.72:0/154183385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 msgr2=0x5571d4d01f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108e1de980 1 --2- 172.21.15.72:0/154183385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4d01f70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f107c00a480 tx=0x7f107c01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108e1de980 1 -- 172.21.15.72:0/154183385 shutdown_connections 2024-04-26T12:50:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108e1de980 1 --2- 172.21.15.72:0/154183385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4d01f70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108e1de980 1 -- 172.21.15.72:0/154183385 >> 172.21.15.72:0/154183385 conn(0x5571d4cf9a50 msgr2=0x5571d4cfbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108e1de980 1 -- 172.21.15.72:0/154183385 shutdown_connections 2024-04-26T12:50:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.940+0000 7f108e1de980 1 -- 172.21.15.72:0/154183385 wait complete. 2024-04-26T12:50:18.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 Processor -- start 2024-04-26T12:50:18.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 -- start start 2024-04-26T12:50:18.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4dea520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5571d4c02a70 con 0x5571d4c73880 2024-04-26T12:50:18.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4dea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4dea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50528/0 (socket says 172.21.15.72:50528) 2024-04-26T12:50:18.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108bcf9640 1 -- 172.21.15.72:0/1645861363 learned_addr learned my addr 172.21.15.72:0/1645861363 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108bcf9640 1 -- 172.21.15.72:0/1645861363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d4deaaf0 con 0x5571d4c73880 2024-04-26T12:50:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108bcf9640 1 --2- 172.21.15.72:0/1645861363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4dea520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f107c017e90 tx=0x7f107c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d12b3261915f31c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f0f79e0b640 1 -- 172.21.15.72:0/1645861363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0b0030 con 0x5571d4c73880 2024-04-26T12:50:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f0f79e0b640 1 -- 172.21.15.72:0/1645861363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0bb070 con 0x5571d4c73880 2024-04-26T12:50:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f0f79e0b640 1 -- 172.21.15.72:0/1645861363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0ab820 con 0x5571d4c73880 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 -- 172.21.15.72:0/1645861363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 msgr2=0x5571d4dea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 --2- 172.21.15.72:0/1645861363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4dea520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f107c017e90 tx=0x7f107c003030 comp rx=0 tx=0).stop 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 -- 172.21.15.72:0/1645861363 shutdown_connections 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 --2- 172.21.15.72:0/1645861363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4dea520 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 -- 172.21.15.72:0/1645861363 >> 172.21.15.72:0/1645861363 conn(0x5571d4cf9a50 msgr2=0x5571d4de60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 -- 172.21.15.72:0/1645861363 shutdown_connections 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.956+0000 7f108e1de980 1 -- 172.21.15.72:0/1645861363 wait complete. 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 Processor -- start 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 -- start start 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4df1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5571d4d06ad0 con 0x5571d4c73880 2024-04-26T12:50:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4df1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4df1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50536/0 (socket says 172.21.15.72:50536) 2024-04-26T12:50:18.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108bcf9640 1 -- 172.21.15.72:0/2600936800 learned_addr learned my addr 172.21.15.72:0/2600936800 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108bcf9640 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d4df1ad0 con 0x5571d4c73880 2024-04-26T12:50:18.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108bcf9640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4df1590 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f107c017e90 tx=0x7f107c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f0f73fff640 1 -- 172.21.15.72:0/2600936800 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0b6630 con 0x5571d4c73880 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f0f73fff640 1 -- 172.21.15.72:0/2600936800 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0c5070 con 0x5571d4c73880 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571d4df1d60 con 0x5571d4c73880 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f0f73fff640 1 -- 172.21.15.72:0/2600936800 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0b6900 con 0x5571d4c73880 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571d4df49e0 con 0x5571d4c73880 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f0f73fff640 1 -- 172.21.15.72:0/2600936800 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f107c0b6aa0 con 0x5571d4c73880 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f0f73fff640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f74034650 0x7f0f74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f0f73fff640 1 -- 172.21.15.72:0/2600936800 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f107c0a8070 con 0x5571d4c73880 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108b4f8640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f74034650 0x7f0f74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4d024b0 0x5571d4df84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4df8b10 con 0x5571d4d024b0 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.960+0000 7f108c4fa640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4d024b0 0x5571d4df84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108b4f8640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f74034650 0x7f0f74036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1080000f70 tx=0x7f10800012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108c4fa640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4d024b0 0x5571d4df84c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108c4fa640 1 -- 172.21.15.72:0/2600936800 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4d024b0 2024-04-26T12:50:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4df5be0 con 0x5571d4d024b0 2024-04-26T12:50:18.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108c4fa640 1 -- 172.21.15.72:0/2600936800 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4d024b0 2024-04-26T12:50:18.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4dfae90 0x5571d4dfd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4dfd970 con 0x5571d4dfae90 2024-04-26T12:50:18.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108bcf9640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4dfae90 0x5571d4dfd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108bcf9640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4dfae90 0x5571d4dfd280 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108bcf9640 1 -- 172.21.15.72:0/2600936800 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f107c0cacc0 con 0x5571d4dfae90 2024-04-26T12:50:18.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4df9d30 con 0x5571d4d024b0 2024-04-26T12:50:18.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108c4fa640 1 -- 172.21.15.72:0/2600936800 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4d024b0 2024-04-26T12:50:18.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4dfedd0 0x5571d4e011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e01900 con 0x5571d4dfedd0 2024-04-26T12:50:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108b4f8640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4dfedd0 0x5571d4e011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.964+0000 7f108b4f8640 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4dfedd0 0x5571d4e011c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108b4f8640 1 -- 172.21.15.72:0/2600936800 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f108000e620 con 0x5571d4dfedd0 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108e1de980 1 Processor -- start 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108e1de980 1 -- start start 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108e1de980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4e0f990 0x5571d4e0fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108e1de980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5571d4c06ab0 con 0x5571d4e0f990 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4e0f990 0x5571d4e0fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4e0f990 0x5571d4e0fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50538/0 (socket says 172.21.15.72:50538) 2024-04-26T12:50:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108bcf9640 1 -- 172.21.15.72:0/345543804 learned_addr learned my addr 172.21.15.72:0/345543804 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108bcf9640 1 -- 172.21.15.72:0/345543804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d4e102f0 con 0x5571d4e0f990 2024-04-26T12:50:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108bcf9640 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4e0f990 0x5571d4e0fdb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f107c0b6fd0 tx=0x7f107c0098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f0f717fa640 1 -- 172.21.15.72:0/345543804 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0aa3b0 con 0x5571d4e0f990 2024-04-26T12:50:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f0f717fa640 1 -- 172.21.15.72:0/345543804 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0ed070 con 0x5571d4e0f990 2024-04-26T12:50:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571d4e10d90 con 0x5571d4e0f990 2024-04-26T12:50:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f0f717fa640 1 -- 172.21.15.72:0/345543804 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0bfd10 con 0x5571d4e0f990 2024-04-26T12:50:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571d4e11260 con 0x5571d4e0f990 2024-04-26T12:50:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f0f717fa640 1 -- 172.21.15.72:0/345543804 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f107c0ca470 con 0x5571d4e0f990 2024-04-26T12:50:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f0f717fa640 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f640346a0 0x7f0f64036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f0f717fa640 1 -- 172.21.15.72:0/345543804 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f107c0d3e00 con 0x5571d4e0f990 2024-04-26T12:50:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.968+0000 7f108b4f8640 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f640346a0 0x7f0f64036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 Processor -- start 2024-04-26T12:50:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- start start 2024-04-26T12:50:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108b4f8640 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f640346a0 0x7f0f64036b60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5571d4dfdd40 tx=0x7f108000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4cff940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5571d4dead80 con 0x5571d4cff520 2024-04-26T12:50:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4cff940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4cff940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50544/0 (socket says 172.21.15.72:50544) 2024-04-26T12:50:18.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 -- 172.21.15.72:0/1761549661 learned_addr learned my addr 172.21.15.72:0/1761549661 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 -- 172.21.15.72:0/1761549661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d4cfdd50 con 0x5571d4cff520 2024-04-26T12:50:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 --2- 172.21.15.72:0/1761549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4cff940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f107c0a6760 tx=0x7f107c0a6850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca787c542e764c74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f0f6affd640 1 -- 172.21.15.72:0/1761549661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0b0550 con 0x5571d4cff520 2024-04-26T12:50:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f0f6affd640 1 -- 172.21.15.72:0/1761549661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c102070 con 0x5571d4cff520 2024-04-26T12:50:18.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f0f6affd640 1 -- 172.21.15.72:0/1761549661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0b0030 con 0x5571d4cff520 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- 172.21.15.72:0/1761549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 msgr2=0x5571d4cff940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 --2- 172.21.15.72:0/1761549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4cff940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f107c0a6760 tx=0x7f107c0a6850 comp rx=0 tx=0).stop 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- 172.21.15.72:0/1761549661 shutdown_connections 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 --2- 172.21.15.72:0/1761549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4cff940 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- 172.21.15.72:0/1761549661 >> 172.21.15.72:0/1761549661 conn(0x5571d4e18cf0 msgr2=0x5571d4e16d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- 172.21.15.72:0/1761549661 shutdown_connections 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- 172.21.15.72:0/1761549661 wait complete. 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 Processor -- start 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- start start 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4e25e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108e1de980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5571d4cfe100 con 0x5571d4cff520 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4e25e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4e25e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50552/0 (socket says 172.21.15.72:50552) 2024-04-26T12:50:18.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.972+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 learned_addr learned my addr 172.21.15.72:0/3974558474 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:18.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d4e26360 con 0x5571d4cff520 2024-04-26T12:50:18.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108bcf9640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4e25e20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f107c0e4e70 tx=0x7f107c0c9f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f0f697fa640 1 -- 172.21.15.72:0/3974558474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c114070 con 0x5571d4cff520 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f0f697fa640 1 -- 172.21.15.72:0/3974558474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0b1040 con 0x5571d4cff520 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f0f697fa640 1 -- 172.21.15.72:0/3974558474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f107c0b8de0 con 0x5571d4cff520 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571d4e26360 con 0x5571d4cff520 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571d4e26360 con 0x5571d4cff520 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f0f697fa640 1 -- 172.21.15.72:0/3974558474 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f107c117070 con 0x5571d4cff520 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f0f697fa640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f54034600 0x7f0f54036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f0f697fa640 1 -- 172.21.15.72:0/3974558474 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f107c11ac80 con 0x5571d4cff520 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108b4f8640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f54034600 0x7f0f54036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4e30da0 0x5571d4e33240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e33990 con 0x5571d4e30da0 2024-04-26T12:50:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108c4fa640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4e30da0 0x5571d4e33240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108b4f8640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f54034600 0x7f0f54036ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f108000bf60 tx=0x7f1080010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108c4fa640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4e30da0 0x5571d4e33240 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 20 realm 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e33da0 con 0x5571d4e30da0 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.976+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e34640 con 0x5571d4e30da0 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4e35740 0x5571d4e37b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e380b0 con 0x5571d4e35740 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108bcf9640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4e35740 0x5571d4e37b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108bcf9640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4e35740 0x5571d4e37b30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 20 searching for the correct realm 2024-04-26T12:50:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4e39fe0 0x5571d4e3c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3cb40 con 0x5571d4e39fe0 2024-04-26T12:50:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108b4f8640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4e39fe0 0x5571d4e3c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108b4f8640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4e39fe0 0x5571d4e3c470 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108b4f8640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1080037040 0x7f1080036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3cb40 con 0x7f1080037040 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108c4fa640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1080037040 0x7f1080036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.980+0000 7f108c4fa640 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1080037040 0x7f1080036410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x7f1080037040 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.984+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x7f1080037040 2024-04-26T12:50:18.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:18.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:18.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:18.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:18.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:18.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:18.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:18.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.988+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:18.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x7f1080037040 2024-04-26T12:50:18.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:18.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:18.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:18.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:18.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:18.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:18.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:18.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x7f1080037040 2024-04-26T12:50:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e39fe0 2024-04-26T12:50:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e35740 2024-04-26T12:50:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x5571d4e30da0 2024-04-26T12:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.992+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e349e0 con 0x7f1080037040 2024-04-26T12:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e38900 con 0x5571d4e30da0 2024-04-26T12:50:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e38900 con 0x5571d4e30da0 2024-04-26T12:50:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e38900 con 0x5571d4e39fe0 2024-04-26T12:50:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 zone default found 2024-04-26T12:50:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 4 Realm: () 2024-04-26T12:50:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 zonegroup default 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e391a0 con 0x5571d4e35740 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3e9a0 con 0x5571d4e39fe0 2024-04-26T12:50:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3ed40 con 0x5571d4e39fe0 2024-04-26T12:50:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 started sync module instance, tier type = 2024-04-26T12:50:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3de40 con 0x7f1080037040 2024-04-26T12:50:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93947391370080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3de40 con 0x7f1080037040 2024-04-26T12:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:18.996+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3f7e0 con 0x5571d4e30da0 2024-04-26T12:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.000+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93947391370080] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.000+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.000+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93947391374000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3de40 con 0x5571d4e30da0 2024-04-26T12:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.000+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e401f0 con 0x5571d4e39fe0 2024-04-26T12:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93947391374000] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93947391367568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e3ddb0 con 0x5571d4e39fe0 2024-04-26T12:50:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e40f80 con 0x7f1080037040 2024-04-26T12:50:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93947391380112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e41820 con 0x7f1080037040 2024-04-26T12:50:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e42220 con 0x5571d4e30da0 2024-04-26T12:50:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93947391367568] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93947391380112] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93947391378912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e412f0 con 0x5571d4e30da0 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.004+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e42ac0 con 0x5571d4e35740 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93947391378912] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93947391387152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e412f0 con 0x5571d4e35740 2024-04-26T12:50:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e43310 con 0x5571d4e35740 2024-04-26T12:50:19.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93947391389552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e43a20 con 0x5571d4e35740 2024-04-26T12:50:19.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e44520 con 0x5571d4e35740 2024-04-26T12:50:19.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.008+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93947391387152] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93947391393808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e444e0 con 0x5571d4e35740 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=0 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=1 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=2 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=3 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=4 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=5 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93947391389552] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=6 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93947391393808] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 20 add_watcher() i=7 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:19.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e434b0 con 0x5571d4e30da0 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.012+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93947391384880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e43470 con 0x5571d4e30da0 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93947391384880] v33'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f0f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 5 note: GC not initialized 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f0f40fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 20 Filter name: none 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f0eba7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:19.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e6a7c0 con 0x7f1080037040 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv19 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f0f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.016+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93947391384880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x5571d4e30da0 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93947391384880] v33'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93947391370080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x7f1080037040 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93947391370080] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108e1de980 20 remove_watcher() i=0 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108e1de980 2 removed watcher, disabling cache 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93947391374000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x5571d4e30da0 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93947391374000] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108e1de980 20 remove_watcher() i=1 2024-04-26T12:50:19.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.020+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93947391367568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x5571d4e39fe0 2024-04-26T12:50:19.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.024+0000 7f108b4f8640 1 -- 172.21.15.72:0/3974558474 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93947391367568] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108000e620 con 0x5571d4e39fe0 2024-04-26T12:50:19.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.024+0000 7f108e1de980 20 remove_watcher() i=2 2024-04-26T12:50:19.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.024+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93947391380112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x7f1080037040 2024-04-26T12:50:19.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.024+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93947391380112] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x7f1080037040 2024-04-26T12:50:19.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.024+0000 7f108e1de980 20 remove_watcher() i=3 2024-04-26T12:50:19.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.024+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93947391378912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x5571d4e30da0 2024-04-26T12:50:19.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.028+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93947391378912] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400a4d0 con 0x5571d4e30da0 2024-04-26T12:50:19.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.028+0000 7f108e1de980 20 remove_watcher() i=4 2024-04-26T12:50:19.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.028+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93947391387152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x5571d4e35740 2024-04-26T12:50:19.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.028+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93947391387152] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.028+0000 7f108e1de980 20 remove_watcher() i=5 2024-04-26T12:50:19.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.028+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93947391389552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x5571d4e35740 2024-04-26T12:50:19.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93947391389552] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 20 remove_watcher() i=6 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93947391393808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5571d4e685e0 con 0x5571d4e35740 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108bcf9640 1 -- 172.21.15.72:0/3974558474 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93947391393808] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c116030 con 0x5571d4e35740 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 20 remove_watcher() i=7 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4e35740 msgr2=0x5571d4e37b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4e35740 0x5571d4e37b30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4e30da0 msgr2=0x5571d4e33240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4e30da0 0x5571d4e33240 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1080037040 msgr2=0x7f1080036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1080037040 0x7f1080036410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4e39fe0 msgr2=0x5571d4e3c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.032+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4e39fe0 0x5571d4e3c470 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f54034600 msgr2=0x7f0f54036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f54034600 0x7f0f54036ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f108000bf60 tx=0x7f1080010000 comp rx=0 tx=0).stop 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 msgr2=0x5571d4e25e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108c4fa640 1 -- 172.21.15.72:0/3974558474 reap_dead start 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4e25e20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f107c0e4e70 tx=0x7f107c0c9f50 comp rx=0 tx=0).stop 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 shutdown_connections 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/3974558474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4cff520 0x5571d4e25e20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 >> 172.21.15.72:0/3974558474 conn(0x5571d4e18cf0 msgr2=0x5571d4e16350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 shutdown_connections 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/3974558474 wait complete. 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f640346a0 msgr2=0x7f0f64036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f640346a0 0x7f0f64036b60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5571d4dfdd40 tx=0x7f108000f000 comp rx=0 tx=0).stop 2024-04-26T12:50:19.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4e0f990 msgr2=0x5571d4e0fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4e0f990 0x5571d4e0fdb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f107c0b6fd0 tx=0x7f107c0098d0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 shutdown_connections 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f640346a0 0x7f0f64036b60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/345543804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4e0f990 0x5571d4e0fdb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 >> 172.21.15.72:0/345543804 conn(0x5571d4e047a0 msgr2=0x5571d4e052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 shutdown_connections 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/345543804 wait complete. 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4dfae90 msgr2=0x5571d4dfd280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5571d4dfae90 0x5571d4dfd280 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4d024b0 msgr2=0x5571d4df84c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5571d4d024b0 0x5571d4df84c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4dfedd0 msgr2=0x5571d4e011c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5571d4dfedd0 0x5571d4e011c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f74034650 msgr2=0x7f0f74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0f74034650 0x7f0f74036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1080000f70 tx=0x7f10800012c0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 msgr2=0x5571d4df1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 --2- 172.21.15.72:0/2600936800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5571d4c73880 0x5571d4df1590 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f107c017e90 tx=0x7f107c018020 comp rx=0 tx=0).stop 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108c4fa640 1 -- 172.21.15.72:0/2600936800 reap_dead start 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 shutdown_connections 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 >> 172.21.15.72:0/2600936800 conn(0x5571d4cf9a50 msgr2=0x5571d4de4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 shutdown_connections 2024-04-26T12:50:19.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.036+0000 7f108e1de980 1 -- 172.21.15.72:0/2600936800 wait complete. 2024-04-26T12:50:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:{"key":"bucket:myfoo","ver":{"tag":"_rE59Wkz1xwHqG2jiFUKSzGd","ver":2},"mtime":"2024-04-26T12:50:18.647988Z","data":{"bucket":{"name":"myfoo","marker":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","bucket_id":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-04-26T12:50:17.070930Z","linked":false,"has_bucket_info":false}} 2024-04-26T12:50:19.045 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_rE59Wkz1xwHqG2jiFUKSzGd', 'ver': 2}, 'mtime': '2024-04-26T12:50:18.647988Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'bucket_id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-26T12:50:17.070930Z', 'linked': False, 'has_bucket_info': False}} 2024-04-26T12:50:19.045 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1'] 2024-04-26T12:50:19.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1'] 2024-04-26T12:50:19.046 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:19.132 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:19.132 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:19.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.132+0000 7f40e0df9980 1 Processor -- start 2024-04-26T12:50:19.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.132+0000 7f40e0df9980 1 -- start start 2024-04-26T12:50:19.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.132+0000 7f40e0df9980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55edafb53990 0x55edafb55d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.132+0000 7f40e0df9980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55edaf9fa510 con 0x55edafb4f480 2024-04-26T12:50:19.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.132+0000 7f40e0df9980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55edafa01430 con 0x55edafb53990 2024-04-26T12:50:19.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.136+0000 7f40de113640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55edafb53990 0x55edafb55d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.136+0000 7f40de914640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55edafb4f480 0x55edafb4f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36196/0 (socket says 172.21.15.72:36196) 2024-04-26T12:50:19.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.136+0000 7f40de914640 1 -- 172.21.15.72:0/1568309905 learned_addr learned my addr 172.21.15.72:0/1568309905 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:19.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.136+0000 7f40de113640 1 -- 172.21.15.72:0/1568309905 >> v1:172.21.15.29:6789/0 conn(0x55edafb4f480 legacy=0x55edafb4f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.136+0000 7f40de113640 1 -- 172.21.15.72:0/1568309905 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edaf9d6ae0 con 0x55edafb53990 2024-04-26T12:50:19.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40de113640 1 --2- 172.21.15.72:0/1568309905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb53990 0x55edafb55d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f40c800a480 tx=0x7f40c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8393c917a8a179cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40dd912640 1 -- 172.21.15.72:0/1568309905 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c80b0070 con 0x55edafb53990 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40dd912640 1 -- 172.21.15.72:0/1568309905 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c80ab540 con 0x55edafb53990 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40dd912640 1 -- 172.21.15.72:0/1568309905 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c80ab840 con 0x55edafb53990 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40e0df9980 1 -- 172.21.15.72:0/1568309905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb53990 msgr2=0x55edafb55d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40e0df9980 1 --2- 172.21.15.72:0/1568309905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb53990 0x55edafb55d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f40c800a480 tx=0x7f40c801b280 comp rx=0 tx=0).stop 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40e0df9980 1 -- 172.21.15.72:0/1568309905 shutdown_connections 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40e0df9980 1 --2- 172.21.15.72:0/1568309905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb53990 0x55edafb55d80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40e0df9980 1 -- 172.21.15.72:0/1568309905 >> 172.21.15.72:0/1568309905 conn(0x55edafac2b60 msgr2=0x55edafac2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40e0df9980 1 -- 172.21.15.72:0/1568309905 shutdown_connections 2024-04-26T12:50:19.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.140+0000 7f40e0df9980 1 -- 172.21.15.72:0/1568309905 wait complete. 2024-04-26T12:50:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 Processor -- start 2024-04-26T12:50:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- start start 2024-04-26T12:50:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc3a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55edafa50a70 con 0x55edafb4f480 2024-04-26T12:50:19.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc3a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc3a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50570/0 (socket says 172.21.15.72:50570) 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40de914640 1 -- 172.21.15.72:0/3870562233 learned_addr learned my addr 172.21.15.72:0/3870562233 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40de914640 1 -- 172.21.15.72:0/3870562233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edafc3ac30 con 0x55edafb4f480 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40de914640 1 --2- 172.21.15.72:0/3870562233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc3a660 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f40d00015f0 tx=0x7f40d0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78dcf70d824d169f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f3fcce09640 1 -- 172.21.15.72:0/3870562233 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0004530 con 0x55edafb4f480 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f3fcce09640 1 -- 172.21.15.72:0/3870562233 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d00046f0 con 0x55edafb4f480 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f3fcce09640 1 -- 172.21.15.72:0/3870562233 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0004a90 con 0x55edafb4f480 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- 172.21.15.72:0/3870562233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 msgr2=0x55edafc3a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3870562233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc3a660 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f40d00015f0 tx=0x7f40d0001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- 172.21.15.72:0/3870562233 shutdown_connections 2024-04-26T12:50:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3870562233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc3a660 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- 172.21.15.72:0/3870562233 >> 172.21.15.72:0/3870562233 conn(0x55edafac2b60 msgr2=0x55edafc361f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- 172.21.15.72:0/3870562233 shutdown_connections 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- 172.21.15.72:0/3870562233 wait complete. 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 Processor -- start 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- start start 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc41970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.156+0000 7f40e0df9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55edafb58db0 con 0x55edafb4f480 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc41970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc41970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50576/0 (socket says 172.21.15.72:50576) 2024-04-26T12:50:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40de914640 1 -- 172.21.15.72:0/112113937 learned_addr learned my addr 172.21.15.72:0/112113937 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40de914640 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edafc41eb0 con 0x55edafb4f480 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40de914640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc41970 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55edafc3b4f0 tx=0x7f40d0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f3fcb606640 1 -- 172.21.15.72:0/112113937 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0013760 con 0x55edafb4f480 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f3fcb606640 1 -- 172.21.15.72:0/112113937 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d0013900 con 0x55edafb4f480 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edafc42140 con 0x55edafb4f480 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f3fcb606640 1 -- 172.21.15.72:0/112113937 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0013be0 con 0x55edafb4f480 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edafc44d80 con 0x55edafb4f480 2024-04-26T12:50:19.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f3fcb606640 1 -- 172.21.15.72:0/112113937 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40d0010070 con 0x55edafb4f480 2024-04-26T12:50:19.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f3fcb606640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc40346a0 0x7f3fc4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f3fcb606640 1 -- 172.21.15.72:0/112113937 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f40d0018070 con 0x55edafb4f480 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40de113640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc40346a0 0x7f3fc4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafb53990 0x55edafc48860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc48ed0 con 0x55edafb53990 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40df115640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafb53990 0x55edafc48860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40de113640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc40346a0 0x7f3fc4036b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ad000 tx=0x7f40c80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40df115640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafb53990 0x55edafc48860 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40df115640 1 -- 172.21.15.72:0/112113937 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafb53990 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.160+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc45fa0 con 0x55edafb53990 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40df115640 1 -- 172.21.15.72:0/112113937 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafb53990 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc4b270 0x55edafc4d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc4dd50 con 0x55edafc4b270 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40de914640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc4b270 0x55edafc4d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40de914640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc4b270 0x55edafc4d660 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40de914640 1 -- 172.21.15.72:0/112113937 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc4b270 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc4a110 con 0x55edafb53990 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40df115640 1 -- 172.21.15.72:0/112113937 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafb53990 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc4f1b0 0x55edafc515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc51ce0 con 0x55edafc4f1b0 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40de113640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc4f1b0 0x55edafc515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40de113640 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc4f1b0 0x55edafc515a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40de113640 1 -- 172.21.15.72:0/112113937 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40c80b3040 con 0x55edafc4f1b0 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 Processor -- start 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 -- start start 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc5fd40 0x55edafc60180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40e0df9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55edafa54ab0 con 0x55edafc5fd40 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.164+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc5fd40 0x55edafc60180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc5fd40 0x55edafc60180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50582/0 (socket says 172.21.15.72:50582) 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 -- 172.21.15.72:0/1431447036 learned_addr learned my addr 172.21.15.72:0/1431447036 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 -- 172.21.15.72:0/1431447036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edafc606c0 con 0x55edafc5fd40 2024-04-26T12:50:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc5fd40 0x55edafc60180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f40d0048330 tx=0x7f40d0041d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f3fc8e01640 1 -- 172.21.15.72:0/1431447036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0010bc0 con 0x55edafc5fd40 2024-04-26T12:50:19.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edafc61080 con 0x55edafc5fd40 2024-04-26T12:50:19.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f3fc8e01640 1 -- 172.21.15.72:0/1431447036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d00123c0 con 0x55edafc5fd40 2024-04-26T12:50:19.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f3fc8e01640 1 -- 172.21.15.72:0/1431447036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d00126e0 con 0x55edafc5fd40 2024-04-26T12:50:19.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edafc61550 con 0x55edafc5fd40 2024-04-26T12:50:19.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f3fc8e01640 1 -- 172.21.15.72:0/1431447036 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40d0012880 con 0x55edafc5fd40 2024-04-26T12:50:19.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f3fc8e01640 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb8034650 0x7f3fb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f3fc8e01640 1 -- 172.21.15.72:0/1431447036 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f40d003b070 con 0x55edafc5fd40 2024-04-26T12:50:19.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de113640 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb8034650 0x7f3fb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40e0df9980 1 Processor -- start 2024-04-26T12:50:19.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40e0df9980 1 -- start start 2024-04-26T12:50:19.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40e0df9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc6d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40e0df9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55edafc3af80 con 0x55edafc6cd00 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de113640 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb8034650 0x7f3fb8036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ae040 tx=0x7f40c8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc6d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc6d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50590/0 (socket says 172.21.15.72:50590) 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 -- 172.21.15.72:0/3382478650 learned_addr learned my addr 172.21.15.72:0/3382478650 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.168+0000 7f40de914640 1 -- 172.21.15.72:0/3382478650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edafc6d6d0 con 0x55edafc6cd00 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40de914640 1 --2- 172.21.15.72:0/3382478650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc6d100 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f40d00046c0 tx=0x7f40d0033430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cd06b477b61bf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f3fc27fc640 1 -- 172.21.15.72:0/3382478650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d00410c0 con 0x55edafc6cd00 2024-04-26T12:50:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f3fc27fc640 1 -- 172.21.15.72:0/3382478650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d0048410 con 0x55edafc6cd00 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f3fc27fc640 1 -- 172.21.15.72:0/3382478650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0041260 con 0x55edafc6cd00 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- 172.21.15.72:0/3382478650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 msgr2=0x55edafc6d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3382478650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc6d100 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f40d00046c0 tx=0x7f40d0033430 comp rx=0 tx=0).stop 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- 172.21.15.72:0/3382478650 shutdown_connections 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3382478650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc6d100 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- 172.21.15.72:0/3382478650 >> 172.21.15.72:0/3382478650 conn(0x55edafc69040 msgr2=0x55edafc670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- 172.21.15.72:0/3382478650 shutdown_connections 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- 172.21.15.72:0/3382478650 wait complete. 2024-04-26T12:50:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 Processor -- start 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- start start 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc73f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55edafc6dd90 con 0x55edafc6cd00 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc73f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40de914640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc73f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50602/0 (socket says 172.21.15.72:50602) 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 learned_addr learned my addr 172.21.15.72:0/3473424020 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edafc744a0 con 0x55edafc6cd00 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40de914640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc73f60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f40d00046c0 tx=0x7f40d000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f3fc0ff9640 1 -- 172.21.15.72:0/3473424020 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d006d020 con 0x55edafc6cd00 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f3fc0ff9640 1 -- 172.21.15.72:0/3473424020 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d0011400 con 0x55edafc6cd00 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f3fc0ff9640 1 -- 172.21.15.72:0/3473424020 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d00116e0 con 0x55edafc6cd00 2024-04-26T12:50:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edafc744a0 con 0x55edafc6cd00 2024-04-26T12:50:19.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.172+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edafc744a0 con 0x55edafc6cd00 2024-04-26T12:50:19.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f3fc0ff9640 1 -- 172.21.15.72:0/3473424020 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40d0070020 con 0x55edafc6cd00 2024-04-26T12:50:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f3fc0ff9640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa80346a0 0x7f3fa8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f3fc0ff9640 1 -- 172.21.15.72:0/3473424020 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f40d0062040 con 0x55edafc6cd00 2024-04-26T12:50:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40de113640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa80346a0 0x7f3fa8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafc7f0c0 0x55edafc81580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc81cd0 con 0x55edafc7f0c0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40df115640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafc7f0c0 0x55edafc81580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40de113640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa80346a0 0x7f3fa8036b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55edafc520e0 tx=0x7f40c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40df115640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafc7f0c0 0x55edafc81580 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafc7f0c0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 realm 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc820e0 con 0x55edafc7f0c0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafc7f0c0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82980 con 0x55edafc7f0c0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafc7f0c0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafc7f0c0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc83a80 0x55edafc85e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc864c0 con 0x55edafc83a80 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40de914640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc83a80 0x55edafc85e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.176+0000 7f40de914640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc83a80 0x55edafc85e70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40e0df9980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40e0df9980 20 searching for the correct realm 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc883a0 0x55edafc8a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8ae50 con 0x55edafc883a0 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de113640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc883a0 0x55edafc8a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de113640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc883a0 0x55edafc8a7d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de113640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40c80ab030 0x7f40c80d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8ae50 con 0x7f40c80ab030 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40c80ab030 0x7f40c80d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40c80ab030 0x7f40c80d1400 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d80083f0 con 0x7f40c80ab030 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d80083f0 con 0x55edafc7f0c0 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.180+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x7f40c80ab030 2024-04-26T12:50:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x7f40c80ab030 2024-04-26T12:50:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x7f40c80ab030 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40d8026040 con 0x7f40c80ab030 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.184+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x7f40c80ab030 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x7f40c80ab030 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.188+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x7f40c80ab030 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x7f40c80ab030 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc883a0 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc83a80 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x55edafc7f0c0 2024-04-26T12:50:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55edafc82d20 con 0x7f40c80ab030 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d8026040 con 0x7f40c80ab030 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc86d10 con 0x55edafc7f0c0 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc86d10 con 0x55edafc7f0c0 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40d8026040 con 0x55edafc7f0c0 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc86d10 con 0x55edafc883a0 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 zone default found 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 4 Realm: () 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 zonegroup default 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc876b0 con 0x55edafc83a80 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc87210 con 0x55edafc883a0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.192+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8d220 con 0x55edafc883a0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 20 started sync module instance, tier type = 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8c5f0 con 0x7f40c80ab030 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8026040 con 0x7f40c80ab030 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94479344782064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8c5f0 con 0x7f40c80ab030 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8dca0 con 0x55edafc7f0c0 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94479344782064] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94479344785664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8c5f0 con 0x55edafc7f0c0 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.196+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8e6b0 con 0x55edafc883a0 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94479344785664] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94479344779584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8c560 con 0x55edafc883a0 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8f3b0 con 0x7f40c80ab030 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94479344791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc8fac0 con 0x7f40c80ab030 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc905c0 con 0x55edafc7f0c0 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94479344779584] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.200+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94479344791568] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.204+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.204+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94479344795824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc90580 con 0x55edafc7f0c0 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.204+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc909e0 con 0x55edafc83a80 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.204+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94479344795824] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.204+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.204+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94479344792848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc90d80 con 0x55edafc83a80 2024-04-26T12:50:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.204+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc91670 con 0x55edafc83a80 2024-04-26T12:50:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94479344792848] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94479344790096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc91850 con 0x55edafc83a80 2024-04-26T12:50:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc920e0 con 0x55edafc83a80 2024-04-26T12:50:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94479344790096] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94479344799104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc922c0 con 0x55edafc83a80 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 20 add_watcher() i=0 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 20 add_watcher() i=1 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 20 add_watcher() i=2 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 20 add_watcher() i=3 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 20 add_watcher() i=4 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 20 add_watcher() i=5 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.208+0000 7f40e0df9980 20 add_watcher() i=6 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94479344799104] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 20 add_watcher() i=7 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafc95690 con 0x55edafc7f0c0 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94479344804272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafc92a80 con 0x55edafc7f0c0 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94479344804272] v33'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f3f957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 5 note: GC not initialized 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f3f0ffff640 20 reqs_thread_entry: start 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 20 Filter name: none 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f3f0dffb640 20 reqs_thread_entry: start 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.212+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb8de0 con 0x55edafc83a80 2024-04-26T12:50:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafcbaec0 con 0x7f40c80ab030 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv19 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafcbc900 con 0x7f40c80ab030 2024-04-26T12:50:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcc0ee0 con 0x7f40c80ab030 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(65 foo.buckets [call] v33'20 uv18 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.216+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcc6dc0 con 0x7f40c80ab030 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(66 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'21 uv21 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94479344976336 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafcc1310 con 0x55edafc83a80 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== watch-notify(notify (1) cookie 94479344792848 notify 141733920772 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55edafc61080 con 0x55edafc83a80 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f3fc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94479344792848 notifier 4510 bl.length()=752 2024-04-26T12:50:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(67 notify.5 [notify cookie 94479344976336 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f3fc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f3fc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f3fc27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f3fc27fc640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3fa4003eb0 con 0x55edafc83a80 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== watch-notify(notify_complete (2) cookie 94479344976336 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55edafc606c0 con 0x55edafc83a80 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_sources= new_sources= 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential sources added=[] removed=[] 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_dests= new_dests= 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential dests added=[] removed=[] 2024-04-26T12:50:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.220+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcbc1d0 con 0x55edafc83a80 2024-04-26T12:50:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.224+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(69 fud.buckets [call] v33'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.224+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcc6610 con 0x7f40c80ab030 2024-04-26T12:50:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'22 uv22 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40e0df9980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:50:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40e0df9980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40e0df9980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:50:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94479344976336 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55edafcc5ab0 con 0x55edafc83a80 2024-04-26T12:50:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== watch-notify(notify (1) cookie 94479344790096 notify 141733920773 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55edafc44d80 con 0x55edafc83a80 2024-04-26T12:50:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f3fc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94479344790096 notifier 4510 bl.length()=314 2024-04-26T12:50:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f3fc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:50:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f3fc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(71 notify.6 [notify cookie 94479344976336 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f3fc27fc640 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3fa4003eb0 con 0x55edafc83a80 2024-04-26T12:50:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== watch-notify(notify_complete (2) cookie 94479344976336 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55edafc42140 con 0x55edafc83a80 2024-04-26T12:50:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f3f957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.228+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94479344804272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x55edafc7f0c0 2024-04-26T12:50:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94479344804272] v33'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94479344782064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x7f40c80ab030 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94479344782064] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40e0df9980 20 remove_watcher() i=0 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40e0df9980 2 removed watcher, disabling cache 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94479344785664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x55edafc7f0c0 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94479344785664] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40e0df9980 20 remove_watcher() i=1 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.232+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94479344779584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x55edafc883a0 2024-04-26T12:50:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.236+0000 7f40de113640 1 -- 172.21.15.72:0/3473424020 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94479344779584] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c80d8040 con 0x55edafc883a0 2024-04-26T12:50:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.236+0000 7f40e0df9980 20 remove_watcher() i=2 2024-04-26T12:50:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.236+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94479344791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x7f40c80ab030 2024-04-26T12:50:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.236+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94479344791568] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x7f40c80ab030 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.236+0000 7f40e0df9980 20 remove_watcher() i=3 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.236+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94479344795824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x55edafc7f0c0 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.240+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94479344795824] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8036040 con 0x55edafc7f0c0 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.240+0000 7f40e0df9980 20 remove_watcher() i=4 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.240+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94479344792848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x55edafc83a80 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.240+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94479344792848] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.240+0000 7f40e0df9980 20 remove_watcher() i=5 2024-04-26T12:50:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.240+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94479344790096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x55edafc83a80 2024-04-26T12:50:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94479344790096] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 20 remove_watcher() i=6 2024-04-26T12:50:19.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94479344799104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55edafcb6b10 con 0x55edafc83a80 2024-04-26T12:50:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40de914640 1 -- 172.21.15.72:0/3473424020 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94479344799104] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d001b030 con 0x55edafc83a80 2024-04-26T12:50:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 20 remove_watcher() i=7 2024-04-26T12:50:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc83a80 msgr2=0x55edafc85e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc83a80 0x55edafc85e70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafc7f0c0 msgr2=0x55edafc81580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafc7f0c0 0x55edafc81580 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40c80ab030 msgr2=0x7f40c80d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40c80ab030 0x7f40c80d1400 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc883a0 msgr2=0x55edafc8a7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc883a0 0x55edafc8a7d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa80346a0 msgr2=0x7f3fa8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa80346a0 0x7f3fa8036b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55edafc520e0 tx=0x7f40c80a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:19.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 msgr2=0x55edafc73f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40df115640 1 -- 172.21.15.72:0/3473424020 reap_dead start 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc73f60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f40d00046c0 tx=0x7f40d000ef70 comp rx=0 tx=0).stop 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 shutdown_connections 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/3473424020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc6cd00 0x55edafc73f60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 >> 172.21.15.72:0/3473424020 conn(0x55edafc69040 msgr2=0x55edafc666a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 shutdown_connections 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/3473424020 wait complete. 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb8034650 msgr2=0x7f3fb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb8034650 0x7f3fb8036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ae040 tx=0x7f40c8005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc5fd40 msgr2=0x55edafc60180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc5fd40 0x55edafc60180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f40d0048330 tx=0x7f40d0041d30 comp rx=0 tx=0).stop 2024-04-26T12:50:19.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 shutdown_connections 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb8034650 0x7f3fb8036b10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/1431447036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafc5fd40 0x55edafc60180 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 >> 172.21.15.72:0/1431447036 conn(0x55edafc54b00 msgr2=0x55edafc55610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 shutdown_connections 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/1431447036 wait complete. 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc4b270 msgr2=0x55edafc4d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55edafc4b270 0x55edafc4d660 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafb53990 msgr2=0x55edafc48860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55edafb53990 0x55edafc48860 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc4f1b0 msgr2=0x55edafc515a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55edafc4f1b0 0x55edafc515a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc40346a0 msgr2=0x7f3fc4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc40346a0 0x7f3fc4036b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ad000 tx=0x7f40c80a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 msgr2=0x55edafc41970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 --2- 172.21.15.72:0/112113937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55edafb4f480 0x55edafc41970 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55edafc3b4f0 tx=0x7f40d0000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40df115640 1 -- 172.21.15.72:0/112113937 reap_dead start 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 shutdown_connections 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 >> 172.21.15.72:0/112113937 conn(0x55edafac2b60 msgr2=0x55edafc34d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 shutdown_connections 2024-04-26T12:50:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.244+0000 7f40e0df9980 1 -- 172.21.15.72:0/112113937 wait complete. 2024-04-26T12:50:19.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T12:50:19.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T12:50:19.256 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T12:50:19.331 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:19.331 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:19.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b8046980 1 Processor -- start 2024-04-26T12:50:19.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b8046980 1 -- start start 2024-04-26T12:50:19.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b8046980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557e556ac690 0x557e556aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b8046980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557e55555510 con 0x557e5561c880 2024-04-26T12:50:19.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b8046980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x557e5555c430 con 0x557e556ac690 2024-04-26T12:50:19.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b5360640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557e556ac690 0x557e556aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b5b61640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x557e5561c880 0x557e556aaf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36212/0 (socket says 172.21.15.72:36212) 2024-04-26T12:50:19.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b5b61640 1 -- 172.21.15.72:0/296163587 learned_addr learned my addr 172.21.15.72:0/296163587 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:19.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b5360640 1 -- 172.21.15.72:0/296163587 >> v1:172.21.15.29:6789/0 conn(0x557e5561c880 legacy=0x557e556aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.332+0000 7fc4b5360640 1 -- 172.21.15.72:0/296163587 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e55531ae0 con 0x557e556ac690 2024-04-26T12:50:19.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b5360640 1 --2- 172.21.15.72:0/296163587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556ac690 0x557e556aea80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00a480 tx=0x7fc4ac01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3d6645bf177d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b4b5f640 1 -- 172.21.15.72:0/296163587 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4ac0b0070 con 0x557e556ac690 2024-04-26T12:50:19.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b4b5f640 1 -- 172.21.15.72:0/296163587 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ac0ab540 con 0x557e556ac690 2024-04-26T12:50:19.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b4b5f640 1 -- 172.21.15.72:0/296163587 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4ac0ab840 con 0x557e556ac690 2024-04-26T12:50:19.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b8046980 1 -- 172.21.15.72:0/296163587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556ac690 msgr2=0x557e556aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b8046980 1 --2- 172.21.15.72:0/296163587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556ac690 0x557e556aea80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00a480 tx=0x7fc4ac01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:19.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b8046980 1 -- 172.21.15.72:0/296163587 shutdown_connections 2024-04-26T12:50:19.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b8046980 1 --2- 172.21.15.72:0/296163587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556ac690 0x557e556aea80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b8046980 1 -- 172.21.15.72:0/296163587 >> 172.21.15.72:0/296163587 conn(0x557e556a2a50 msgr2=0x557e556a4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b8046980 1 -- 172.21.15.72:0/296163587 shutdown_connections 2024-04-26T12:50:19.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.336+0000 7fc4b8046980 1 -- 172.21.15.72:0/296163587 wait complete. 2024-04-26T12:50:19.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 Processor -- start 2024-04-26T12:50:19.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 -- start start 2024-04-26T12:50:19.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e55793510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e555aba70 con 0x557e5561c880 2024-04-26T12:50:19.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e55793510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e55793510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50610/0 (socket says 172.21.15.72:50610) 2024-04-26T12:50:19.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b5b61640 1 -- 172.21.15.72:0/1668860775 learned_addr learned my addr 172.21.15.72:0/1668860775 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b5b61640 1 -- 172.21.15.72:0/1668860775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e55793ae0 con 0x557e5561c880 2024-04-26T12:50:19.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/1668860775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e55793510 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8001e20 tx=0x7fc4a800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf26cc84bbe18be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc3a3e07640 1 -- 172.21.15.72:0/1668860775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a8012020 con 0x557e5561c880 2024-04-26T12:50:19.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc3a3e07640 1 -- 172.21.15.72:0/1668860775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a800e7c0 con 0x557e5561c880 2024-04-26T12:50:19.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc3a3e07640 1 -- 172.21.15.72:0/1668860775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a800eb00 con 0x557e5561c880 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 -- 172.21.15.72:0/1668860775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 msgr2=0x557e55793510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 --2- 172.21.15.72:0/1668860775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e55793510 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8001e20 tx=0x7fc4a800b790 comp rx=0 tx=0).stop 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 -- 172.21.15.72:0/1668860775 shutdown_connections 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 --2- 172.21.15.72:0/1668860775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e55793510 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 -- 172.21.15.72:0/1668860775 >> 172.21.15.72:0/1668860775 conn(0x557e556a2a50 msgr2=0x557e5578f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 -- 172.21.15.72:0/1668860775 shutdown_connections 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 -- 172.21.15.72:0/1668860775 wait complete. 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.352+0000 7fc4b8046980 1 Processor -- start 2024-04-26T12:50:19.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b8046980 1 -- start start 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b8046980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e5579a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b8046980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e556afb60 con 0x557e5561c880 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e5579a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e5579a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50626/0 (socket says 172.21.15.72:50626) 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b5b61640 1 -- 172.21.15.72:0/2273961681 learned_addr learned my addr 172.21.15.72:0/2273961681 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b5b61640 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5579acb0 con 0x557e5561c880 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e5579a770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8001e20 tx=0x7fc4a8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc3a2604640 1 -- 172.21.15.72:0/2273961681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a8012030 con 0x557e5561c880 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e5579af40 con 0x557e5561c880 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc3a2604640 1 -- 172.21.15.72:0/2273961681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8001480 con 0x557e5561c880 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5579db30 con 0x557e5561c880 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc3a2604640 1 -- 172.21.15.72:0/2273961681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a801a920 con 0x557e5561c880 2024-04-26T12:50:19.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc3a2604640 1 -- 172.21.15.72:0/2273961681 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4a8015020 con 0x557e5561c880 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc3a2604640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc39c034650 0x7fc39c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc3a2604640 1 -- 172.21.15.72:0/2273961681 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fc4a8020030 con 0x557e5561c880 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b5360640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc39c034650 0x7fc39c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e556ac690 0x557e557a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557a1c60 con 0x557e556ac690 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b6362640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e556ac690 0x557e557a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b5360640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc39c034650 0x7fc39c036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0ad000 tx=0x7fc4ac0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.356+0000 7fc4b6362640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e556ac690 0x557e557a1610 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b6362640 1 -- 172.21.15.72:0/2273961681 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e556ac690 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e5579ed50 con 0x557e556ac690 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b6362640 1 -- 172.21.15.72:0/2273961681 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e556ac690 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557a3f90 0x557e557a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557a6a50 con 0x557e557a3f90 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557a3f90 0x557e557a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557a3f90 0x557e557a6380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b5b61640 1 -- 172.21.15.72:0/2273961681 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4a8008030 con 0x557e557a3f90 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557a2e30 con 0x557e556ac690 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b6362640 1 -- 172.21.15.72:0/2273961681 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e556ac690 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557a7e90 0x557e557aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557aaa10 con 0x557e557a7e90 2024-04-26T12:50:19.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b5360640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557a7e90 0x557e557aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b5360640 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557a7e90 0x557e557aa280 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b5360640 1 -- 172.21.15.72:0/2273961681 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4ac0b3040 con 0x557e557a7e90 2024-04-26T12:50:19.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 Processor -- start 2024-04-26T12:50:19.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.360+0000 7fc4b8046980 1 -- start start 2024-04-26T12:50:19.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e557b8a60 0x557e557b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e555afab0 con 0x557e557b8a60 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e557b8a60 0x557e557b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e557b8a60 0x557e557b8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50636/0 (socket says 172.21.15.72:50636) 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b5b61640 1 -- 172.21.15.72:0/2308783609 learned_addr learned my addr 172.21.15.72:0/2308783609 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b5b61640 1 -- 172.21.15.72:0/2308783609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e557b93c0 con 0x557e557b8a60 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e557b8a60 0x557e557b8e80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800e790 tx=0x7fc4a8017f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc39b7fe640 1 -- 172.21.15.72:0/2308783609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a803e070 con 0x557e557b8a60 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc39b7fe640 1 -- 172.21.15.72:0/2308783609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8003b50 con 0x557e557b8a60 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e557b9e60 con 0x557e557b8a60 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc39b7fe640 1 -- 172.21.15.72:0/2308783609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a8041bb0 con 0x557e557b8a60 2024-04-26T12:50:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e557b9e60 con 0x557e557b8a60 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc39b7fe640 1 -- 172.21.15.72:0/2308783609 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4a8009070 con 0x557e557b8a60 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc39b7fe640 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc390034650 0x7fc390036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc39b7fe640 1 -- 172.21.15.72:0/2308783609 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fc4a8005050 con 0x557e557b8a60 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b5360640 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc390034650 0x7fc390036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 Processor -- start 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 -- start start 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b5360640 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc390034650 0x7fc390036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0ae040 tx=0x7fc4ac005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e556a8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.364+0000 7fc4b8046980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e55793e30 con 0x557e556a8500 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e556a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e556a8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50648/0 (socket says 172.21.15.72:50648) 2024-04-26T12:50:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4193658581 learned_addr learned my addr 172.21.15.72:0/4193658581 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4193658581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e556a6d50 con 0x557e556a8500 2024-04-26T12:50:19.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/4193658581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e556a8900 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8017fd0 tx=0x7fc4a802dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898565e183b4304a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc3997fa640 1 -- 172.21.15.72:0/4193658581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a80419d0 con 0x557e556a8500 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc3997fa640 1 -- 172.21.15.72:0/4193658581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8024940 con 0x557e556a8500 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc3997fa640 1 -- 172.21.15.72:0/4193658581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a804f100 con 0x557e556a8500 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- 172.21.15.72:0/4193658581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 msgr2=0x557e556a8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4193658581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e556a8900 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8017fd0 tx=0x7fc4a802dc40 comp rx=0 tx=0).stop 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- 172.21.15.72:0/4193658581 shutdown_connections 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4193658581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e556a8900 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- 172.21.15.72:0/4193658581 >> 172.21.15.72:0/4193658581 conn(0x557e557c1ba0 msgr2=0x557e557bfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- 172.21.15.72:0/4193658581 shutdown_connections 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- 172.21.15.72:0/4193658581 wait complete. 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 Processor -- start 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- start start 2024-04-26T12:50:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e557ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557e556a7160 con 0x557e556a8500 2024-04-26T12:50:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e557ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e557ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50656/0 (socket says 172.21.15.72:50656) 2024-04-26T12:50:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 learned_addr learned my addr 172.21.15.72:0/4210812366 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e557cf280 con 0x557e556a8500 2024-04-26T12:50:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e557ced40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8017fd0 tx=0x7fc4a8024b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc3877fe640 1 -- 172.21.15.72:0/4210812366 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a806f070 con 0x557e556a8500 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e557cf280 con 0x557e556a8500 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc3877fe640 1 -- 172.21.15.72:0/4210812366 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8003440 con 0x557e556a8500 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc3877fe640 1 -- 172.21.15.72:0/4210812366 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a80419d0 con 0x557e556a8500 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.368+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e557cf6f0 con 0x557e556a8500 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc3877fe640 1 -- 172.21.15.72:0/4210812366 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4a8072070 con 0x557e556a8500 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc3877fe640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc380034650 0x7fc380036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc3877fe640 1 -- 172.21.15.72:0/4210812366 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fc4a8066030 con 0x557e556a8500 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b5360640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc380034650 0x7fc380036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e557d9ec0 0x557e557dc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557dcad0 con 0x557e557d9ec0 2024-04-26T12:50:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b6362640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e557d9ec0 0x557e557dc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b5360640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc380034650 0x7fc380036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac000c10 tx=0x7fc4ac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b6362640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e557d9ec0 0x557e557dc380 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 realm 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557dcee0 con 0x557e557d9ec0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557dd780 con 0x557e557d9ec0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557d9ec0 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557de880 0x557e557e0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557e12c0 con 0x557e557de880 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557de880 0x557e557e0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.372+0000 7fc4b5b61640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557de880 0x557e557e0c70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b8046980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b8046980 20 searching for the correct realm 2024-04-26T12:50:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557e31a0 0x557e557e55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557e5c30 con 0x557e557e31a0 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5360640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557e31a0 0x557e557e55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5360640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557e31a0 0x557e557e55b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5360640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc4ac0ce040 0x7fc4ac0db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557e5c30 con 0x7fc4ac0ce040 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc4ac0ce040 0x7fc4ac0db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc4ac0ce040 0x7fc4ac0db410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557de880 2024-04-26T12:50:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557d9ec0 2024-04-26T12:50:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557d9ec0 2024-04-26T12:50:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.376+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557de880 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557de880 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x7fc4ac0ce040 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557e31a0 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557d9ec0 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557de880 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557d9ec0 2024-04-26T12:50:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x7fc4ac0ce040 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557e557ddb20 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557de880 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.380+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557d9ec0 2024-04-26T12:50:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557d9ec0 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557de880 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557e31a0 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x7fc4ac0ce040 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557d9ec0 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557de880 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557e31a0 2024-04-26T12:50:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557de880 2024-04-26T12:50:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.384+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x7fc4ac0ce040 2024-04-26T12:50:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557e31a0 2024-04-26T12:50:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557de880 2024-04-26T12:50:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x557e557d9ec0 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc4ac0e8040 con 0x7fc4ac0ce040 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557e1b10 con 0x557e557d9ec0 2024-04-26T12:50:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557e1b10 con 0x557e557d9ec0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557e1b10 con 0x557e557e31a0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 zone default found 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 4 Realm: () 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:19.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 zonegroup default 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557e2500 con 0x557e557de880 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557e7f40 con 0x557e557e31a0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557e82e0 con 0x557e557e31a0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 started sync module instance, tier type = 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.388+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e7380 con 0x7fc4ac0ce040 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.392+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.392+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94001088591728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e7380 con 0x7fc4ac0ce040 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.392+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e8b30 con 0x557e557d9ec0 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.392+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94001088591728] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.392+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.392+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94001088589792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e8b30 con 0x557e557d9ec0 2024-04-26T12:50:19.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.392+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e94f0 con 0x557e557e31a0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94001088589792] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94001088595584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e8aa0 con 0x557e557e31a0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ea230 con 0x7fc4ac0ce040 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94001088601408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ea160 con 0x7fc4ac0ce040 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557eb0f0 con 0x557e557d9ec0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94001088601408] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.396+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94001088595584] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.400+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.400+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94001088600208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557eac40 con 0x557e557d9ec0 2024-04-26T12:50:19.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.400+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557eb990 con 0x557e557de880 2024-04-26T12:50:19.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.400+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.400+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94001088607456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557eac40 con 0x557e557de880 2024-04-26T12:50:19.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.400+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ec6d0 con 0x557e557de880 2024-04-26T12:50:19.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.400+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94001088600208] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94001088603600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ec690 con 0x557e557de880 2024-04-26T12:50:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ed0e0 con 0x557e557de880 2024-04-26T12:50:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94001088607456] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94001088603600] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94001088613328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ec220 con 0x557e557de880 2024-04-26T12:50:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 20 add_watcher() i=0 2024-04-26T12:50:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 20 add_watcher() i=1 2024-04-26T12:50:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 20 add_watcher() i=2 2024-04-26T12:50:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 20 add_watcher() i=3 2024-04-26T12:50:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 20 add_watcher() i=4 2024-04-26T12:50:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 20 add_watcher() i=5 2024-04-26T12:50:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.404+0000 7fc4b8046980 20 add_watcher() i=6 2024-04-26T12:50:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94001088613328] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b8046980 20 add_watcher() i=7 2024-04-26T12:50:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b8046980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557f01e0 con 0x557e557d9ec0 2024-04-26T12:50:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94001088609584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ed660 con 0x557e557d9ec0 2024-04-26T12:50:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94001088609584] v33'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc36bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b8046980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b8046980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.408+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557f8af0 con 0x557e557d9ec0 2024-04-26T12:50:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.412+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.412+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557f91c0 con 0x557e557de880 2024-04-26T12:50:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.412+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.412+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557f91c0 con 0x557e557e31a0 2024-04-26T12:50:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.412+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.412+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557f97b0 con 0x557e557d9ec0 2024-04-26T12:50:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.416+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.416+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557f9c60 con 0x7fc4ac0ce040 2024-04-26T12:50:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.416+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.416+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fa1d0 con 0x557e557e31a0 2024-04-26T12:50:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.416+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.416+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fa680 con 0x557e557d9ec0 2024-04-26T12:50:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.420+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.420+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fa710 con 0x557e557de880 2024-04-26T12:50:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.420+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.420+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fa7a0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.424+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.424+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fa8b0 con 0x557e557e31a0 2024-04-26T12:50:19.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.424+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.424+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x7fc4ac0ce040 2024-04-26T12:50:19.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.424+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.424+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557de880 2024-04-26T12:50:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.428+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.428+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x7fc4ac0ce040 2024-04-26T12:50:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.428+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.428+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557de880 2024-04-26T12:50:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557d9ec0 2024-04-26T12:50:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'114 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557e31a0 2024-04-26T12:50:19.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fae20 con 0x7fc4ac0ce040 2024-04-26T12:50:19.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.432+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fae20 con 0x557e557e31a0 2024-04-26T12:50:19.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.436+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.436+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fadc0 con 0x557e557d9ec0 2024-04-26T12:50:19.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.436+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.436+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fadc0 con 0x557e557d9ec0 2024-04-26T12:50:19.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.436+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.436+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fadc0 con 0x557e557e31a0 2024-04-26T12:50:19.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.440+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.440+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fae20 con 0x7fc4ac0ce040 2024-04-26T12:50:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.440+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.440+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fae20 con 0x557e557e31a0 2024-04-26T12:50:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.444+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.444+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fadc0 con 0x557e557e31a0 2024-04-26T12:50:19.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.444+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.444+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557e31a0 2024-04-26T12:50:19.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.444+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.444+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557e31a0 2024-04-26T12:50:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.448+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.448+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557de880 2024-04-26T12:50:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.448+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.448+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557e31a0 2024-04-26T12:50:19.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.452+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.452+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557de880 2024-04-26T12:50:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.452+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.452+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557e31a0 2024-04-26T12:50:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.456+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.456+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x557e557de880 2024-04-26T12:50:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.456+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.456+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557fad30 con 0x7fc4ac0ce040 2024-04-26T12:50:19.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc36afe5640 20 reqs_thread_entry: start 2024-04-26T12:50:19.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b8046980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:19.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b8046980 20 Filter name: none 2024-04-26T12:50:19.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc368fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:19.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b8046980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:50:19.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b8046980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e557f4c90 con 0x557e557de880 2024-04-26T12:50:19.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b8046980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:50:19.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.460+0000 7fc4b8046980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:50:19.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc4b8046980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:19.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc4b8046980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557e55818a60 con 0x557e557de880 2024-04-26T12:50:19.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.462 INFO:teuthology.orchestra.run.smithi072.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T12:50:19.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc36bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94001088609584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557f56e0 con 0x557e557d9ec0 2024-04-26T12:50:19.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94001088609584] v33'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.464+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94001088591728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557ebd30 con 0x7fc4ac0ce040 2024-04-26T12:50:19.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.468+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94001088591728] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.468+0000 7fc4b8046980 20 remove_watcher() i=0 2024-04-26T12:50:19.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.468+0000 7fc4b8046980 2 removed watcher, disabling cache 2024-04-26T12:50:19.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.468+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94001088589792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e7770 con 0x557e557d9ec0 2024-04-26T12:50:19.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.468+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94001088589792] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.468+0000 7fc4b8046980 20 remove_watcher() i=1 2024-04-26T12:50:19.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.468+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94001088595584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e7770 con 0x557e557e31a0 2024-04-26T12:50:19.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b5360640 1 -- 172.21.15.72:0/4210812366 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94001088595584] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ac0d9070 con 0x557e557e31a0 2024-04-26T12:50:19.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b8046980 20 remove_watcher() i=2 2024-04-26T12:50:19.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94001088601408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e7770 con 0x7fc4ac0ce040 2024-04-26T12:50:19.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94001088601408] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x7fc4ac0ce040 2024-04-26T12:50:19.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b8046980 20 remove_watcher() i=3 2024-04-26T12:50:19.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94001088600208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e9d40 con 0x557e557d9ec0 2024-04-26T12:50:19.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94001088600208] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b000a4d0 con 0x557e557d9ec0 2024-04-26T12:50:19.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b8046980 20 remove_watcher() i=4 2024-04-26T12:50:19.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.472+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94001088607456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e7770 con 0x557e557de880 2024-04-26T12:50:19.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.476+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94001088607456] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.476+0000 7fc4b8046980 20 remove_watcher() i=5 2024-04-26T12:50:19.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.476+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94001088603600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e9890 con 0x557e557de880 2024-04-26T12:50:19.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.476+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94001088603600] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.476+0000 7fc4b8046980 20 remove_watcher() i=6 2024-04-26T12:50:19.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.476+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94001088613328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557e557e9d40 con 0x557e557de880 2024-04-26T12:50:19.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b5b61640 1 -- 172.21.15.72:0/4210812366 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94001088613328] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8071030 con 0x557e557de880 2024-04-26T12:50:19.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 20 remove_watcher() i=7 2024-04-26T12:50:19.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557de880 msgr2=0x557e557e0c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557de880 0x557e557e0c70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e557d9ec0 msgr2=0x557e557dc380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e557d9ec0 0x557e557dc380 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc4ac0ce040 msgr2=0x7fc4ac0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc4ac0ce040 0x7fc4ac0db410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557e31a0 msgr2=0x557e557e55b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557e31a0 0x557e557e55b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc380034650 msgr2=0x7fc380036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc380034650 0x7fc380036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac000c10 tx=0x7fc4ac0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 msgr2=0x557e557ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b6362640 1 -- 172.21.15.72:0/4210812366 reap_dead start 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e557ced40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8017fd0 tx=0x7fc4a8024b40 comp rx=0 tx=0).stop 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 shutdown_connections 2024-04-26T12:50:19.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/4210812366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e556a8500 0x557e557ced40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 >> 172.21.15.72:0/4210812366 conn(0x557e557c1ba0 msgr2=0x557e557bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 shutdown_connections 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/4210812366 wait complete. 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc390034650 msgr2=0x7fc390036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc390034650 0x7fc390036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0ae040 tx=0x7fc4ac005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e557b8a60 msgr2=0x557e557b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e557b8a60 0x557e557b8e80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800e790 tx=0x7fc4a8017f40 comp rx=0 tx=0).stop 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 shutdown_connections 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc390034650 0x7fc390036b10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2308783609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e557b8a60 0x557e557b8e80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 >> 172.21.15.72:0/2308783609 conn(0x557e557ad870 msgr2=0x557e557ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 shutdown_connections 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2308783609 wait complete. 2024-04-26T12:50:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557a3f90 msgr2=0x557e557a6380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557e557a3f90 0x557e557a6380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e556ac690 msgr2=0x557e557a1610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557e556ac690 0x557e557a1610 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557a7e90 msgr2=0x557e557aa280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557e557a7e90 0x557e557aa280 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc39c034650 msgr2=0x7fc39c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc39c034650 0x7fc39c036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0ad000 tx=0x7fc4ac0a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 msgr2=0x557e5579a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 --2- 172.21.15.72:0/2273961681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557e5561c880 0x557e5579a770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8001e20 tx=0x7fc4a8000ee0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b6362640 1 -- 172.21.15.72:0/2273961681 reap_dead start 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 shutdown_connections 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 >> 172.21.15.72:0/2273961681 conn(0x557e556a2a50 msgr2=0x557e5578dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 shutdown_connections 2024-04-26T12:50:19.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.480+0000 7fc4b8046980 1 -- 172.21.15.72:0/2273961681 wait complete. 2024-04-26T12:50:19.492 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:50:19.493 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-26T12:50:19.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-26T12:50:19.493 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-26T12:50:19.572 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:19.572 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:19.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.572+0000 7fd9d9d5b980 1 Processor -- start 2024-04-26T12:50:19.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.572+0000 7fd9d9d5b980 1 -- start start 2024-04-26T12:50:19.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.572+0000 7fd9d9d5b980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562676bb42d0 0x562676bb46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.572+0000 7fd9d9d5b980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562676a61510 con 0x562676bb4bf0 2024-04-26T12:50:19.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.572+0000 7fd9d9d5b980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x562676a68430 con 0x562676bb42d0 2024-04-26T12:50:19.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d7876640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562676bb42d0 0x562676bb46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d7876640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562676bb42d0 0x562676bb46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50660/0 (socket says 172.21.15.72:50660) 2024-04-26T12:50:19.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d7876640 1 -- 172.21.15.72:0/1201392363 learned_addr learned my addr 172.21.15.72:0/1201392363 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d7075640 1 --1- 172.21.15.72:0/1201392363 >> v1:172.21.15.29:6789/0 conn(0x562676bb4bf0 0x562676bb55b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36218/0 (socket says 172.21.15.72:36218) 2024-04-26T12:50:19.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d7876640 1 -- 172.21.15.72:0/1201392363 >> v1:172.21.15.29:6789/0 conn(0x562676bb4bf0 legacy=0x562676bb55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d7876640 1 -- 172.21.15.72:0/1201392363 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562676a3dae0 con 0x562676bb42d0 2024-04-26T12:50:19.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d7876640 1 --2- 172.21.15.72:0/1201392363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676bb46b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000a5c0 tx=0x7fd9d001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4947702ebd0f8ab4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d6874640 1 -- 172.21.15.72:0/1201392363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00a6070 con 0x562676bb42d0 2024-04-26T12:50:19.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d6874640 1 -- 172.21.15.72:0/1201392363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00af070 con 0x562676bb42d0 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d6874640 1 -- 172.21.15.72:0/1201392363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00aa5c0 con 0x562676bb42d0 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/1201392363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 msgr2=0x562676bb46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/1201392363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676bb46b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000a5c0 tx=0x7fd9d001b340 comp rx=0 tx=0).stop 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/1201392363 shutdown_connections 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/1201392363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676bb46b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.576+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/1201392363 >> 172.21.15.72:0/1201392363 conn(0x562676bafba0 msgr2=0x562676bb1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.580+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/1201392363 shutdown_connections 2024-04-26T12:50:19.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.580+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/1201392363 wait complete. 2024-04-26T12:50:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 Processor -- start 2024-04-26T12:50:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 -- start start 2024-04-26T12:50:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676b2a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562676ab7a70 con 0x562676bb42d0 2024-04-26T12:50:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676b2a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676b2a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50674/0 (socket says 172.21.15.72:50674) 2024-04-26T12:50:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d7876640 1 -- 172.21.15.72:0/2037517043 learned_addr learned my addr 172.21.15.72:0/2037517043 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d7876640 1 -- 172.21.15.72:0/2037517043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562676b2ace0 con 0x562676bb42d0 2024-04-26T12:50:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d7876640 1 --2- 172.21.15.72:0/2037517043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676b2a710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00199f0 tx=0x7fd9d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1487800745af2f61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd8c5e0b640 1 -- 172.21.15.72:0/2037517043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00aaa00 con 0x562676bb42d0 2024-04-26T12:50:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd8c5e0b640 1 -- 172.21.15.72:0/2037517043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00aaba0 con 0x562676bb42d0 2024-04-26T12:50:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd8c5e0b640 1 -- 172.21.15.72:0/2037517043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00bd3f0 con 0x562676bb42d0 2024-04-26T12:50:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2037517043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 msgr2=0x562676b2a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2037517043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676b2a710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00199f0 tx=0x7fd9d0003030 comp rx=0 tx=0).stop 2024-04-26T12:50:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2037517043 shutdown_connections 2024-04-26T12:50:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2037517043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676b2a710 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2037517043 >> 172.21.15.72:0/2037517043 conn(0x562676bafba0 msgr2=0x562676c9b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2037517043 shutdown_connections 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.592+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2037517043 wait complete. 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 Processor -- start 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 -- start start 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676ca8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562676bbe320 con 0x562676bb42d0 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676ca8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676ca8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50678/0 (socket says 172.21.15.72:50678) 2024-04-26T12:50:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d7876640 1 -- 172.21.15.72:0/424843452 learned_addr learned my addr 172.21.15.72:0/424843452 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d7876640 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562676ca9480 con 0x562676bb42d0 2024-04-26T12:50:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d7876640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676ca8f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd9d001b380 tx=0x7fd9d00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd8bffff640 1 -- 172.21.15.72:0/424843452 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00bd7c0 con 0x562676bb42d0 2024-04-26T12:50:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562676ca9710 con 0x562676bb42d0 2024-04-26T12:50:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd8bffff640 1 -- 172.21.15.72:0/424843452 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00bd960 con 0x562676bb42d0 2024-04-26T12:50:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562676cac300 con 0x562676bb42d0 2024-04-26T12:50:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd8bffff640 1 -- 172.21.15.72:0/424843452 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00bdc40 con 0x562676bb42d0 2024-04-26T12:50:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd8bffff640 1 -- 172.21.15.72:0/424843452 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9d00ce030 con 0x562676bb42d0 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd8bffff640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8c0034650 0x7fd8c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd8bffff640 1 -- 172.21.15.72:0/424843452 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fd9d00cc020 con 0x562676bb42d0 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d7075640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8c0034650 0x7fd8c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676bb4bf0 0x562676caff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cb04d0 con 0x562676bb4bf0 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.596+0000 7fd9d8077640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676bb4bf0 0x562676caff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d7075640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8c0034650 0x7fd8c0036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc000f70 tx=0x7fd9cc001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d8077640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676bb4bf0 0x562676caff50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d8077640 1 -- 172.21.15.72:0/424843452 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676bb4bf0 2024-04-26T12:50:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cad520 con 0x562676bb4bf0 2024-04-26T12:50:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d8077640 1 -- 172.21.15.72:0/424843452 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676bb4bf0 2024-04-26T12:50:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676cb2800 0x562676cb4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cb52c0 con 0x562676cb2800 2024-04-26T12:50:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d7876640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676cb2800 0x562676cb4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d7876640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676cb2800 0x562676cb4bf0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d7876640 1 -- 172.21.15.72:0/424843452 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd9d00c6d20 con 0x562676cb2800 2024-04-26T12:50:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cb16a0 con 0x562676bb4bf0 2024-04-26T12:50:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d8077640 1 -- 172.21.15.72:0/424843452 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676bb4bf0 2024-04-26T12:50:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cb6700 0x562676cb8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cb9260 con 0x562676cb6700 2024-04-26T12:50:19.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d7075640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cb6700 0x562676cb8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d7075640 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cb6700 0x562676cb8af0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.600+0000 7fd9d7075640 1 -- 172.21.15.72:0/424843452 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9cc00f6a0 con 0x562676cb6700 2024-04-26T12:50:19.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 Processor -- start 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 -- start start 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cc72b0 0x562676cc76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562676abbab0 con 0x562676cc72b0 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cc72b0 0x562676cc76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cc72b0 0x562676cc76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50688/0 (socket says 172.21.15.72:50688) 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d7876640 1 -- 172.21.15.72:0/3697799943 learned_addr learned my addr 172.21.15.72:0/3697799943 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d7876640 1 -- 172.21.15.72:0/3697799943 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562676cc7c10 con 0x562676cc72b0 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d7876640 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cc72b0 0x562676cc76d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00e3520 tx=0x7fd9d00c5dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd8bd7fa640 1 -- 172.21.15.72:0/3697799943 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00ed070 con 0x562676cc72b0 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd8bd7fa640 1 -- 172.21.15.72:0/3697799943 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00cfd40 con 0x562676cc72b0 2024-04-26T12:50:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562676cc86b0 con 0x562676cc72b0 2024-04-26T12:50:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd8bd7fa640 1 -- 172.21.15.72:0/3697799943 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00c65b0 con 0x562676cc72b0 2024-04-26T12:50:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562676cc8b80 con 0x562676cc72b0 2024-04-26T12:50:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd8bd7fa640 1 -- 172.21.15.72:0/3697799943 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9d00f0070 con 0x562676cc72b0 2024-04-26T12:50:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd8bd7fa640 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8b0034650 0x7fd8b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd8bd7fa640 1 -- 172.21.15.72:0/3697799943 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fd9d00e2070 con 0x562676cc72b0 2024-04-26T12:50:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d7075640 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8b0034650 0x7fd8b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 Processor -- start 2024-04-26T12:50:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 -- start start 2024-04-26T12:50:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d7075640 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8b0034650 0x7fd8b0036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x562676cb9660 tx=0x7fd9cc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cd4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.604+0000 7fd9d9d5b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562676b28e40 con 0x562676cd4340 2024-04-26T12:50:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cd4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cd4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50704/0 (socket says 172.21.15.72:50704) 2024-04-26T12:50:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 -- 172.21.15.72:0/2311711469 learned_addr learned my addr 172.21.15.72:0/2311711469 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 -- 172.21.15.72:0/2311711469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562676cd4d30 con 0x562676cd4340 2024-04-26T12:50:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 --2- 172.21.15.72:0/2311711469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cd4760 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00cffd0 tx=0x7fd9d00c7590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3b90a2d83df807 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2311711469 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00da410 con 0x562676cd4340 2024-04-26T12:50:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2311711469 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d0104070 con 0x562676cd4340 2024-04-26T12:50:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2311711469 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00a7290 con 0x562676cd4340 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2311711469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 msgr2=0x562676cd4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2311711469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cd4760 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00cffd0 tx=0x7fd9d00c7590 comp rx=0 tx=0).stop 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2311711469 shutdown_connections 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2311711469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cd4760 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2311711469 >> 172.21.15.72:0/2311711469 conn(0x562676cd06d0 msgr2=0x562676cce730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2311711469 shutdown_connections 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2311711469 wait complete. 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 Processor -- start 2024-04-26T12:50:19.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- start start 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cdb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562676cd4d30 con 0x562676cd4340 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cdb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cdb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50720/0 (socket says 172.21.15.72:50720) 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 learned_addr learned my addr 172.21.15.72:0/2290208239 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562676cdba00 con 0x562676cd4340 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d7876640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cdb4c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00da990 tx=0x7fd9d00e6f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd8b57fa640 1 -- 172.21.15.72:0/2290208239 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d010e070 con 0x562676cd4340 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562676cdba00 con 0x562676cd4340 2024-04-26T12:50:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd8b57fa640 1 -- 172.21.15.72:0/2290208239 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00e3e50 con 0x562676cd4340 2024-04-26T12:50:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd8b57fa640 1 -- 172.21.15.72:0/2290208239 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00ac550 con 0x562676cd4340 2024-04-26T12:50:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.608+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562676cdbe70 con 0x562676cd4340 2024-04-26T12:50:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd8b57fa640 1 -- 172.21.15.72:0/2290208239 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd9d0119060 con 0x562676cd4340 2024-04-26T12:50:19.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd8b57fa640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8a0034650 0x7fd8a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd8b57fa640 1 -- 172.21.15.72:0/2290208239 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fd9d0113c40 con 0x562676cd4340 2024-04-26T12:50:19.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d7075640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8a0034650 0x7fd8a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676ce6450 0x562676ce8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676ce9060 con 0x562676ce6450 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d8077640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676ce6450 0x562676ce8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d7075640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8a0034650 0x7fd8a0036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c010 tx=0x7fd9cc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d8077640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676ce6450 0x562676ce8910 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 realm 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676ce9470 con 0x562676ce6450 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676ce9d10 con 0x562676ce6450 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676ceae10 0x562676ced200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676ced850 con 0x562676ceae10 2024-04-26T12:50:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.612+0000 7fd9d7876640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676ceae10 0x562676ced200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7876640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676ceae10 0x562676ced200 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d9d5b980 20 searching for the correct realm 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cef730 0x562676cf1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cf2200 con 0x562676cef730 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7075640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cef730 0x562676cf1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7075640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cef730 0x562676cf1b80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7075640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd9cc01fbe0 0x7fd9cc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cf2200 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd9cc01fbe0 0x7fd9cc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd9cc01fbe0 0x7fd9cc03a3c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.616+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.620+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.624+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676cef730 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ceae10 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x562676ce6450 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562676cea0b0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:19.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cee0a0 con 0x562676ce6450 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cee0a0 con 0x562676ce6450 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cee0a0 con 0x562676cef730 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 zone default found 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 4 Realm: () 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 zonegroup default 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.628+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676ceeab0 con 0x562676ceae10 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cf4510 con 0x562676cef730 2024-04-26T12:50:19.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cf48b0 con 0x562676cef730 2024-04-26T12:50:19.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 20 started sync module instance, tier type = 2024-04-26T12:50:19.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:19.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf3950 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94723202039104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf3950 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf5140 con 0x562676ce6450 2024-04-26T12:50:19.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94723202039104] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94723202042960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf3950 con 0x562676ce6450 2024-04-26T12:50:19.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.632+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf5b50 con 0x562676cef730 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.636+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94723202042960] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.636+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.636+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94723202036896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf38c0 con 0x562676cef730 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.636+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf68b0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.636+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.636+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94723202048928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf7150 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.636+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf7b50 con 0x562676ce6450 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94723202036896] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94723202048928] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94723202047728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf6c20 con 0x562676ce6450 2024-04-26T12:50:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf83f0 con 0x562676ceae10 2024-04-26T12:50:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94723202047728] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94723202056000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf6c20 con 0x562676ceae10 2024-04-26T12:50:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.640+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf8c40 con 0x562676ceae10 2024-04-26T12:50:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.644+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94723202056000] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.644+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.644+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94723202053728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf9490 con 0x562676ceae10 2024-04-26T12:50:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.644+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf9e50 con 0x562676ceae10 2024-04-26T12:50:19.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94723202063024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cfa560 con 0x562676ceae10 2024-04-26T12:50:19.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94723202053728] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=0 2024-04-26T12:50:19.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=1 2024-04-26T12:50:19.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=2 2024-04-26T12:50:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=3 2024-04-26T12:50:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=4 2024-04-26T12:50:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=5 2024-04-26T12:50:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=6 2024-04-26T12:50:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94723202063024] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 add_watcher() i=7 2024-04-26T12:50:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676cf9070 con 0x562676ce6450 2024-04-26T12:50:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94723202064368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cfae60 con 0x562676ce6450 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94723202064368] v33'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 5 note: GC not initialized 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd88cfe1640 20 reqs_thread_entry: start 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd9d9d5b980 20 Filter name: none 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.648+0000 7fd8067fc640 20 reqs_thread_entry: start 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676d20d80 con 0x562676ceae10 2024-04-26T12:50:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:50:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:50:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:19.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:19.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676d22e60 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv22 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676d24870 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv21 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.652+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676d25d40 con 0x562676ceae10 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(65 fud.buckets [call] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676d26140 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv22 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676d2bd10 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'23 uv23 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94723202250784 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562676d29200 con 0x562676ceae10 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== watch-notify(notify (1) cookie 94723202053728 notify 141733920774 ret 0) ==== 380+0+0 (crc 0 0 0) 0x562676cc86b0 con 0x562676ceae10 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd8b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94723202053728 notifier 4524 bl.length()=338 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd8b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd8b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(68 notify.6 [notify cookie 94723202250784 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.656+0000 7fd8b6ffd640 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd89c003eb0 con 0x562676ceae10 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== watch-notify(notify_complete (2) cookie 94723202250784 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562676cc7c10 con 0x562676ceae10 2024-04-26T12:50:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94723202064368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676d1eab0 con 0x562676ce6450 2024-04-26T12:50:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94723202064368] v33'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94723202039104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676d1eab0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94723202039104] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d9d5b980 20 remove_watcher() i=0 2024-04-26T12:50:19.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d9d5b980 2 removed watcher, disabling cache 2024-04-26T12:50:19.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.660+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94723202042960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676d1eab0 con 0x562676ce6450 2024-04-26T12:50:19.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.664+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94723202042960] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.664+0000 7fd9d9d5b980 20 remove_watcher() i=1 2024-04-26T12:50:19.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.664+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94723202036896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676d1eab0 con 0x562676cef730 2024-04-26T12:50:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d7075640 1 -- 172.21.15.72:0/2290208239 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94723202036896] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9cc037040 con 0x562676cef730 2024-04-26T12:50:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d9d5b980 20 remove_watcher() i=2 2024-04-26T12:50:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94723202048928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf34a0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94723202048928] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x7fd9cc01fbe0 2024-04-26T12:50:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d9d5b980 20 remove_watcher() i=3 2024-04-26T12:50:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94723202047728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf63a0 con 0x562676ce6450 2024-04-26T12:50:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94723202047728] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9c800a4d0 con 0x562676ce6450 2024-04-26T12:50:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d9d5b980 20 remove_watcher() i=4 2024-04-26T12:50:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.668+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94723202056000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf34a0 con 0x562676ceae10 2024-04-26T12:50:19.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.672+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94723202056000] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.672+0000 7fd9d9d5b980 20 remove_watcher() i=5 2024-04-26T12:50:19.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.672+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94723202053728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf5ef0 con 0x562676ceae10 2024-04-26T12:50:19.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.672+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94723202053728] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.672+0000 7fd9d9d5b980 20 remove_watcher() i=6 2024-04-26T12:50:19.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.672+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94723202063024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562676cf63a0 con 0x562676ceae10 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d7876640 1 -- 172.21.15.72:0/2290208239 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94723202063024] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00fd030 con 0x562676ceae10 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 20 remove_watcher() i=7 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676ceae10 msgr2=0x562676ced200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676ceae10 0x562676ced200 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676ce6450 msgr2=0x562676ce8910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676ce6450 0x562676ce8910 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd9cc01fbe0 msgr2=0x7fd9cc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd9cc01fbe0 0x7fd9cc03a3c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cef730 msgr2=0x562676cf1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cef730 0x562676cf1b80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8a0034650 msgr2=0x7fd8a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8a0034650 0x7fd8a0036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c010 tx=0x7fd9cc010000 comp rx=0 tx=0).stop 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 msgr2=0x562676cdb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/2290208239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cd4340 0x562676cdb4c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00da990 tx=0x7fd9d00e6f40 comp rx=0 tx=0).stop 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d8077640 1 -- 172.21.15.72:0/2290208239 reap_dead start 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 shutdown_connections 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 >> 172.21.15.72:0/2290208239 conn(0x562676cd06d0 msgr2=0x562676ccdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 shutdown_connections 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/2290208239 wait complete. 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8b0034650 msgr2=0x7fd8b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8b0034650 0x7fd8b0036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x562676cb9660 tx=0x7fd9cc00f000 comp rx=0 tx=0).stop 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cc72b0 msgr2=0x562676cc76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cc72b0 0x562676cc76d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00e3520 tx=0x7fd9d00c5dd0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 shutdown_connections 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8b0034650 0x7fd8b0036b10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/3697799943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676cc72b0 0x562676cc76d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 >> 172.21.15.72:0/3697799943 conn(0x562676cbc0c0 msgr2=0x562676cbcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 shutdown_connections 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/3697799943 wait complete. 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676cb2800 msgr2=0x562676cb4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562676cb2800 0x562676cb4bf0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676bb4bf0 msgr2=0x562676caff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562676bb4bf0 0x562676caff50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cb6700 msgr2=0x562676cb8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562676cb6700 0x562676cb8af0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8c0034650 msgr2=0x7fd8c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8c0034650 0x7fd8c0036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc000f70 tx=0x7fd9cc001380 comp rx=0 tx=0).stop 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 msgr2=0x562676ca8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 --2- 172.21.15.72:0/424843452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562676bb42d0 0x562676ca8f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd9d001b380 tx=0x7fd9d00180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d8077640 1 -- 172.21.15.72:0/424843452 reap_dead start 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 shutdown_connections 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 >> 172.21.15.72:0/424843452 conn(0x562676bafba0 msgr2=0x562676b29360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 shutdown_connections 2024-04-26T12:50:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.676+0000 7fd9d9d5b980 1 -- 172.21.15.72:0/424843452 wait complete. 2024-04-26T12:50:19.686 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1'] 2024-04-26T12:50:19.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1'] 2024-04-26T12:50:19.686 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:19.769 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:19.769 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:19.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c88cd980 1 Processor -- start 2024-04-26T12:50:19.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c88cd980 1 -- start start 2024-04-26T12:50:19.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c88cd980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564a1597d990 0x564a1597fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c88cd980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564a15824510 con 0x564a15979480 2024-04-26T12:50:19.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c88cd980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564a1582b430 con 0x564a1597d990 2024-04-26T12:50:19.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c5be7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564a1597d990 0x564a1597fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c63e8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x564a15979480 0x564a15979860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36226/0 (socket says 172.21.15.72:36226) 2024-04-26T12:50:19.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3142380322 learned_addr learned my addr 172.21.15.72:0/3142380322 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:19.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c5be7640 1 -- 172.21.15.72:0/3142380322 >> v1:172.21.15.29:6789/0 conn(0x564a15979480 legacy=0x564a15979860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c5be7640 1 -- 172.21.15.72:0/3142380322 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a15800ae0 con 0x564a1597d990 2024-04-26T12:50:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.772+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/3142380322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a1597d990 0x564a1597fd80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00a480 tx=0x7fa6bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee3f0d57222777 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c53e6640 1 -- 172.21.15.72:0/3142380322 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6bc0b0070 con 0x564a1597d990 2024-04-26T12:50:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c53e6640 1 -- 172.21.15.72:0/3142380322 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6bc0ab540 con 0x564a1597d990 2024-04-26T12:50:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c53e6640 1 -- 172.21.15.72:0/3142380322 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6bc0ab840 con 0x564a1597d990 2024-04-26T12:50:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3142380322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a1597d990 msgr2=0x564a1597fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3142380322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a1597d990 0x564a1597fd80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00a480 tx=0x7fa6bc01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3142380322 shutdown_connections 2024-04-26T12:50:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3142380322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a1597d990 0x564a1597fd80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3142380322 >> 172.21.15.72:0/3142380322 conn(0x564a158ecb60 msgr2=0x564a158ecf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3142380322 shutdown_connections 2024-04-26T12:50:19.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.776+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3142380322 wait complete. 2024-04-26T12:50:19.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c88cd980 1 Processor -- start 2024-04-26T12:50:19.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c88cd980 1 -- start start 2024-04-26T12:50:19.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c88cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c88cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a1587aa70 con 0x564a15979480 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50730/0 (socket says 172.21.15.72:50730) 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3525568945 learned_addr learned my addr 172.21.15.72:0/3525568945 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3525568945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a15a64c90 con 0x564a15979480 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/3525568945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a646c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80017b0 tx=0x7fa6b8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa6d5f113b79b6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa5b4608640 1 -- 172.21.15.72:0/3525568945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8016070 con 0x564a15979480 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa5b4608640 1 -- 172.21.15.72:0/3525568945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b8004530 con 0x564a15979480 2024-04-26T12:50:19.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.788+0000 7fa5b4608640 1 -- 172.21.15.72:0/3525568945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8004870 con 0x564a15979480 2024-04-26T12:50:19.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3525568945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 msgr2=0x564a15a646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3525568945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a646c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80017b0 tx=0x7fa6b8001c70 comp rx=0 tx=0).stop 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3525568945 shutdown_connections 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3525568945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a646c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3525568945 >> 172.21.15.72:0/3525568945 conn(0x564a158ecb60 msgr2=0x564a15a60250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3525568945 shutdown_connections 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3525568945 wait complete. 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 Processor -- start 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- start start 2024-04-26T12:50:19.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a6b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a15982db0 con 0x564a15979480 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a6b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a6b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50740/0 (socket says 172.21.15.72:50740) 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3355842218 learned_addr learned my addr 172.21.15.72:0/3355842218 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a15a6bf10 con 0x564a15979480 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a6b9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000f90 tx=0x7fa6b8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa5b2e05640 1 -- 172.21.15.72:0/3355842218 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8020070 con 0x564a15979480 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa5b2e05640 1 -- 172.21.15.72:0/3355842218 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b8011400 con 0x564a15979480 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a15a6c1a0 con 0x564a15979480 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa5b2e05640 1 -- 172.21.15.72:0/3355842218 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8016040 con 0x564a15979480 2024-04-26T12:50:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a15a6ede0 con 0x564a15979480 2024-04-26T12:50:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa5b2e05640 1 -- 172.21.15.72:0/3355842218 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa6b8023070 con 0x564a15979480 2024-04-26T12:50:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.792+0000 7fa5b2e05640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5ac034650 0x7fa5ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa5b2e05640 1 -- 172.21.15.72:0/3355842218 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fa6b8049150 con 0x564a15979480 2024-04-26T12:50:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5ac034650 0x7fa5ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a1597d990 0x564a15a72a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15a72f70 con 0x564a1597d990 2024-04-26T12:50:19.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c6be9640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a1597d990 0x564a15a72a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5ac034650 0x7fa5ac036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0ad000 tx=0x7fa6bc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c6be9640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a1597d990 0x564a15a72a30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c6be9640 1 -- 172.21.15.72:0/3355842218 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a1597d990 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15a6ffe0 con 0x564a1597d990 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c6be9640 1 -- 172.21.15.72:0/3355842218 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a1597d990 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15a75210 0x564a15a77600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15a77cf0 con 0x564a15a75210 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15a75210 0x564a15a77600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15a75210 0x564a15a77600 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3355842218 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15a75210 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15a74080 con 0x564a1597d990 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c6be9640 1 -- 172.21.15.72:0/3355842218 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a1597d990 2024-04-26T12:50:19.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15a79150 0x564a15a7b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15a7bc40 con 0x564a15a79150 2024-04-26T12:50:19.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.796+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15a79150 0x564a15a7b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15a79150 0x564a15a7b540 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c5be7640 1 -- 172.21.15.72:0/3355842218 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa6bc0b3040 con 0x564a15a79150 2024-04-26T12:50:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c88cd980 1 Processor -- start 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c88cd980 1 -- start start 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c88cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a89d20 0x564a15a8a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c88cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a1587eab0 con 0x564a15a89d20 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a89d20 0x564a15a8a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a89d20 0x564a15a8a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50756/0 (socket says 172.21.15.72:50756) 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c63e8640 1 -- 172.21.15.72:0/1694601743 learned_addr learned my addr 172.21.15.72:0/1694601743 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c63e8640 1 -- 172.21.15.72:0/1694601743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a15a8a6a0 con 0x564a15a89d20 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a89d20 0x564a15a8a160 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80475c0 tx=0x7fa6b8023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa5abfff640 1 -- 172.21.15.72:0/1694601743 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b802a040 con 0x564a15a89d20 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a15a8b060 con 0x564a15a89d20 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa5abfff640 1 -- 172.21.15.72:0/1694601743 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b80116e0 con 0x564a15a89d20 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa5abfff640 1 -- 172.21.15.72:0/1694601743 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b802a420 con 0x564a15a89d20 2024-04-26T12:50:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a15a8b530 con 0x564a15a89d20 2024-04-26T12:50:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa5abfff640 1 -- 172.21.15.72:0/1694601743 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa6b80119c0 con 0x564a15a89d20 2024-04-26T12:50:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa5abfff640 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5a0034650 0x7fa5a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa5abfff640 1 -- 172.21.15.72:0/1694601743 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fa6b8036070 con 0x564a15a89d20 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.800+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5a0034650 0x7fa5a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 Processor -- start 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- start start 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5a0034650 0x7fa5a0036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x564a15a733b0 tx=0x7fa6bc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a97100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a15a64fe0 con 0x564a15a96d00 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a97100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a97100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50764/0 (socket says 172.21.15.72:50764) 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3077999877 learned_addr learned my addr 172.21.15.72:0/3077999877 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 -- 172.21.15.72:0/3077999877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a15a976d0 con 0x564a15a96d00 2024-04-26T12:50:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/3077999877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a97100 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8023c10 tx=0x7fa6b803a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a980368b9da852 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa5a9ffb640 1 -- 172.21.15.72:0/3077999877 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b805d070 con 0x564a15a96d00 2024-04-26T12:50:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa5a9ffb640 1 -- 172.21.15.72:0/3077999877 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b804bdb0 con 0x564a15a96d00 2024-04-26T12:50:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa5a9ffb640 1 -- 172.21.15.72:0/3077999877 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8054040 con 0x564a15a96d00 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3077999877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 msgr2=0x564a15a97100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3077999877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a97100 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8023c10 tx=0x7fa6b803a590 comp rx=0 tx=0).stop 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3077999877 shutdown_connections 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3077999877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a97100 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3077999877 >> 172.21.15.72:0/3077999877 conn(0x564a15a93040 msgr2=0x564a15a910a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3077999877 shutdown_connections 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3077999877 wait complete. 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 Processor -- start 2024-04-26T12:50:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- start start 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a9df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c88cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564a15a97d90 con 0x564a15a96d00 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a9df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a9df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50772/0 (socket says 172.21.15.72:50772) 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 learned_addr learned my addr 172.21.15.72:0/4213682387 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.804+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a15a9e4a0 con 0x564a15a96d00 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a9df60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa6b804c040 tx=0x7fa6b8039f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa597fff640 1 -- 172.21.15.72:0/4213682387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b8065020 con 0x564a15a96d00 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a15a9e4a0 con 0x564a15a96d00 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa597fff640 1 -- 172.21.15.72:0/4213682387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b8040d20 con 0x564a15a96d00 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa597fff640 1 -- 172.21.15.72:0/4213682387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6b805d040 con 0x564a15a96d00 2024-04-26T12:50:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a15a9e4a0 con 0x564a15a96d00 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa597fff640 1 -- 172.21.15.72:0/4213682387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa6b8068020 con 0x564a15a96d00 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa597fff640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa590034650 0x7fa590036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa597fff640 1 -- 172.21.15.72:0/4213682387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fa6b806bc40 con 0x564a15a96d00 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa590034650 0x7fa590036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a15aa90d0 0x564a15aab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15aabce0 con 0x564a15aa90d0 2024-04-26T12:50:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c6be9640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a15aa90d0 0x564a15aab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa590034650 0x7fa590036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc000c10 tx=0x7fa6bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c6be9640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a15aa90d0 0x564a15aab590 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a15aa90d0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 realm 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15aac0f0 con 0x564a15aa90d0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a15aa90d0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15aac990 con 0x564a15aa90d0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a15aa90d0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a15aa90d0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.808+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15aada90 0x564a15aafe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab04d0 con 0x564a15aada90 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15aada90 0x564a15aafe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c63e8640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15aada90 0x564a15aafe80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c88cd980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c88cd980 20 searching for the correct realm 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15ab23b0 0x564a15ab4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab4ea0 con 0x564a15ab23b0 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15ab23b0 0x564a15ab4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15ab23b0 0x564a15ab4820 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c5be7640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa6bc0ab030 0x7fa6bc0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab4ea0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c6be9640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa6bc0ab030 0x7fa6bc0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c6be9640 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa6bc0ab030 0x7fa6bc0d1400 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c00083f0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.812+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c00083f0 con 0x564a15aa90d0 2024-04-26T12:50:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x7fa6bc0ab030 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x7fa6bc0ab030 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa6c0026040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.816+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x7fa6bc0ab030 2024-04-26T12:50:19.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.820+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x7fa6bc0ab030 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15ab23b0 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aada90 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x564a15aa90d0 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a15aacd30 con 0x7fa6bc0ab030 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c0026040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab0d20 con 0x564a15aa90d0 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab0d20 con 0x564a15aa90d0 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6c0026040 con 0x564a15aa90d0 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:19.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab0d20 con 0x564a15ab23b0 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 zone default found 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 4 Realm: () 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 zonegroup default 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.824+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab1680 con 0x564a15aada90 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab6d60 con 0x564a15ab23b0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab71c0 con 0x564a15ab23b0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 20 started sync module instance, tier type = 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab61a0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0026040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94876191123104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab61a0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab7cb0 con 0x564a15aa90d0 2024-04-26T12:50:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.828+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94876191123104] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94876191127488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab61a0 con 0x564a15aa90d0 2024-04-26T12:50:19.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab86c0 con 0x564a15ab23b0 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94876191127488] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94876191120624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab6110 con 0x564a15ab23b0 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab9400 con 0x7fa6bc0ab030 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94876191133456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab9ca0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.832+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15aba660 con 0x564a15aa90d0 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94876191120624] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94876191133456] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94876191138224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15aba5d0 con 0x564a15aa90d0 2024-04-26T12:50:19.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ab9bf0 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94876191138224] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94876191135552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15abaf00 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.836+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15abb750 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.840+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94876191135552] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.840+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.840+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94876191140432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15abbfa0 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.840+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15abc830 con 0x564a15aada90 2024-04-26T12:50:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94876191146816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15abd000 con 0x564a15aada90 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=0 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=1 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=2 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=3 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=4 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=5 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94876191140432] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=6 2024-04-26T12:50:19.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94876191146816] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 add_watcher() i=7 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15abbaf0 con 0x564a15aa90d0 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94876191148688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15abbaf0 con 0x564a15aa90d0 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94876191148688] v33'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa57cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 5 note: GC not initialized 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa4f77fe640 20 reqs_thread_entry: start 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.844+0000 7fa6c88cd980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:19.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 20 Filter name: none 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa4f57fa640 20 reqs_thread_entry: start 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae38a0 con 0x564a15aa90d0 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae5980 con 0x7fa6bc0ab030 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 20 rados->read ofs=0 len=0 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae7160 con 0x7fa6bc0ab030 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv21 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:19.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15aeb990 con 0x564a15aada90 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(65 fud.buckets [call] v33'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.848+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15af18b0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(66 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'24 uv24 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94876191324160 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15aebdc0 con 0x564a15aada90 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== watch-notify(notify (1) cookie 94876191135552 notify 141733920775 ret 0) ==== 794+0+0 (crc 0 0 0) 0x564a15a8b060 con 0x564a15aada90 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa5a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94876191135552 notifier 4531 bl.length()=752 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa5a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa5a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:19.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(67 notify.5 [notify cookie 94876191324160 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa5a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa5a9ffb640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa58c003eb0 con 0x564a15aada90 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== watch-notify(notify_complete (2) cookie 94876191324160 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a15a8a6a0 con 0x564a15aada90 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_sources= new_sources= 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential sources added=[] removed=[] 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_dests= new_dests= 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential dests added=[] removed=[] 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae77e0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.852+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.856+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(69 foo.buckets [call] v33'25 uv25 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.856+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae77e0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.856+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'26 uv26 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.856+0000 7fa6c88cd980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.856+0000 7fa6c88cd980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.856+0000 7fa6c88cd980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.856+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94876191324128 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae54d0 con 0x564a15aada90 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== watch-notify(notify (1) cookie 94876191140432 notify 141733920776 ret 0) ==== 356+0+0 (crc 0 0 0) 0x564a15a6ede0 con 0x564a15aada90 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa5a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94876191140432 notifier 4531 bl.length()=314 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa5a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa5a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(71 notify.6 [notify cookie 94876191324128 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa5a9ffb640 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa58c003eb0 con 0x564a15aada90 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== watch-notify(notify_complete (2) cookie 94876191324128 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564a15a6c1a0 con 0x564a15aada90 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa57cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94876191148688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x564a15aa90d0 2024-04-26T12:50:19.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94876191148688] v33'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.860+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94876191123104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.864+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94876191123104] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.864+0000 7fa6c88cd980 20 remove_watcher() i=0 2024-04-26T12:50:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.864+0000 7fa6c88cd980 2 removed watcher, disabling cache 2024-04-26T12:50:19.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.864+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94876191127488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x564a15aa90d0 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.864+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94876191127488] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.864+0000 7fa6c88cd980 20 remove_watcher() i=1 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.864+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94876191120624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x564a15ab23b0 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c5be7640 1 -- 172.21.15.72:0/4213682387 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94876191120624] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6bc0d8040 con 0x564a15ab23b0 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c88cd980 20 remove_watcher() i=2 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94876191133456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x7fa6bc0ab030 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94876191133456] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x7fa6bc0ab030 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c88cd980 20 remove_watcher() i=3 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94876191138224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x564a15aa90d0 2024-04-26T12:50:19.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94876191138224] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c0036040 con 0x564a15aa90d0 2024-04-26T12:50:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c88cd980 20 remove_watcher() i=4 2024-04-26T12:50:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.868+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94876191135552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x564a15aada90 2024-04-26T12:50:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.872+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94876191135552] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.872+0000 7fa6c88cd980 20 remove_watcher() i=5 2024-04-26T12:50:19.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.872+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94876191140432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x564a15aada90 2024-04-26T12:50:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94876191140432] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 20 remove_watcher() i=6 2024-04-26T12:50:19.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94876191146816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a15ae15d0 con 0x564a15aada90 2024-04-26T12:50:19.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c63e8640 1 -- 172.21.15.72:0/4213682387 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94876191146816] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b802c070 con 0x564a15aada90 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 20 remove_watcher() i=7 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15aada90 msgr2=0x564a15aafe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15aada90 0x564a15aafe80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a15aa90d0 msgr2=0x564a15aab590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a15aa90d0 0x564a15aab590 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa6bc0ab030 msgr2=0x7fa6bc0d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa6bc0ab030 0x7fa6bc0d1400 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15ab23b0 msgr2=0x564a15ab4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15ab23b0 0x564a15ab4820 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa590034650 msgr2=0x7fa590036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa590034650 0x7fa590036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc000c10 tx=0x7fa6bc0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c6be9640 1 -- 172.21.15.72:0/4213682387 reap_dead start 2024-04-26T12:50:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 msgr2=0x564a15a9df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a9df60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa6b804c040 tx=0x7fa6b8039f50 comp rx=0 tx=0).stop 2024-04-26T12:50:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 shutdown_connections 2024-04-26T12:50:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/4213682387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a96d00 0x564a15a9df60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 >> 172.21.15.72:0/4213682387 conn(0x564a15a93040 msgr2=0x564a15a906a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 shutdown_connections 2024-04-26T12:50:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/4213682387 wait complete. 2024-04-26T12:50:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5a0034650 msgr2=0x7fa5a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5a0034650 0x7fa5a0036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x564a15a733b0 tx=0x7fa6bc005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a89d20 msgr2=0x564a15a8a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a89d20 0x564a15a8a160 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80475c0 tx=0x7fa6b8023ac0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 shutdown_connections 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5a0034650 0x7fa5a0036b10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/1694601743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15a89d20 0x564a15a8a160 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 >> 172.21.15.72:0/1694601743 conn(0x564a15a7eae0 msgr2=0x564a15a7f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 shutdown_connections 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/1694601743 wait complete. 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15a75210 msgr2=0x564a15a77600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564a15a75210 0x564a15a77600 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a1597d990 msgr2=0x564a15a72a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564a1597d990 0x564a15a72a30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15a79150 msgr2=0x564a15a7b540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564a15a79150 0x564a15a7b540 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5ac034650 msgr2=0x7fa5ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa5ac034650 0x7fa5ac036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0ad000 tx=0x7fa6bc0a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 msgr2=0x564a15a6b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 --2- 172.21.15.72:0/3355842218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564a15979480 0x564a15a6b9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000f90 tx=0x7fa6b8001260 comp rx=0 tx=0).stop 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c6be9640 1 -- 172.21.15.72:0/3355842218 reap_dead start 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 shutdown_connections 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 >> 172.21.15.72:0/3355842218 conn(0x564a158ecb60 msgr2=0x564a15a5ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 shutdown_connections 2024-04-26T12:50:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.876+0000 7fa6c88cd980 1 -- 172.21.15.72:0/3355842218 wait complete. 2024-04-26T12:50:19.898 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T12:50:19.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T12:50:19.898 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc5a91980 1 Processor -- start 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc5a91980 1 -- start start 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc5a91980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5597f4c8c6e0 0x5597f4c8ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc5a91980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5597f4b36510 con 0x5597f4c88180 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc5a91980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5597f4b3d430 con 0x5597f4c8c6e0 2024-04-26T12:50:19.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc2dab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5597f4c8c6e0 0x5597f4c8ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc35ac640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5597f4c88180 0x5597f4c88560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36236/0 (socket says 172.21.15.72:36236) 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc35ac640 1 -- 172.21.15.72:0/1221386338 learned_addr learned my addr 172.21.15.72:0/1221386338 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc2dab640 1 -- 172.21.15.72:0/1221386338 >> v1:172.21.15.29:6789/0 conn(0x5597f4c88180 legacy=0x5597f4c88560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.976+0000 7f5bc2dab640 1 -- 172.21.15.72:0/1221386338 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f4b12ae0 con 0x5597f4c8c6e0 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/1221386338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c8c6e0 0x5597f4c8ead0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00a480 tx=0x7f5bac01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cb613ef38eb9dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc25aa640 1 -- 172.21.15.72:0/1221386338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bac0b0070 con 0x5597f4c8c6e0 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc25aa640 1 -- 172.21.15.72:0/1221386338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bac0ab540 con 0x5597f4c8c6e0 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc25aa640 1 -- 172.21.15.72:0/1221386338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bac0ab840 con 0x5597f4c8c6e0 2024-04-26T12:50:19.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc5a91980 1 -- 172.21.15.72:0/1221386338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c8c6e0 msgr2=0x5597f4c8ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/1221386338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c8c6e0 0x5597f4c8ead0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00a480 tx=0x7f5bac01b280 comp rx=0 tx=0).stop 2024-04-26T12:50:19.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc5a91980 1 -- 172.21.15.72:0/1221386338 shutdown_connections 2024-04-26T12:50:19.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/1221386338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c8c6e0 0x5597f4c8ead0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc5a91980 1 -- 172.21.15.72:0/1221386338 >> 172.21.15.72:0/1221386338 conn(0x5597f4c83a50 msgr2=0x5597f4c85e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc5a91980 1 -- 172.21.15.72:0/1221386338 shutdown_connections 2024-04-26T12:50:19.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.980+0000 7f5bc5a91980 1 -- 172.21.15.72:0/1221386338 wait complete. 2024-04-26T12:50:19.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc5a91980 1 Processor -- start 2024-04-26T12:50:19.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc5a91980 1 -- start start 2024-04-26T12:50:19.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc5a91980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc5a91980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5597f4b8ca70 con 0x5597f4c88180 2024-04-26T12:50:19.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d744e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50800/0 (socket says 172.21.15.72:50800) 2024-04-26T12:50:19.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc35ac640 1 -- 172.21.15.72:0/2394491355 learned_addr learned my addr 172.21.15.72:0/2394491355 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc35ac640 1 -- 172.21.15.72:0/2394491355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f4d74ab0 con 0x5597f4c88180 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.992+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/2394491355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d744e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0015f0 tx=0x7f5bbc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523612baef3875fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5ab160a640 1 -- 172.21.15.72:0/2394491355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc004530 con 0x5597f4c88180 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5ab160a640 1 -- 172.21.15.72:0/2394491355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0046f0 con 0x5597f4c88180 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5ab160a640 1 -- 172.21.15.72:0/2394491355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc004a90 con 0x5597f4c88180 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2394491355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 msgr2=0x5597f4d744e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/2394491355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d744e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0015f0 tx=0x7f5bbc001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2394491355 shutdown_connections 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/2394491355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d744e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2394491355 >> 172.21.15.72:0/2394491355 conn(0x5597f4c83a50 msgr2=0x5597f4d70070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2394491355 shutdown_connections 2024-04-26T12:50:19.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2394491355 wait complete. 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 Processor -- start 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- start start 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d7b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5597f4c8faf0 con 0x5597f4c88180 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d7b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d7b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50808/0 (socket says 172.21.15.72:50808) 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc35ac640 1 -- 172.21.15.72:0/3170412021 learned_addr learned my addr 172.21.15.72:0/3170412021 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:19.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc35ac640 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f4d7bc80 con 0x5597f4c88180 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d7b740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5597f4d75370 tx=0x7f5bbc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5aafe07640 1 -- 172.21.15.72:0/3170412021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc013760 con 0x5597f4c88180 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5aafe07640 1 -- 172.21.15.72:0/3170412021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc013900 con 0x5597f4c88180 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5aafe07640 1 -- 172.21.15.72:0/3170412021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc013be0 con 0x5597f4c88180 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597f4d7bf10 con 0x5597f4c88180 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:19.996+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f4d7eb50 con 0x5597f4c88180 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5aafe07640 1 -- 172.21.15.72:0/3170412021 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5bbc010070 con 0x5597f4c88180 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5aafe07640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5aa8034650 0x7f5aa8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5aafe07640 1 -- 172.21.15.72:0/3170412021 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f5bbc018070 con 0x5597f4c88180 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5aa8034650 0x7f5aa8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4c8c6e0 0x5597f4d826b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4d82d20 con 0x5597f4c8c6e0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc3dad640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4c8c6e0 0x5597f4d826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5aa8034650 0x7f5aa8036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0ad000 tx=0x7f5bac0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc3dad640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4c8c6e0 0x5597f4d826b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc3dad640 1 -- 172.21.15.72:0/3170412021 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4c8c6e0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4d7fd70 con 0x5597f4c8c6e0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc3dad640 1 -- 172.21.15.72:0/3170412021 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4c8c6e0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4d850a0 0x5597f4d87490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4d87b80 con 0x5597f4d850a0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4d850a0 0x5597f4d87490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4d850a0 0x5597f4d87490 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.000+0000 7f5bc35ac640 1 -- 172.21.15.72:0/3170412021 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5bbc01b030 con 0x5597f4d850a0 2024-04-26T12:50:20.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4d83f40 con 0x5597f4c8c6e0 2024-04-26T12:50:20.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc3dad640 1 -- 172.21.15.72:0/3170412021 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4c8c6e0 2024-04-26T12:50:20.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4d88fe0 0x5597f4d8b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4d8bb10 con 0x5597f4d88fe0 2024-04-26T12:50:20.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4d88fe0 0x5597f4d8b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4d88fe0 0x5597f4d8b3d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc2dab640 1 -- 172.21.15.72:0/3170412021 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5bac0ac8a0 con 0x5597f4d88fe0 2024-04-26T12:50:20.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 Processor -- start 2024-04-26T12:50:20.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 -- start start 2024-04-26T12:50:20.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4d99b60 0x5597f4d99f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5597f4b90ab0 con 0x5597f4d99b60 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4d99b60 0x5597f4d99f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4d99b60 0x5597f4d99f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50816/0 (socket says 172.21.15.72:50816) 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc35ac640 1 -- 172.21.15.72:0/2903173458 learned_addr learned my addr 172.21.15.72:0/2903173458 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc35ac640 1 -- 172.21.15.72:0/2903173458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f4d9a4c0 con 0x5597f4d99b60 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4d99b60 0x5597f4d99f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0483b0 tx=0x7f5bbc012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5aad602640 1 -- 172.21.15.72:0/2903173458 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc039030 con 0x5597f4d99b60 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597f4d9af60 con 0x5597f4d99b60 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5aad602640 1 -- 172.21.15.72:0/2903173458 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0413d0 con 0x5597f4d99b60 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5aad602640 1 -- 172.21.15.72:0/2903173458 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc043040 con 0x5597f4d99b60 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.004+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f4d9b430 con 0x5597f4d99b60 2024-04-26T12:50:20.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5aad602640 1 -- 172.21.15.72:0/2903173458 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5bbc041a10 con 0x5597f4d99b60 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5aad602640 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a9c034650 0x7f5a9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5aad602640 1 -- 172.21.15.72:0/2903173458 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f5bbc03d070 con 0x5597f4d99b60 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a9c034650 0x7f5a9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 Processor -- start 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- start start 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a9c034650 0x7f5a9c036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5597f4d83220 tx=0x7f5bac005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4da6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5597f4d74e00 con 0x5597f4da6970 2024-04-26T12:50:20.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4da6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4da6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50832/0 (socket says 172.21.15.72:50832) 2024-04-26T12:50:20.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 -- 172.21.15.72:0/3835575306 learned_addr learned my addr 172.21.15.72:0/3835575306 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 -- 172.21.15.72:0/3835575306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f4da7360 con 0x5597f4da6970 2024-04-26T12:50:20.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/3835575306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4da6d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc03a010 tx=0x7f5bbc005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709831896d5969fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5aa6ffd640 1 -- 172.21.15.72:0/3835575306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc066070 con 0x5597f4da6970 2024-04-26T12:50:20.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5aa6ffd640 1 -- 172.21.15.72:0/3835575306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc052dd0 con 0x5597f4da6970 2024-04-26T12:50:20.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5aa6ffd640 1 -- 172.21.15.72:0/3835575306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc059070 con 0x5597f4da6970 2024-04-26T12:50:20.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3835575306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 msgr2=0x5597f4da6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3835575306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4da6d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc03a010 tx=0x7f5bbc005440 comp rx=0 tx=0).stop 2024-04-26T12:50:20.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3835575306 shutdown_connections 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3835575306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4da6d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3835575306 >> 172.21.15.72:0/3835575306 conn(0x5597f4da2d00 msgr2=0x5597f4da0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3835575306 shutdown_connections 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3835575306 wait complete. 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 Processor -- start 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- start start 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4dadc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc5a91980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5597f4da78f0 con 0x5597f4da6970 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4dadc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4dadc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50838/0 (socket says 172.21.15.72:50838) 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.008+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 learned_addr learned my addr 172.21.15.72:0/862896957 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f4dae1c0 con 0x5597f4da6970 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4dadc80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0056b0 tx=0x7f5bbc0055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5aa57fa640 1 -- 172.21.15.72:0/862896957 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc066040 con 0x5597f4da6970 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597f4dae1c0 con 0x5597f4da6970 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5aa57fa640 1 -- 172.21.15.72:0/862896957 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc071020 con 0x5597f4da6970 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5aa57fa640 1 -- 172.21.15.72:0/862896957 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bbc05c040 con 0x5597f4da6970 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f4dae1c0 con 0x5597f4da6970 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5aa57fa640 1 -- 172.21.15.72:0/862896957 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5bbc041d00 con 0x5597f4da6970 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5aa57fa640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a8c034650 0x7f5a8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5aa57fa640 1 -- 172.21.15.72:0/862896957 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f5bbc072030 con 0x5597f4da6970 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a8c034650 0x7f5a8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4db8d80 0x5597f4dbb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbb990 con 0x5597f4db8d80 2024-04-26T12:50:20.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc3dad640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4db8d80 0x5597f4dbb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a8c034650 0x7f5a8c036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5597f4d8bf10 tx=0x7f5bac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc3dad640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4db8d80 0x5597f4dbb240 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4db8d80 2024-04-26T12:50:20.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 realm 2024-04-26T12:50:20.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbbda0 con 0x5597f4db8d80 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4db8d80 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbc670 con 0x5597f4db8d80 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4db8d80 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.012+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4db8d80 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4db8d80 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4dbd770 0x5597f4dbfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc0130 con 0x5597f4dbd770 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4dbd770 0x5597f4dbfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc35ac640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4dbd770 0x5597f4dbfb60 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 20 searching for the correct realm 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4dc2080 0x5597f4dc44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc4b80 con 0x5597f4dc2080 2024-04-26T12:50:20.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4dc2080 0x5597f4dc44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4dc2080 0x5597f4dc44b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc2dab640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5bac0cf040 0x7f5bac0dc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc4b80 con 0x7f5bac0cf040 2024-04-26T12:50:20.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc3dad640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5bac0cf040 0x7f5bac0dc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc3dad640 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5bac0cf040 0x7f5bac0dc410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb40083f0 con 0x7f5bac0cf040 2024-04-26T12:50:20.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.016+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4dbd770 2024-04-26T12:50:20.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4db8d80 2024-04-26T12:50:20.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb40083f0 con 0x5597f4db8d80 2024-04-26T12:50:20.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4db8d80 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4dbd770 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4dbd770 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x7f5bac0cf040 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x7f5bac0cf040 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4dc2080 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4db8d80 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4dbd770 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.020+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4db8d80 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x7f5bac0cf040 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5bb4026040 con 0x7f5bac0cf040 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dbca10 con 0x5597f4dc2080 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dc2080 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dbd770 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dc2080 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dc2080 2024-04-26T12:50:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4db8d80 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4db8d80 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dbd770 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dc2080 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.024+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x7f5bac0cf040 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x7f5bac0cf040 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4db8d80 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dbd770 2024-04-26T12:50:20.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dc2080 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dbd770 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x7f5bac0cf040 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x7f5bac0cf040 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dc2080 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4dbd770 2024-04-26T12:50:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x5597f4db8d80 2024-04-26T12:50:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f5bac0e9040 con 0x7f5bac0cf040 2024-04-26T12:50:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.028+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bb4026040 con 0x7f5bac0cf040 2024-04-26T12:50:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:20.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc09f0 con 0x5597f4db8d80 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc09f0 con 0x5597f4db8d80 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bb4026040 con 0x5597f4db8d80 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc09f0 con 0x5597f4dc2080 2024-04-26T12:50:20.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 zone default found 2024-04-26T12:50:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 4 Realm: () 2024-04-26T12:50:20.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:20.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 zonegroup default 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc1410 con 0x5597f4dbd770 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc6e90 con 0x5597f4dc2080 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc7230 con 0x5597f4dc2080 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 started sync module instance, tier type = 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc62d0 con 0x7f5bac0cf040 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4026040 con 0x7f5bac0cf040 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94111136507632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc62d0 con 0x7f5bac0cf040 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.032+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc7a80 con 0x5597f4db8d80 2024-04-26T12:50:20.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.036+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94111136507632] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.036+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.036+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94111136505648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc7a80 con 0x5597f4db8d80 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.036+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc8440 con 0x5597f4dc2080 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.036+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94111136505648] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94111136511440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc79f0 con 0x5597f4dc2080 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc9180 con 0x7f5bac0cf040 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94111136517264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc9a20 con 0x7f5bac0cf040 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dca420 con 0x5597f4db8d80 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94111136511440] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94111136517264] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94111136516064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc94f0 con 0x5597f4db8d80 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.040+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcacc0 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.044+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94111136516064] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.044+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.044+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94111136524304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc94f0 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.044+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcb510 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.044+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94111136524304] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94111136526432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcb930 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcc2f0 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94111136526432] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94111136527792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcc2f0 con 0x5597f4dbd770 2024-04-26T12:50:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 20 add_watcher() i=0 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 20 add_watcher() i=1 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 20 add_watcher() i=2 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 20 add_watcher() i=3 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 20 add_watcher() i=4 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 20 add_watcher() i=5 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.048+0000 7f5bc5a91980 20 add_watcher() i=6 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94111136527792] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 20 add_watcher() i=7 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcf670 con 0x5597f4db8d80 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94111136542800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcc460 con 0x5597f4db8d80 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94111136542800] v33'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dcea80 con 0x5597f4db8d80 2024-04-26T12:50:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.052+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd8900 con 0x5597f4dbd770 2024-04-26T12:50:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.056+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.056+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd8900 con 0x5597f4dc2080 2024-04-26T12:50:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.056+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.056+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd8d00 con 0x5597f4db8d80 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.060+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.060+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd9270 con 0x7f5bac0cf040 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.060+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.060+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd97e0 con 0x5597f4dc2080 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.060+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.060+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd9c90 con 0x5597f4db8d80 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.064+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.064+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd7da0 con 0x5597f4dbd770 2024-04-26T12:50:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.064+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.064+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd7da0 con 0x7f5bac0cf040 2024-04-26T12:50:20.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.068+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.068+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd7da0 con 0x5597f4dc2080 2024-04-26T12:50:20.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.068+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.068+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd7e90 con 0x7f5bac0cf040 2024-04-26T12:50:20.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.068+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.068+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd7e90 con 0x5597f4dbd770 2024-04-26T12:50:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.072+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.072+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd8000 con 0x7f5bac0cf040 2024-04-26T12:50:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.072+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.072+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd8000 con 0x5597f4dbd770 2024-04-26T12:50:20.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.076+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.076+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dd8000 con 0x5597f4db8d80 2024-04-26T12:50:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.076+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'123 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.076+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.076+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.076+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x7f5bac0cf040 2024-04-26T12:50:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.080+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.080+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.080+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.080+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4db8d80 2024-04-26T12:50:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.080+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.080+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4db8d80 2024-04-26T12:50:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.084+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.084+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.084+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.084+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x7f5bac0cf040 2024-04-26T12:50:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.088+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.088+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.088+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.088+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.088+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.088+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.092+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.092+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.092+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.092+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dbd770 2024-04-26T12:50:20.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.096+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.096+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.096+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.096+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dbd770 2024-04-26T12:50:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.100+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.100+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dc2080 2024-04-26T12:50:20.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.100+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.100+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x5597f4dbd770 2024-04-26T12:50:20.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.104+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.104+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dda620 con 0x7f5bac0cf040 2024-04-26T12:50:20.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5a78fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:20.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:20.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 20 Filter name: none 2024-04-26T12:50:20.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f59f27fc640 20 reqs_thread_entry: start 2024-04-26T12:50:20.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:50:20.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df5650 con 0x5597f4dbd770 2024-04-26T12:50:20.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:50:20.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:50:20.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:50:20.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:20.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df7f40 con 0x5597f4dbd770 2024-04-26T12:50:20.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T12:50:20.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.108+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df5f20 con 0x5597f4dbd770 2024-04-26T12:50:20.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc5a91980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:50:20.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94111136704944 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df8550 con 0x5597f4dc2080 2024-04-26T12:50:20.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== watch-notify(notify (1) cookie 94111136511440 notify 141733920771 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5597f4dd7720 con 0x5597f4dc2080 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5aa6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94111136511440 notifier 4538 bl.length()=170 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(97 notify.2 [notify cookie 94111136704944 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5aa6ffd640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5a88003d70 con 0x5597f4dc2080 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== watch-notify(notify_complete (2) cookie 94111136704944 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5597f4dd9440 con 0x5597f4dc2080 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc5a91980 10 removing email index: 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc5a91980 10 removing user buckets index 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.112+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x5597f4dbd770 2024-04-26T12:50:20.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(99 fud.buckets [delete] v33'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc5a91980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94111136711888 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df7990 con 0x5597f4dbd770 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== watch-notify(notify (1) cookie 94111136526432 notify 141733920777 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5597f4dd8500 con 0x5597f4dbd770 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5aa6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94111136526432 notifier 4538 bl.length()=160 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(100 notify.6 [notify cookie 94111136711888 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5aa6ffd640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5a88003d70 con 0x5597f4dbd770 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== watch-notify(notify_complete (2) cookie 94111136711888 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5bbc096040 con 0x5597f4dbd770 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc5a91980 10 removing user index: fud 2024-04-26T12:50:20.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.116+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x5597f4dbd770 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(102 fud [call,call,delete] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc5a91980 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc5a91980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94111136711888 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df6980 con 0x5597f4dbd770 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== watch-notify(notify (1) cookie 94111136524304 notify 141733920778 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f5bbc096040 con 0x5597f4dbd770 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(103 notify.5 [notify cookie 94111136711888 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5aa67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94111136524304 notifier 4538 bl.length()=152 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5aa67fc640 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f59f80032d0 con 0x5597f4dbd770 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== watch-notify(notify_complete (2) cookie 94111136711888 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5bbc04c070 con 0x5597f4dbd770 2024-04-26T12:50:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.120+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94111136542800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x5597f4db8d80 2024-04-26T12:50:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94111136542800] v33'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94111136507632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x7f5bac0cf040 2024-04-26T12:50:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94111136507632] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5bc5a91980 20 remove_watcher() i=0 2024-04-26T12:50:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5bc5a91980 2 removed watcher, disabling cache 2024-04-26T12:50:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.124+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94111136505648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x5597f4db8d80 2024-04-26T12:50:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.128+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94111136505648] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.128+0000 7f5bc5a91980 20 remove_watcher() i=1 2024-04-26T12:50:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.128+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94111136511440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x5597f4dc2080 2024-04-26T12:50:20.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.128+0000 7f5bc2dab640 1 -- 172.21.15.72:0/862896957 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94111136511440] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac0da070 con 0x5597f4dc2080 2024-04-26T12:50:20.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.128+0000 7f5bc5a91980 20 remove_watcher() i=2 2024-04-26T12:50:20.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.128+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94111136517264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc75d0 con 0x7f5bac0cf040 2024-04-26T12:50:20.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.132+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94111136517264] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x7f5bac0cf040 2024-04-26T12:50:20.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.132+0000 7f5bc5a91980 20 remove_watcher() i=3 2024-04-26T12:50:20.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.132+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94111136516064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x5597f4db8d80 2024-04-26T12:50:20.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.132+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94111136516064] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bb4036040 con 0x5597f4db8d80 2024-04-26T12:50:20.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.132+0000 7f5bc5a91980 20 remove_watcher() i=4 2024-04-26T12:50:20.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.132+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94111136524304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc75d0 con 0x5597f4dbd770 2024-04-26T12:50:20.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.136+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94111136524304] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.136+0000 7f5bc5a91980 20 remove_watcher() i=5 2024-04-26T12:50:20.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.136+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94111136526432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4dc87e0 con 0x5597f4dbd770 2024-04-26T12:50:20.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.136+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94111136526432] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.136+0000 7f5bc5a91980 20 remove_watcher() i=6 2024-04-26T12:50:20.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.136+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94111136527792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5597f4df84d0 con 0x5597f4dbd770 2024-04-26T12:50:20.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc35ac640 1 -- 172.21.15.72:0/862896957 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94111136527792] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bbc069070 con 0x5597f4dbd770 2024-04-26T12:50:20.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 20 remove_watcher() i=7 2024-04-26T12:50:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4dbd770 msgr2=0x5597f4dbfb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4dbd770 0x5597f4dbfb60 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4db8d80 msgr2=0x5597f4dbb240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4db8d80 0x5597f4dbb240 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5bac0cf040 msgr2=0x7f5bac0dc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5bac0cf040 0x7f5bac0dc410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4dc2080 msgr2=0x5597f4dc44b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4dc2080 0x5597f4dc44b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a8c034650 msgr2=0x7f5a8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a8c034650 0x7f5a8c036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5597f4d8bf10 tx=0x7f5bac0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc3dad640 1 -- 172.21.15.72:0/862896957 reap_dead start 2024-04-26T12:50:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 msgr2=0x5597f4dadc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4dadc80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0056b0 tx=0x7f5bbc0055e0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 shutdown_connections 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/862896957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4da6970 0x5597f4dadc80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 >> 172.21.15.72:0/862896957 conn(0x5597f4da2d00 msgr2=0x5597f4da0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 shutdown_connections 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/862896957 wait complete. 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a9c034650 msgr2=0x7f5a9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a9c034650 0x7f5a9c036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5597f4d83220 tx=0x7f5bac005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4d99b60 msgr2=0x5597f4d99f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4d99b60 0x5597f4d99f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0483b0 tx=0x7f5bbc012ef0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 shutdown_connections 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a9c034650 0x7f5a9c036b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/2903173458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4d99b60 0x5597f4d99f80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 >> 172.21.15.72:0/2903173458 conn(0x5597f4d8e970 msgr2=0x5597f4d8f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 shutdown_connections 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/2903173458 wait complete. 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4d850a0 msgr2=0x5597f4d87490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5597f4d850a0 0x5597f4d87490 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4c8c6e0 msgr2=0x5597f4d826b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5597f4c8c6e0 0x5597f4d826b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4d88fe0 msgr2=0x5597f4d8b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5597f4d88fe0 0x5597f4d8b3d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.140+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5aa8034650 msgr2=0x7f5aa8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5aa8034650 0x7f5aa8036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0ad000 tx=0x7f5bac0a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 msgr2=0x5597f4d7b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc5a91980 1 --2- 172.21.15.72:0/3170412021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5597f4c88180 0x5597f4d7b740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5597f4d75370 tx=0x7f5bbc000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc3dad640 1 -- 172.21.15.72:0/3170412021 reap_dead start 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 shutdown_connections 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 >> 172.21.15.72:0/3170412021 conn(0x5597f4c83a50 msgr2=0x5597f4d6eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 shutdown_connections 2024-04-26T12:50:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.144+0000 7f5bc5a91980 1 -- 172.21.15.72:0/3170412021 wait complete. 2024-04-26T12:50:20.154 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:50:20.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:50:20.154 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-26T12:50:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:20.252 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89e718980 1 Processor -- start 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89e718980 1 -- start start 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89e718980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fd907c1480 0x55fd907c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89e718980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd9066c510 con 0x55fd907c1da0 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89e718980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55fd90673430 con 0x55fd907c1480 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89c233640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fd907c1480 0x55fd907c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89ba32640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55fd907c1da0 0x55fd907c2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36240/0 (socket says 172.21.15.72:36240) 2024-04-26T12:50:20.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89ba32640 1 -- 172.21.15.72:0/3429302357 learned_addr learned my addr 172.21.15.72:0/3429302357 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89b231640 1 -- 172.21.15.72:0/3429302357 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368481792 0 0) 0x55fd9066c510 con 0x55fd907c1da0 2024-04-26T12:50:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.252+0000 7fa89b231640 1 -- 172.21.15.72:0/3429302357 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa884001e20 con 0x55fd907c1da0 2024-04-26T12:50:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89c233640 1 -- 172.21.15.72:0/3429302357 >> v1:172.21.15.29:6789/0 conn(0x55fd907c1da0 legacy=0x55fd907c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89c233640 1 -- 172.21.15.72:0/3429302357 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd90648ae0 con 0x55fd907c1480 2024-04-26T12:50:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89c233640 1 --2- 172.21.15.72:0/3429302357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd907c1860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a420 tx=0x7fa88c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10266a8a53e956 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89b231640 1 -- 172.21.15.72:0/3429302357 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0af070 con 0x55fd907c1480 2024-04-26T12:50:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89b231640 1 -- 172.21.15.72:0/3429302357 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0aa530 con 0x55fd907c1480 2024-04-26T12:50:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89b231640 1 -- 172.21.15.72:0/3429302357 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0aa850 con 0x55fd907c1480 2024-04-26T12:50:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89e718980 1 -- 172.21.15.72:0/3429302357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 msgr2=0x55fd907c1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89e718980 1 --2- 172.21.15.72:0/3429302357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd907c1860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a420 tx=0x7fa88c01afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89e718980 1 -- 172.21.15.72:0/3429302357 shutdown_connections 2024-04-26T12:50:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89e718980 1 --2- 172.21.15.72:0/3429302357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd907c1860 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89e718980 1 -- 172.21.15.72:0/3429302357 >> 172.21.15.72:0/3429302357 conn(0x55fd90734b60 msgr2=0x55fd90734f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89e718980 1 -- 172.21.15.72:0/3429302357 shutdown_connections 2024-04-26T12:50:20.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.256+0000 7fa89e718980 1 -- 172.21.15.72:0/3429302357 wait complete. 2024-04-26T12:50:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.272+0000 7fa89e718980 1 Processor -- start 2024-04-26T12:50:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.272+0000 7fa89e718980 1 -- start start 2024-04-26T12:50:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.272+0000 7fa89e718980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908acc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.272+0000 7fa89e718980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fd906c2a70 con 0x55fd907c1480 2024-04-26T12:50:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.272+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.272+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50850/0 (socket says 172.21.15.72:50850) 2024-04-26T12:50:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.272+0000 7fa89c233640 1 -- 172.21.15.72:0/2358701334 learned_addr learned my addr 172.21.15.72:0/2358701334 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89c233640 1 -- 172.21.15.72:0/2358701334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd908ad1d0 con 0x55fd907c1480 2024-04-26T12:50:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89c233640 1 --2- 172.21.15.72:0/2358701334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908acc00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a420 tx=0x7fa88c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5436fb057a59bd12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa78a60c640 1 -- 172.21.15.72:0/2358701334 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0af050 con 0x55fd907c1480 2024-04-26T12:50:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa78a60c640 1 -- 172.21.15.72:0/2358701334 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0b0040 con 0x55fd907c1480 2024-04-26T12:50:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa78a60c640 1 -- 172.21.15.72:0/2358701334 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0aab00 con 0x55fd907c1480 2024-04-26T12:50:20.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- 172.21.15.72:0/2358701334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 msgr2=0x55fd908acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 --2- 172.21.15.72:0/2358701334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908acc00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a420 tx=0x7fa88c0033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- 172.21.15.72:0/2358701334 shutdown_connections 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 --2- 172.21.15.72:0/2358701334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908acc00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- 172.21.15.72:0/2358701334 >> 172.21.15.72:0/2358701334 conn(0x55fd90734b60 msgr2=0x55fd908a8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- 172.21.15.72:0/2358701334 shutdown_connections 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- 172.21.15.72:0/2358701334 wait complete. 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 Processor -- start 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- start start 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fd907cb4d0 con 0x55fd907c1480 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50858/0 (socket says 172.21.15.72:50858) 2024-04-26T12:50:20.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89c233640 1 -- 172.21.15.72:0/1297229786 learned_addr learned my addr 172.21.15.72:0/1297229786 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89c233640 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd908b41b0 con 0x55fd907c1480 2024-04-26T12:50:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89c233640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908b3c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a420 tx=0x7fa88c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa788e09640 1 -- 172.21.15.72:0/1297229786 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0c5070 con 0x55fd907c1480 2024-04-26T12:50:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa788e09640 1 -- 172.21.15.72:0/1297229786 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0b6ba0 con 0x55fd907c1480 2024-04-26T12:50:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd908b4440 con 0x55fd907c1480 2024-04-26T12:50:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa788e09640 1 -- 172.21.15.72:0/1297229786 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0c1480 con 0x55fd907c1480 2024-04-26T12:50:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.276+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd908b70c0 con 0x55fd907c1480 2024-04-26T12:50:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa788e09640 1 -- 172.21.15.72:0/1297229786 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa88c0c1620 con 0x55fd907c1480 2024-04-26T12:50:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa788e09640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa7840346a0 0x7fa784036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa788e09640 1 -- 172.21.15.72:0/1297229786 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fa88c0bb070 con 0x55fd907c1480 2024-04-26T12:50:20.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89ba32640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa7840346a0 0x7fa784036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd907c1da0 0x55fd908bad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908bb250 con 0x55fd907c1da0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89ca34640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd907c1da0 0x55fd908bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89ba32640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa7840346a0 0x7fa784036b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa890001dc0 tx=0x7fa890001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89ca34640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd907c1da0 0x55fd908bad10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89ca34640 1 -- 172.21.15.72:0/1297229786 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd907c1da0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908b82e0 con 0x55fd907c1da0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89ca34640 1 -- 172.21.15.72:0/1297229786 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd907c1da0 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908bd560 0x55fd908bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908c0040 con 0x55fd908bd560 2024-04-26T12:50:20.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.280+0000 7fa89c233640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908bd560 0x55fd908bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89c233640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908bd560 0x55fd908bf950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89c233640 1 -- 172.21.15.72:0/1297229786 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa88c0d0070 con 0x55fd908bd560 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908bc400 con 0x55fd907c1da0 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89ca34640 1 -- 172.21.15.72:0/1297229786 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd907c1da0 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908c14a0 0x55fd908c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908c3fd0 con 0x55fd908c14a0 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89ba32640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908c14a0 0x55fd908c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89ba32640 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908c14a0 0x55fd908c3890 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89ba32640 1 -- 172.21.15.72:0/1297229786 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908c14a0 2024-04-26T12:50:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89e718980 1 Processor -- start 2024-04-26T12:50:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89e718980 1 -- start start 2024-04-26T12:50:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89e718980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908d2060 0x55fd908d2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89e718980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fd906c6ab0 con 0x55fd908d2060 2024-04-26T12:50:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908d2060 0x55fd908d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908d2060 0x55fd908d2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50866/0 (socket says 172.21.15.72:50866) 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89c233640 1 -- 172.21.15.72:0/2361943103 learned_addr learned my addr 172.21.15.72:0/2361943103 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89c233640 1 -- 172.21.15.72:0/2361943103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd908d29c0 con 0x55fd908d2060 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.284+0000 7fa89c233640 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908d2060 0x55fd908d2480 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0d1890 tx=0x7fa88c0a9730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa781ffb640 1 -- 172.21.15.72:0/2361943103 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0e1020 con 0x55fd908d2060 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd908d3460 con 0x55fd908d2060 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa781ffb640 1 -- 172.21.15.72:0/2361943103 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0bf370 con 0x55fd908d2060 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa781ffb640 1 -- 172.21.15.72:0/2361943103 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0bf6b0 con 0x55fd908d2060 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd908d3930 con 0x55fd908d2060 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa781ffb640 1 -- 172.21.15.72:0/2361943103 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa88c0c0720 con 0x55fd908d2060 2024-04-26T12:50:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa781ffb640 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa774034650 0x7fa774036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa781ffb640 1 -- 172.21.15.72:0/2361943103 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fa88c0eda40 con 0x55fd908d2060 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89ba32640 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa774034650 0x7fa774036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89e718980 1 Processor -- start 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89e718980 1 -- start start 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89ba32640 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa774034650 0x7fa774036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa89000bfe0 tx=0x7fa89000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89e718980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908df290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89e718980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fd908ad460 con 0x55fd908dee70 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908df290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908df290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50874/0 (socket says 172.21.15.72:50874) 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89c233640 1 -- 172.21.15.72:0/2178776178 learned_addr learned my addr 172.21.15.72:0/2178776178 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89c233640 1 -- 172.21.15.72:0/2178776178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd908df860 con 0x55fd908dee70 2024-04-26T12:50:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.288+0000 7fa89c233640 1 --2- 172.21.15.72:0/2178776178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908df290 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0d1fd0 tx=0x7fa88c0b8f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7731e24efb5ebd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa77b7fe640 1 -- 172.21.15.72:0/2178776178 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0fa020 con 0x55fd908dee70 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa77b7fe640 1 -- 172.21.15.72:0/2178776178 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0e39a0 con 0x55fd908dee70 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa77b7fe640 1 -- 172.21.15.72:0/2178776178 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0e3480 con 0x55fd908dee70 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- 172.21.15.72:0/2178776178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 msgr2=0x55fd908df290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 --2- 172.21.15.72:0/2178776178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908df290 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0d1fd0 tx=0x7fa88c0b8f80 comp rx=0 tx=0).stop 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- 172.21.15.72:0/2178776178 shutdown_connections 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 --2- 172.21.15.72:0/2178776178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908df290 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- 172.21.15.72:0/2178776178 >> 172.21.15.72:0/2178776178 conn(0x55fd908db200 msgr2=0x55fd908d9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- 172.21.15.72:0/2178776178 shutdown_connections 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- 172.21.15.72:0/2178776178 wait complete. 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 Processor -- start 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- start start 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fd908dff50 con 0x55fd908dee70 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89c233640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908e6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50886/0 (socket says 172.21.15.72:50886) 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 learned_addr learned my addr 172.21.15.72:0/3654452603 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd908e6690 con 0x55fd908dee70 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89c233640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908e6150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0c9df0 tx=0x7fa88c0ac160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa779ffb640 1 -- 172.21.15.72:0/3654452603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c10e070 con 0x55fd908dee70 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd908e6690 con 0x55fd908dee70 2024-04-26T12:50:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa779ffb640 1 -- 172.21.15.72:0/3654452603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0c0a10 con 0x55fd908dee70 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa779ffb640 1 -- 172.21.15.72:0/3654452603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0c0cf0 con 0x55fd908dee70 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.292+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd908e6690 con 0x55fd908dee70 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa779ffb640 1 -- 172.21.15.72:0/3654452603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa88c111070 con 0x55fd908dee70 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa779ffb640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa76c034650 0x7fa76c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa779ffb640 1 -- 172.21.15.72:0/3654452603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fa88c114c80 con 0x55fd908dee70 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ba32640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa76c034650 0x7fa76c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd908f10d0 0x55fd908f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f3ce0 con 0x55fd908f10d0 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ca34640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd908f10d0 0x55fd908f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ba32640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa76c034650 0x7fa76c036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55fd908bb6e0 tx=0x7fa890010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ca34640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd908f10d0 0x55fd908f3590 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd908f10d0 2024-04-26T12:50:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 realm 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f40f0 con 0x55fd908f10d0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd908f10d0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f49c0 con 0x55fd908f10d0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd908f10d0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd908f10d0 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908f5ac0 0x55fd908f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f8480 con 0x55fd908f5ac0 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89c233640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908f5ac0 0x55fd908f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.296+0000 7fa89c233640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908f5ac0 0x55fd908f7eb0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89e718980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89e718980 20 searching for the correct realm 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908fa3d0 0x55fd908fc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908fced0 con 0x55fd908fa3d0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ba32640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908fa3d0 0x55fd908fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ba32640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908fa3d0 0x55fd908fc800 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ba32640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa890037040 0x7fa890036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908fced0 con 0x7fa890037040 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa890037040 0x7fa890036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa890037040 0x7fa890036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8940083f0 con 0x7fa890037040 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8940083f0 con 0x55fd908f10d0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.300+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x7fa890037040 2024-04-26T12:50:20.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x7fa890037040 2024-04-26T12:50:20.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x7fa890037040 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa894026040 con 0x7fa890037040 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.304+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x7fa890037040 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x7fa890037040 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.308+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x7fa890037040 2024-04-26T12:50:20.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x7fa890037040 2024-04-26T12:50:20.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908fa3d0 2024-04-26T12:50:20.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x55fd908f10d0 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f4d60 con 0x7fa890037040 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa894026040 con 0x7fa890037040 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f8d40 con 0x55fd908f10d0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.312+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f8d40 con 0x55fd908f10d0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa894026040 con 0x55fd908f10d0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f8d40 con 0x55fd908fa3d0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 zone default found 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 4 Realm: () 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 zonegroup default 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908f96c0 con 0x55fd908f5ac0 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908fed90 con 0x55fd908fa3d0 2024-04-26T12:50:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd908ff1f0 con 0x55fd908fa3d0 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 started sync module instance, tier type = 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd908fe1d0 con 0x7fa890037040 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894026040 con 0x7fa890037040 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94547540436720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd908fe1d0 con 0x7fa890037040 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.316+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd908ffc90 con 0x55fd908f10d0 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.320+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94547540436720] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x7fa890037040 2024-04-26T12:50:20.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.320+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.320+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94547540440992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd908fe1d0 con 0x55fd908f10d0 2024-04-26T12:50:20.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.320+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd909006a0 con 0x55fd908fa3d0 2024-04-26T12:50:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94547540440992] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94547540434208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd908fe140 con 0x55fd908fa3d0 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90901450 con 0x7fa890037040 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x7fa890037040 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94547540447040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90901cf0 con 0x7fa890037040 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd909026b0 con 0x55fd908f10d0 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94547540434208] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94547540447040] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x7fa890037040 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94547540451840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90901c50 con 0x55fd908f10d0 2024-04-26T12:50:20.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.324+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90902620 con 0x55fd908f5ac0 2024-04-26T12:50:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94547540454096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd909033a0 con 0x55fd908f5ac0 2024-04-26T12:50:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90903d60 con 0x55fd908f5ac0 2024-04-26T12:50:20.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94547540451840] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94547540454096] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94547540457648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90904100 con 0x55fd908f5ac0 2024-04-26T12:50:20.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.328+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90904950 con 0x55fd908f5ac0 2024-04-26T12:50:20.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94547540460256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90904d10 con 0x55fd908f5ac0 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=0 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=1 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=2 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=3 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=4 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=5 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94547540457648] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=6 2024-04-26T12:50:20.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94547540460256] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 20 add_watcher() i=7 2024-04-26T12:50:20.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:20.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.332+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd909017a0 con 0x55fd908f10d0 2024-04-26T12:50:20.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94547540449184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90905220 con 0x55fd908f10d0 2024-04-26T12:50:20.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94547540449184] v33'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa7527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:20.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:20.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 5 note: GC not initialized 2024-04-26T12:50:20.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa7517e2640 20 reqs_thread_entry: start 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 Filter name: none 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa6c2ffd640 20 reqs_thread_entry: start 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd9092b810 con 0x55fd908f5ac0 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:50:20.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929da0 con 0x55fd908f5ac0 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:50:20.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.336+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd9092e510 con 0x55fd908f5ac0 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v33'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89e718980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89e718980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89e718980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94547540631216 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd9092efe0 con 0x7fa890037040 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== watch-notify(notify (1) cookie 94547540447040 notify 141733920786 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fa894010040 con 0x7fa890037040 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa77b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 94547540447040 notifier 4545 bl.length()=610 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa77b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa77b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 notify.3 [notify cookie 94547540631216 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa894036040 con 0x7fa890037040 2024-04-26T12:50:20.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa77b7fe640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa760003eb0 con 0x7fa890037040 2024-04-26T12:50:20.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x7fa890037040 2024-04-26T12:50:20.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== watch-notify(notify_complete (2) cookie 94547540631216 notify 141733920786 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa89400a740 con 0x7fa890037040 2024-04-26T12:50:20.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.340+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd9092e4f0 con 0x55fd908f5ac0 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v33'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89e718980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89e718980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89e718980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94547540626752 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fd9092e4f0 con 0x55fd908fa3d0 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== watch-notify(notify (1) cookie 94547540434208 notify 141733920772 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7fa890041040 con 0x55fd908fa3d0 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa77b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94547540434208 notifier 4545 bl.length()=192 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 notify.2 [notify cookie 94547540626752 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa77b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa77b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:50:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa77b7fe640 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa760003eb0 con 0x55fd908fa3d0 2024-04-26T12:50:20.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== watch-notify(notify_complete (2) cookie 94547540626752 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa884001e20 con 0x55fd908fa3d0 2024-04-26T12:50:20.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.344 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:50:20.340947Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:20.340938Z","tags":[],"group_ids":[]} 2024-04-26T12:50:20.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa7527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.344+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94547540449184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x55fd908f10d0 2024-04-26T12:50:20.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94547540449184] v33'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94547540436720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x7fa890037040 2024-04-26T12:50:20.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94547540436720] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x7fa890037040 2024-04-26T12:50:20.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89e718980 20 remove_watcher() i=0 2024-04-26T12:50:20.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89e718980 2 removed watcher, disabling cache 2024-04-26T12:50:20.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94547540440992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x55fd908f10d0 2024-04-26T12:50:20.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94547540440992] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89e718980 20 remove_watcher() i=1 2024-04-26T12:50:20.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.348+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94547540434208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x55fd908fa3d0 2024-04-26T12:50:20.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.352+0000 7fa89ba32640 1 -- 172.21.15.72:0/3654452603 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94547540434208] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89000e6e0 con 0x55fd908fa3d0 2024-04-26T12:50:20.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.352+0000 7fa89e718980 20 remove_watcher() i=2 2024-04-26T12:50:20.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.352+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94547540447040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x7fa890037040 2024-04-26T12:50:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.352+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94547540447040] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x7fa890037040 2024-04-26T12:50:20.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.352+0000 7fa89e718980 20 remove_watcher() i=3 2024-04-26T12:50:20.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.352+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94547540451840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x55fd908f10d0 2024-04-26T12:50:20.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.356+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94547540451840] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa894036040 con 0x55fd908f10d0 2024-04-26T12:50:20.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.356+0000 7fa89e718980 20 remove_watcher() i=4 2024-04-26T12:50:20.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.356+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94547540454096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x55fd908f5ac0 2024-04-26T12:50:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.356+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94547540454096] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.356+0000 7fa89e718980 20 remove_watcher() i=5 2024-04-26T12:50:20.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.356+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94547540457648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x55fd908f5ac0 2024-04-26T12:50:20.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94547540457648] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 20 remove_watcher() i=6 2024-04-26T12:50:20.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94547540460256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fd90929310 con 0x55fd908f5ac0 2024-04-26T12:50:20.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89c233640 1 -- 172.21.15.72:0/3654452603 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94547540460256] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c110030 con 0x55fd908f5ac0 2024-04-26T12:50:20.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 20 remove_watcher() i=7 2024-04-26T12:50:20.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908f5ac0 msgr2=0x55fd908f7eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908f5ac0 0x55fd908f7eb0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd908f10d0 msgr2=0x55fd908f3590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd908f10d0 0x55fd908f3590 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa890037040 msgr2=0x7fa890036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa890037040 0x7fa890036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908fa3d0 msgr2=0x55fd908fc800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908fa3d0 0x55fd908fc800 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa76c034650 msgr2=0x7fa76c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa76c034650 0x7fa76c036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55fd908bb6e0 tx=0x7fa890010000 comp rx=0 tx=0).stop 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 msgr2=0x55fd908e6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/3654452603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908dee70 0x55fd908e6150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0c9df0 tx=0x7fa88c0ac160 comp rx=0 tx=0).stop 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 reap_dead start 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89ca34640 1 -- 172.21.15.72:0/3654452603 reap_dead start 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 shutdown_connections 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 >> 172.21.15.72:0/3654452603 conn(0x55fd908db200 msgr2=0x55fd908d8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 shutdown_connections 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/3654452603 wait complete. 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa774034650 msgr2=0x7fa774036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa774034650 0x7fa774036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa89000bfe0 tx=0x7fa89000f000 comp rx=0 tx=0).stop 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908d2060 msgr2=0x55fd908d2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908d2060 0x55fd908d2480 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0d1890 tx=0x7fa88c0a9730 comp rx=0 tx=0).stop 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 shutdown_connections 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa774034650 0x7fa774036b10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 --2- 172.21.15.72:0/2361943103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd908d2060 0x55fd908d2480 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 >> 172.21.15.72:0/2361943103 conn(0x55fd908c6e70 msgr2=0x55fd908c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 shutdown_connections 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.360+0000 7fa89e718980 1 -- 172.21.15.72:0/2361943103 wait complete. 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908bd560 msgr2=0x55fd908bf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fd908bd560 0x55fd908bf950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd907c1da0 msgr2=0x55fd908bad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fd907c1da0 0x55fd908bad10 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908c14a0 msgr2=0x55fd908c3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fd908c14a0 0x55fd908c3890 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa7840346a0 msgr2=0x7fa784036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa7840346a0 0x7fa784036b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa890001dc0 tx=0x7fa890001360 comp rx=0 tx=0).stop 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 msgr2=0x55fd908b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 --2- 172.21.15.72:0/1297229786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fd907c1480 0x55fd908b3c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a420 tx=0x7fa88c019810 comp rx=0 tx=0).stop 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89ca34640 1 -- 172.21.15.72:0/1297229786 reap_dead start 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 shutdown_connections 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 >> 172.21.15.72:0/1297229786 conn(0x55fd90734b60 msgr2=0x55fd908a72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 shutdown_connections 2024-04-26T12:50:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.364+0000 7fa89e718980 1 -- 172.21.15.72:0/1297229786 wait complete. 2024-04-26T12:50:20.373 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:50:20.340947Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:20.340938Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:20.373 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:50:20.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:50:20.374 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-26T12:50:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1f00252980 1 Processor -- start 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1f00252980 1 -- start start 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1f00252980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565554a33680 0x565554a35a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1f00252980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5655548dd510 con 0x565554a2f120 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1f00252980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5655548e4430 con 0x565554a33680 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efd56c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565554a33680 0x565554a35a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efdd6d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x565554a2f120 0x565554a2f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36254/0 (socket says 172.21.15.72:36254) 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efd56c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565554a33680 0x565554a35a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50896/0 (socket says 172.21.15.72:50896) 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2074319077 learned_addr learned my addr 172.21.15.72:0/2074319077 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efcd6b640 1 -- 172.21.15.72:0/2074319077 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178032527 0 0) 0x5655548dd510 con 0x565554a2f120 2024-04-26T12:50:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efcd6b640 1 -- 172.21.15.72:0/2074319077 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ee8001e20 con 0x565554a2f120 2024-04-26T12:50:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efd56c640 1 -- 172.21.15.72:0/2074319077 >> v1:172.21.15.29:6789/0 conn(0x565554a2f120 legacy=0x565554a2f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.412+0000 7f1efd56c640 1 -- 172.21.15.72:0/2074319077 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655548b9ae0 con 0x565554a33680 2024-04-26T12:50:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1efd56c640 1 --2- 172.21.15.72:0/2074319077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a33680 0x565554a35a70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400a480 tx=0x7f1ef401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02eb80515af267a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1efcd6b640 1 -- 172.21.15.72:0/2074319077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef40b0070 con 0x565554a33680 2024-04-26T12:50:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1efcd6b640 1 -- 172.21.15.72:0/2074319077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef40ab540 con 0x565554a33680 2024-04-26T12:50:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1efcd6b640 1 -- 172.21.15.72:0/2074319077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef40ab820 con 0x565554a33680 2024-04-26T12:50:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1f00252980 1 -- 172.21.15.72:0/2074319077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a33680 msgr2=0x565554a35a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1f00252980 1 --2- 172.21.15.72:0/2074319077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a33680 0x565554a35a70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400a480 tx=0x7f1ef401b280 comp rx=0 tx=0).stop 2024-04-26T12:50:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1f00252980 1 -- 172.21.15.72:0/2074319077 shutdown_connections 2024-04-26T12:50:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1f00252980 1 --2- 172.21.15.72:0/2074319077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a33680 0x565554a35a70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1f00252980 1 -- 172.21.15.72:0/2074319077 >> 172.21.15.72:0/2074319077 conn(0x565554a2a9f0 msgr2=0x565554a2ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1f00252980 1 -- 172.21.15.72:0/2074319077 shutdown_connections 2024-04-26T12:50:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.416+0000 7f1f00252980 1 -- 172.21.15.72:0/2074319077 wait complete. 2024-04-26T12:50:20.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.428+0000 7f1f00252980 1 Processor -- start 2024-04-26T12:50:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.428+0000 7f1f00252980 1 -- start start 2024-04-26T12:50:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b18fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565554933a70 con 0x565554a2f120 2024-04-26T12:50:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b18fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b18fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50908/0 (socket says 172.21.15.72:50908) 2024-04-26T12:50:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 -- 172.21.15.72:0/1515928904 learned_addr learned my addr 172.21.15.72:0/1515928904 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 -- 172.21.15.72:0/1515928904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565554b195a0 con 0x565554a2f120 2024-04-26T12:50:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/1515928904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b18fd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0001dc0 tx=0x7f1ef000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fc2f1dbf0459f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1debe07640 1 -- 172.21.15.72:0/1515928904 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0012020 con 0x565554a2f120 2024-04-26T12:50:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1debe07640 1 -- 172.21.15.72:0/1515928904 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef000e7c0 con 0x565554a2f120 2024-04-26T12:50:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1debe07640 1 -- 172.21.15.72:0/1515928904 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef000eb40 con 0x565554a2f120 2024-04-26T12:50:20.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- 172.21.15.72:0/1515928904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 msgr2=0x565554b18fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 --2- 172.21.15.72:0/1515928904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b18fd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0001dc0 tx=0x7f1ef000b6d0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- 172.21.15.72:0/1515928904 shutdown_connections 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 --2- 172.21.15.72:0/1515928904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b18fd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- 172.21.15.72:0/1515928904 >> 172.21.15.72:0/1515928904 conn(0x565554a2a9f0 msgr2=0x565554b14b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- 172.21.15.72:0/1515928904 shutdown_connections 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- 172.21.15.72:0/1515928904 wait complete. 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 Processor -- start 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- start start 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b20320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1f00252980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5655549a3ee0 con 0x565554a2f120 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b20320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b20320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50914/0 (socket says 172.21.15.72:50914) 2024-04-26T12:50:20.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.432+0000 7f1efdd6d640 1 -- 172.21.15.72:0/3002293095 learned_addr learned my addr 172.21.15.72:0/3002293095 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efdd6d640 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565554b20860 con 0x565554a2f120 2024-04-26T12:50:20.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b20320 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x565554b19e60 tx=0x7f1ef0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1dea604640 1 -- 172.21.15.72:0/3002293095 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0012030 con 0x565554a2f120 2024-04-26T12:50:20.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565554b20af0 con 0x565554a2f120 2024-04-26T12:50:20.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1dea604640 1 -- 172.21.15.72:0/3002293095 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0001440 con 0x565554a2f120 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1dea604640 1 -- 172.21.15.72:0/3002293095 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef001aaf0 con 0x565554a2f120 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565554b23700 con 0x565554a2f120 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1dea604640 1 -- 172.21.15.72:0/3002293095 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ef0015020 con 0x565554a2f120 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1dea604640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1de4034650 0x7f1de4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1dea604640 1 -- 172.21.15.72:0/3002293095 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f1ef0020030 con 0x565554a2f120 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efd56c640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1de4034650 0x7f1de4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554a33680 0x565554b27220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b27890 con 0x565554a33680 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efe56e640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554a33680 0x565554b27220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efd56c640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1de4034650 0x7f1de4036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40ad000 tx=0x7f1ef40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efe56e640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554a33680 0x565554b27220 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efe56e640 1 -- 172.21.15.72:0/3002293095 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554a33680 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b24920 con 0x565554a33680 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1efe56e640 1 -- 172.21.15.72:0/3002293095 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554a33680 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b29bc0 0x565554b2bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.436+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b2c6a0 con 0x565554b29bc0 2024-04-26T12:50:20.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b29bc0 0x565554b2bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b29bc0 0x565554b2bfb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efdd6d640 1 -- 172.21.15.72:0/3002293095 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b29bc0 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b28a30 con 0x565554a33680 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efe56e640 1 -- 172.21.15.72:0/3002293095 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554a33680 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b2db00 0x565554b2fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b305f0 con 0x565554b2db00 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efd56c640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b2db00 0x565554b2fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efd56c640 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b2db00 0x565554b2fef0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efd56c640 1 -- 172.21.15.72:0/3002293095 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b2db00 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1f00252980 1 Processor -- start 2024-04-26T12:50:20.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1f00252980 1 -- start start 2024-04-26T12:50:20.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1f00252980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b3e680 0x565554b3eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1f00252980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565554937ab0 con 0x565554b3e680 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b3e680 0x565554b3eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b3e680 0x565554b3eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50926/0 (socket says 172.21.15.72:50926) 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.440+0000 7f1efdd6d640 1 -- 172.21.15.72:0/286201084 learned_addr learned my addr 172.21.15.72:0/286201084 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efdd6d640 1 -- 172.21.15.72:0/286201084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565554b3efe0 con 0x565554b3e680 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b3e680 0x565554b3eaa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0048560 tx=0x7f1ef0018c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1de37fe640 1 -- 172.21.15.72:0/286201084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0016780 con 0x565554b3e680 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1de37fe640 1 -- 172.21.15.72:0/286201084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0018430 con 0x565554b3e680 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565554b3fa80 con 0x565554b3e680 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1de37fe640 1 -- 172.21.15.72:0/286201084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0016920 con 0x565554b3e680 2024-04-26T12:50:20.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565554b3ff50 con 0x565554b3e680 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1de37fe640 1 -- 172.21.15.72:0/286201084 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ef0009070 con 0x565554b3e680 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1de37fe640 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dd8034650 0x7f1dd8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1de37fe640 1 -- 172.21.15.72:0/286201084 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f1ef0037070 con 0x565554b3e680 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efd56c640 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dd8034650 0x7f1dd8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1f00252980 1 Processor -- start 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1f00252980 1 -- start start 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efd56c640 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dd8034650 0x7f1dd8036b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x565554b27d40 tx=0x7f1ef4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1f00252980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b4f9e0 0x565554b4fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1f00252980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565554b198f0 con 0x565554b4f9e0 2024-04-26T12:50:20.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b4f9e0 0x565554b4fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b4f9e0 0x565554b4fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50930/0 (socket says 172.21.15.72:50930) 2024-04-26T12:50:20.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efdd6d640 1 -- 172.21.15.72:0/3217629037 learned_addr learned my addr 172.21.15.72:0/3217629037 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.444+0000 7f1efdd6d640 1 -- 172.21.15.72:0/3217629037 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565554b503d0 con 0x565554b4f9e0 2024-04-26T12:50:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/3217629037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b4f9e0 0x565554b4fe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1ef001ad50 tx=0x7f1ef00244e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d5398736145756 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1de17fa640 1 -- 172.21.15.72:0/3217629037 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0041bc0 con 0x565554b4f9e0 2024-04-26T12:50:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1de17fa640 1 -- 172.21.15.72:0/3217629037 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef005c070 con 0x565554b4f9e0 2024-04-26T12:50:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1de17fa640 1 -- 172.21.15.72:0/3217629037 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef00095f0 con 0x565554b4f9e0 2024-04-26T12:50:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- 172.21.15.72:0/3217629037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b4f9e0 msgr2=0x565554b4fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 --2- 172.21.15.72:0/3217629037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b4f9e0 0x565554b4fe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1ef001ad50 tx=0x7f1ef00244e0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- 172.21.15.72:0/3217629037 shutdown_connections 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 --2- 172.21.15.72:0/3217629037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b4f9e0 0x565554b4fe00 secure :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1ef001ad50 tx=0x7f1ef00244e0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- 172.21.15.72:0/3217629037 >> 172.21.15.72:0/3217629037 conn(0x565554b47960 msgr2=0x565554b459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- 172.21.15.72:0/3217629037 shutdown_connections 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- 172.21.15.72:0/3217629037 wait complete. 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 Processor -- start 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- start start 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b56d80 0x565554b571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565554b50960 con 0x565554b56d80 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b56d80 0x565554b571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1efdd6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b56d80 0x565554b571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50932/0 (socket says 172.21.15.72:50932) 2024-04-26T12:50:20.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 learned_addr learned my addr 172.21.15.72:0/2017912063 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565554b576e0 con 0x565554b56d80 2024-04-26T12:50:20.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b56d80 0x565554b571a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ef001ad50 tx=0x7f1ef0015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1dcf7fe640 1 -- 172.21.15.72:0/2017912063 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef0018840 con 0x565554b56d80 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565554b576e0 con 0x565554b56d80 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1dcf7fe640 1 -- 172.21.15.72:0/2017912063 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef000c960 con 0x565554b56d80 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1dcf7fe640 1 -- 172.21.15.72:0/2017912063 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ef00308c0 con 0x565554b56d80 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.448+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565554b576e0 con 0x565554b56d80 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1dcf7fe640 1 -- 172.21.15.72:0/2017912063 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ef0030a60 con 0x565554b56d80 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1dcf7fe640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dc8034650 0x7f1dc8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1dcf7fe640 1 -- 172.21.15.72:0/2017912063 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f1ef002de00 con 0x565554b56d80 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efd56c640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dc8034650 0x7f1dc8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554b62310 0x565554b647b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b64f00 con 0x565554b62310 2024-04-26T12:50:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efe56e640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554b62310 0x565554b647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efd56c640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dc8034650 0x7f1dc8036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40b6fd0 tx=0x7f1ef40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efe56e640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554b62310 0x565554b647b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 realm 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b65310 con 0x565554b62310 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b65bb0 con 0x565554b62310 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b66cb0 0x565554b690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b696f0 con 0x565554b66cb0 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.452+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b66cb0 0x565554b690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efdd6d640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b66cb0 0x565554b690a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1f00252980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1f00252980 20 searching for the correct realm 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b6b5d0 0x565554b6da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b6e0c0 con 0x565554b6b5d0 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efd56c640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b6b5d0 0x565554b6da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efd56c640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b6b5d0 0x565554b6da40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efd56c640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1ef40ab030 0x7f1ef40d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b6e0c0 con 0x7f1ef40ab030 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efe56e640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1ef40ab030 0x7f1ef40d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efe56e640 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1ef40ab030 0x7f1ef40d1400 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.456+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x7f1ef40ab030 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x7f1ef40ab030 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.460+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x7f1ef40ab030 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.464+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x7f1ef40ab030 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b6b5d0 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b66cb0 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x565554b62310 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565554b65f50 con 0x7f1ef40ab030 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1f00252980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1f00252980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1f00252980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1f00252980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1f00252980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.468+0000 7f1f00252980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b69f40 con 0x565554b62310 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b69f40 con 0x565554b62310 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b69f40 con 0x565554b6b5d0 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 zone default found 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 4 Realm: () 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 zonegroup default 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b6a870 con 0x565554b66cb0 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b6ff50 con 0x565554b6b5d0 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b70390 con 0x565554b6b5d0 2024-04-26T12:50:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 started sync module instance, tier type = 2024-04-26T12:50:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b6f3c0 con 0x7f1ef40ab030 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94924493486304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b6f3c0 con 0x7f1ef40ab030 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.472+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b70ec0 con 0x565554b62310 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.476+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94924493486304] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.476+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.476+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94924493490576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b6f3c0 con 0x565554b62310 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.476+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b718d0 con 0x565554b6b5d0 2024-04-26T12:50:20.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94924493493280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b72120 con 0x565554b6b5d0 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b72b40 con 0x7f1ef40ab030 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94924493490576] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94924493497904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b72f30 con 0x7f1ef40ab030 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b738f0 con 0x565554b62310 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94924493493280] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94924493497904] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94924493483792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b73440 con 0x565554b62310 2024-04-26T12:50:20.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.480+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b73c90 con 0x565554b66cb0 2024-04-26T12:50:20.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94924493501808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b744e0 con 0x565554b66cb0 2024-04-26T12:50:20.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b74ea0 con 0x565554b66cb0 2024-04-26T12:50:20.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94924493483792] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94924493495408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b756f0 con 0x565554b66cb0 2024-04-26T12:50:20.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b75f80 con 0x565554b66cb0 2024-04-26T12:50:20.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.484+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94924493501808] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94924493504560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b76160 con 0x565554b66cb0 2024-04-26T12:50:20.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=0 2024-04-26T12:50:20.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=1 2024-04-26T12:50:20.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=2 2024-04-26T12:50:20.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=3 2024-04-26T12:50:20.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=4 2024-04-26T12:50:20.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=5 2024-04-26T12:50:20.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94924493495408] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=6 2024-04-26T12:50:20.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94924493504560] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 20 add_watcher() i=7 2024-04-26T12:50:20.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:20.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b79080 con 0x565554b62310 2024-04-26T12:50:20.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.488+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94924493509184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b76500 con 0x565554b62310 2024-04-26T12:50:20.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94924493509184] v33'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 5 note: GC not initialized 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1dae7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 Filter name: none 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1d1ffff640 20 reqs_thread_entry: start 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b9c880 con 0x565554b66cb0 2024-04-26T12:50:20.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 rados_obj.operate() r=0 bl.length=419 2024-04-26T12:50:20.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554b9c2d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv26 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.492+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554ba0030 con 0x7f1ef40ab030 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv24 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554ba47a0 con 0x7f1ef40ab030 2024-04-26T12:50:20.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(65 foo.buckets [call] v33'27 uv27 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.496+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:66 8.1d 8:b99a352c:root::.bucket.meta.testx%3amyfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554ba80b0 con 0x565554b66cb0 2024-04-26T12:50:20.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [create,call,writefull 0~412,setxattr (203)] v33'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x7 2024-04-26T12:50:20.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:20.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T12:50:20.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:20.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94924493708592 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554ba7970 con 0x565554b62310 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94924493483792 notify 141733920779 ret 0) ==== 889+0+0 (crc 0 0 0) 0x565554ba0420 con 0x565554b62310 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1de17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94924493483792 notifier 4552 bl.length()=847 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1de17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x7 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1de17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1de17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(67 notify.4 [notify cookie 94924493708592 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1de17fa640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1dc0003eb0 con 0x565554b62310 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify_complete (2) cookie 94924493708592 notify 141733920779 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565554b9f620 con 0x565554b62310 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 20 handle_bi_update(): bucket=testx:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_sources= new_sources= 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 20 handle_bi_update(): bucket=testx:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential sources added=[] removed=[] 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 20 handle_bi_update(): bucket=testx:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_dests= new_dests= 2024-04-26T12:50:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 20 handle_bi_update(): bucket=testx:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential dests added=[] removed=[] 2024-04-26T12:50:20.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554ba39d0 con 0x565554b62310 2024-04-26T12:50:20.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v33'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.500+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554ba81f0 con 0x565554b62310 2024-04-26T12:50:20.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v33'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-26T12:50:20.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T12:50:20.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-26T12:50:20.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94924493698336 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554ba3df0 con 0x565554b62310 2024-04-26T12:50:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== watch-notify(notify (1) cookie 94924493483792 notify 141733920780 ret 0) ==== 390+0+0 (crc 0 0 0) 0x565554ba6fa0 con 0x565554b62310 2024-04-26T12:50:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1de17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94924493483792 notifier 4552 bl.length()=348 2024-04-26T12:50:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1de17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-26T12:50:20.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1de17fa640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T12:50:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(71 notify.4 [notify cookie 94924493698336 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1de17fa640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1dc0003eb0 con 0x565554b62310 2024-04-26T12:50:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== watch-notify(notify_complete (2) cookie 94924493698336 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565554ba6d40 con 0x565554b62310 2024-04-26T12:50:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554ba39d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(73 myfoo [call,delete] v33'28 uv28 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T12:50:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:50:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.504+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94924493698336 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554ba3df0 con 0x565554b66cb0 2024-04-26T12:50:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== watch-notify(notify (1) cookie 94924493495408 notify 141733920779 ret 0) ==== 191+0+0 (crc 0 0 0) 0x565554ba45f0 con 0x565554b66cb0 2024-04-26T12:50:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1de0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94924493495408 notifier 4552 bl.length()=149 2024-04-26T12:50:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.6 [notify cookie 94924493698336 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1de0ff9640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1d280032d0 con 0x565554b66cb0 2024-04-26T12:50:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== watch-notify(notify_complete (2) cookie 94924493698336 notify 141733920779 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565554b3efe0 con 0x565554b66cb0 2024-04-26T12:50:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:76 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554ba39d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(76 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call,delete] v33'29 uv29 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1f00252980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 from cache 2024-04-26T12:50:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1f00252980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.508+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94924493686448 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565554ba39d0 con 0x565554b66cb0 2024-04-26T12:50:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== watch-notify(notify (1) cookie 94924493501808 notify 141733920780 ret 0) ==== 248+0+0 (crc 0 0 0) 0x565554b3efe0 con 0x565554b66cb0 2024-04-26T12:50:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1de17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94924493501808 notifier 4552 bl.length()=206 2024-04-26T12:50:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1de17fa640 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1dc0003eb0 con 0x565554b66cb0 2024-04-26T12:50:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(77 notify.5 [notify cookie 94924493686448 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== watch-notify(notify_complete (2) cookie 94924493686448 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565554b23700 con 0x565554b66cb0 2024-04-26T12:50:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94924493509184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x565554b62310 2024-04-26T12:50:20.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94924493509184] v33'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.512+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94924493486304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x7f1ef40ab030 2024-04-26T12:50:20.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.516+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94924493486304] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.516+0000 7f1f00252980 20 remove_watcher() i=0 2024-04-26T12:50:20.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.516+0000 7f1f00252980 2 removed watcher, disabling cache 2024-04-26T12:50:20.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.516+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94924493490576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x565554b62310 2024-04-26T12:50:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.516+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94924493490576] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.516+0000 7f1f00252980 20 remove_watcher() i=1 2024-04-26T12:50:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.516+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94924493493280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x565554b6b5d0 2024-04-26T12:50:20.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.520+0000 7f1efd56c640 1 -- 172.21.15.72:0/2017912063 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94924493493280] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef40b3040 con 0x565554b6b5d0 2024-04-26T12:50:20.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.520+0000 7f1f00252980 20 remove_watcher() i=2 2024-04-26T12:50:20.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.520+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94924493497904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x7f1ef40ab030 2024-04-26T12:50:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.520+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94924493497904] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x7f1ef40ab030 2024-04-26T12:50:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.520+0000 7f1f00252980 20 remove_watcher() i=3 2024-04-26T12:50:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.520+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94924493483792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x565554b62310 2024-04-26T12:50:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.524+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94924493483792] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef800a4d0 con 0x565554b62310 2024-04-26T12:50:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.524+0000 7f1f00252980 20 remove_watcher() i=4 2024-04-26T12:50:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.524+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94924493501808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x565554b66cb0 2024-04-26T12:50:20.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.524+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94924493501808] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.524+0000 7f1f00252980 20 remove_watcher() i=5 2024-04-26T12:50:20.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.524+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94924493495408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x565554b66cb0 2024-04-26T12:50:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94924493495408] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 20 remove_watcher() i=6 2024-04-26T12:50:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94924493504560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565554b9a410 con 0x565554b66cb0 2024-04-26T12:50:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1efdd6d640 1 -- 172.21.15.72:0/2017912063 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94924493504560] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ef0008030 con 0x565554b66cb0 2024-04-26T12:50:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 20 remove_watcher() i=7 2024-04-26T12:50:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b66cb0 msgr2=0x565554b690a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b66cb0 0x565554b690a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554b62310 msgr2=0x565554b647b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554b62310 0x565554b647b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1ef40ab030 msgr2=0x7f1ef40d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1ef40ab030 0x7f1ef40d1400 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b6b5d0 msgr2=0x565554b6da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b6b5d0 0x565554b6da40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dc8034650 msgr2=0x7f1dc8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dc8034650 0x7f1dc8036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40b6fd0 tx=0x7f1ef40a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b56d80 msgr2=0x565554b571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1efe56e640 1 -- 172.21.15.72:0/2017912063 reap_dead start 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b56d80 0x565554b571a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ef001ad50 tx=0x7f1ef0015f90 comp rx=0 tx=0).stop 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 shutdown_connections 2024-04-26T12:50:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/2017912063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b56d80 0x565554b571a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 >> 172.21.15.72:0/2017912063 conn(0x565554b47960 msgr2=0x565554b44fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 shutdown_connections 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/2017912063 wait complete. 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dd8034650 msgr2=0x7f1dd8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dd8034650 0x7f1dd8036b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x565554b27d40 tx=0x7f1ef4005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b3e680 msgr2=0x565554b3eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b3e680 0x565554b3eaa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0048560 tx=0x7f1ef0018c80 comp rx=0 tx=0).stop 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 shutdown_connections 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1dd8034650 0x7f1dd8036b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 --2- 172.21.15.72:0/286201084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554b3e680 0x565554b3eaa0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.528+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 >> 172.21.15.72:0/286201084 conn(0x565554b33490 msgr2=0x565554b33fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 shutdown_connections 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/286201084 wait complete. 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b29bc0 msgr2=0x565554b2bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565554b29bc0 0x565554b2bfb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554a33680 msgr2=0x565554b27220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565554a33680 0x565554b27220 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b2db00 msgr2=0x565554b2fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565554b2db00 0x565554b2fef0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1de4034650 msgr2=0x7f1de4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1de4034650 0x7f1de4036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40ad000 tx=0x7f1ef40a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 msgr2=0x565554b20320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 --2- 172.21.15.72:0/3002293095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565554a2f120 0x565554b20320 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x565554b19e60 tx=0x7f1ef0000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1efe56e640 1 -- 172.21.15.72:0/3002293095 reap_dead start 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 shutdown_connections 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 >> 172.21.15.72:0/3002293095 conn(0x565554a2a9f0 msgr2=0x565554b13670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 shutdown_connections 2024-04-26T12:50:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.532+0000 7f1f00252980 1 -- 172.21.15.72:0/3002293095 wait complete. 2024-04-26T12:50:20.541 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-26T12:50:20.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-26T12:50:20.542 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-26T12:50:20.622 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:20.622 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d728d980 1 Processor -- start 2024-04-26T12:50:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d728d980 1 -- start start 2024-04-26T12:50:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d728d980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ca43ea8ff0 0x55ca43f37f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d728d980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca43de2510 con 0x55ca43f384d0 2024-04-26T12:50:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d728d980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ca43de9430 con 0x55ca43ea8ff0 2024-04-26T12:50:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d4da8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ca43ea8ff0 0x55ca43f37f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d45a7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55ca43f384d0 0x55ca43f3a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36262/0 (socket says 172.21.15.72:36262) 2024-04-26T12:50:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d4da8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ca43ea8ff0 0x55ca43f37f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50948/0 (socket says 172.21.15.72:50948) 2024-04-26T12:50:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d45a7640 1 -- 172.21.15.72:0/3855513808 learned_addr learned my addr 172.21.15.72:0/3855513808 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d4da8640 1 -- 172.21.15.72:0/3855513808 >> v1:172.21.15.29:6789/0 conn(0x55ca43f384d0 legacy=0x55ca43f3a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.624+0000 7f74d4da8640 1 -- 172.21.15.72:0/3855513808 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca43dbeae0 con 0x55ca43ea8ff0 2024-04-26T12:50:20.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d4da8640 1 --2- 172.21.15.72:0/3855513808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca43f37f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a420 tx=0x7f74cc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37e0da6a371ddf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d3da6640 1 -- 172.21.15.72:0/3855513808 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0af070 con 0x55ca43ea8ff0 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d3da6640 1 -- 172.21.15.72:0/3855513808 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0aa530 con 0x55ca43ea8ff0 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d3da6640 1 -- 172.21.15.72:0/3855513808 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0aa850 con 0x55ca43ea8ff0 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d728d980 1 -- 172.21.15.72:0/3855513808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 msgr2=0x55ca43f37f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d728d980 1 --2- 172.21.15.72:0/3855513808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca43f37f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a420 tx=0x7f74cc01afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d728d980 1 -- 172.21.15.72:0/3855513808 shutdown_connections 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d728d980 1 --2- 172.21.15.72:0/3855513808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca43f37f90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d728d980 1 -- 172.21.15.72:0/3855513808 >> 172.21.15.72:0/3855513808 conn(0x55ca43f2fa70 msgr2=0x55ca43f31e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d728d980 1 -- 172.21.15.72:0/3855513808 shutdown_connections 2024-04-26T12:50:20.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.628+0000 7f74d728d980 1 -- 172.21.15.72:0/3855513808 wait complete. 2024-04-26T12:50:20.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d728d980 1 Processor -- start 2024-04-26T12:50:20.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d728d980 1 -- start start 2024-04-26T12:50:20.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d728d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca44020570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d728d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ca43e38a70 con 0x55ca43ea8ff0 2024-04-26T12:50:20.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca44020570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca44020570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50960/0 (socket says 172.21.15.72:50960) 2024-04-26T12:50:20.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d4da8640 1 -- 172.21.15.72:0/2359694091 learned_addr learned my addr 172.21.15.72:0/2359694091 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.644+0000 7f74d4da8640 1 -- 172.21.15.72:0/2359694091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca44020b40 con 0x55ca43ea8ff0 2024-04-26T12:50:20.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d4da8640 1 --2- 172.21.15.72:0/2359694091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca44020570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f74cc018c00 tx=0x7f74cc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a529177944e66a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f73c2e0d640 1 -- 172.21.15.72:0/2359694091 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0af050 con 0x55ca43ea8ff0 2024-04-26T12:50:20.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f73c2e0d640 1 -- 172.21.15.72:0/2359694091 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0b0040 con 0x55ca43ea8ff0 2024-04-26T12:50:20.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f73c2e0d640 1 -- 172.21.15.72:0/2359694091 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0aabb0 con 0x55ca43ea8ff0 2024-04-26T12:50:20.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- 172.21.15.72:0/2359694091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 msgr2=0x55ca44020570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 --2- 172.21.15.72:0/2359694091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca44020570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f74cc018c00 tx=0x7f74cc0033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- 172.21.15.72:0/2359694091 shutdown_connections 2024-04-26T12:50:20.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 --2- 172.21.15.72:0/2359694091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43ea8ff0 0x55ca44020570 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- 172.21.15.72:0/2359694091 >> 172.21.15.72:0/2359694091 conn(0x55ca43f2fa70 msgr2=0x55ca4401c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- 172.21.15.72:0/2359694091 shutdown_connections 2024-04-26T12:50:20.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- 172.21.15.72:0/2359694091 wait complete. 2024-04-26T12:50:20.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 Processor -- start 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- start start 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43f384d0 0x55ca43f356f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ca43f3caf0 con 0x55ca43f384d0 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43f384d0 0x55ca43f356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43f384d0 0x55ca43f356f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50968/0 (socket says 172.21.15.72:50968) 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d4da8640 1 -- 172.21.15.72:0/860196942 learned_addr learned my addr 172.21.15.72:0/860196942 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d4da8640 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca43f35c30 con 0x55ca43f384d0 2024-04-26T12:50:20.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d4da8640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43f384d0 0x55ca43f356f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f90 tx=0x7f74cc019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f73c160a640 1 -- 172.21.15.72:0/860196942 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0c1480 con 0x55ca43f384d0 2024-04-26T12:50:20.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca43f33ef0 con 0x55ca43f384d0 2024-04-26T12:50:20.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f73c160a640 1 -- 172.21.15.72:0/860196942 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0c1620 con 0x55ca43f384d0 2024-04-26T12:50:20.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f73c160a640 1 -- 172.21.15.72:0/860196942 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0c1920 con 0x55ca43f384d0 2024-04-26T12:50:20.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.648+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca43f343e0 con 0x55ca43f384d0 2024-04-26T12:50:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f73c160a640 1 -- 172.21.15.72:0/860196942 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74cc0c1ac0 con 0x55ca43f384d0 2024-04-26T12:50:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f73c160a640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73bc0346a0 0x7f73bc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f73c160a640 1 -- 172.21.15.72:0/860196942 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f74cc0bb070 con 0x55ca43f384d0 2024-04-26T12:50:20.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d45a7640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73bc0346a0 0x7f73bc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca4402ed50 0x55ca44031140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca44031680 con 0x55ca4402ed50 2024-04-26T12:50:20.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d55a9640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca4402ed50 0x55ca44031140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d45a7640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73bc0346a0 0x7f73bc036b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74c8001da0 tx=0x7f74c8001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d55a9640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca4402ed50 0x55ca44031140 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d55a9640 1 -- 172.21.15.72:0/860196942 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca4402ed50 2024-04-26T12:50:20.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca44031a20 con 0x55ca4402ed50 2024-04-26T12:50:20.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d55a9640 1 -- 172.21.15.72:0/860196942 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca4402ed50 2024-04-26T12:50:20.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca44033520 0x55ca44035990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca44036120 con 0x55ca44033520 2024-04-26T12:50:20.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.652+0000 7f74d4da8640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca44033520 0x55ca44035990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d4da8640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca44033520 0x55ca44035990 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d4da8640 1 -- 172.21.15.72:0/860196942 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f74cc0d0070 con 0x55ca44033520 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca44032270 con 0x55ca4402ed50 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d55a9640 1 -- 172.21.15.72:0/860196942 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca4402ed50 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca44037580 0x55ca44039970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4403a0b0 con 0x55ca44037580 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d45a7640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca44037580 0x55ca44039970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d45a7640 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca44037580 0x55ca44039970 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d45a7640 1 -- 172.21.15.72:0/860196942 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca44037580 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d728d980 1 Processor -- start 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d728d980 1 -- start start 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d728d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44048140 0x55ca44048560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d728d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ca43e3cab0 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44048140 0x55ca44048560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44048140 0x55ca44048560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50970/0 (socket says 172.21.15.72:50970) 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d4da8640 1 -- 172.21.15.72:0/3673580903 learned_addr learned my addr 172.21.15.72:0/3673580903 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.656+0000 7f74d4da8640 1 -- 172.21.15.72:0/3673580903 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca44048aa0 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d4da8640 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44048140 0x55ca44048560 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0d1bb0 tx=0x7f74cc0d1640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f73ba7fc640 1 -- 172.21.15.72:0/3673580903 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0bf370 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca44049540 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f73ba7fc640 1 -- 172.21.15.72:0/3673580903 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0bf510 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f73ba7fc640 1 -- 172.21.15.72:0/3673580903 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0e2170 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca44049a10 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f73ba7fc640 1 -- 172.21.15.72:0/3673580903 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74cc0e2310 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f73ba7fc640 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73ac034650 0x7f73ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f73ba7fc640 1 -- 172.21.15.72:0/3673580903 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f74cc0d4040 con 0x55ca44048140 2024-04-26T12:50:20.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d45a7640 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73ac034650 0x7f73ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d728d980 1 Processor -- start 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d728d980 1 -- start start 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d45a7640 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73ac034650 0x7f73ac036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55ca44032610 tx=0x7f74c800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d728d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca44055580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d728d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ca44020dd0 con 0x55ca44055160 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca44055580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca44055580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:50984/0 (socket says 172.21.15.72:50984) 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d4da8640 1 -- 172.21.15.72:0/1141599849 learned_addr learned my addr 172.21.15.72:0/1141599849 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d4da8640 1 -- 172.21.15.72:0/1141599849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca44055b50 con 0x55ca44055160 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f74d4da8640 1 --2- 172.21.15.72:0/1141599849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca44055580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0eeb50 tx=0x7f74cc0ee580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87b963e719f2a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.660+0000 7f73abfff640 1 -- 172.21.15.72:0/1141599849 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0fe070 con 0x55ca44055160 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f73abfff640 1 -- 172.21.15.72:0/1141599849 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc007950 con 0x55ca44055160 2024-04-26T12:50:20.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f73abfff640 1 -- 172.21.15.72:0/1141599849 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0070a0 con 0x55ca44055160 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- 172.21.15.72:0/1141599849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 msgr2=0x55ca44055580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 --2- 172.21.15.72:0/1141599849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca44055580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0eeb50 tx=0x7f74cc0ee580 comp rx=0 tx=0).stop 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- 172.21.15.72:0/1141599849 shutdown_connections 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 --2- 172.21.15.72:0/1141599849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca44055580 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- 172.21.15.72:0/1141599849 >> 172.21.15.72:0/1141599849 conn(0x55ca440514a0 msgr2=0x55ca4404f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- 172.21.15.72:0/1141599849 shutdown_connections 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- 172.21.15.72:0/1141599849 wait complete. 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 Processor -- start 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- start start 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca4405c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ca44056210 con 0x55ca44055160 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca4405c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d4da8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca4405c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51000/0 (socket says 172.21.15.72:51000) 2024-04-26T12:50:20.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 learned_addr learned my addr 172.21.15.72:0/2480644916 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4405c970 con 0x55ca44055160 2024-04-26T12:50:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d4da8640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca4405c430 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0ee8d0 tx=0x7f74cc0ebed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f73aa7fc640 1 -- 172.21.15.72:0/2480644916 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc106070 con 0x55ca44055160 2024-04-26T12:50:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f73aa7fc640 1 -- 172.21.15.72:0/2480644916 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0d3e00 con 0x55ca44055160 2024-04-26T12:50:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f73aa7fc640 1 -- 172.21.15.72:0/2480644916 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc0fe040 con 0x55ca44055160 2024-04-26T12:50:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca4405c970 con 0x55ca44055160 2024-04-26T12:50:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.664+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4405c970 con 0x55ca44055160 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f73aa7fc640 1 -- 172.21.15.72:0/2480644916 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74cc109070 con 0x55ca44055160 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f73aa7fc640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73a00346a0 0x7f73a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f73aa7fc640 1 -- 172.21.15.72:0/2480644916 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f74cc10cc90 con 0x55ca44055160 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d45a7640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73a00346a0 0x7f73a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca44067520 0x55ca440699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406a110 con 0x55ca44067520 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d55a9640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca44067520 0x55ca440699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d45a7640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73a00346a0 0x7f73a0036b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55ca4403a4b0 tx=0x7f74c8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d55a9640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca44067520 0x55ca440699c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca44067520 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 realm 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406a570 con 0x55ca44067520 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca44067520 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406ae10 con 0x55ca44067520 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca44067520 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca44067520 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca4406bf10 0x55ca4406e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406e880 con 0x55ca4406bf10 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.668+0000 7f74d4da8640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca4406bf10 0x55ca4406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d4da8640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca4406bf10 0x55ca4406e300 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d728d980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d728d980 20 searching for the correct realm 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca440707b0 0x55ca44072c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca44073310 con 0x55ca440707b0 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d45a7640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca440707b0 0x55ca44072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d45a7640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca440707b0 0x55ca44072c40 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d45a7640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74c8037040 0x7f74c8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca44073310 con 0x7f74c8037040 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d55a9640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74c8037040 0x7f74c8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d55a9640 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74c8037040 0x7f74c8036410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c40083f0 con 0x7f74c8037040 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.672+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c40083f0 con 0x55ca44067520 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x7f74c8037040 2024-04-26T12:50:20.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x7f74c8037040 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.676+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x7f74c8037040 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f74c4026040 con 0x7f74c8037040 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.680+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x7f74c8037040 2024-04-26T12:50:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x7f74c8037040 2024-04-26T12:50:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x7f74c8037040 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x7f74c8037040 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca440707b0 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.684+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca4406bf10 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x55ca44067520 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406b1b0 con 0x7f74c8037040 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c4026040 con 0x7f74c8037040 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406f0d0 con 0x55ca44067520 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406f0d0 con 0x55ca44067520 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74c4026040 con 0x55ca44067520 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406f0d0 con 0x55ca440707b0 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 zone default found 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 4 Realm: () 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 zonegroup default 2024-04-26T12:50:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4406f970 con 0x55ca4406bf10 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca44075170 con 0x55ca440707b0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca44075510 con 0x55ca440707b0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 started sync module instance, tier type = 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.688+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074610 con 0x7f74c8037040 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.692+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4026040 con 0x7f74c8037040 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.692+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94327213083408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074610 con 0x7f74c8037040 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.692+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44075fc0 con 0x55ca44067520 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.692+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94327213083408] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x7f74c8037040 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.692+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.692+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94327213087392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074610 con 0x55ca44067520 2024-04-26T12:50:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.692+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca440769d0 con 0x55ca440707b0 2024-04-26T12:50:20.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94327213090080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44077220 con 0x55ca440707b0 2024-04-26T12:50:20.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44077c60 con 0x7f74c8037040 2024-04-26T12:50:20.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94327213087392] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x7f74c8037040 2024-04-26T12:50:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94327213094704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44078050 con 0x7f74c8037040 2024-04-26T12:50:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44078a10 con 0x55ca44067520 2024-04-26T12:50:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.696+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94327213090080] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94327213094704] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x7f74c8037040 2024-04-26T12:50:20.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94327213080928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44078560 con 0x55ca44067520 2024-04-26T12:50:20.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44078db0 con 0x55ca4406bf10 2024-04-26T12:50:20.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94327213080928] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94327213098336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44078980 con 0x55ca4406bf10 2024-04-26T12:50:20.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.700+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44079ab0 con 0x55ca4406bf10 2024-04-26T12:50:20.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.704+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94327213098336] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.704+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.704+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94327213101664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44079c30 con 0x55ca4406bf10 2024-04-26T12:50:20.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.704+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca4407a750 con 0x55ca4406bf10 2024-04-26T12:50:20.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.704+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94327213101664] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94327213105696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca4407a710 con 0x55ca4406bf10 2024-04-26T12:50:20.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=0 2024-04-26T12:50:20.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=1 2024-04-26T12:50:20.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=2 2024-04-26T12:50:20.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=3 2024-04-26T12:50:20.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=4 2024-04-26T12:50:20.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=5 2024-04-26T12:50:20.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=6 2024-04-26T12:50:20.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94327213105696] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 20 add_watcher() i=7 2024-04-26T12:50:20.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:20.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca4407db70 con 0x55ca44067520 2024-04-26T12:50:20.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.708+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94327213102720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca4407b090 con 0x55ca44067520 2024-04-26T12:50:20.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94327213102720] v33'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f738afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 5 note: GC not initialized 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f7389fe3640 20 reqs_thread_entry: start 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 20 Filter name: none 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f72fb7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ca440a0ee0 con 0x55ca44067520 2024-04-26T12:50:20.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 20 rados_obj.operate() r=0 bl.length=193 2024-04-26T12:50:20.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f738afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.712+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94327213102720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44061930 con 0x55ca44067520 2024-04-26T12:50:20.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94327213102720] v33'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94327213083408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44079680 con 0x7f74c8037040 2024-04-26T12:50:20.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94327213083408] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x7f74c8037040 2024-04-26T12:50:20.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d728d980 20 remove_watcher() i=0 2024-04-26T12:50:20.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d728d980 2 removed watcher, disabling cache 2024-04-26T12:50:20.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94327213087392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074b10 con 0x55ca44067520 2024-04-26T12:50:20.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94327213087392] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d728d980 20 remove_watcher() i=1 2024-04-26T12:50:20.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.716+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94327213090080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074b10 con 0x55ca440707b0 2024-04-26T12:50:20.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.720+0000 7f74d45a7640 1 -- 172.21.15.72:0/2480644916 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94327213090080] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c800e6c0 con 0x55ca440707b0 2024-04-26T12:50:20.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.720+0000 7f74d728d980 20 remove_watcher() i=2 2024-04-26T12:50:20.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.720+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94327213094704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074b10 con 0x7f74c8037040 2024-04-26T12:50:20.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.720+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94327213094704] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x7f74c8037040 2024-04-26T12:50:20.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.720+0000 7f74d728d980 20 remove_watcher() i=3 2024-04-26T12:50:20.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.720+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94327213080928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44077730 con 0x55ca44067520 2024-04-26T12:50:20.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.724+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94327213080928] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c4036040 con 0x55ca44067520 2024-04-26T12:50:20.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.724+0000 7f74d728d980 20 remove_watcher() i=4 2024-04-26T12:50:20.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.724+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94327213098336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074b10 con 0x55ca4406bf10 2024-04-26T12:50:20.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.724+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94327213098336] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.724+0000 7f74d728d980 20 remove_watcher() i=5 2024-04-26T12:50:20.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.724+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94327213101664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44074160 con 0x55ca4406bf10 2024-04-26T12:50:20.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94327213101664] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 20 remove_watcher() i=6 2024-04-26T12:50:20.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94327213105696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ca44079710 con 0x55ca4406bf10 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d4da8640 1 -- 172.21.15.72:0/2480644916 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94327213105696] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc112070 con 0x55ca4406bf10 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 20 remove_watcher() i=7 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca4406bf10 msgr2=0x55ca4406e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca4406bf10 0x55ca4406e300 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca44067520 msgr2=0x55ca440699c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca44067520 0x55ca440699c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74c8037040 msgr2=0x7f74c8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74c8037040 0x7f74c8036410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca440707b0 msgr2=0x55ca44072c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca440707b0 0x55ca44072c40 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73a00346a0 msgr2=0x7f73a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73a00346a0 0x7f73a0036b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55ca4403a4b0 tx=0x7f74c8010000 comp rx=0 tx=0).stop 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 msgr2=0x55ca4405c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 --2- 172.21.15.72:0/2480644916 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44055160 0x55ca4405c430 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0ee8d0 tx=0x7f74cc0ebed0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 reap_dead start 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d55a9640 1 -- 172.21.15.72:0/2480644916 reap_dead start 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 shutdown_connections 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 >> 172.21.15.72:0/2480644916 conn(0x55ca440514a0 msgr2=0x55ca4404f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 shutdown_connections 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.728+0000 7f74d728d980 1 -- 172.21.15.72:0/2480644916 wait complete. 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73ac034650 msgr2=0x7f73ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73ac034650 0x7f73ac036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55ca44032610 tx=0x7f74c800f000 comp rx=0 tx=0).stop 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44048140 msgr2=0x55ca44048560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44048140 0x55ca44048560 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0d1bb0 tx=0x7f74cc0d1640 comp rx=0 tx=0).stop 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 shutdown_connections 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73ac034650 0x7f73ac036b10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/3673580903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca44048140 0x55ca44048560 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 >> 172.21.15.72:0/3673580903 conn(0x55ca4403cf50 msgr2=0x55ca4403da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 shutdown_connections 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/3673580903 wait complete. 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca44033520 msgr2=0x55ca44035990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ca44033520 0x55ca44035990 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca4402ed50 msgr2=0x55ca44031140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ca4402ed50 0x55ca44031140 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca44037580 msgr2=0x55ca44039970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ca44037580 0x55ca44039970 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73bc0346a0 msgr2=0x7f73bc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f73bc0346a0 0x7f73bc036b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74c8001da0 tx=0x7f74c8001300 comp rx=0 tx=0).stop 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43f384d0 msgr2=0x55ca43f356f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 --2- 172.21.15.72:0/860196942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ca43f384d0 0x55ca43f356f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f90 tx=0x7f74cc019810 comp rx=0 tx=0).stop 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d55a9640 1 -- 172.21.15.72:0/860196942 reap_dead start 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 shutdown_connections 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 >> 172.21.15.72:0/860196942 conn(0x55ca43f2fa70 msgr2=0x55ca4401ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 shutdown_connections 2024-04-26T12:50:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.732+0000 7f74d728d980 1 -- 172.21.15.72:0/860196942 wait complete. 2024-04-26T12:50:20.742 INFO:teuthology.orchestra.run.smithi072.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"DwJp6S67U7VlSWTtp7DQB7Tm","ver":2},"mtime":"2024-04-26T12:50:20.504753Z","data":{"bucket":{"name":"myfoo","marker":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","bucket_id":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-04-26T12:50:17.070930Z","linked":true,"has_bucket_info":false}} 2024-04-26T12:50:20.743 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'DwJp6S67U7VlSWTtp7DQB7Tm', 'ver': 2}, 'mtime': '2024-04-26T12:50:20.504753Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'bucket_id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-26T12:50:17.070930Z', 'linked': True, 'has_bucket_info': False}} 2024-04-26T12:50:20.743 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-26T12:50:20.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-26T12:50:20.743 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-26T12:50:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:20.825 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.824+0000 7fe962536980 1 Processor -- start 2024-04-26T12:50:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.824+0000 7fe962536980 1 -- start start 2024-04-26T12:50:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe962536980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562da458ba00 0x562da458ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe962536980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562da4432510 con 0x562da45874f0 2024-04-26T12:50:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe962536980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x562da4439430 con 0x562da458ba00 2024-04-26T12:50:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe960051640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x562da45874f0 0x562da45878d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36264/0 (socket says 172.21.15.72:36264) 2024-04-26T12:50:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe960051640 1 -- 172.21.15.72:0/2627904490 learned_addr learned my addr 172.21.15.72:0/2627904490 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f850640 1 --2- 172.21.15.72:0/2627904490 >> v2:172.21.15.29:3300/0 conn(0x562da458ba00 0x562da458ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f04f640 1 -- 172.21.15.72:0/2627904490 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569692811 0 0) 0x562da4432510 con 0x562da45874f0 2024-04-26T12:50:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f850640 1 -- 172.21.15.72:0/2627904490 >> v1:172.21.15.29:6789/0 conn(0x562da45874f0 legacy=0x562da45878d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f850640 1 -- 172.21.15.72:0/2627904490 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da440eae0 con 0x562da458ba00 2024-04-26T12:50:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f850640 1 --2- 172.21.15.72:0/2627904490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da458ba00 0x562da458ddf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe95400a480 tx=0x7fe95401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c42cb95997d5c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f04f640 1 -- 172.21.15.72:0/2627904490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9540b0070 con 0x562da458ba00 2024-04-26T12:50:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f04f640 1 -- 172.21.15.72:0/2627904490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9540ab540 con 0x562da458ba00 2024-04-26T12:50:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.828+0000 7fe95f04f640 1 -- 172.21.15.72:0/2627904490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9540ab840 con 0x562da458ba00 2024-04-26T12:50:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.832+0000 7fe962536980 1 -- 172.21.15.72:0/2627904490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da458ba00 msgr2=0x562da458ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.832+0000 7fe962536980 1 --2- 172.21.15.72:0/2627904490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da458ba00 0x562da458ddf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe95400a480 tx=0x7fe95401b280 comp rx=0 tx=0).stop 2024-04-26T12:50:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.832+0000 7fe962536980 1 -- 172.21.15.72:0/2627904490 shutdown_connections 2024-04-26T12:50:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.832+0000 7fe962536980 1 --2- 172.21.15.72:0/2627904490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da458ba00 0x562da458ddf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.832+0000 7fe962536980 1 -- 172.21.15.72:0/2627904490 >> 172.21.15.72:0/2627904490 conn(0x562da44fabd0 msgr2=0x562da44fafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.832+0000 7fe962536980 1 -- 172.21.15.72:0/2627904490 shutdown_connections 2024-04-26T12:50:20.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.832+0000 7fe962536980 1 -- 172.21.15.72:0/2627904490 wait complete. 2024-04-26T12:50:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 Processor -- start 2024-04-26T12:50:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 -- start start 2024-04-26T12:50:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562da4488a70 con 0x562da45874f0 2024-04-26T12:50:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51022/0 (socket says 172.21.15.72:51022) 2024-04-26T12:50:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe960051640 1 -- 172.21.15.72:0/1807758580 learned_addr learned my addr 172.21.15.72:0/1807758580 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe960051640 1 -- 172.21.15.72:0/1807758580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da4672990 con 0x562da45874f0 2024-04-26T12:50:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe960051640 1 --2- 172.21.15.72:0/1807758580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46723c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe95000b250 tx=0x7fe95000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aa41b0bad5ea88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe84e60c640 1 -- 172.21.15.72:0/1807758580 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95000d640 con 0x562da45874f0 2024-04-26T12:50:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe84e60c640 1 -- 172.21.15.72:0/1807758580 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950008070 con 0x562da45874f0 2024-04-26T12:50:20.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe84e60c640 1 -- 172.21.15.72:0/1807758580 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95000d990 con 0x562da45874f0 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 -- 172.21.15.72:0/1807758580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 msgr2=0x562da46723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 --2- 172.21.15.72:0/1807758580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46723c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe95000b250 tx=0x7fe95000b710 comp rx=0 tx=0).stop 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 -- 172.21.15.72:0/1807758580 shutdown_connections 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 --2- 172.21.15.72:0/1807758580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46723c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 -- 172.21.15.72:0/1807758580 >> 172.21.15.72:0/1807758580 conn(0x562da44fabd0 msgr2=0x562da466df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 -- 172.21.15.72:0/1807758580 shutdown_connections 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.848+0000 7fe962536980 1 -- 172.21.15.72:0/1807758580 wait complete. 2024-04-26T12:50:20.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 Processor -- start 2024-04-26T12:50:20.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 -- start start 2024-04-26T12:50:20.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46796b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562da4590e20 con 0x562da45874f0 2024-04-26T12:50:20.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46796b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51038/0 (socket says 172.21.15.72:51038) 2024-04-26T12:50:20.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe960051640 1 -- 172.21.15.72:0/3962913172 learned_addr learned my addr 172.21.15.72:0/3962913172 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe960051640 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da4679bf0 con 0x562da45874f0 2024-04-26T12:50:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe960051640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46796b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe950000c10 tx=0x7fe950000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe84ce09640 1 -- 172.21.15.72:0/3962913172 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95001a7c0 con 0x562da45874f0 2024-04-26T12:50:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562da4679e80 con 0x562da45874f0 2024-04-26T12:50:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe84ce09640 1 -- 172.21.15.72:0/3962913172 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95001a960 con 0x562da45874f0 2024-04-26T12:50:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe84ce09640 1 -- 172.21.15.72:0/3962913172 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95001ac60 con 0x562da45874f0 2024-04-26T12:50:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da467cac0 con 0x562da45874f0 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe84ce09640 1 -- 172.21.15.72:0/3962913172 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe950017070 con 0x562da45874f0 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe84ce09640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8480346a0 0x7fe848036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe84ce09640 1 -- 172.21.15.72:0/3962913172 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe950015020 con 0x562da45874f0 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe95f850640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8480346a0 0x7fe848036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da458ba00 0x562da46805e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da4680c50 con 0x562da458ba00 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.852+0000 7fe960852640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da458ba00 0x562da46805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe95f850640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8480346a0 0x7fe848036b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9540ad000 tx=0x7fe9540a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe960852640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da458ba00 0x562da46805e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe960852640 1 -- 172.21.15.72:0/3962913172 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da458ba00 2024-04-26T12:50:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da467dce0 con 0x562da458ba00 2024-04-26T12:50:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe960852640 1 -- 172.21.15.72:0/3962913172 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da458ba00 2024-04-26T12:50:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da4682fa0 0x562da4685390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da4685a60 con 0x562da4682fa0 2024-04-26T12:50:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe960051640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da4682fa0 0x562da4685390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe960051640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da4682fa0 0x562da4685390 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe960051640 1 -- 172.21.15.72:0/3962913172 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe95002e070 con 0x562da4682fa0 2024-04-26T12:50:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da4681e40 con 0x562da458ba00 2024-04-26T12:50:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe960852640 1 -- 172.21.15.72:0/3962913172 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da458ba00 2024-04-26T12:50:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da4686ea0 0x562da4689290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da4689a20 con 0x562da4686ea0 2024-04-26T12:50:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.856+0000 7fe95f850640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da4686ea0 0x562da4689290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe95f850640 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da4686ea0 0x562da4689290 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe95f850640 1 -- 172.21.15.72:0/3962913172 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe9540b3040 con 0x562da4686ea0 2024-04-26T12:50:20.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe962536980 1 Processor -- start 2024-04-26T12:50:20.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe962536980 1 -- start start 2024-04-26T12:50:20.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe962536980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da4697a70 0x562da4697e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe962536980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562da448cab0 con 0x562da4697a70 2024-04-26T12:50:20.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da4697a70 0x562da4697e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da4697a70 0x562da4697e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51054/0 (socket says 172.21.15.72:51054) 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe960051640 1 -- 172.21.15.72:0/3355234050 learned_addr learned my addr 172.21.15.72:0/3355234050 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe960051640 1 -- 172.21.15.72:0/3355234050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da46983d0 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe960051640 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da4697a70 0x562da4697e90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe95001b540 tx=0x7fe9500196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe845ffb640 1 -- 172.21.15.72:0/3355234050 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95000eda0 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe845ffb640 1 -- 172.21.15.72:0/3355234050 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950012960 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562da4698e70 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe845ffb640 1 -- 172.21.15.72:0/3355234050 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950012c80 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.860+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da4699340 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe845ffb640 1 -- 172.21.15.72:0/3355234050 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe95003b070 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe845ffb640 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8380346a0 0x7fe838036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe845ffb640 1 -- 172.21.15.72:0/3355234050 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe950033ca0 con 0x562da4697a70 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe95f850640 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8380346a0 0x7fe838036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 Processor -- start 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- start start 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562da4672ce0 con 0x562da46a4a20 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe95f850640 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8380346a0 0x7fe838036b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe954000c10 tx=0x7fe954005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51058/0 (socket says 172.21.15.72:51058) 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe960051640 1 -- 172.21.15.72:0/2315712542 learned_addr learned my addr 172.21.15.72:0/2315712542 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe960051640 1 -- 172.21.15.72:0/2315712542 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da46a53f0 con 0x562da46a4a20 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe960051640 1 --2- 172.21.15.72:0/2315712542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46a4e20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe95001ee20 tx=0x7fe9500425d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d8e70064ea19cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe83f7fe640 1 -- 172.21.15.72:0/2315712542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950025340 con 0x562da46a4a20 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe83f7fe640 1 -- 172.21.15.72:0/2315712542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950059070 con 0x562da46a4a20 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe83f7fe640 1 -- 172.21.15.72:0/2315712542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950012740 con 0x562da46a4a20 2024-04-26T12:50:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- 172.21.15.72:0/2315712542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 msgr2=0x562da46a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 --2- 172.21.15.72:0/2315712542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46a4e20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe95001ee20 tx=0x7fe9500425d0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- 172.21.15.72:0/2315712542 shutdown_connections 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 --2- 172.21.15.72:0/2315712542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46a4e20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- 172.21.15.72:0/2315712542 >> 172.21.15.72:0/2315712542 conn(0x562da46a0d60 msgr2=0x562da469edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- 172.21.15.72:0/2315712542 shutdown_connections 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- 172.21.15.72:0/2315712542 wait complete. 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 Processor -- start 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- start start 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.864+0000 7fe962536980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562da46a5ad0 con 0x562da46a4a20 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe960051640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51062/0 (socket says 172.21.15.72:51062) 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 learned_addr learned my addr 172.21.15.72:0/257165816 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da46ac1e0 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe960051640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46abca0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe95004a8d0 tx=0x7fe950009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe83dffb640 1 -- 172.21.15.72:0/257165816 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95006c070 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562da46ac1e0 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe83dffb640 1 -- 172.21.15.72:0/257165816 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950012e20 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe83dffb640 1 -- 172.21.15.72:0/257165816 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950025340 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da46ac1e0 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe83dffb640 1 -- 172.21.15.72:0/257165816 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe95006f070 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe83dffb640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe830034650 0x7fe830036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe83dffb640 1 -- 172.21.15.72:0/257165816 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe950050030 con 0x562da46a4a20 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe95f850640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe830034650 0x7fe830036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da46b6df0 0x562da46b9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46b99e0 con 0x562da46b6df0 2024-04-26T12:50:20.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.868+0000 7fe960852640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da46b6df0 0x562da46b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe95f850640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe830034650 0x7fe830036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x562da4689e20 tx=0x7fe9540b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960852640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da46b6df0 0x562da46b9290 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 realm 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46b9df0 con 0x562da46b6df0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46ba690 con 0x562da46b6df0 2024-04-26T12:50:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da46bb790 0x562da46bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46be1d0 con 0x562da46bb790 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960051640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da46bb790 0x562da46bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960051640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da46bb790 0x562da46bdb80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 20 searching for the correct realm 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da46c00b0 0x562da46c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46c2ba0 con 0x562da46c00b0 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.872+0000 7fe95f850640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da46c00b0 0x562da46c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe95f850640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da46c00b0 0x562da46c2520 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe95f850640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe9540cc040 0x7fe9540dc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46c2ba0 con 0x7fe9540cc040 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe9540cc040 0x7fe9540dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe9540cc040 0x7fe9540dc430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.876+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x7fe9540cc040 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x7fe9540cc040 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.880+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x7fe9540cc040 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.884+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x7fe9540cc040 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46c00b0 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46bb790 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x562da46b6df0 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562da46baa30 con 0x7fe9540cc040 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:20.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46bea20 con 0x562da46b6df0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46bea20 con 0x562da46b6df0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46bea20 con 0x562da46c00b0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 zone default found 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 4 Realm: () 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 zonegroup default 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.888+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46bf3a0 con 0x562da46bb790 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46c4a90 con 0x562da46c00b0 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46c4ed0 con 0x562da46c00b0 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 20 started sync module instance, tier type = 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c3ea0 con 0x7fe9540cc040 2024-04-26T12:50:20.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94754032075760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c3ea0 con 0x7fe9540cc040 2024-04-26T12:50:20.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.892+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c5960 con 0x562da46b6df0 2024-04-26T12:50:20.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94754032080048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c58d0 con 0x562da46b6df0 2024-04-26T12:50:20.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c6870 con 0x562da46c00b0 2024-04-26T12:50:20.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94754032075760] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94754032080048] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94754032083872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c39f0 con 0x562da46c00b0 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.896+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c7110 con 0x7fe9540cc040 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94754032086384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c77e0 con 0x7fe9540cc040 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c8300 con 0x562da46b6df0 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94754032083872] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94754032086384] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94754032090576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c82c0 con 0x562da46b6df0 2024-04-26T12:50:20.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.900+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c86f0 con 0x562da46bb790 2024-04-26T12:50:20.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94754032087600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c8f90 con 0x562da46bb790 2024-04-26T12:50:20.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c9950 con 0x562da46bb790 2024-04-26T12:50:20.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94754032090576] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94754032087600] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94754032096416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c9cf0 con 0x562da46bb790 2024-04-26T12:50:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.904+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46ca540 con 0x562da46bb790 2024-04-26T12:50:20.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94754032096416] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94754032099472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46ca960 con 0x562da46bb790 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 20 add_watcher() i=0 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 20 add_watcher() i=1 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 20 add_watcher() i=2 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 20 add_watcher() i=3 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 20 add_watcher() i=4 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 20 add_watcher() i=5 2024-04-26T12:50:20.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.908+0000 7fe962536980 20 add_watcher() i=6 2024-04-26T12:50:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94754032099472] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 20 add_watcher() i=7 2024-04-26T12:50:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46cdc90 con 0x562da46b6df0 2024-04-26T12:50:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94754032113344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46caad0 con 0x562da46b6df0 2024-04-26T12:50:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94754032113344] v33'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe8167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 5 note: GC not initialized 2024-04-26T12:50:20.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe8157e2640 20 reqs_thread_entry: start 2024-04-26T12:50:20.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:20.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 20 Filter name: none 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe786ffd640 20 reqs_thread_entry: start 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.912+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46f1530 con 0x562da46b6df0 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46f3610 con 0x562da46b6df0 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv3 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 20 rados_obj.operate() r=0 bl.length=193 2024-04-26T12:50:20.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-26T12:50:20.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T12:50:20.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:20.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 20 rados->read ofs=0 len=0 2024-04-26T12:50:20.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.1d 8:b99a352c:root::.bucket.meta.testx%3amyfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46f4e80 con 0x562da46bb790 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 20 rados_obj.operate() r=0 bl.length=412 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46f9160 con 0x562da46b6df0 2024-04-26T12:50:20.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v33'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.916+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46fca70 con 0x7fe9540cc040 2024-04-26T12:50:20.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [create,call,writefull 0~379,setxattr (123)] v33'30 uv30 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x7 2024-04-26T12:50:20.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:20.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:20.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:20.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94754032297904 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46fc430 con 0x562da46bb790 2024-04-26T12:50:20.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== watch-notify(notify (1) cookie 94754032087600 notify 141733920781 ret 0) ==== 770+0+0 (crc 0 0 0) 0x562da46f43a0 con 0x562da46bb790 2024-04-26T12:50:20.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe83f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94754032087600 notifier 4566 bl.length()=728 2024-04-26T12:50:20.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe83f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x7 2024-04-26T12:50:20.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe83f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:20.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe83f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe83f7fe640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe824003eb0 con 0x562da46bb790 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(67 notify.5 [notify cookie 94754032297904 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== watch-notify(notify_complete (2) cookie 94754032297904 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562da46983d0 con 0x562da46bb790 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_sources= new_sources= 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential sources added=[] removed=[] 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_dests= new_dests= 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential dests added=[] removed=[] 2024-04-26T12:50:20.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.920+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46fc550 con 0x7fe9540cc040 2024-04-26T12:50:20.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.924+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(69 foo.buckets [call] v33'31 uv31 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.924+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46fb990 con 0x7fe9540cc040 2024-04-26T12:50:20.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'32 uv32 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe962536980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:50:20.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe962536980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:20.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe962536980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:50:20.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94754032304288 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46fd070 con 0x562da46bb790 2024-04-26T12:50:20.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== watch-notify(notify (1) cookie 94754032096416 notify 141733920782 ret 0) ==== 356+0+0 (crc 0 0 0) 0x562da467cac0 con 0x562da46bb790 2024-04-26T12:50:20.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe83effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 94754032096416 notifier 4566 bl.length()=314 2024-04-26T12:50:20.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(71 notify.6 [notify cookie 94754032304288 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe83effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:50:20.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe83effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:20.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe83effd640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe794003410 con 0x562da46bb790 2024-04-26T12:50:20.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== watch-notify(notify_complete (2) cookie 94754032304288 notify 141733920782 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562da4679e80 con 0x562da46bb790 2024-04-26T12:50:20.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.928+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46fc0a0 con 0x562da46b6df0 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v33'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe962536980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe962536980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94754032304288 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46f97a0 con 0x562da46b6df0 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== watch-notify(notify (1) cookie 94754032090576 notify 141733920781 ret 0) ==== 197+0+0 (crc 0 0 0) 0x562da46fc550 con 0x562da46b6df0 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe83effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94754032090576 notifier 4566 bl.length()=155 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(74 notify.4 [notify cookie 94754032304288 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe83effd640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe794003410 con 0x562da46b6df0 2024-04-26T12:50:20.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== watch-notify(notify_complete (2) cookie 94754032304288 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562da46fb7c0 con 0x562da46b6df0 2024-04-26T12:50:20.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 8.1d 8:b99a352c:root::.bucket.meta.testx%3amyfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46fc0a0 con 0x562da46bb790 2024-04-26T12:50:20.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call,delete] v33'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe962536980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 from cache 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe962536980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.932+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94754032304288 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562da46fc760 con 0x562da46b6df0 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== watch-notify(notify (1) cookie 94754032090576 notify 141733920782 ret 0) ==== 254+0+0 (crc 0 0 0) 0x562da46fb7c0 con 0x562da46b6df0 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe83f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 94754032090576 notifier 4566 bl.length()=212 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe83f7fe640 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe824003eb0 con 0x562da46b6df0 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(77 notify.4 [notify cookie 94754032304288 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== watch-notify(notify_complete (2) cookie 94754032304288 notify 141733920782 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562da46fce10 con 0x562da46b6df0 2024-04-26T12:50:20.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe8167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:20.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94754032113344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46fc0a0 con 0x562da46b6df0 2024-04-26T12:50:20.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94754032113344] v33'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.936+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94754032075760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46fc0a0 con 0x7fe9540cc040 2024-04-26T12:50:20.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.940+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94754032075760] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.940+0000 7fe962536980 20 remove_watcher() i=0 2024-04-26T12:50:20.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.940+0000 7fe962536980 2 removed watcher, disabling cache 2024-04-26T12:50:20.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.940+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94754032080048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c43d0 con 0x562da46b6df0 2024-04-26T12:50:20.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.940+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94754032080048] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x562da46b6df0 2024-04-26T12:50:20.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.940+0000 7fe962536980 20 remove_watcher() i=1 2024-04-26T12:50:20.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.940+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94754032083872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c54b0 con 0x562da46c00b0 2024-04-26T12:50:20.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.944+0000 7fe95f850640 1 -- 172.21.15.72:0/257165816 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94754032083872] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9540c8030 con 0x562da46c00b0 2024-04-26T12:50:20.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.944+0000 7fe962536980 20 remove_watcher() i=2 2024-04-26T12:50:20.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.944+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94754032086384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c54b0 con 0x7fe9540cc040 2024-04-26T12:50:20.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.944+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94754032086384] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95800a4d0 con 0x7fe9540cc040 2024-04-26T12:50:20.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.944+0000 7fe962536980 20 remove_watcher() i=3 2024-04-26T12:50:20.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.944+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94754032090576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c6d70 con 0x562da46b6df0 2024-04-26T12:50:20.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.948+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94754032090576] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95804e040 con 0x562da46b6df0 2024-04-26T12:50:20.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.948+0000 7fe962536980 20 remove_watcher() i=4 2024-04-26T12:50:20.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.948+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94754032087600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c54b0 con 0x562da46bb790 2024-04-26T12:50:20.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.948+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94754032087600] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.948+0000 7fe962536980 20 remove_watcher() i=5 2024-04-26T12:50:20.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.948+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94754032096416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c7dd0 con 0x562da46bb790 2024-04-26T12:50:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94754032096416] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 20 remove_watcher() i=6 2024-04-26T12:50:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94754032099472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562da46c6d70 con 0x562da46bb790 2024-04-26T12:50:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe960051640 1 -- 172.21.15.72:0/257165816 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94754032099472] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95006e030 con 0x562da46bb790 2024-04-26T12:50:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 20 remove_watcher() i=7 2024-04-26T12:50:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da46bb790 msgr2=0x562da46bdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da46bb790 0x562da46bdb80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da46b6df0 msgr2=0x562da46b9290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da46b6df0 0x562da46b9290 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe9540cc040 msgr2=0x7fe9540dc430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe9540cc040 0x7fe9540dc430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da46c00b0 msgr2=0x562da46c2520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da46c00b0 0x562da46c2520 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe830034650 msgr2=0x7fe830036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe830034650 0x7fe830036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x562da4689e20 tx=0x7fe9540b9040 comp rx=0 tx=0).stop 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 msgr2=0x562da46abca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe960852640 1 -- 172.21.15.72:0/257165816 reap_dead start 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46abca0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe95004a8d0 tx=0x7fe950009f10 comp rx=0 tx=0).stop 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 shutdown_connections 2024-04-26T12:50:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/257165816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da46a4a20 0x562da46abca0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 >> 172.21.15.72:0/257165816 conn(0x562da46a0d60 msgr2=0x562da469e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 shutdown_connections 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/257165816 wait complete. 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8380346a0 msgr2=0x7fe838036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8380346a0 0x7fe838036b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe954000c10 tx=0x7fe954005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da4697a70 msgr2=0x562da4697e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da4697a70 0x562da4697e90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe95001b540 tx=0x7fe9500196d0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 shutdown_connections 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8380346a0 0x7fe838036b60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 --2- 172.21.15.72:0/3355234050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da4697a70 0x562da4697e90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 >> 172.21.15.72:0/3355234050 conn(0x562da468c880 msgr2=0x562da468d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 shutdown_connections 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.952+0000 7fe962536980 1 -- 172.21.15.72:0/3355234050 wait complete. 2024-04-26T12:50:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da4682fa0 msgr2=0x562da4685390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562da4682fa0 0x562da4685390 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da458ba00 msgr2=0x562da46805e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562da458ba00 0x562da46805e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da4686ea0 msgr2=0x562da4689290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562da4686ea0 0x562da4689290 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8480346a0 msgr2=0x7fe848036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe8480346a0 0x7fe848036b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9540ad000 tx=0x7fe9540a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 msgr2=0x562da46796b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 --2- 172.21.15.72:0/3962913172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562da45874f0 0x562da46796b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe950000c10 tx=0x7fe950000ee0 comp rx=0 tx=0).stop 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe960852640 1 -- 172.21.15.72:0/3962913172 reap_dead start 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 shutdown_connections 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 >> 172.21.15.72:0/3962913172 conn(0x562da44fabd0 msgr2=0x562da466ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 shutdown_connections 2024-04-26T12:50:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:20.956+0000 7fe962536980 1 -- 172.21.15.72:0/3962913172 wait complete. 2024-04-26T12:50:20.966 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:50:20.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:50:20.967 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-26T12:50:21.047 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:21.048 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:21.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f9121593980 1 Processor -- start 2024-04-26T12:50:21.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f9121593980 1 -- start start 2024-04-26T12:50:21.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f9121593980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b2920598d0 0x55b2920ea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f9121593980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b291f92510 con 0x55b2920ea880 2024-04-26T12:50:21.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f9121593980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b291f99430 con 0x55b2920598d0 2024-04-26T12:50:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f911f0ae640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b2920598d0 0x55b2920ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f911e8ad640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55b2920ea880 0x55b2920ecc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36276/0 (socket says 172.21.15.72:36276) 2024-04-26T12:50:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.048+0000 7f911e8ad640 1 -- 172.21.15.72:0/1364400342 learned_addr learned my addr 172.21.15.72:0/1364400342 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911e0ac640 1 -- 172.21.15.72:0/1364400342 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107952136 0 0) 0x55b291f92510 con 0x55b2920ea880 2024-04-26T12:50:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911e0ac640 1 -- 172.21.15.72:0/1364400342 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9108001e20 con 0x55b2920ea880 2024-04-26T12:50:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911f0ae640 1 -- 172.21.15.72:0/1364400342 >> v1:172.21.15.29:6789/0 conn(0x55b2920ea880 legacy=0x55b2920ecc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911f0ae640 1 -- 172.21.15.72:0/1364400342 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b291f6eae0 con 0x55b2920598d0 2024-04-26T12:50:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911f0ae640 1 --2- 172.21.15.72:0/1364400342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2920ea340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f911000a480 tx=0x7f911001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d281ad3335209228 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911e0ac640 1 -- 172.21.15.72:0/1364400342 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100b0070 con 0x55b2920598d0 2024-04-26T12:50:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911e0ac640 1 -- 172.21.15.72:0/1364400342 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100ab540 con 0x55b2920598d0 2024-04-26T12:50:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f911e0ac640 1 -- 172.21.15.72:0/1364400342 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100ab840 con 0x55b2920598d0 2024-04-26T12:50:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f9121593980 1 -- 172.21.15.72:0/1364400342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 msgr2=0x55b2920ea340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f9121593980 1 --2- 172.21.15.72:0/1364400342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2920ea340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f911000a480 tx=0x7f911001b280 comp rx=0 tx=0).stop 2024-04-26T12:50:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f9121593980 1 -- 172.21.15.72:0/1364400342 shutdown_connections 2024-04-26T12:50:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f9121593980 1 --2- 172.21.15.72:0/1364400342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2920ea340 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f9121593980 1 -- 172.21.15.72:0/1364400342 >> 172.21.15.72:0/1364400342 conn(0x55b2920dfa60 msgr2=0x55b2920e1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f9121593980 1 -- 172.21.15.72:0/1364400342 shutdown_connections 2024-04-26T12:50:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.052+0000 7f9121593980 1 -- 172.21.15.72:0/1364400342 wait complete. 2024-04-26T12:50:21.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.068+0000 7f9121593980 1 Processor -- start 2024-04-26T12:50:21.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.068+0000 7f9121593980 1 -- start start 2024-04-26T12:50:21.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.068+0000 7f9121593980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.068+0000 7f9121593980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b291fe8a70 con 0x55b2920598d0 2024-04-26T12:50:21.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.068+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.068+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51072/0 (socket says 172.21.15.72:51072) 2024-04-26T12:50:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.068+0000 7f911f0ae640 1 -- 172.21.15.72:0/519469683 learned_addr learned my addr 172.21.15.72:0/519469683 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f911f0ae640 1 -- 172.21.15.72:0/519469683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2921d2aa0 con 0x55b2920598d0 2024-04-26T12:50:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f911f0ae640 1 --2- 172.21.15.72:0/519469683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d24d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9110000c10 tx=0x7f9110003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc0a25fecc6d264 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f900d60a640 1 -- 172.21.15.72:0/519469683 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100b0070 con 0x55b2920598d0 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f900d60a640 1 -- 172.21.15.72:0/519469683 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100bc070 con 0x55b2920598d0 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f900d60a640 1 -- 172.21.15.72:0/519469683 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100abc30 con 0x55b2920598d0 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- 172.21.15.72:0/519469683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 msgr2=0x55b2921d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 --2- 172.21.15.72:0/519469683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d24d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9110000c10 tx=0x7f9110003030 comp rx=0 tx=0).stop 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- 172.21.15.72:0/519469683 shutdown_connections 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 --2- 172.21.15.72:0/519469683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d24d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- 172.21.15.72:0/519469683 >> 172.21.15.72:0/519469683 conn(0x55b2920dfa60 msgr2=0x55b2921ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- 172.21.15.72:0/519469683 shutdown_connections 2024-04-26T12:50:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- 172.21.15.72:0/519469683 wait complete. 2024-04-26T12:50:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 Processor -- start 2024-04-26T12:50:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- start start 2024-04-26T12:50:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b2920f0e50 con 0x55b2920598d0 2024-04-26T12:50:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51080/0 (socket says 172.21.15.72:51080) 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f911f0ae640 1 -- 172.21.15.72:0/1321330077 learned_addr learned my addr 172.21.15.72:0/1321330077 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f911f0ae640 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2921d9a80 con 0x55b2920598d0 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f911f0ae640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d9540 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f91100b9040 tx=0x7f9110018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f900be07640 1 -- 172.21.15.72:0/1321330077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100b77c0 con 0x55b2920598d0 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2921d9d10 con 0x55b2920598d0 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f900be07640 1 -- 172.21.15.72:0/1321330077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100b1040 con 0x55b2920598d0 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f900be07640 1 -- 172.21.15.72:0/1321330077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100b7a90 con 0x55b2920598d0 2024-04-26T12:50:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.072+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2921dc990 con 0x55b2920598d0 2024-04-26T12:50:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f900be07640 1 -- 172.21.15.72:0/1321330077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f91100b7c30 con 0x55b2920598d0 2024-04-26T12:50:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f900be07640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90040346a0 0x7f9004036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f900be07640 1 -- 172.21.15.72:0/1321330077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f91100a8070 con 0x55b2920598d0 2024-04-26T12:50:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911e8ad640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90040346a0 0x7f9004036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2920ea880 0x55b2921e0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2921e0a90 con 0x55b2920ea880 2024-04-26T12:50:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911f8af640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2920ea880 0x55b2921e0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911e8ad640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90040346a0 0x7f9004036b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9114000f70 tx=0x7f91140010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911f8af640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2920ea880 0x55b2921e0470 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911f8af640 1 -- 172.21.15.72:0/1321330077 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b2920ea880 2024-04-26T12:50:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2921ddb90 con 0x55b2920ea880 2024-04-26T12:50:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911f8af640 1 -- 172.21.15.72:0/1321330077 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f911800a4d0 con 0x55b2920ea880 2024-04-26T12:50:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2921e2e10 0x55b2921e5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2921e58f0 con 0x55b2921e2e10 2024-04-26T12:50:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911f0ae640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2921e2e10 0x55b2921e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.076+0000 7f911f0ae640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2921e2e10 0x55b2921e5200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911f0ae640 1 -- 172.21.15.72:0/1321330077 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f91100aa3b0 con 0x55b2921e2e10 2024-04-26T12:50:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2921e1cb0 con 0x55b2920ea880 2024-04-26T12:50:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911f8af640 1 -- 172.21.15.72:0/1321330077 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f911800a4d0 con 0x55b2920ea880 2024-04-26T12:50:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2921e6d50 0x55b2921e9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2921e9880 con 0x55b2921e6d50 2024-04-26T12:50:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911e8ad640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2921e6d50 0x55b2921e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911e8ad640 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2921e6d50 0x55b2921e9140 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911e8ad640 1 -- 172.21.15.72:0/1321330077 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f911400e6c0 con 0x55b2921e6d50 2024-04-26T12:50:21.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f9121593980 1 Processor -- start 2024-04-26T12:50:21.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f9121593980 1 -- start start 2024-04-26T12:50:21.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f9121593980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2921f7910 0x55b2921f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f9121593980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b291fecab0 con 0x55b2921f7910 2024-04-26T12:50:21.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2921f7910 0x55b2921f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2921f7910 0x55b2921f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51090/0 (socket says 172.21.15.72:51090) 2024-04-26T12:50:21.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911f0ae640 1 -- 172.21.15.72:0/1647902433 learned_addr learned my addr 172.21.15.72:0/1647902433 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911f0ae640 1 -- 172.21.15.72:0/1647902433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2921f8270 con 0x55b2921f7910 2024-04-26T12:50:21.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.080+0000 7f911f0ae640 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2921f7910 0x55b2921f7d30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f91100e36b0 tx=0x7f91100b5d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9009602640 1 -- 172.21.15.72:0/1647902433 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100e5050 con 0x55b2921f7910 2024-04-26T12:50:21.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9009602640 1 -- 172.21.15.72:0/1647902433 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100b84e0 con 0x55b2921f7910 2024-04-26T12:50:21.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9009602640 1 -- 172.21.15.72:0/1647902433 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100e32a0 con 0x55b2921f7910 2024-04-26T12:50:21.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2921f8d10 con 0x55b2921f7910 2024-04-26T12:50:21.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2921f8d10 con 0x55b2921f7910 2024-04-26T12:50:21.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9009602640 1 -- 172.21.15.72:0/1647902433 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f91100b8780 con 0x55b2921f7910 2024-04-26T12:50:21.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9009602640 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ff8034650 0x7f8ff8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9009602640 1 -- 172.21.15.72:0/1647902433 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f91100ea1b0 con 0x55b2921f7910 2024-04-26T12:50:21.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f911e8ad640 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ff8034650 0x7f8ff8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9121593980 1 Processor -- start 2024-04-26T12:50:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9121593980 1 -- start start 2024-04-26T12:50:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f911e8ad640 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ff8034650 0x7f8ff8036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f911400c010 tx=0x7f911400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9121593980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b292204b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9121593980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b2921d2d30 con 0x55b292204770 2024-04-26T12:50:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b292204b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b292204b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51094/0 (socket says 172.21.15.72:51094) 2024-04-26T12:50:21.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f911f0ae640 1 -- 172.21.15.72:0/546469403 learned_addr learned my addr 172.21.15.72:0/546469403 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f911f0ae640 1 -- 172.21.15.72:0/546469403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b292205120 con 0x55b292204770 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f911f0ae640 1 --2- 172.21.15.72:0/546469403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b292204b50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f91100bf010 tx=0x7f91100b6ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f013e9a09652724a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.084+0000 7f9002ffd640 1 -- 172.21.15.72:0/546469403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100cb3e0 con 0x55b292204770 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9002ffd640 1 -- 172.21.15.72:0/546469403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100e3440 con 0x55b292204770 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9002ffd640 1 -- 172.21.15.72:0/546469403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100b6c00 con 0x55b292204770 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- 172.21.15.72:0/546469403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 msgr2=0x55b292204b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 --2- 172.21.15.72:0/546469403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b292204b50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f91100bf010 tx=0x7f91100b6ae0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- 172.21.15.72:0/546469403 shutdown_connections 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 --2- 172.21.15.72:0/546469403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b292204b50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- 172.21.15.72:0/546469403 >> 172.21.15.72:0/546469403 conn(0x55b292200ab0 msgr2=0x55b2921feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- 172.21.15.72:0/546469403 shutdown_connections 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- 172.21.15.72:0/546469403 wait complete. 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 Processor -- start 2024-04-26T12:50:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- start start 2024-04-26T12:50:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b29220bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b292205820 con 0x55b292204770 2024-04-26T12:50:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b29220bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f911f0ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b29220bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51100/0 (socket says 172.21.15.72:51100) 2024-04-26T12:50:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 learned_addr learned my addr 172.21.15.72:0/3891952934 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29220c200 con 0x55b292204770 2024-04-26T12:50:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f911f0ae640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b29220bcc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f91100ddf00 tx=0x7f91100aeef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f90017fa640 1 -- 172.21.15.72:0/3891952934 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9110114070 con 0x55b292204770 2024-04-26T12:50:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b29220c200 con 0x55b292204770 2024-04-26T12:50:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f90017fa640 1 -- 172.21.15.72:0/3891952934 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100cbb30 con 0x55b292204770 2024-04-26T12:50:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f90017fa640 1 -- 172.21.15.72:0/3891952934 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91100c1400 con 0x55b292204770 2024-04-26T12:50:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.088+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29220c200 con 0x55b292204770 2024-04-26T12:50:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f90017fa640 1 -- 172.21.15.72:0/3891952934 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9110117070 con 0x55b292204770 2024-04-26T12:50:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f90017fa640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8fe8034650 0x7f8fe8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f90017fa640 1 -- 172.21.15.72:0/3891952934 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f911010a030 con 0x55b292204770 2024-04-26T12:50:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911e8ad640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8fe8034650 0x7f8fe8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b292216df0 0x55b2922192b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292219a00 con 0x55b292216df0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f8af640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b292216df0 0x55b2922192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911e8ad640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8fe8034650 0x7f8fe8036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55b2921e0fb0 tx=0x7f9114010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f8af640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b292216df0 0x55b2922192b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 realm 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292219e10 con 0x55b292216df0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29221a6b0 con 0x55b292216df0 2024-04-26T12:50:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b29221b7b0 0x55b29221dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29221e240 con 0x55b29221b7b0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f0ae640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b29221b7b0 0x55b29221dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.092+0000 7f911f0ae640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b29221b7b0 0x55b29221dba0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f9121593980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f9121593980 20 searching for the correct realm 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b292220120 0x55b292222570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b292222bf0 con 0x55b292220120 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911e8ad640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b292220120 0x55b292222570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911e8ad640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b292220120 0x55b292222570 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911e8ad640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9114037040 0x7f9114036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b292222bf0 con 0x7f9114037040 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9114037040 0x7f9114036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9114037040 0x7f9114036410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.096+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x7f9114037040 2024-04-26T12:50:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x7f9114037040 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.100+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x7f9114037040 2024-04-26T12:50:21.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.104+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x7f9114037040 2024-04-26T12:50:21.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292220120 2024-04-26T12:50:21.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b29221b7b0 2024-04-26T12:50:21.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x55b292216df0 2024-04-26T12:50:21.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b29221aa50 con 0x7f9114037040 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.108+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29221ea90 con 0x55b292216df0 2024-04-26T12:50:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29221ea90 con 0x55b292216df0 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29221ea90 con 0x55b292220120 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 zone default found 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 4 Realm: () 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:21.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 zonegroup default 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29221f430 con 0x55b29221b7b0 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292224b00 con 0x55b292220120 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292224f60 con 0x55b292220120 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 started sync module instance, tier type = 2024-04-26T12:50:21.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:21.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292223ef0 con 0x7f9114037040 2024-04-26T12:50:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225444258832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292223ef0 con 0x7f9114037040 2024-04-26T12:50:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.112+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292225a20 con 0x55b292216df0 2024-04-26T12:50:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.116+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225444258832] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.116+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.116+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225444263216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292223ef0 con 0x55b292216df0 2024-04-26T12:50:21.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.116+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292226430 con 0x55b292220120 2024-04-26T12:50:21.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225444263216] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225444256320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292223e60 con 0x55b292220120 2024-04-26T12:50:21.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292227180 con 0x7f9114037040 2024-04-26T12:50:21.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225444269568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292227a20 con 0x7f9114037040 2024-04-26T12:50:21.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292228420 con 0x55b292216df0 2024-04-26T12:50:21.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225444256320] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225444269568] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225444268064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292227500 con 0x55b292216df0 2024-04-26T12:50:21.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.120+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292228cc0 con 0x55b29221b7b0 2024-04-26T12:50:21.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.124+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225444268064] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.124+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.124+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225444276240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292227500 con 0x55b29221b7b0 2024-04-26T12:50:21.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.124+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292229510 con 0x55b29221b7b0 2024-04-26T12:50:21.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225444276240] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225444273968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292229d60 con 0x55b29221b7b0 2024-04-26T12:50:21.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b29222a630 con 0x55b29221b7b0 2024-04-26T12:50:21.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225444273968] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225444280496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b29222a810 con 0x55b29221b7b0 2024-04-26T12:50:21.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 20 add_watcher() i=0 2024-04-26T12:50:21.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 20 add_watcher() i=1 2024-04-26T12:50:21.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 20 add_watcher() i=2 2024-04-26T12:50:21.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 20 add_watcher() i=3 2024-04-26T12:50:21.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 20 add_watcher() i=4 2024-04-26T12:50:21.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 20 add_watcher() i=5 2024-04-26T12:50:21.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.128+0000 7f9121593980 20 add_watcher() i=6 2024-04-26T12:50:21.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225444280496] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f9121593980 20 add_watcher() i=7 2024-04-26T12:50:21.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f9121593980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:21.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b29222dbe0 con 0x55b292216df0 2024-04-26T12:50:21.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225444284160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b29222afd0 con 0x55b292216df0 2024-04-26T12:50:21.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225444284160] v33'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f8fd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f9121593980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:21.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f9121593980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:21.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.132+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292236530 con 0x55b292216df0 2024-04-26T12:50:21.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.136+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.136+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292236b80 con 0x55b29221b7b0 2024-04-26T12:50:21.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.136+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.136+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292236b80 con 0x55b292220120 2024-04-26T12:50:21.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.140+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.140+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922371b0 con 0x55b292216df0 2024-04-26T12:50:21.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.140+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.140+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292237570 con 0x7f9114037040 2024-04-26T12:50:21.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.144+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.144+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292237970 con 0x55b292220120 2024-04-26T12:50:21.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.144+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.144+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292237ee0 con 0x55b292216df0 2024-04-26T12:50:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.148+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.148+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238390 con 0x55b29221b7b0 2024-04-26T12:50:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.148+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.148+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238390 con 0x7f9114037040 2024-04-26T12:50:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.152+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.152+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238390 con 0x55b292220120 2024-04-26T12:50:21.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.152+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.152+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x7f9114037040 2024-04-26T12:50:21.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.156+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.156+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b29221b7b0 2024-04-26T12:50:21.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.156+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.156+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x7f9114037040 2024-04-26T12:50:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.156+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.156+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b29221b7b0 2024-04-26T12:50:21.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.160+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.160+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b292216df0 2024-04-26T12:50:21.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.160+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'136 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.160+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b292220120 2024-04-26T12:50:21.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.164+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.164+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x7f9114037040 2024-04-26T12:50:21.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.164+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.164+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b292220120 2024-04-26T12:50:21.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.168+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.168+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b292216df0 2024-04-26T12:50:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.168+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.168+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b292216df0 2024-04-26T12:50:21.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.172+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.172+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x55b292220120 2024-04-26T12:50:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.172+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.172+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922321d0 con 0x7f9114037040 2024-04-26T12:50:21.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.172+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.172+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922322a0 con 0x55b292220120 2024-04-26T12:50:21.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.176+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.176+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922322a0 con 0x55b292220120 2024-04-26T12:50:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.176+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.176+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922322a0 con 0x55b292220120 2024-04-26T12:50:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.176+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.176+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922322a0 con 0x55b292220120 2024-04-26T12:50:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.180+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.180+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2922322a0 con 0x55b29221b7b0 2024-04-26T12:50:21.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.180+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.180+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238ef0 con 0x55b292220120 2024-04-26T12:50:21.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.184+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.184+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238ef0 con 0x55b29221b7b0 2024-04-26T12:50:21.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.188+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.188+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238ef0 con 0x55b292220120 2024-04-26T12:50:21.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.188+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.188+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238ef0 con 0x55b29221b7b0 2024-04-26T12:50:21.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292238ef0 con 0x7f9114037040 2024-04-26T12:50:21.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f8fd4fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:21.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f9121593980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:21.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f9121593980 20 Filter name: none 2024-04-26T12:50:21.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f8f4e7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:21.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f9121593980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T12:50:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f9121593980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.192+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292253f20 con 0x55b29221b7b0 2024-04-26T12:50:21.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 20 rados_obj.operate() r=0 bl.length=419 2024-04-26T12:50:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-26T12:50:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:50:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292256990 con 0x55b292216df0 2024-04-26T12:50:21.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T12:50:21.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292254970 con 0x55b29221b7b0 2024-04-26T12:50:21.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:50:21.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.196+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94225444459728 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292256db0 con 0x55b292220120 2024-04-26T12:50:21.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== watch-notify(notify (1) cookie 94225444256320 notify 141733920773 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b292237970 con 0x55b292220120 2024-04-26T12:50:21.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94225444256320 notifier 4573 bl.length()=170 2024-04-26T12:50:21.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9002ffd640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8fe4003d70 con 0x55b292220120 2024-04-26T12:50:21.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(97 notify.2 [notify cookie 94225444459728 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== watch-notify(notify_complete (2) cookie 94225444459728 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b292237d10 con 0x55b292220120 2024-04-26T12:50:21.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9121593980 10 removing email index: 2024-04-26T12:50:21.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9121593980 10 removing user buckets index 2024-04-26T12:50:21.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292254970 con 0x55b292216df0 2024-04-26T12:50:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v33'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9121593980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-26T12:50:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94225444459728 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292256db0 con 0x55b292216df0 2024-04-26T12:50:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== watch-notify(notify (1) cookie 94225444268064 notify 141733920783 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55b292235ec0 con 0x55b292216df0 2024-04-26T12:50:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f90027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94225444268064 notifier 4573 bl.length()=175 2024-04-26T12:50:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(100 notify.4 [notify cookie 94225444459728 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f90027fc640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8f540032d0 con 0x55b292216df0 2024-04-26T12:50:21.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== watch-notify(notify_complete (2) cookie 94225444459728 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b292237380 con 0x55b292216df0 2024-04-26T12:50:21.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9121593980 10 removing user index: testx$tenanteduser 2024-04-26T12:50:21.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.200+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292258b10 con 0x55b29221b7b0 2024-04-26T12:50:21.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v33'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f9121593980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-26T12:50:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f9121593980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-26T12:50:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94225444472416 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b292258a80 con 0x7f9114037040 2024-04-26T12:50:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== watch-notify(notify (1) cookie 94225444269568 notify 141733920787 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55b292237380 con 0x7f9114037040 2024-04-26T12:50:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f9002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 94225444269568 notifier 4573 bl.length()=167 2024-04-26T12:50:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f9002ffd640 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8fe4003d70 con 0x7f9114037040 2024-04-26T12:50:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(103 notify.3 [notify cookie 94225444472416 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== watch-notify(notify_complete (2) cookie 94225444472416 notify 141733920787 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b2922371b0 con 0x7f9114037040 2024-04-26T12:50:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f8fd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.204+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225444284160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292230ed0 con 0x55b292216df0 2024-04-26T12:50:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.208+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94225444284160] v33'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.208+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225444258832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b29222a700 con 0x7f9114037040 2024-04-26T12:50:21.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.208+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94225444258832] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.208+0000 7f9121593980 20 remove_watcher() i=0 2024-04-26T12:50:21.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.208+0000 7f9121593980 2 removed watcher, disabling cache 2024-04-26T12:50:21.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.208+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225444263216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b29222a700 con 0x55b292216df0 2024-04-26T12:50:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94225444263216] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f9121593980 20 remove_watcher() i=1 2024-04-26T12:50:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225444256320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292225530 con 0x55b292220120 2024-04-26T12:50:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f911e8ad640 1 -- 172.21.15.72:0/3891952934 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94225444256320] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911400e6c0 con 0x55b292220120 2024-04-26T12:50:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f9121593980 20 remove_watcher() i=2 2024-04-26T12:50:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225444269568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b29222a700 con 0x7f9114037040 2024-04-26T12:50:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94225444269568] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x7f9114037040 2024-04-26T12:50:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f9121593980 20 remove_watcher() i=3 2024-04-26T12:50:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.212+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225444268064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292223a40 con 0x55b292216df0 2024-04-26T12:50:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.216+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94225444268064] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f911800a4d0 con 0x55b292216df0 2024-04-26T12:50:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.216+0000 7f9121593980 20 remove_watcher() i=4 2024-04-26T12:50:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.216+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225444276240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292225530 con 0x55b29221b7b0 2024-04-26T12:50:21.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.220+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94225444276240] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.220+0000 7f9121593980 20 remove_watcher() i=5 2024-04-26T12:50:21.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.220+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225444273968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b29222a700 con 0x55b29221b7b0 2024-04-26T12:50:21.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.220+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94225444273968] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.220+0000 7f9121593980 20 remove_watcher() i=6 2024-04-26T12:50:21.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.220+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225444280496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b292226820 con 0x55b29221b7b0 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f911f0ae640 1 -- 172.21.15.72:0/3891952934 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94225444280496] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9110116030 con 0x55b29221b7b0 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 20 remove_watcher() i=7 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b29221b7b0 msgr2=0x55b29221dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b29221b7b0 0x55b29221dba0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b292216df0 msgr2=0x55b2922192b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b292216df0 0x55b2922192b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9114037040 msgr2=0x7f9114036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9114037040 0x7f9114036410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b292220120 msgr2=0x55b292222570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b292220120 0x55b292222570 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8fe8034650 msgr2=0x7f8fe8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8fe8034650 0x7f8fe8036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55b2921e0fb0 tx=0x7f9114010000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 msgr2=0x55b29220bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b29220bcc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f91100ddf00 tx=0x7f91100aeef0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f911f8af640 1 -- 172.21.15.72:0/3891952934 reap_dead start 2024-04-26T12:50:21.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 shutdown_connections 2024-04-26T12:50:21.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/3891952934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b292204770 0x55b29220bcc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 >> 172.21.15.72:0/3891952934 conn(0x55b292200ab0 msgr2=0x55b2921fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 shutdown_connections 2024-04-26T12:50:21.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/3891952934 wait complete. 2024-04-26T12:50:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ff8034650 msgr2=0x7f8ff8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ff8034650 0x7f8ff8036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f911400c010 tx=0x7f911400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2921f7910 msgr2=0x55b2921f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2921f7910 0x55b2921f7d30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f91100e36b0 tx=0x7f91100b5d70 comp rx=0 tx=0).stop 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 shutdown_connections 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f8ff8034650 0x7f8ff8036b10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1647902433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2921f7910 0x55b2921f7d30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 >> 172.21.15.72:0/1647902433 conn(0x55b2921ec720 msgr2=0x55b2921ed230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 shutdown_connections 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1647902433 wait complete. 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2921e2e10 msgr2=0x55b2921e5200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2921e2e10 0x55b2921e5200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2920ea880 msgr2=0x55b2921e0470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2920ea880 0x55b2921e0470 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2921e6d50 msgr2=0x55b2921e9140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2921e6d50 0x55b2921e9140 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90040346a0 msgr2=0x7f9004036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f90040346a0 0x7f9004036b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9114000f70 tx=0x7f91140010b0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 msgr2=0x55b2921d9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 --2- 172.21.15.72:0/1321330077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2920598d0 0x55b2921d9540 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f91100b9040 tx=0x7f9110018020 comp rx=0 tx=0).stop 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f911f8af640 1 -- 172.21.15.72:0/1321330077 reap_dead start 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 shutdown_connections 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 >> 172.21.15.72:0/1321330077 conn(0x55b2920dfa60 msgr2=0x55b2921ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 shutdown_connections 2024-04-26T12:50:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.224+0000 7f9121593980 1 -- 172.21.15.72:0/1321330077 wait complete. 2024-04-26T12:50:21.247 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-26T12:50:21.251 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-26T12:50:21.299 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:21.299 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-26T12:50:21.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-26T12:50:21.299 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-26T12:50:21.335 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:21.335 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:21.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c2fd7980 1 Processor -- start 2024-04-26T12:50:21.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c2fd7980 1 -- start start 2024-04-26T12:50:21.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c2fd7980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c4b79314f0 0x55c4b79318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c2fd7980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c4b77dc510 con 0x55c4b7931e10 2024-04-26T12:50:21.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c2fd7980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c4b77e3430 con 0x55c4b79314f0 2024-04-26T12:50:21.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c0af2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c4b79314f0 0x55c4b79318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c0af2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c4b79314f0 0x55c4b79318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51102/0 (socket says 172.21.15.72:51102) 2024-04-26T12:50:21.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c02f1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55c4b7931e10 0x55c4b79327d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36286/0 (socket says 172.21.15.72:36286) 2024-04-26T12:50:21.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c0af2640 1 -- 172.21.15.72:0/3451774331 learned_addr learned my addr 172.21.15.72:0/3451774331 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c0af2640 1 -- 172.21.15.72:0/3451774331 >> v1:172.21.15.29:6789/0 conn(0x55c4b7931e10 legacy=0x55c4b79327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.336+0000 7f68c0af2640 1 -- 172.21.15.72:0/3451774331 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b77b8ae0 con 0x55c4b79314f0 2024-04-26T12:50:21.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c0af2640 1 --2- 172.21.15.72:0/3451774331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b79318d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f68b000a5c0 tx=0x7f68b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112e2db998bf7765 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68bfaf0640 1 -- 172.21.15.72:0/3451774331 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00a6070 con 0x55c4b79314f0 2024-04-26T12:50:21.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68bfaf0640 1 -- 172.21.15.72:0/3451774331 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00af070 con 0x55c4b79314f0 2024-04-26T12:50:21.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68bfaf0640 1 -- 172.21.15.72:0/3451774331 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00aa5c0 con 0x55c4b79314f0 2024-04-26T12:50:21.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3451774331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 msgr2=0x55c4b79318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3451774331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b79318d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f68b000a5c0 tx=0x7f68b001b340 comp rx=0 tx=0).stop 2024-04-26T12:50:21.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3451774331 shutdown_connections 2024-04-26T12:50:21.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3451774331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b79318d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3451774331 >> 172.21.15.72:0/3451774331 conn(0x55c4b78a4bd0 msgr2=0x55c4b78a4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3451774331 shutdown_connections 2024-04-26T12:50:21.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.340+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3451774331 wait complete. 2024-04-26T12:50:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c2fd7980 1 Processor -- start 2024-04-26T12:50:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c2fd7980 1 -- start start 2024-04-26T12:50:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c2fd7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a1cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c2fd7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c4b7832a70 con 0x55c4b79314f0 2024-04-26T12:50:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a1cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a1cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51114/0 (socket says 172.21.15.72:51114) 2024-04-26T12:50:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c0af2640 1 -- 172.21.15.72:0/398831605 learned_addr learned my addr 172.21.15.72:0/398831605 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c0af2640 1 -- 172.21.15.72:0/398831605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b7a1d320 con 0x55c4b79314f0 2024-04-26T12:50:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.356+0000 7f68c0af2640 1 --2- 172.21.15.72:0/398831605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a1cd50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f68b00199f0 tx=0x7f68b0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d19b2c07022bfa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f67aee0d640 1 -- 172.21.15.72:0/398831605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00aaa00 con 0x55c4b79314f0 2024-04-26T12:50:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f67aee0d640 1 -- 172.21.15.72:0/398831605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00aaba0 con 0x55c4b79314f0 2024-04-26T12:50:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f67aee0d640 1 -- 172.21.15.72:0/398831605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00bd3f0 con 0x55c4b79314f0 2024-04-26T12:50:21.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- 172.21.15.72:0/398831605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 msgr2=0x55c4b7a1cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/398831605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a1cd50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f68b00199f0 tx=0x7f68b0003030 comp rx=0 tx=0).stop 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- 172.21.15.72:0/398831605 shutdown_connections 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/398831605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a1cd50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- 172.21.15.72:0/398831605 >> 172.21.15.72:0/398831605 conn(0x55c4b78a4bd0 msgr2=0x55c4b7a188e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- 172.21.15.72:0/398831605 shutdown_connections 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- 172.21.15.72:0/398831605 wait complete. 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 Processor -- start 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- start start 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a23e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c4b793b540 con 0x55c4b79314f0 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a23e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a23e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51122/0 (socket says 172.21.15.72:51122) 2024-04-26T12:50:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c0af2640 1 -- 172.21.15.72:0/3477979945 learned_addr learned my addr 172.21.15.72:0/3477979945 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c0af2640 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b7a243b0 con 0x55c4b79314f0 2024-04-26T12:50:21.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c0af2640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a23e70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f68b001b170 tx=0x7f68b00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f67ad60a640 1 -- 172.21.15.72:0/3477979945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00bd7c0 con 0x55c4b79314f0 2024-04-26T12:50:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4b7a24640 con 0x55c4b79314f0 2024-04-26T12:50:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f67ad60a640 1 -- 172.21.15.72:0/3477979945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00bd960 con 0x55c4b79314f0 2024-04-26T12:50:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f67ad60a640 1 -- 172.21.15.72:0/3477979945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00bdc40 con 0x55c4b79314f0 2024-04-26T12:50:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.360+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b7a27250 con 0x55c4b79314f0 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f67ad60a640 1 -- 172.21.15.72:0/3477979945 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68b00ce020 con 0x55c4b79314f0 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f67ad60a640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f67a80346a0 0x7f67a8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f67ad60a640 1 -- 172.21.15.72:0/3477979945 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f68b00cc020 con 0x55c4b79314f0 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c02f1640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f67a80346a0 0x7f67a8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7931e10 0x55c4b7a2aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a2b3e0 con 0x55c4b7931e10 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c12f3640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7931e10 0x55c4b7a2aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c02f1640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f67a80346a0 0x7f67a8036b60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000f70 tx=0x7f68b4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c12f3640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7931e10 0x55c4b7a2aea0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c12f3640 1 -- 172.21.15.72:0/3477979945 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7931e10 2024-04-26T12:50:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a28450 con 0x55c4b7931e10 2024-04-26T12:50:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c12f3640 1 -- 172.21.15.72:0/3477979945 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7931e10 2024-04-26T12:50:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a2d720 0x55c4b7a2fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a30200 con 0x55c4b7a2d720 2024-04-26T12:50:21.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c0af2640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a2d720 0x55c4b7a2fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.364+0000 7f68c0af2640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a2d720 0x55c4b7a2fb10 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c0af2640 1 -- 172.21.15.72:0/3477979945 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68b00c6cd0 con 0x55c4b7a2d720 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a2c5c0 con 0x55c4b7931e10 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c12f3640 1 -- 172.21.15.72:0/3477979945 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7931e10 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a31660 0x55c4b7a33a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a34190 con 0x55c4b7a31660 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c02f1640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a31660 0x55c4b7a33a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c02f1640 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a31660 0x55c4b7a33a50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c02f1640 1 -- 172.21.15.72:0/3477979945 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68b400f6a0 con 0x55c4b7a31660 2024-04-26T12:50:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 Processor -- start 2024-04-26T12:50:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 -- start start 2024-04-26T12:50:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a42220 0x55c4b7a42640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c4b7836ab0 con 0x55c4b7a42220 2024-04-26T12:50:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a42220 0x55c4b7a42640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a42220 0x55c4b7a42640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51138/0 (socket says 172.21.15.72:51138) 2024-04-26T12:50:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c0af2640 1 -- 172.21.15.72:0/1326995436 learned_addr learned my addr 172.21.15.72:0/1326995436 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c0af2640 1 -- 172.21.15.72:0/1326995436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b7a42b80 con 0x55c4b7a42220 2024-04-26T12:50:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c0af2640 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a42220 0x55c4b7a42640 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f68b00bc920 tx=0x7f68b00de3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f67a67fc640 1 -- 172.21.15.72:0/1326995436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00c5db0 con 0x55c4b7a42220 2024-04-26T12:50:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4b7a43620 con 0x55c4b7a42220 2024-04-26T12:50:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f67a67fc640 1 -- 172.21.15.72:0/1326995436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00bc9e0 con 0x55c4b7a42220 2024-04-26T12:50:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f67a67fc640 1 -- 172.21.15.72:0/1326995436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00bccc0 con 0x55c4b7a42220 2024-04-26T12:50:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.368+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b7a43af0 con 0x55c4b7a42220 2024-04-26T12:50:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f67a67fc640 1 -- 172.21.15.72:0/1326995436 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68b00c6480 con 0x55c4b7a42220 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f67a67fc640 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6798034650 0x7f6798036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f67a67fc640 1 -- 172.21.15.72:0/1326995436 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f68b00eec30 con 0x55c4b7a42220 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c02f1640 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6798034650 0x7f6798036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 Processor -- start 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 -- start start 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a4f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c4b7a1d5b0 con 0x55c4b7a4f240 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c02f1640 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6798034650 0x7f6798036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55c4b7a2b8c0 tx=0x7f68b400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a4f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a4f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51150/0 (socket says 172.21.15.72:51150) 2024-04-26T12:50:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c0af2640 1 -- 172.21.15.72:0/3036682266 learned_addr learned my addr 172.21.15.72:0/3036682266 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c0af2640 1 -- 172.21.15.72:0/3036682266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b7a4fc10 con 0x55c4b7a4f240 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c0af2640 1 --2- 172.21.15.72:0/3036682266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a4f640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f68b00d9010 tx=0x7f68b00b5ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38271c74beded5b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f6797fff640 1 -- 172.21.15.72:0/3036682266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00e51d0 con 0x55c4b7a4f240 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f6797fff640 1 -- 172.21.15.72:0/3036682266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00e3270 con 0x55c4b7a4f240 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f6797fff640 1 -- 172.21.15.72:0/3036682266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00cfa80 con 0x55c4b7a4f240 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3036682266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 msgr2=0x55c4b7a4f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3036682266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a4f640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f68b00d9010 tx=0x7f68b00b5ef0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3036682266 shutdown_connections 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.372+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3036682266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a4f640 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3036682266 >> 172.21.15.72:0/3036682266 conn(0x55c4b7a4b580 msgr2=0x55c4b7a495e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3036682266 shutdown_connections 2024-04-26T12:50:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3036682266 wait complete. 2024-04-26T12:50:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 Processor -- start 2024-04-26T12:50:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 -- start start 2024-04-26T12:50:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c4b7a502f0 con 0x55c4b7a4f240 2024-04-26T12:50:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c0af2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:51162/0 (socket says 172.21.15.72:51162) 2024-04-26T12:50:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 learned_addr learned my addr 172.21.15.72:0/1584966696 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b7a569e0 con 0x55c4b7a4f240 2024-04-26T12:50:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c0af2640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a564a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f68b0005120 tx=0x7f68b00cded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f67967fc640 1 -- 172.21.15.72:0/1584966696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00c7ae0 con 0x55c4b7a4f240 2024-04-26T12:50:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4b7a569e0 con 0x55c4b7a4f240 2024-04-26T12:50:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f67967fc640 1 -- 172.21.15.72:0/1584966696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00c7c80 con 0x55c4b7a4f240 2024-04-26T12:50:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f67967fc640 1 -- 172.21.15.72:0/1584966696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b00e5a50 con 0x55c4b7a4f240 2024-04-26T12:50:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b7a56e50 con 0x55c4b7a4f240 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f67967fc640 1 -- 172.21.15.72:0/1584966696 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68b0112030 con 0x55c4b7a4f240 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f67967fc640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f678c034650 0x7f678c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.376+0000 7f67967fc640 1 -- 172.21.15.72:0/1584966696 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f68b0110070 con 0x55c4b7a4f240 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c02f1640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f678c034650 0x7f678c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7a615c0 0x55c4b7a63a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a641d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c12f3640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7a615c0 0x55c4b7a63a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c02f1640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f678c034650 0x7f678c036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f68b400ffd0 tx=0x7f68b4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c12f3640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7a615c0 0x55c4b7a63a80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 realm 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a645e0 con 0x55c4b7a615c0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a64e80 con 0x55c4b7a615c0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a65f80 0x55c4b7a68370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a68a10 con 0x55c4b7a65f80 2024-04-26T12:50:21.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c0af2640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a65f80 0x55c4b7a68370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c0af2640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a65f80 0x55c4b7a68370 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.380+0000 7f68c2fd7980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c2fd7980 20 searching for the correct realm 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a6a8f0 0x55c4b7a6cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6d3e0 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c02f1640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a6a8f0 0x55c4b7a6cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c02f1640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a6a8f0 0x55c4b7a6cd60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c02f1640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f68b401fbe0 0x7f68b403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6d3e0 con 0x7f68b401fbe0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f68b401fbe0 0x7f68b403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f68b401fbe0 0x7f68b403a3c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.384+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x7f68b401fbe0 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x7f68b401fbe0 2024-04-26T12:50:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.388+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x7f68b401fbe0 2024-04-26T12:50:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.392+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x7f68b401fbe0 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a65f80 2024-04-26T12:50:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x55c4b7a615c0 2024-04-26T12:50:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a65220 con 0x7f68b401fbe0 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a69260 con 0x55c4b7a615c0 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.396+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a69260 con 0x55c4b7a615c0 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a69260 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 zone default found 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 4 Realm: () 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 zonegroup default 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a69bf0 con 0x55c4b7a65f80 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6f2d0 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6f810 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 started sync module instance, tier type = 2024-04-26T12:50:21.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:21.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6e6e0 con 0x7f68b401fbe0 2024-04-26T12:50:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94303383120864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6e6e0 con 0x7f68b401fbe0 2024-04-26T12:50:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.400+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a702d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.404+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94303383120864] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.404+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.404+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94303383125472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6e6e0 con 0x55c4b7a615c0 2024-04-26T12:50:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.404+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a70ce0 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.404+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94303383125472] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94303383118384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6e650 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a71a90 con 0x7f68b401fbe0 2024-04-26T12:50:21.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94303383131520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a72330 con 0x7f68b401fbe0 2024-04-26T12:50:21.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a72d30 con 0x55c4b7a615c0 2024-04-26T12:50:21.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94303383118384] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94303383131520] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94303383130320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a71e00 con 0x55c4b7a615c0 2024-04-26T12:50:21.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.408+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a735d0 con 0x55c4b7a65f80 2024-04-26T12:50:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.412+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94303383130320] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.412+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.412+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94303383138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a71e00 con 0x55c4b7a65f80 2024-04-26T12:50:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.412+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a73e20 con 0x55c4b7a65f80 2024-04-26T12:50:21.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.412+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94303383138592] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94303383140720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74240 con 0x55c4b7a65f80 2024-04-26T12:50:21.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74c00 con 0x55c4b7a65f80 2024-04-26T12:50:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94303383144272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a75020 con 0x55c4b7a65f80 2024-04-26T12:50:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 20 add_watcher() i=0 2024-04-26T12:50:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 20 add_watcher() i=1 2024-04-26T12:50:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 20 add_watcher() i=2 2024-04-26T12:50:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 20 add_watcher() i=3 2024-04-26T12:50:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 20 add_watcher() i=4 2024-04-26T12:50:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 20 add_watcher() i=5 2024-04-26T12:50:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94303383140720] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.416+0000 7f68c2fd7980 20 add_watcher() i=6 2024-04-26T12:50:21.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94303383144272] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c2fd7980 20 add_watcher() i=7 2024-04-26T12:50:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c2fd7980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a75020 con 0x55c4b7a615c0 2024-04-26T12:50:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94303383145328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74f90 con 0x55c4b7a615c0 2024-04-26T12:50:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94303383145328] v33'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f6776fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c2fd7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c2fd7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.420+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a80b10 con 0x55c4b7a615c0 2024-04-26T12:50:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.424+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.424+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a811e0 con 0x55c4b7a65f80 2024-04-26T12:50:21.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.424+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.424+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a811e0 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.424+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.424+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a81c80 con 0x55c4b7a615c0 2024-04-26T12:50:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.428+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.428+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a82070 con 0x7f68b401fbe0 2024-04-26T12:50:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.428+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.428+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a825e0 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.428+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.428+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a82a90 con 0x55c4b7a615c0 2024-04-26T12:50:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.432+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.432+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a82a90 con 0x55c4b7a65f80 2024-04-26T12:50:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.432+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.436+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a82a90 con 0x7f68b401fbe0 2024-04-26T12:50:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.436+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.436+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a82a90 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.436+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.436+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83180 con 0x7f68b401fbe0 2024-04-26T12:50:21.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.440+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.440+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83180 con 0x55c4b7a65f80 2024-04-26T12:50:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.440+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.440+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83180 con 0x7f68b401fbe0 2024-04-26T12:50:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.440+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.440+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83180 con 0x55c4b7a65f80 2024-04-26T12:50:21.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.444+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.444+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83180 con 0x55c4b7a615c0 2024-04-26T12:50:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.444+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'141 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.444+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83180 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.448+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.448+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83270 con 0x7f68b401fbe0 2024-04-26T12:50:21.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.448+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.448+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83270 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.452+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.452+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83210 con 0x55c4b7a615c0 2024-04-26T12:50:21.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.452+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.452+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a615c0 2024-04-26T12:50:21.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.452+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.452+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.456+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.456+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x7f68b401fbe0 2024-04-26T12:50:21.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.456+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.456+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.460+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.460+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.460+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.460+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.460+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.460+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.464+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.464+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a65f80 2024-04-26T12:50:21.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.464+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.464+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.464+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.464+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a65f80 2024-04-26T12:50:21.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.468+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.468+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.472+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.472+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x55c4b7a65f80 2024-04-26T12:50:21.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.472+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.472+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a83730 con 0x7f68b401fbe0 2024-04-26T12:50:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f6775fe3640 20 reqs_thread_entry: start 2024-04-26T12:50:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 20 Filter name: none 2024-04-26T12:50:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f66e77fe640 20 reqs_thread_entry: start 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a7ccb0 con 0x7f68b401fbe0 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.476+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7aa0210 con 0x7f68b401fbe0 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(95 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 20 get_obj_state: octx=0x7f68b800aae0 obj=myfoo:four state=0x55c4b7aa14b8 s->prefetch_data=0 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:96 3.36s0 3:6f295b6e:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7aa22e0 con 0x7f68b401fbe0 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(96 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 10 manifest: total_size = 4 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10558355318969449809 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 20 get_obj_state: octx=0x7f68b800aae0 obj=myfoo:four state=0x55c4b7aa14b8 s->prefetch_data=0 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 20 prepare_atomic_modification: state is not atomic. state=0x55c4b7aa14b8 2024-04-26T12:50:21.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 2024-04-26T12:50:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 4.c 4:31d931f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7aa6c60 con 0x55c4b7a615c0 2024-04-26T12:50:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(97 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.480+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 3.36s0 3:6f295b6e:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7aa6c60 con 0x7f68b401fbe0 2024-04-26T12:50:21.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.484+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(98 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1_four [call] v33'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.484+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 4.c 4:31d931f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7aa76f0 con 0x55c4b7a615c0 2024-04-26T12:50:21.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.484+0000 7f6776fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.484+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94303383145328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7aa76f0 con 0x55c4b7a615c0 2024-04-26T12:50:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.484+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(99 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.484+0000 7f67977fe640 20 handle_completion(): completion ok for obj=four 2024-04-26T12:50:21.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.488+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94303383145328] v33'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.488+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94303383120864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74b70 con 0x7f68b401fbe0 2024-04-26T12:50:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.488+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94303383120864] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.488+0000 7f68c2fd7980 20 remove_watcher() i=0 2024-04-26T12:50:21.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.488+0000 7f68c2fd7980 2 removed watcher, disabling cache 2024-04-26T12:50:21.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.488+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94303383125472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74b70 con 0x55c4b7a615c0 2024-04-26T12:50:21.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.492+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94303383125472] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.492+0000 7f68c2fd7980 20 remove_watcher() i=1 2024-04-26T12:50:21.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.492+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94303383118384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6fde0 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.492+0000 7f68c02f1640 1 -- 172.21.15.72:0/1584966696 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94303383118384] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b4037040 con 0x55c4b7a6a8f0 2024-04-26T12:50:21.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.492+0000 7f68c2fd7980 20 remove_watcher() i=2 2024-04-26T12:50:21.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.492+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94303383131520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74b70 con 0x7f68b401fbe0 2024-04-26T12:50:21.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.496+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94303383131520] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x7f68b401fbe0 2024-04-26T12:50:21.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.496+0000 7f68c2fd7980 20 remove_watcher() i=3 2024-04-26T12:50:21.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.496+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94303383130320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6e230 con 0x55c4b7a615c0 2024-04-26T12:50:21.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.496+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94303383130320] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b800a4d0 con 0x55c4b7a615c0 2024-04-26T12:50:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.496+0000 7f68c2fd7980 20 remove_watcher() i=4 2024-04-26T12:50:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.496+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94303383138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74b70 con 0x55c4b7a65f80 2024-04-26T12:50:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.500+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94303383138592] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.500+0000 7f68c2fd7980 20 remove_watcher() i=5 2024-04-26T12:50:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.500+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94303383140720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a6e230 con 0x55c4b7a65f80 2024-04-26T12:50:21.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.500+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94303383140720] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.500+0000 7f68c2fd7980 20 remove_watcher() i=6 2024-04-26T12:50:21.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.500+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94303383144272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c4b7a74b70 con 0x55c4b7a65f80 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c0af2640 1 -- 172.21.15.72:0/1584966696 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94303383144272] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b00f4070 con 0x55c4b7a65f80 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 20 remove_watcher() i=7 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a65f80 msgr2=0x55c4b7a68370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a65f80 0x55c4b7a68370 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7a615c0 msgr2=0x55c4b7a63a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7a615c0 0x55c4b7a63a80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f68b401fbe0 msgr2=0x7f68b403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f68b401fbe0 0x7f68b403a3c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a6a8f0 msgr2=0x55c4b7a6cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a6a8f0 0x55c4b7a6cd60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f678c034650 msgr2=0x7f678c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f678c034650 0x7f678c036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f68b400ffd0 tx=0x7f68b4010000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 msgr2=0x55c4b7a564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1584966696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a4f240 0x55c4b7a564a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f68b0005120 tx=0x7f68b00cded0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c12f3640 1 -- 172.21.15.72:0/1584966696 reap_dead start 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 shutdown_connections 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 >> 172.21.15.72:0/1584966696 conn(0x55c4b7a4b580 msgr2=0x55c4b7a48be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 shutdown_connections 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1584966696 wait complete. 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6798034650 msgr2=0x7f6798036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6798034650 0x7f6798036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55c4b7a2b8c0 tx=0x7f68b400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a42220 msgr2=0x55c4b7a42640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a42220 0x55c4b7a42640 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f68b00bc920 tx=0x7f68b00de3a0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 shutdown_connections 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6798034650 0x7f6798036b10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/1326995436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b7a42220 0x55c4b7a42640 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 >> 172.21.15.72:0/1326995436 conn(0x55c4b7a37030 msgr2=0x55c4b7a37b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 shutdown_connections 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/1326995436 wait complete. 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a2d720 msgr2=0x55c4b7a2fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c4b7a2d720 0x55c4b7a2fb10 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7931e10 msgr2=0x55c4b7a2aea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c4b7931e10 0x55c4b7a2aea0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a31660 msgr2=0x55c4b7a33a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c4b7a31660 0x55c4b7a33a50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f67a80346a0 msgr2=0x7f67a8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f67a80346a0 0x7f67a8036b60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000f70 tx=0x7f68b4001380 comp rx=0 tx=0).stop 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 msgr2=0x55c4b7a23e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.504+0000 7f68c2fd7980 1 --2- 172.21.15.72:0/3477979945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c4b79314f0 0x55c4b7a23e70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f68b001b170 tx=0x7f68b00180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.508+0000 7f68c12f3640 1 -- 172.21.15.72:0/3477979945 reap_dead start 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.508+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 shutdown_connections 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.508+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 >> 172.21.15.72:0/3477979945 conn(0x55c4b78a4bd0 msgr2=0x55c4b7a173f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.508+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 shutdown_connections 2024-04-26T12:50:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.508+0000 7f68c2fd7980 1 -- 172.21.15.72:0/3477979945 wait complete. 2024-04-26T12:50:21.518 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:50:21.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:50:21.518 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T12:50:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5864c54980 1 Processor -- start 2024-04-26T12:50:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5864c54980 1 -- start start 2024-04-26T12:50:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5864c54980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563b8d78c870 0x563b8d78ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5864c54980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563b8d635510 con 0x563b8d786760 2024-04-26T12:50:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5864c54980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x563b8d63c430 con 0x563b8d78c870 2024-04-26T12:50:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5861f6e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563b8d78c870 0x563b8d78ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5861f6e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x563b8d78c870 0x563b8d78ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34456/0 (socket says 172.21.15.72:34456) 2024-04-26T12:50:21.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f586276f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x563b8d786760 0x563b8d786b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36948/0 (socket says 172.21.15.72:36948) 2024-04-26T12:50:21.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5861f6e640 1 -- 172.21.15.72:0/354796976 learned_addr learned my addr 172.21.15.72:0/354796976 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5861f6e640 1 -- 172.21.15.72:0/354796976 >> v1:172.21.15.29:6789/0 conn(0x563b8d786760 legacy=0x563b8d786b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.604+0000 7f5861f6e640 1 -- 172.21.15.72:0/354796976 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8d611ae0 con 0x563b8d78c870 2024-04-26T12:50:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5861f6e640 1 --2- 172.21.15.72:0/354796976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d78c870 0x563b8d78ec60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a5c0 tx=0x7f584c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f89250a0b99d902 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f586176d640 1 -- 172.21.15.72:0/354796976 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f584c0a6070 con 0x563b8d78c870 2024-04-26T12:50:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f586176d640 1 -- 172.21.15.72:0/354796976 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584c0af070 con 0x563b8d78c870 2024-04-26T12:50:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f586176d640 1 -- 172.21.15.72:0/354796976 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f584c0aa5c0 con 0x563b8d78c870 2024-04-26T12:50:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5864c54980 1 -- 172.21.15.72:0/354796976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d78c870 msgr2=0x563b8d78ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5864c54980 1 --2- 172.21.15.72:0/354796976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d78c870 0x563b8d78ec60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a5c0 tx=0x7f584c01b340 comp rx=0 tx=0).stop 2024-04-26T12:50:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5864c54980 1 -- 172.21.15.72:0/354796976 shutdown_connections 2024-04-26T12:50:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5864c54980 1 --2- 172.21.15.72:0/354796976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d78c870 0x563b8d78ec60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5864c54980 1 -- 172.21.15.72:0/354796976 >> 172.21.15.72:0/354796976 conn(0x563b8d7821f0 msgr2=0x563b8d784610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5864c54980 1 -- 172.21.15.72:0/354796976 shutdown_connections 2024-04-26T12:50:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.608+0000 7f5864c54980 1 -- 172.21.15.72:0/354796976 wait complete. 2024-04-26T12:50:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.624+0000 7f5864c54980 1 Processor -- start 2024-04-26T12:50:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.624+0000 7f5864c54980 1 -- start start 2024-04-26T12:50:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.624+0000 7f5864c54980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d873490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.624+0000 7f5864c54980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563b8d68ba70 con 0x563b8d786760 2024-04-26T12:50:21.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.624+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d873490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.624+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d873490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34462/0 (socket says 172.21.15.72:34462) 2024-04-26T12:50:21.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.624+0000 7f586276f640 1 -- 172.21.15.72:0/1687554848 learned_addr learned my addr 172.21.15.72:0/1687554848 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f586276f640 1 -- 172.21.15.72:0/1687554848 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8d873a60 con 0x563b8d786760 2024-04-26T12:50:21.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f586276f640 1 --2- 172.21.15.72:0/1687554848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d873490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f585c001e50 tx=0x7f585c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45342824b19f95a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5750608640 1 -- 172.21.15.72:0/1687554848 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c00e5d0 con 0x563b8d786760 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5750608640 1 -- 172.21.15.72:0/1687554848 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c00e770 con 0x563b8d786760 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5750608640 1 -- 172.21.15.72:0/1687554848 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c00eab0 con 0x563b8d786760 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- 172.21.15.72:0/1687554848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 msgr2=0x563b8d873490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 --2- 172.21.15.72:0/1687554848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d873490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f585c001e50 tx=0x7f585c001e80 comp rx=0 tx=0).stop 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- 172.21.15.72:0/1687554848 shutdown_connections 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 --2- 172.21.15.72:0/1687554848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d873490 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- 172.21.15.72:0/1687554848 >> 172.21.15.72:0/1687554848 conn(0x563b8d7821f0 msgr2=0x563b8d86f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- 172.21.15.72:0/1687554848 shutdown_connections 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- 172.21.15.72:0/1687554848 wait complete. 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 Processor -- start 2024-04-26T12:50:21.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- start start 2024-04-26T12:50:21.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d87a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563b8d791c60 con 0x563b8d786760 2024-04-26T12:50:21.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d87a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d87a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34472/0 (socket says 172.21.15.72:34472) 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f586276f640 1 -- 172.21.15.72:0/2386280383 learned_addr learned my addr 172.21.15.72:0/2386280383 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f586276f640 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8d87ac60 con 0x563b8d786760 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f586276f640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d87a720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x563b8d874320 tx=0x7f585c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f574ee05640 1 -- 172.21.15.72:0/2386280383 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c001260 con 0x563b8d786760 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b8d87aef0 con 0x563b8d786760 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f574ee05640 1 -- 172.21.15.72:0/2386280383 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c00fa40 con 0x563b8d786760 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f574ee05640 1 -- 172.21.15.72:0/2386280383 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c02c060 con 0x563b8d786760 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.628+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b8d87da90 con 0x563b8d786760 2024-04-26T12:50:21.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f574ee05640 1 -- 172.21.15.72:0/2386280383 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f585c017070 con 0x563b8d786760 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f574ee05640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57480346a0 0x7f5748036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f574ee05640 1 -- 172.21.15.72:0/2386280383 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f585c015020 con 0x563b8d786760 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5861f6e640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57480346a0 0x7f5748036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d78c870 0x563b8d881620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d881c40 con 0x563b8d78c870 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5862f70640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d78c870 0x563b8d881620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5861f6e640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57480346a0 0x7f5748036b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ae000 tx=0x7f584c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5862f70640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d78c870 0x563b8d881620 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5862f70640 1 -- 172.21.15.72:0/2386280383 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d78c870 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d87ecb0 con 0x563b8d78c870 2024-04-26T12:50:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5862f70640 1 -- 172.21.15.72:0/2386280383 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d78c870 2024-04-26T12:50:21.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d883f90 0x563b8d886380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d886a50 con 0x563b8d883f90 2024-04-26T12:50:21.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.632+0000 7f586276f640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d883f90 0x563b8d886380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f586276f640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d883f90 0x563b8d886380 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f586276f640 1 -- 172.21.15.72:0/2386280383 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f585c02e070 con 0x563b8d883f90 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d882e30 con 0x563b8d78c870 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5862f70640 1 -- 172.21.15.72:0/2386280383 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d78c870 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d887e90 0x563b8d88a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d88aa10 con 0x563b8d887e90 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5861f6e640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d887e90 0x563b8d88a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5861f6e640 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d887e90 0x563b8d88a280 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5861f6e640 1 -- 172.21.15.72:0/2386280383 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d887e90 2024-04-26T12:50:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5864c54980 1 Processor -- start 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5864c54980 1 -- start start 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5864c54980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d789380 0x563b8d787820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f5864c54980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563b8d68fab0 con 0x563b8d789380 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d789380 0x563b8d787820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d789380 0x563b8d787820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34482/0 (socket says 172.21.15.72:34482) 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f586276f640 1 -- 172.21.15.72:0/189728190 learned_addr learned my addr 172.21.15.72:0/189728190 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.636+0000 7f586276f640 1 -- 172.21.15.72:0/189728190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8d787d60 con 0x563b8d789380 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f586276f640 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d789380 0x563b8d787820 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f585c01b950 tx=0x7f585c028c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5747fff640 1 -- 172.21.15.72:0/189728190 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c041070 con 0x563b8d789380 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b8d787ff0 con 0x563b8d789380 2024-04-26T12:50:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5747fff640 1 -- 172.21.15.72:0/189728190 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c01a480 con 0x563b8d789380 2024-04-26T12:50:21.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5747fff640 1 -- 172.21.15.72:0/189728190 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c01a760 con 0x563b8d789380 2024-04-26T12:50:21.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b8d7884c0 con 0x563b8d789380 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5747fff640 1 -- 172.21.15.72:0/189728190 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f585c03a070 con 0x563b8d789380 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5747fff640 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f573c034650 0x7f573c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5747fff640 1 -- 172.21.15.72:0/189728190 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f585c045050 con 0x563b8d789380 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5861f6e640 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f573c034650 0x7f573c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5864c54980 1 Processor -- start 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5864c54980 1 -- start start 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5864c54980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5864c54980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563b8d873db0 con 0x563b8d8a7a20 2024-04-26T12:50:21.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f5861f6e640 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f573c034650 0x7f573c036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f584c01b380 tx=0x7f584c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8a7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34494/0 (socket says 172.21.15.72:34494) 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f586276f640 1 -- 172.21.15.72:0/1685928306 learned_addr learned my addr 172.21.15.72:0/1685928306 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f586276f640 1 -- 172.21.15.72:0/1685928306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8d8a8410 con 0x563b8d8a7a20 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.640+0000 7f586276f640 1 --2- 172.21.15.72:0/1685928306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8a7e40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f585c01bfd0 tx=0x7f585c047960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306dda16365b84b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5745ffb640 1 -- 172.21.15.72:0/1685928306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c042500 con 0x563b8d8a7a20 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5745ffb640 1 -- 172.21.15.72:0/1685928306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c0470d0 con 0x563b8d8a7a20 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5745ffb640 1 -- 172.21.15.72:0/1685928306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c0426a0 con 0x563b8d8a7a20 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- 172.21.15.72:0/1685928306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 msgr2=0x563b8d8a7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 --2- 172.21.15.72:0/1685928306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8a7e40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f585c01bfd0 tx=0x7f585c047960 comp rx=0 tx=0).stop 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- 172.21.15.72:0/1685928306 shutdown_connections 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 --2- 172.21.15.72:0/1685928306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8a7e40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- 172.21.15.72:0/1685928306 >> 172.21.15.72:0/1685928306 conn(0x563b8d8a3d60 msgr2=0x563b8d8a1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- 172.21.15.72:0/1685928306 shutdown_connections 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- 172.21.15.72:0/1685928306 wait complete. 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 Processor -- start 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- start start 2024-04-26T12:50:21.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563b8d8a8ad0 con 0x563b8d8a7a20 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f586276f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34500/0 (socket says 172.21.15.72:34500) 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 learned_addr learned my addr 172.21.15.72:0/1114064570 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8d8af210 con 0x563b8d8a7a20 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f586276f640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8aecd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f585c0317e0 tx=0x7f585c05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5733fff640 1 -- 172.21.15.72:0/1114064570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c06f070 con 0x563b8d8a7a20 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b8d8af210 con 0x563b8d8a7a20 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5733fff640 1 -- 172.21.15.72:0/1114064570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c047e60 con 0x563b8d8a7a20 2024-04-26T12:50:21.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5733fff640 1 -- 172.21.15.72:0/1114064570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585c048180 con 0x563b8d8a7a20 2024-04-26T12:50:21.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.644+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b8d8af680 con 0x563b8d8a7a20 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5733fff640 1 -- 172.21.15.72:0/1114064570 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f585c072070 con 0x563b8d8a7a20 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5733fff640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f572c034650 0x7f572c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5733fff640 1 -- 172.21.15.72:0/1114064570 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f585c065030 con 0x563b8d8a7a20 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5861f6e640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f572c034650 0x7f572c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d8b9de0 0x563b8d8bc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bc9d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5862f70640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d8b9de0 0x563b8d8bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5861f6e640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f572c034650 0x7f572c036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x563b8d88ae10 tx=0x7f584c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5862f70640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d8b9de0 0x563b8d8bc280 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 realm 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bcde0 con 0x563b8d8b9de0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bd680 con 0x563b8d8b9de0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d8be780 0x563b8d8c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c10f0 con 0x563b8d8be780 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f586276f640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d8be780 0x563b8d8c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.648+0000 7f586276f640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d8be780 0x563b8d8c0b70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5864c54980 20 searching for the correct realm 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d8c3020 0x563b8d8c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c5bb0 con 0x563b8d8c3020 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5861f6e640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d8c3020 0x563b8d8c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5861f6e640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d8c3020 0x563b8d8c54e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5861f6e640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f584c0e0040 0x7f584c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c5bb0 con 0x7f584c0e0040 2024-04-26T12:50:21.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5862f70640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f584c0e0040 0x7f584c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5862f70640 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f584c0e0040 0x7f584c0e0420 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.652+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x7f584c0e0040 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.656+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x7f584c0e0040 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.660+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x7f584c0e0040 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x7f584c0e0040 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8c3020 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8be780 2024-04-26T12:50:21.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.664+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x563b8d8b9de0 2024-04-26T12:50:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8bda20 con 0x7f584c0e0040 2024-04-26T12:50:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c1940 con 0x563b8d8b9de0 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c1940 con 0x563b8d8b9de0 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c1940 con 0x563b8d8c3020 2024-04-26T12:50:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 zone default found 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 4 Realm: () 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 zonegroup default 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c21e0 con 0x563b8d8be780 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c7a10 con 0x563b8d8c3020 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c7db0 con 0x563b8d8c3020 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 started sync module instance, tier type = 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.668+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c6eb0 con 0x7f584c0e0040 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.672+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.672+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94813777851312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c6eb0 con 0x7f584c0e0040 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.672+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c8770 con 0x563b8d8b9de0 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.672+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94813777851312] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.672+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.672+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94813777855472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c6eb0 con 0x563b8d8b9de0 2024-04-26T12:50:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.672+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c9180 con 0x563b8d8c3020 2024-04-26T12:50:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94813777855472] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94813777848832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c6e20 con 0x563b8d8c3020 2024-04-26T12:50:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8c9ed0 con 0x7f584c0e0040 2024-04-26T12:50:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94813777861456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8ca770 con 0x7f584c0e0040 2024-04-26T12:50:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8cb170 con 0x563b8d8b9de0 2024-04-26T12:50:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94813777848832] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.676+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94813777861456] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.680+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.680+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94813777859952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8ca250 con 0x563b8d8b9de0 2024-04-26T12:50:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.680+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8cba10 con 0x563b8d8be780 2024-04-26T12:50:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.680+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94813777859952] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.680+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.680+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94813777868128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8ca250 con 0x563b8d8be780 2024-04-26T12:50:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.680+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8cc260 con 0x563b8d8be780 2024-04-26T12:50:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94813777868128] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94813777865856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8ccab0 con 0x563b8d8be780 2024-04-26T12:50:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8cd300 con 0x563b8d8be780 2024-04-26T12:50:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94813777875024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8cdae0 con 0x563b8d8be780 2024-04-26T12:50:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 20 add_watcher() i=0 2024-04-26T12:50:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 20 add_watcher() i=1 2024-04-26T12:50:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 20 add_watcher() i=2 2024-04-26T12:50:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 20 add_watcher() i=3 2024-04-26T12:50:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 20 add_watcher() i=4 2024-04-26T12:50:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 20 add_watcher() i=5 2024-04-26T12:50:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94813777865856] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.684+0000 7f5864c54980 20 add_watcher() i=6 2024-04-26T12:50:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94813777875024] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 20 add_watcher() i=7 2024-04-26T12:50:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8cc600 con 0x563b8d8b9de0 2024-04-26T12:50:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94813777876336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8cc630 con 0x563b8d8b9de0 2024-04-26T12:50:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94813777876336] v33'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5718fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 5 note: GC not initialized 2024-04-26T12:50:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f56937fe640 20 reqs_thread_entry: start 2024-04-26T12:50:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.688+0000 7f5864c54980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 Filter name: none 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f56917fa640 20 reqs_thread_entry: start 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f4260 con 0x7f584c0e0040 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f4b90 con 0x7f584c0e0040 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(63 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f4bd0 con 0x7f584c0e0040 2024-04-26T12:50:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f62b0 con 0x7f584c0e0040 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(65 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 4.39 4:9c6c5753:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f5910 con 0x563b8d8c3020 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 4.5 4:a34a0678:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8fae20 con 0x563b8d8c3020 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 4.2 4:43d66ddb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8fd810 con 0x563b8d8b9de0 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 4.9 4:91fcabb3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d900170 con 0x563b8d8b9de0 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 4.26 4:66c705c7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8fd810 con 0x563b8d8be780 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 4.2 4:42690739:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d904f20 con 0x563b8d8b9de0 2024-04-26T12:50:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 4.c 4:31d931f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d907a40 con 0x563b8d8b9de0 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 4.7 4:e183a031:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f8e00 con 0x563b8d8be780 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(66 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 4.1e 4:788778d7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d907a40 con 0x563b8d8be780 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:75 4.13 4:c9844179:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f8e00 con 0x7f584c0e0040 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 4.22 4:454d4585:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b8d90d730 con 0x563b8d8b9de0 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(68 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(69 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(71 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(72 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(76 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(75 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.692+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(74 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5718fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94813777876336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x563b8d8b9de0 2024-04-26T12:50:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94813777876336] v33'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94813777851312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x7f584c0e0040 2024-04-26T12:50:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94813777851312] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5864c54980 20 remove_watcher() i=0 2024-04-26T12:50:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5864c54980 2 removed watcher, disabling cache 2024-04-26T12:50:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.696+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94813777855472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x563b8d8b9de0 2024-04-26T12:50:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.700+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94813777855472] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.700+0000 7f5864c54980 20 remove_watcher() i=1 2024-04-26T12:50:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.700+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94813777848832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x563b8d8c3020 2024-04-26T12:50:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.700+0000 7f5861f6e640 1 -- 172.21.15.72:0/1114064570 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94813777848832] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584c0aaac0 con 0x563b8d8c3020 2024-04-26T12:50:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.700+0000 7f5864c54980 20 remove_watcher() i=2 2024-04-26T12:50:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.700+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94813777861456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x7f584c0e0040 2024-04-26T12:50:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.704+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94813777861456] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x7f584c0e0040 2024-04-26T12:50:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.704+0000 7f5864c54980 20 remove_watcher() i=3 2024-04-26T12:50:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.704+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94813777859952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x563b8d8b9de0 2024-04-26T12:50:21.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.704+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94813777859952] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585400a4d0 con 0x563b8d8b9de0 2024-04-26T12:50:21.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.704+0000 7f5864c54980 20 remove_watcher() i=4 2024-04-26T12:50:21.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.704+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94813777868128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x563b8d8be780 2024-04-26T12:50:21.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.708+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94813777868128] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.708+0000 7f5864c54980 20 remove_watcher() i=5 2024-04-26T12:50:21.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.708+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94813777865856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x563b8d8be780 2024-04-26T12:50:21.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.708+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94813777865856] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.708+0000 7f5864c54980 20 remove_watcher() i=6 2024-04-26T12:50:21.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.708+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94813777875024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563b8d8f1c20 con 0x563b8d8be780 2024-04-26T12:50:21.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f586276f640 1 -- 172.21.15.72:0/1114064570 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94813777875024] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f585c071030 con 0x563b8d8be780 2024-04-26T12:50:21.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 20 remove_watcher() i=7 2024-04-26T12:50:21.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d8be780 msgr2=0x563b8d8c0b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d8be780 0x563b8d8c0b70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d8b9de0 msgr2=0x563b8d8bc280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d8b9de0 0x563b8d8bc280 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f584c0e0040 msgr2=0x7f584c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f584c0e0040 0x7f584c0e0420 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d8c3020 msgr2=0x563b8d8c54e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d8c3020 0x563b8d8c54e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f572c034650 msgr2=0x7f572c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f572c034650 0x7f572c036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x563b8d88ae10 tx=0x7f584c0c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 msgr2=0x563b8d8aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/1114064570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d8a7a20 0x563b8d8aecd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f585c0317e0 tx=0x7f585c05c000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 reap_dead start 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5862f70640 1 -- 172.21.15.72:0/1114064570 reap_dead start 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 shutdown_connections 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 >> 172.21.15.72:0/1114064570 conn(0x563b8d8a3d60 msgr2=0x563b8d8a13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 shutdown_connections 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/1114064570 wait complete. 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f573c034650 msgr2=0x7f573c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f573c034650 0x7f573c036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f584c01b380 tx=0x7f584c005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d789380 msgr2=0x563b8d787820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d789380 0x563b8d787820 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f585c01b950 tx=0x7f585c028c70 comp rx=0 tx=0).stop 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 shutdown_connections 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f573c034650 0x7f573c036b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/189728190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d789380 0x563b8d787820 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 >> 172.21.15.72:0/189728190 conn(0x563b8d88d870 msgr2=0x563b8d88e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 shutdown_connections 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/189728190 wait complete. 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d883f90 msgr2=0x563b8d886380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x563b8d883f90 0x563b8d886380 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d78c870 msgr2=0x563b8d881620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x563b8d78c870 0x563b8d881620 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d887e90 msgr2=0x563b8d88a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x563b8d887e90 0x563b8d88a280 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57480346a0 msgr2=0x7f5748036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f57480346a0 0x7f5748036b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ae000 tx=0x7f584c0a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 msgr2=0x563b8d87a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 --2- 172.21.15.72:0/2386280383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563b8d786760 0x563b8d87a720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x563b8d874320 tx=0x7f585c000bd0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5862f70640 1 -- 172.21.15.72:0/2386280383 reap_dead start 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 shutdown_connections 2024-04-26T12:50:21.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 >> 172.21.15.72:0/2386280383 conn(0x563b8d7821f0 msgr2=0x563b8d86db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 shutdown_connections 2024-04-26T12:50:21.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.712+0000 7f5864c54980 1 -- 172.21.15.72:0/2386280383 wait complete. 2024-04-26T12:50:21.725 INFO:teuthology.orchestra.run.smithi072.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f52412b2-0d18-4618-9944-7ddcdd8afe97","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","marker":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:50:20.920937Z","creation_time":"2024-04-26T12:50:17.070930Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T12:50:21.725 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:50:20.920937Z', 'creation_time': '2024-04-26T12:50:17.070930Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:50:21.725 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-26T12:50:21.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-26T12:50:21.725 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-26T12:50:21.804 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:21.805 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:21.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.804+0000 7fe280ed6980 1 Processor -- start 2024-04-26T12:50:21.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe280ed6980 1 -- start start 2024-04-26T12:50:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe280ed6980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b2b019b940 0x55b2b0199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe280ed6980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b2b00d2510 con 0x55b2b019a430 2024-04-26T12:50:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe280ed6980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b2b00d9430 con 0x55b2b019b940 2024-04-26T12:50:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe27e9f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b2b019b940 0x55b2b0199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe27e9f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b2b019b940 0x55b2b0199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34504/0 (socket says 172.21.15.72:34504) 2024-04-26T12:50:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe27e9f1640 1 -- 172.21.15.72:0/1421158223 learned_addr learned my addr 172.21.15.72:0/1421158223 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe277fff640 1 --1- 172.21.15.72:0/1421158223 >> v1:172.21.15.29:6789/0 conn(0x55b2b019a430 0x55b2b022d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36962/0 (socket says 172.21.15.72:36962) 2024-04-26T12:50:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe27e9f1640 1 -- 172.21.15.72:0/1421158223 >> v1:172.21.15.29:6789/0 conn(0x55b2b019a430 legacy=0x55b2b022d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe27e9f1640 1 -- 172.21.15.72:0/1421158223 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b00aeae0 con 0x55b2b019b940 2024-04-26T12:50:21.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/1421158223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0199ef0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe27000a5c0 tx=0x7fe27001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e29d6aa01a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.808+0000 7fe27e1f0640 1 -- 172.21.15.72:0/1421158223 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700a6070 con 0x55b2b019b940 2024-04-26T12:50:21.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe27e1f0640 1 -- 172.21.15.72:0/1421158223 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700af070 con 0x55b2b019b940 2024-04-26T12:50:21.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe27e1f0640 1 -- 172.21.15.72:0/1421158223 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700aa5c0 con 0x55b2b019b940 2024-04-26T12:50:21.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe280ed6980 1 -- 172.21.15.72:0/1421158223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 msgr2=0x55b2b0199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe280ed6980 1 --2- 172.21.15.72:0/1421158223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0199ef0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe27000a5c0 tx=0x7fe27001b340 comp rx=0 tx=0).stop 2024-04-26T12:50:21.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe280ed6980 1 -- 172.21.15.72:0/1421158223 shutdown_connections 2024-04-26T12:50:21.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe280ed6980 1 --2- 172.21.15.72:0/1421158223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0199ef0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe280ed6980 1 -- 172.21.15.72:0/1421158223 >> 172.21.15.72:0/1421158223 conn(0x55b2b0220b80 msgr2=0x55b2b0222fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe280ed6980 1 -- 172.21.15.72:0/1421158223 shutdown_connections 2024-04-26T12:50:21.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.812+0000 7fe280ed6980 1 -- 172.21.15.72:0/1421158223 wait complete. 2024-04-26T12:50:21.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 Processor -- start 2024-04-26T12:50:21.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 -- start start 2024-04-26T12:50:21.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019a430 0x55b2b0312d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b2b0128a70 con 0x55b2b019a430 2024-04-26T12:50:21.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019a430 0x55b2b0312d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019a430 0x55b2b0312d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34518/0 (socket says 172.21.15.72:34518) 2024-04-26T12:50:21.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe27e9f1640 1 -- 172.21.15.72:0/1006794534 learned_addr learned my addr 172.21.15.72:0/1006794534 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe27e9f1640 1 -- 172.21.15.72:0/1006794534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b03132d0 con 0x55b2b019a430 2024-04-26T12:50:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/1006794534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019a430 0x55b2b0312d00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe27000a5c0 tx=0x7fe270003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf843d91a7bea5e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe16ce09640 1 -- 172.21.15.72:0/1006794534 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700aa9b0 con 0x55b2b019a430 2024-04-26T12:50:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe16ce09640 1 -- 172.21.15.72:0/1006794534 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700aab50 con 0x55b2b019a430 2024-04-26T12:50:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe16ce09640 1 -- 172.21.15.72:0/1006794534 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700aae50 con 0x55b2b019a430 2024-04-26T12:50:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 -- 172.21.15.72:0/1006794534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019a430 msgr2=0x55b2b0312d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 --2- 172.21.15.72:0/1006794534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019a430 0x55b2b0312d00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe27000a5c0 tx=0x7fe270003030 comp rx=0 tx=0).stop 2024-04-26T12:50:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 -- 172.21.15.72:0/1006794534 shutdown_connections 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 --2- 172.21.15.72:0/1006794534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019a430 0x55b2b0312d00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 -- 172.21.15.72:0/1006794534 >> 172.21.15.72:0/1006794534 conn(0x55b2b0220b80 msgr2=0x55b2b030e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 -- 172.21.15.72:0/1006794534 shutdown_connections 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.828+0000 7fe280ed6980 1 -- 172.21.15.72:0/1006794534 wait complete. 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe280ed6980 1 Processor -- start 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe280ed6980 1 -- start start 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe280ed6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0319fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe280ed6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b2b02314c0 con 0x55b2b019b940 2024-04-26T12:50:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0319fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0319fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34522/0 (socket says 172.21.15.72:34522) 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe27e9f1640 1 -- 172.21.15.72:0/3680006153 learned_addr learned my addr 172.21.15.72:0/3680006153 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe27e9f1640 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b031a510 con 0x55b2b019b940 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0319fd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe27000a5c0 tx=0x7fe2700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe16b606640 1 -- 172.21.15.72:0/3680006153 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700c6690 con 0x55b2b019b940 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2b031a7a0 con 0x55b2b019b940 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe16b606640 1 -- 172.21.15.72:0/3680006153 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700c6830 con 0x55b2b019b940 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe16b606640 1 -- 172.21.15.72:0/3680006153 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700c6b30 con 0x55b2b019b940 2024-04-26T12:50:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.832+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b031d420 con 0x55b2b019b940 2024-04-26T12:50:21.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe16b606640 1 -- 172.21.15.72:0/3680006153 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2700ce020 con 0x55b2b019b940 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe16b606640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1640346a0 0x7fe164036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe16b606640 1 -- 172.21.15.72:0/3680006153 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe2700cc020 con 0x55b2b019b940 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe277fff640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1640346a0 0x7fe164036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b031eef0 0x55b2b03212e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0321900 con 0x55b2b031eef0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe27f1f2640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b031eef0 0x55b2b03212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe277fff640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1640346a0 0x7fe164036b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe268001e50 tx=0x7fe2680013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe27f1f2640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b031eef0 0x55b2b03212e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe27f1f2640 1 -- 172.21.15.72:0/3680006153 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b031eef0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b031e620 con 0x55b2b031eef0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe27f1f2640 1 -- 172.21.15.72:0/3680006153 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b031eef0 2024-04-26T12:50:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b0323bf0 0x55b2b0325fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b03266b0 con 0x55b2b0323bf0 2024-04-26T12:50:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b0323bf0 0x55b2b0325fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b0323bf0 0x55b2b0325fe0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe27e9f1640 1 -- 172.21.15.72:0/3680006153 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2700c6cd0 con 0x55b2b0323bf0 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.836+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0322a90 con 0x55b2b031eef0 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe27f1f2640 1 -- 172.21.15.72:0/3680006153 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b031eef0 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0327af0 0x55b2b0329ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b032a670 con 0x55b2b0327af0 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe277fff640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0327af0 0x55b2b0329ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe277fff640 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0327af0 0x55b2b0329ee0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe277fff640 1 -- 172.21.15.72:0/3680006153 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe26800f700 con 0x55b2b0327af0 2024-04-26T12:50:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 Processor -- start 2024-04-26T12:50:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 -- start start 2024-04-26T12:50:21.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b03386c0 0x55b2b0338ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b2b012cab0 con 0x55b2b03386c0 2024-04-26T12:50:21.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b03386c0 0x55b2b0338ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b03386c0 0x55b2b0338ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34524/0 (socket says 172.21.15.72:34524) 2024-04-26T12:50:21.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe27e9f1640 1 -- 172.21.15.72:0/3544322509 learned_addr learned my addr 172.21.15.72:0/3544322509 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe27e9f1640 1 -- 172.21.15.72:0/3544322509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b0339020 con 0x55b2b03386c0 2024-04-26T12:50:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b03386c0 0x55b2b0338ae0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe2700bc970 tx=0x7fe2700c5dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe168e01640 1 -- 172.21.15.72:0/3544322509 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700c53e0 con 0x55b2b03386c0 2024-04-26T12:50:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe168e01640 1 -- 172.21.15.72:0/3544322509 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700d0410 con 0x55b2b03386c0 2024-04-26T12:50:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2b0339ac0 con 0x55b2b03386c0 2024-04-26T12:50:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe168e01640 1 -- 172.21.15.72:0/3544322509 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700d0730 con 0x55b2b03386c0 2024-04-26T12:50:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.840+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b0339f90 con 0x55b2b03386c0 2024-04-26T12:50:21.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe168e01640 1 -- 172.21.15.72:0/3544322509 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2700b3870 con 0x55b2b03386c0 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe168e01640 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1580346f0 0x7fe158036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe168e01640 1 -- 172.21.15.72:0/3544322509 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe2700f59e0 con 0x55b2b03386c0 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe277fff640 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1580346f0 0x7fe158036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 Processor -- start 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 -- start start 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe277fff640 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1580346f0 0x7fe158036bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b2b032aa70 tx=0x7fe26800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b0345ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b2b0313560 con 0x55b2b0345690 2024-04-26T12:50:21.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b0345ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b0345ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34536/0 (socket says 172.21.15.72:34536) 2024-04-26T12:50:21.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe27e9f1640 1 -- 172.21.15.72:0/614971465 learned_addr learned my addr 172.21.15.72:0/614971465 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe27e9f1640 1 -- 172.21.15.72:0/614971465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b0346080 con 0x55b2b0345690 2024-04-26T12:50:21.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/614971465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b0345ab0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe2700c1040 tx=0x7fe2700d0990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b018bc530f87aad0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe1627fc640 1 -- 172.21.15.72:0/614971465 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe270103020 con 0x55b2b0345690 2024-04-26T12:50:21.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe1627fc640 1 -- 172.21.15.72:0/614971465 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700a7bb0 con 0x55b2b0345690 2024-04-26T12:50:21.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe1627fc640 1 -- 172.21.15.72:0/614971465 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700c0e50 con 0x55b2b0345690 2024-04-26T12:50:21.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 -- 172.21.15.72:0/614971465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 msgr2=0x55b2b0345ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 --2- 172.21.15.72:0/614971465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b0345ab0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe2700c1040 tx=0x7fe2700d0990 comp rx=0 tx=0).stop 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 -- 172.21.15.72:0/614971465 shutdown_connections 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 --2- 172.21.15.72:0/614971465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b0345ab0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 -- 172.21.15.72:0/614971465 >> 172.21.15.72:0/614971465 conn(0x55b2b03419d0 msgr2=0x55b2b033fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 -- 172.21.15.72:0/614971465 shutdown_connections 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.844+0000 7fe280ed6980 1 -- 172.21.15.72:0/614971465 wait complete. 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 Processor -- start 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 -- start start 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b034c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b2b0346740 con 0x55b2b0345690 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b034c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe27e9f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b034c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34550/0 (socket says 172.21.15.72:34550) 2024-04-26T12:50:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 learned_addr learned my addr 172.21.15.72:0/325620154 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b034cef0 con 0x55b2b0345690 2024-04-26T12:50:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b034c9b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe2700c5a70 tx=0x7fe2700fe000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe160ff9640 1 -- 172.21.15.72:0/325620154 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe270117070 con 0x55b2b0345690 2024-04-26T12:50:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2b034cef0 con 0x55b2b0345690 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe160ff9640 1 -- 172.21.15.72:0/325620154 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700c95f0 con 0x55b2b0345690 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe160ff9640 1 -- 172.21.15.72:0/325620154 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2700e73f0 con 0x55b2b0345690 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b034cef0 con 0x55b2b0345690 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe160ff9640 1 -- 172.21.15.72:0/325620154 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe27011a070 con 0x55b2b0345690 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe160ff9640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1480345b0 0x7fe148036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe160ff9640 1 -- 172.21.15.72:0/325620154 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7fe27010f050 con 0x55b2b0345690 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe277fff640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1480345b0 0x7fe148036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b0357940 0x55b2b0359de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.848+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035a530 con 0x55b2b0357940 2024-04-26T12:50:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27f1f2640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b0357940 0x55b2b0359de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe277fff640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1480345b0 0x7fe148036a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe26800baa0 tx=0x7fe268010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27f1f2640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b0357940 0x55b2b0359de0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 realm 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035a940 con 0x55b2b0357940 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b1e0 con 0x55b2b0357940 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b035c2e0 0x55b2b035e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035ec50 con 0x55b2b035c2e0 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b035c2e0 0x55b2b035e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27e9f1640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b035c2e0 0x55b2b035e6d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 20 searching for the correct realm 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0360b80 0x55b2b0363040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0363710 con 0x55b2b0360b80 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.852+0000 7fe277fff640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0360b80 0x55b2b0363040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe277fff640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0360b80 0x55b2b0363040 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe277fff640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe26803a3c0 0x7fe26803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0363710 con 0x7fe26803a3c0 2024-04-26T12:50:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe26803a3c0 0x7fe26803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:21.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe26803a3c0 0x7fe26803a800 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.856+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.860+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.864+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b035c2e0 2024-04-26T12:50:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035f4a0 con 0x55b2b0357940 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035f4a0 con 0x55b2b0357940 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035f4a0 con 0x55b2b0360b80 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 zone default found 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 4 Realm: () 2024-04-26T12:50:21.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 zonegroup default 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.868+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035fd40 con 0x55b2b035c2e0 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0365570 con 0x55b2b0360b80 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:21.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0365910 con 0x55b2b0360b80 2024-04-26T12:50:21.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:21.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 20 started sync module instance, tier type = 2024-04-26T12:50:21.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:21.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0364a10 con 0x7fe26803a3c0 2024-04-26T12:50:21.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225948888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0364a10 con 0x7fe26803a3c0 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0366360 con 0x55b2b0357940 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.872+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225948888848] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.876+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.876+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225948892784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0364a10 con 0x55b2b0357940 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.876+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0366d70 con 0x55b2b0360b80 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.876+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225948892784] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.876+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.876+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225948886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0364980 con 0x55b2b0360b80 2024-04-26T12:50:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.876+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367b00 con 0x7fe26803a3c0 2024-04-26T12:50:21.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225948898832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b03683a0 con 0x7fe26803a3c0 2024-04-26T12:50:21.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0368da0 con 0x55b2b0357940 2024-04-26T12:50:21.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225948886368] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225948898832] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225948897632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367e70 con 0x55b2b0357940 2024-04-26T12:50:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.880+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0369640 con 0x55b2b035c2e0 2024-04-26T12:50:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225948897632] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225948905872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367e70 con 0x55b2b035c2e0 2024-04-26T12:50:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0369e90 con 0x55b2b035c2e0 2024-04-26T12:50:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225948905872] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225948908000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b036a2b0 con 0x55b2b035c2e0 2024-04-26T12:50:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.884+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b036ac70 con 0x55b2b035c2e0 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225948908000] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225948909360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b036ac70 con 0x55b2b035c2e0 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=0 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=1 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=2 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=3 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=4 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=5 2024-04-26T12:50:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=6 2024-04-26T12:50:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225948909360] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 20 add_watcher() i=7 2024-04-26T12:50:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b2b036df80 con 0x55b2b0357940 2024-04-26T12:50:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.888+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225948911920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b036b200 con 0x55b2b0357940 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225948911920] v33'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe1357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe280ed6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe280ed6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe280ed6980 5 note: GC not initialized 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe0affff640 20 reqs_thread_entry: start 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe280ed6980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe280ed6980 20 Filter name: none 2024-04-26T12:50:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe0adffb640 20 reqs_thread_entry: start 2024-04-26T12:50:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0390cc0 con 0x55b2b035c2e0 2024-04-26T12:50:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(62 [pgnls start_epoch 33 out=254b] v33'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367e70 con 0x55b2b035c2e0 2024-04-26T12:50:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(63 [pgnls start_epoch 33 out=131b] v33'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.892+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367e70 con 0x55b2b0360b80 2024-04-26T12:50:21.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367e70 con 0x55b2b035c2e0 2024-04-26T12:50:21.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(65 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367e70 con 0x55b2b0357940 2024-04-26T12:50:21.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(66 [pgnls start_epoch 33 out=335b] v33'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fe27800a4d0 con 0x55b2b0357940 2024-04-26T12:50:21.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(67 [pgnls start_epoch 33 out=213b] v33'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(69 [pgnls start_epoch 33 out=295b] v33'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(70 [pgnls start_epoch 33 out=213b] v33'11 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(71 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.896+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(72 [pgnls start_epoch 33 out=336b] v33'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fe27800a4d0 con 0x7fe26803a3c0 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(73 [pgnls start_epoch 33 out=131b] v33'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(74 [pgnls start_epoch 33 out=254b] v33'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(75 [pgnls start_epoch 33 out=90b] v33'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(76 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe2780400e0 con 0x55b2b0357940 2024-04-26T12:50:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(77 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(78 [pgnls start_epoch 33 out=254b] v33'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe2780400e0 con 0x55b2b0357940 2024-04-26T12:50:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(79 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0360b80 2024-04-26T12:50:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(80 [pgnls start_epoch 33 out=172b] v33'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x55b2b0357940 2024-04-26T12:50:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(81 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe278046040 con 0x55b2b0357940 2024-04-26T12:50:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.900+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(82 [pgnls start_epoch 33 out=276b] v33'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fe278046040 con 0x7fe26803a3c0 2024-04-26T12:50:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b2b035b580 con 0x7fe26803a3c0 2024-04-26T12:50:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(83 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe278046040 con 0x7fe26803a3c0 2024-04-26T12:50:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b0357940 2024-04-26T12:50:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(84 [pgnls start_epoch 33 out=295b] v33'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe278046040 con 0x55b2b0357940 2024-04-26T12:50:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b035c2e0 2024-04-26T12:50:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(85 [pgnls start_epoch 33 out=172b] v33'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x7fe26803a3c0 2024-04-26T12:50:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(86 [pgnls start_epoch 33 out=213b] v33'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe278046040 con 0x7fe26803a3c0 2024-04-26T12:50:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b035c2e0 2024-04-26T12:50:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(87 [pgnls start_epoch 33 out=172b] v33'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b0360b80 2024-04-26T12:50:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(88 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.904+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b0360b80 2024-04-26T12:50:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(89 [pgnls start_epoch 33 out=90b] v33'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b0360b80 2024-04-26T12:50:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(90 [pgnls start_epoch 33 out=90b] v33'38 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b0357940 2024-04-26T12:50:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(91 [pgnls start_epoch 33 out=131b] v33'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe278046040 con 0x55b2b0357940 2024-04-26T12:50:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x7fe26803a3c0 2024-04-26T12:50:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(92 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe278046040 con 0x7fe26803a3c0 2024-04-26T12:50:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fe27804b040 con 0x55b2b035c2e0 2024-04-26T12:50:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.908+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(93 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.908 INFO:teuthology.orchestra.run.smithi072.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-26T12:50:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.912+0000 7fe1357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:21.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.912+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225948911920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0367e70 con 0x55b2b0357940 2024-04-26T12:50:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.912+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94225948911920] v33'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe278046040 con 0x55b2b0357940 2024-04-26T12:50:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.912+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225948888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0399450 con 0x7fe26803a3c0 2024-04-26T12:50:21.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.916+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94225948888848] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe278046040 con 0x7fe26803a3c0 2024-04-26T12:50:21.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.916+0000 7fe280ed6980 20 remove_watcher() i=0 2024-04-26T12:50:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.916+0000 7fe280ed6980 2 removed watcher, disabling cache 2024-04-26T12:50:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.916+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225948892784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0399450 con 0x55b2b0357940 2024-04-26T12:50:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.916+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94225948892784] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe278046040 con 0x55b2b0357940 2024-04-26T12:50:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.916+0000 7fe280ed6980 20 remove_watcher() i=1 2024-04-26T12:50:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.916+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225948886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0399450 con 0x55b2b0360b80 2024-04-26T12:50:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe277fff640 1 -- 172.21.15.72:0/325620154 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94225948886368] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe268037040 con 0x55b2b0360b80 2024-04-26T12:50:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe280ed6980 20 remove_watcher() i=2 2024-04-26T12:50:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225948898832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0365e70 con 0x7fe26803a3c0 2024-04-26T12:50:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94225948898832] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe278046040 con 0x7fe26803a3c0 2024-04-26T12:50:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe280ed6980 20 remove_watcher() i=3 2024-04-26T12:50:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225948897632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0364560 con 0x55b2b0357940 2024-04-26T12:50:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94225948897632] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe278046040 con 0x55b2b0357940 2024-04-26T12:50:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe280ed6980 20 remove_watcher() i=4 2024-04-26T12:50:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.920+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225948905872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0365e70 con 0x55b2b035c2e0 2024-04-26T12:50:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.924+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94225948905872] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.924+0000 7fe280ed6980 20 remove_watcher() i=5 2024-04-26T12:50:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.924+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225948908000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0364560 con 0x55b2b035c2e0 2024-04-26T12:50:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94225948908000] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 20 remove_watcher() i=6 2024-04-26T12:50:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225948909360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b2b0365e70 con 0x55b2b035c2e0 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe27e9f1640 1 -- 172.21.15.72:0/325620154 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94225948909360] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe270119030 con 0x55b2b035c2e0 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 20 remove_watcher() i=7 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b035c2e0 msgr2=0x55b2b035e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b035c2e0 0x55b2b035e6d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b0357940 msgr2=0x55b2b0359de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b0357940 0x55b2b0359de0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe26803a3c0 msgr2=0x7fe26803a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe26803a3c0 0x7fe26803a800 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0360b80 msgr2=0x55b2b0363040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0360b80 0x55b2b0363040 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1480345b0 msgr2=0x7fe148036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1480345b0 0x7fe148036a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe26800baa0 tx=0x7fe268010000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 msgr2=0x55b2b034c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe27f1f2640 1 -- 172.21.15.72:0/325620154 reap_dead start 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b034c9b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe2700c5a70 tx=0x7fe2700fe000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 shutdown_connections 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/325620154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b0345690 0x55b2b034c9b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 >> 172.21.15.72:0/325620154 conn(0x55b2b03419d0 msgr2=0x55b2b033fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 shutdown_connections 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/325620154 wait complete. 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1580346f0 msgr2=0x7fe158036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1580346f0 0x7fe158036bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b2b032aa70 tx=0x7fe26800f000 comp rx=0 tx=0).stop 2024-04-26T12:50:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b03386c0 msgr2=0x55b2b0338ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.928+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b03386c0 0x55b2b0338ae0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe2700bc970 tx=0x7fe2700c5dd0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 shutdown_connections 2024-04-26T12:50:21.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1580346f0 0x7fe158036bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3544322509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b03386c0 0x55b2b0338ae0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 >> 172.21.15.72:0/3544322509 conn(0x55b2b032d4d0 msgr2=0x55b2b032dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 shutdown_connections 2024-04-26T12:50:21.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3544322509 wait complete. 2024-04-26T12:50:21.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b0323bf0 msgr2=0x55b2b0325fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b2b0323bf0 0x55b2b0325fe0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b031eef0 msgr2=0x55b2b03212e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b2b031eef0 0x55b2b03212e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0327af0 msgr2=0x55b2b0329ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b2b0327af0 0x55b2b0329ee0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1640346a0 msgr2=0x7fe164036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe1640346a0 0x7fe164036b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe268001e50 tx=0x7fe2680013b0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 msgr2=0x55b2b0319fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 --2- 172.21.15.72:0/3680006153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b2b019b940 0x55b2b0319fd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe27000a5c0 tx=0x7fe2700180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe27f1f2640 1 -- 172.21.15.72:0/3680006153 reap_dead start 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 shutdown_connections 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 >> 172.21.15.72:0/3680006153 conn(0x55b2b0220b80 msgr2=0x55b2b030d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 shutdown_connections 2024-04-26T12:50:21.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:21.932+0000 7fe280ed6980 1 -- 172.21.15.72:0/3680006153 wait complete. 2024-04-26T12:50:21.942 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-26T12:50:21.942 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-26T12:50:21.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-26T12:50:21.942 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-26T12:50:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199cbee980 1 Processor -- start 2024-04-26T12:50:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199cbee980 1 -- start start 2024-04-26T12:50:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199cbee980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b484b2f2c0 0x55b484b2f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199cbee980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4849dc510 con 0x55b484b2fbe0 2024-04-26T12:50:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199cbee980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b4849e3430 con 0x55b484b2f2c0 2024-04-26T12:50:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199a709640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b484b2f2c0 0x55b484b2f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199a709640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b484b2f2c0 0x55b484b2f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34566/0 (socket says 172.21.15.72:34566) 2024-04-26T12:50:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f1999f08640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55b484b2fbe0 0x55b484b305a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36970/0 (socket says 172.21.15.72:36970) 2024-04-26T12:50:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199a709640 1 -- 172.21.15.72:0/2407590206 learned_addr learned my addr 172.21.15.72:0/2407590206 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199a709640 1 -- 172.21.15.72:0/2407590206 >> v1:172.21.15.29:6789/0 conn(0x55b484b2fbe0 legacy=0x55b484b305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.024+0000 7f199a709640 1 -- 172.21.15.72:0/2407590206 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4849b8ae0 con 0x55b484b2f2c0 2024-04-26T12:50:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f199a709640 1 --2- 172.21.15.72:0/2407590206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484b2f6a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f198c00a5c0 tx=0x7f198c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32317cfad5434857 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f1999707640 1 -- 172.21.15.72:0/2407590206 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0a6070 con 0x55b484b2f2c0 2024-04-26T12:50:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f1999707640 1 -- 172.21.15.72:0/2407590206 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c0af070 con 0x55b484b2f2c0 2024-04-26T12:50:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f1999707640 1 -- 172.21.15.72:0/2407590206 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0aa5c0 con 0x55b484b2f2c0 2024-04-26T12:50:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f199cbee980 1 -- 172.21.15.72:0/2407590206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 msgr2=0x55b484b2f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f199cbee980 1 --2- 172.21.15.72:0/2407590206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484b2f6a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f198c00a5c0 tx=0x7f198c01b340 comp rx=0 tx=0).stop 2024-04-26T12:50:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f199cbee980 1 -- 172.21.15.72:0/2407590206 shutdown_connections 2024-04-26T12:50:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f199cbee980 1 --2- 172.21.15.72:0/2407590206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484b2f6a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.028+0000 7f199cbee980 1 -- 172.21.15.72:0/2407590206 >> 172.21.15.72:0/2407590206 conn(0x55b484b2ab90 msgr2=0x55b484b2cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.032+0000 7f199cbee980 1 -- 172.21.15.72:0/2407590206 shutdown_connections 2024-04-26T12:50:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.032+0000 7f199cbee980 1 -- 172.21.15.72:0/2407590206 wait complete. 2024-04-26T12:50:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.044+0000 7f199cbee980 1 Processor -- start 2024-04-26T12:50:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.044+0000 7f199cbee980 1 -- start start 2024-04-26T12:50:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.044+0000 7f199cbee980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.044+0000 7f199cbee980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b484a32a70 con 0x55b484b2f2c0 2024-04-26T12:50:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c1ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34578/0 (socket says 172.21.15.72:34578) 2024-04-26T12:50:22.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 -- 172.21.15.72:0/1684925310 learned_addr learned my addr 172.21.15.72:0/1684925310 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 -- 172.21.15.72:0/1684925310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484c1b0d0 con 0x55b484b2f2c0 2024-04-26T12:50:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 --2- 172.21.15.72:0/1684925310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c1ab00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f198c0199f0 tx=0x7f198c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fdee6f446d7308 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f1888608640 1 -- 172.21.15.72:0/1684925310 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0aaa00 con 0x55b484b2f2c0 2024-04-26T12:50:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f1888608640 1 -- 172.21.15.72:0/1684925310 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c0aaba0 con 0x55b484b2f2c0 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f1888608640 1 -- 172.21.15.72:0/1684925310 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0bd3f0 con 0x55b484b2f2c0 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 -- 172.21.15.72:0/1684925310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 msgr2=0x55b484c1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 --2- 172.21.15.72:0/1684925310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c1ab00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f198c0199f0 tx=0x7f198c003030 comp rx=0 tx=0).stop 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 -- 172.21.15.72:0/1684925310 shutdown_connections 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 --2- 172.21.15.72:0/1684925310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c1ab00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 -- 172.21.15.72:0/1684925310 >> 172.21.15.72:0/1684925310 conn(0x55b484b2ab90 msgr2=0x55b484c16690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 -- 172.21.15.72:0/1684925310 shutdown_connections 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 -- 172.21.15.72:0/1684925310 wait complete. 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 Processor -- start 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 -- start start 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c21c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199cbee980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b484b39310 con 0x55b484b2f2c0 2024-04-26T12:50:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c21c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c21c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34592/0 (socket says 172.21.15.72:34592) 2024-04-26T12:50:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 -- 172.21.15.72:0/2584462876 learned_addr learned my addr 172.21.15.72:0/2584462876 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484c22180 con 0x55b484b2f2c0 2024-04-26T12:50:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.048+0000 7f199a709640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c21c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f198c01b170 tx=0x7f198c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1886e05640 1 -- 172.21.15.72:0/2584462876 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0bd7c0 con 0x55b484b2f2c0 2024-04-26T12:50:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b484c22410 con 0x55b484b2f2c0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1886e05640 1 -- 172.21.15.72:0/2584462876 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c0bd960 con 0x55b484b2f2c0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1886e05640 1 -- 172.21.15.72:0/2584462876 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0bdc40 con 0x55b484b2f2c0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b484c25050 con 0x55b484b2f2c0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1886e05640 1 -- 172.21.15.72:0/2584462876 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f198c0ce020 con 0x55b484b2f2c0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1886e05640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1880034650 0x7f1880036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1886e05640 1 -- 172.21.15.72:0/2584462876 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f198c0cc020 con 0x55b484b2f2c0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1999f08640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1880034650 0x7f1880036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484b2fbe0 0x55b484c28ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c291e0 con 0x55b484b2fbe0 2024-04-26T12:50:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199af0a640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484b2fbe0 0x55b484c28ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f1999f08640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1880034650 0x7f1880036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1984001e50 tx=0x7f19840013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199af0a640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484b2fbe0 0x55b484c28ca0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199af0a640 1 -- 172.21.15.72:0/2584462876 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484b2fbe0 2024-04-26T12:50:22.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c26270 con 0x55b484b2fbe0 2024-04-26T12:50:22.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199af0a640 1 -- 172.21.15.72:0/2584462876 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484b2fbe0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c2b4d0 0x55b484c2d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c2dfb0 con 0x55b484c2b4d0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.052+0000 7f199a709640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c2b4d0 0x55b484c2d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199a709640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c2b4d0 0x55b484c2d8c0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199a709640 1 -- 172.21.15.72:0/2584462876 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c2b4d0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c2a370 con 0x55b484b2fbe0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199af0a640 1 -- 172.21.15.72:0/2584462876 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484b2fbe0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c2f410 0x55b484c31800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c31f40 con 0x55b484c2f410 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f1999f08640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c2f410 0x55b484c31800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f1999f08640 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c2f410 0x55b484c31800 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f1999f08640 1 -- 172.21.15.72:0/2584462876 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f198400f700 con 0x55b484c2f410 2024-04-26T12:50:22.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199cbee980 1 Processor -- start 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199cbee980 1 -- start start 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199cbee980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c3ffd0 0x55b484c403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199cbee980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b484a36ab0 con 0x55b484c3ffd0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c3ffd0 0x55b484c403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c3ffd0 0x55b484c403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34596/0 (socket says 172.21.15.72:34596) 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.056+0000 7f199a709640 1 -- 172.21.15.72:0/3409023520 learned_addr learned my addr 172.21.15.72:0/3409023520 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199a709640 1 -- 172.21.15.72:0/3409023520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484c40930 con 0x55b484c3ffd0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199a709640 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c3ffd0 0x55b484c403f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f198c0e38f0 tx=0x7f198c0c55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f187ffff640 1 -- 172.21.15.72:0/3409023520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0c5e10 con 0x55b484c3ffd0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f187ffff640 1 -- 172.21.15.72:0/3409023520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c0bc9e0 con 0x55b484c3ffd0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b484c413d0 con 0x55b484c3ffd0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f187ffff640 1 -- 172.21.15.72:0/3409023520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0bccc0 con 0x55b484c3ffd0 2024-04-26T12:50:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b484c418a0 con 0x55b484c3ffd0 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f187ffff640 1 -- 172.21.15.72:0/3409023520 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f198c0c6480 con 0x55b484c3ffd0 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f187ffff640 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1874034650 0x7f1874036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f187ffff640 1 -- 172.21.15.72:0/3409023520 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f198c0eec30 con 0x55b484c3ffd0 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f1999f08640 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1874034650 0x7f1874036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199cbee980 1 Processor -- start 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199cbee980 1 -- start start 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199cbee980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c4d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f1999f08640 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1874034650 0x7f1874036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55b484c2e380 tx=0x7f198400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199cbee980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b484c1b360 con 0x55b484c4d030 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c4d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c4d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34608/0 (socket says 172.21.15.72:34608) 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199a709640 1 -- 172.21.15.72:0/1072094728 learned_addr learned my addr 172.21.15.72:0/1072094728 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.060+0000 7f199a709640 1 -- 172.21.15.72:0/1072094728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484c4da00 con 0x55b484c4d030 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199a709640 1 --2- 172.21.15.72:0/1072094728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c4d430 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f198c0bcf10 tx=0x7f198c0e3770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c03c224e5706244 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f187dffb640 1 -- 172.21.15.72:0/1072094728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0c7c10 con 0x55b484c4d030 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f187dffb640 1 -- 172.21.15.72:0/1072094728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c0e3130 con 0x55b484c4d030 2024-04-26T12:50:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f187dffb640 1 -- 172.21.15.72:0/1072094728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0decc0 con 0x55b484c4d030 2024-04-26T12:50:22.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- 172.21.15.72:0/1072094728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 msgr2=0x55b484c4d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 --2- 172.21.15.72:0/1072094728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c4d430 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f198c0bcf10 tx=0x7f198c0e3770 comp rx=0 tx=0).stop 2024-04-26T12:50:22.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- 172.21.15.72:0/1072094728 shutdown_connections 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 --2- 172.21.15.72:0/1072094728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c4d430 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- 172.21.15.72:0/1072094728 >> 172.21.15.72:0/1072094728 conn(0x55b484c49370 msgr2=0x55b484c473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- 172.21.15.72:0/1072094728 shutdown_connections 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- 172.21.15.72:0/1072094728 wait complete. 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 Processor -- start 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- start start 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c54260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b484c4e0e0 con 0x55b484c4d030 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c54260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199a709640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c54260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34624/0 (socket says 172.21.15.72:34624) 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 learned_addr learned my addr 172.21.15.72:0/1804755089 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484c547a0 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199a709640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c54260 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f198c0c9f70 tx=0x7f198c0f1fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f186bfff640 1 -- 172.21.15.72:0/1804755089 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0e5c10 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b484c547a0 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f186bfff640 1 -- 172.21.15.72:0/1804755089 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c111070 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f186bfff640 1 -- 172.21.15.72:0/1804755089 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198c0c7c10 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.064+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b484c54c10 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f186bfff640 1 -- 172.21.15.72:0/1804755089 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f198c0e4ff0 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f186bfff640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f18640346a0 0x7f1864036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f186bfff640 1 -- 172.21.15.72:0/1804755089 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f198c0e9570 con 0x55b484c4d030 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f1999f08640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f18640346a0 0x7f1864036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484c5f260 0x55b484c61720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c61e70 con 0x55b484c5f260 2024-04-26T12:50:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199af0a640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484c5f260 0x55b484c61720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f1999f08640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f18640346a0 0x7f1864036b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55b484c2a340 tx=0x7f1984010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199af0a640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484c5f260 0x55b484c61720 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 realm 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62280 con 0x55b484c5f260 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62b50 con 0x55b484c5f260 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c63c50 0x55b484c66040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c66600 con 0x55b484c63c50 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.068+0000 7f199a709640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c63c50 0x55b484c66040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199a709640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c63c50 0x55b484c66040 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199cbee980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199cbee980 20 searching for the correct realm 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c68550 0x55b484c6a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6b030 con 0x55b484c68550 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f1999f08640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c68550 0x55b484c6a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f1999f08640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c68550 0x55b484c6a960 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f1999f08640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f198401fc00 0x7f198403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6b030 con 0x7f198401fc00 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199af0a640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f198401fc00 0x7f198403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199af0a640 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f198401fc00 0x7f198403a3c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.072+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x7f198401fc00 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.076+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x7f198401fc00 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.080+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x7f198401fc00 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x7f198401fc00 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c68550 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.084+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c63c50 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x55b484c5f260 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b484c62ef0 con 0x7f198401fc00 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:22.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c66ec0 con 0x55b484c5f260 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c66ec0 con 0x55b484c5f260 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c66ec0 con 0x55b484c68550 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 zone default found 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 4 Realm: () 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 zonegroup default 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c678c0 con 0x55b484c63c50 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c67490 con 0x55b484c68550 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6d410 con 0x55b484c68550 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 started sync module instance, tier type = 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.088+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6c7d0 con 0x7f198401fc00 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.092+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.092+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233810095344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6c7d0 con 0x7f198401fc00 2024-04-26T12:50:22.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.092+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6def0 con 0x55b484c5f260 2024-04-26T12:50:22.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.092+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233810095344] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.092+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.092+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233810098656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6c7d0 con 0x55b484c5f260 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.092+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6e900 con 0x55b484c68550 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233810098656] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233810092832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6c740 con 0x55b484c68550 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6f6b0 con 0x7f198401fc00 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233810104736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6ff50 con 0x7f198401fc00 2024-04-26T12:50:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c70950 con 0x55b484c5f260 2024-04-26T12:50:22.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.096+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233810092832] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233810104736] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233810103536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6fa50 con 0x55b484c5f260 2024-04-26T12:50:22.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c711f0 con 0x55b484c63c50 2024-04-26T12:50:22.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233810103536] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233810111808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6fa50 con 0x55b484c63c50 2024-04-26T12:50:22.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.100+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c71a40 con 0x55b484c63c50 2024-04-26T12:50:22.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233810111808] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233810109536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c71a40 con 0x55b484c63c50 2024-04-26T12:50:22.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c72400 con 0x55b484c63c50 2024-04-26T12:50:22.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233810109536] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233810114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c72400 con 0x55b484c63c50 2024-04-26T12:50:22.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 20 add_watcher() i=0 2024-04-26T12:50:22.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 20 add_watcher() i=1 2024-04-26T12:50:22.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 20 add_watcher() i=2 2024-04-26T12:50:22.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 20 add_watcher() i=3 2024-04-26T12:50:22.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 20 add_watcher() i=4 2024-04-26T12:50:22.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 20 add_watcher() i=5 2024-04-26T12:50:22.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.104+0000 7f199cbee980 20 add_watcher() i=6 2024-04-26T12:50:22.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233810114416] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 20 add_watcher() i=7 2024-04-26T12:50:22.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:22.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c75800 con 0x55b484c5f260 2024-04-26T12:50:22.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233810116896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c72cf0 con 0x55b484c5f260 2024-04-26T12:50:22.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233810116896] v33'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f1850fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 5 note: GC not initialized 2024-04-26T12:50:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f17cb7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.108+0000 7f199cbee980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 Filter name: none 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f17c97fa640 20 reqs_thread_entry: start 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c99050 con 0x55b484c5f260 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:22.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c98b70 con 0x7f198401fc00 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 disabling bucket name=myfoo 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c99ac0 con 0x7f198401fc00 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c9b3a0 con 0x7f198401fc00 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(65 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.112+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484ca3ec0 con 0x7f198401fc00 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(66 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'33 uv33 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94233810301056 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c9f950 con 0x55b484c63c50 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== watch-notify(notify (1) cookie 94233810111808 notify 141733920783 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55b484c413d0 con 0x55b484c63c50 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94233810111808 notifier 4601 bl.length()=752 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(67 notify.5 [notify cookie 94233810301056 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1860003eb0 con 0x55b484c63c50 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== watch-notify(notify_complete (2) cookie 94233810301056 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b484c40930 con 0x55b484c63c50 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_sources= new_sources= 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential sources added=[] removed=[] 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_dests= new_dests= 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential dests added=[] removed=[] 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c9bed0 con 0x55b484c5f260 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94233810287136 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b484c9be40 con 0x55b484c5f260 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94233810103536 notify 141733920784 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b484c9b790 con 0x55b484c5f260 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920784 cookie 94233810103536 notifier 4601 bl.length()=567 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(70 notify.4 [notify cookie 94233810287136 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.116+0000 7f187dffb640 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1860003eb0 con 0x55b484c5f260 2024-04-26T12:50:22.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.120+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== watch-notify(notify_complete (2) cookie 94233810287136 notify 141733920784 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b484c99770 con 0x55b484c5f260 2024-04-26T12:50:22.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.120+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.127 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:22.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.120+0000 7f1850fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:22.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.120+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233810116896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c96d80 con 0x55b484c5f260 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.120+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94233810116896] v33'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.120+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233810095344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c96d80 con 0x7f198401fc00 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.124+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94233810095344] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.124+0000 7f199cbee980 20 remove_watcher() i=0 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.124+0000 7f199cbee980 2 removed watcher, disabling cache 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.124+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233810098656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c96d80 con 0x55b484c5f260 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.124+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94233810098656] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.124+0000 7f199cbee980 20 remove_watcher() i=1 2024-04-26T12:50:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.124+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233810092832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c96d80 con 0x55b484c68550 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f1999f08640 1 -- 172.21.15.72:0/1804755089 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94233810092832] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1984037040 con 0x55b484c68550 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199cbee980 20 remove_watcher() i=2 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233810104736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6c320 con 0x7f198401fc00 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94233810104736] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x7f198401fc00 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199cbee980 20 remove_watcher() i=3 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233810103536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6c320 con 0x55b484c5f260 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94233810103536] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199400a4d0 con 0x55b484c5f260 2024-04-26T12:50:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199cbee980 20 remove_watcher() i=4 2024-04-26T12:50:22.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.128+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233810111808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6ecf0 con 0x55b484c63c50 2024-04-26T12:50:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.132+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94233810111808] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.132+0000 7f199cbee980 20 remove_watcher() i=5 2024-04-26T12:50:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.132+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233810109536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c6c320 con 0x55b484c63c50 2024-04-26T12:50:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.132+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94233810109536] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.132+0000 7f199cbee980 20 remove_watcher() i=6 2024-04-26T12:50:22.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.132+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233810114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b484c70460 con 0x55b484c63c50 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199a709640 1 -- 172.21.15.72:0/1804755089 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94233810114416] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f198c0c6cd0 con 0x55b484c63c50 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 20 remove_watcher() i=7 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c63c50 msgr2=0x55b484c66040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c63c50 0x55b484c66040 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484c5f260 msgr2=0x55b484c61720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484c5f260 0x55b484c61720 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f198401fc00 msgr2=0x7f198403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f198401fc00 0x7f198403a3c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c68550 msgr2=0x55b484c6a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c68550 0x55b484c6a960 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f18640346a0 msgr2=0x7f1864036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f18640346a0 0x7f1864036b60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55b484c2a340 tx=0x7f1984010000 comp rx=0 tx=0).stop 2024-04-26T12:50:22.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 msgr2=0x55b484c54260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/1804755089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c4d030 0x55b484c54260 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f198c0c9f70 tx=0x7f198c0f1fa0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199af0a640 1 -- 172.21.15.72:0/1804755089 reap_dead start 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 shutdown_connections 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 >> 172.21.15.72:0/1804755089 conn(0x55b484c49370 msgr2=0x55b484c469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 shutdown_connections 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/1804755089 wait complete. 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1874034650 msgr2=0x7f1874036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1874034650 0x7f1874036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55b484c2e380 tx=0x7f198400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c3ffd0 msgr2=0x55b484c403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c3ffd0 0x55b484c403f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f198c0e38f0 tx=0x7f198c0c55a0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 shutdown_connections 2024-04-26T12:50:22.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1874034650 0x7f1874036b10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/3409023520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484c3ffd0 0x55b484c403f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 >> 172.21.15.72:0/3409023520 conn(0x55b484c34de0 msgr2=0x55b484c358f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 shutdown_connections 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/3409023520 wait complete. 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c2b4d0 msgr2=0x55b484c2d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b484c2b4d0 0x55b484c2d8c0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484b2fbe0 msgr2=0x55b484c28ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b484b2fbe0 0x55b484c28ca0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c2f410 msgr2=0x55b484c31800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b484c2f410 0x55b484c31800 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1880034650 msgr2=0x7f1880036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1880034650 0x7f1880036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1984001e50 tx=0x7f19840013b0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 msgr2=0x55b484c21c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 --2- 172.21.15.72:0/2584462876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b484b2f2c0 0x55b484c21c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f198c01b170 tx=0x7f198c0180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199af0a640 1 -- 172.21.15.72:0/2584462876 reap_dead start 2024-04-26T12:50:22.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 shutdown_connections 2024-04-26T12:50:22.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 >> 172.21.15.72:0/2584462876 conn(0x55b484b2ab90 msgr2=0x55b484c151a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 shutdown_connections 2024-04-26T12:50:22.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.136+0000 7f199cbee980 1 -- 172.21.15.72:0/2584462876 wait complete. 2024-04-26T12:50:22.148 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:22.150 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-26T12:50:22.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-26T12:50:22.151 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-26T12:50:22.221 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:22.222 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:22.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bb0a3c980 1 Processor -- start 2024-04-26T12:50:22.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bb0a3c980 1 -- start start 2024-04-26T12:50:22.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bb0a3c980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565222d404e0 0x565222d408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bb0a3c980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565222beb510 con 0x565222d40e00 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bb0a3c980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x565222bf2430 con 0x565222d404e0 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bae557640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565222d404e0 0x565222d408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4badd56640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x565222d40e00 0x565222d417c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:36980/0 (socket says 172.21.15.72:36980) 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bae557640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565222d404e0 0x565222d408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34630/0 (socket says 172.21.15.72:34630) 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4badd56640 1 -- 172.21.15.72:0/98366533 learned_addr learned my addr 172.21.15.72:0/98366533 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bae557640 1 -- 172.21.15.72:0/98366533 >> v1:172.21.15.29:6789/0 conn(0x565222d40e00 legacy=0x565222d417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.224+0000 7f4bae557640 1 -- 172.21.15.72:0/98366533 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565222bc7ae0 con 0x565222d404e0 2024-04-26T12:50:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bae557640 1 --2- 172.21.15.72:0/98366533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222d408c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000a480 tx=0x7f4ba001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f34f2289d3a631c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bad555640 1 -- 172.21.15.72:0/98366533 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00b0070 con 0x565222d404e0 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bad555640 1 -- 172.21.15.72:0/98366533 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00ab540 con 0x565222d404e0 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bad555640 1 -- 172.21.15.72:0/98366533 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00ab840 con 0x565222d404e0 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/98366533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 msgr2=0x565222d408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/98366533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222d408c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000a480 tx=0x7f4ba001b280 comp rx=0 tx=0).stop 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/98366533 shutdown_connections 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/98366533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222d408c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/98366533 >> 172.21.15.72:0/98366533 conn(0x565222cb3bc0 msgr2=0x565222cb3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/98366533 shutdown_connections 2024-04-26T12:50:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.228+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/98366533 wait complete. 2024-04-26T12:50:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bb0a3c980 1 Processor -- start 2024-04-26T12:50:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bb0a3c980 1 -- start start 2024-04-26T12:50:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bb0a3c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e2bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bb0a3c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565222c41a70 con 0x565222d404e0 2024-04-26T12:50:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e2bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e2bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34638/0 (socket says 172.21.15.72:34638) 2024-04-26T12:50:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bae557640 1 -- 172.21.15.72:0/225631920 learned_addr learned my addr 172.21.15.72:0/225631920 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bae557640 1 -- 172.21.15.72:0/225631920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565222e2c370 con 0x565222d404e0 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.244+0000 7f4bae557640 1 --2- 172.21.15.72:0/225631920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e2bda0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ae040 tx=0x7f4ba0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed707dc0b2e1a0d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4a9c608640 1 -- 172.21.15.72:0/225631920 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00b0040 con 0x565222d404e0 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4a9c608640 1 -- 172.21.15.72:0/225631920 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00ab9d0 con 0x565222d404e0 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4a9c608640 1 -- 172.21.15.72:0/225631920 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00abcf0 con 0x565222d404e0 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/225631920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 msgr2=0x565222e2bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/225631920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e2bda0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ae040 tx=0x7f4ba0003030 comp rx=0 tx=0).stop 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/225631920 shutdown_connections 2024-04-26T12:50:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/225631920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e2bda0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/225631920 >> 172.21.15.72:0/225631920 conn(0x565222cb3bc0 msgr2=0x565222e27930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/225631920 shutdown_connections 2024-04-26T12:50:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/225631920 wait complete. 2024-04-26T12:50:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 Processor -- start 2024-04-26T12:50:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- start start 2024-04-26T12:50:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e32fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565222d4a530 con 0x565222d404e0 2024-04-26T12:50:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e32fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e32fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34654/0 (socket says 172.21.15.72:34654) 2024-04-26T12:50:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bae557640 1 -- 172.21.15.72:0/1736532725 learned_addr learned my addr 172.21.15.72:0/1736532725 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bae557640 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565222e334e0 con 0x565222d404e0 2024-04-26T12:50:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bae557640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e32fa0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4ba001b2c0 tx=0x7f4ba0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4a9ae05640 1 -- 172.21.15.72:0/1736532725 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00b0050 con 0x565222d404e0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4a9ae05640 1 -- 172.21.15.72:0/1736532725 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00b6870 con 0x565222d404e0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4a9ae05640 1 -- 172.21.15.72:0/1736532725 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00b6b50 con 0x565222d404e0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565222e33770 con 0x565222d404e0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.248+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565222e363b0 con 0x565222d404e0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4a9ae05640 1 -- 172.21.15.72:0/1736532725 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4ba00b7420 con 0x565222d404e0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4a9ae05640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a94034650 0x7f4a94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4a9ae05640 1 -- 172.21.15.72:0/1736532725 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f4ba00bc070 con 0x565222d404e0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222d40e00 0x565222e39e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4badd56640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a94034650 0x7f4a94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e3a500 con 0x565222d40e00 2024-04-26T12:50:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4baed58640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222d40e00 0x565222e39e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4badd56640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a94034650 0x7f4a94036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4000f70 tx=0x7f4ba40012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4baed58640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222d40e00 0x565222e39e90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4baed58640 1 -- 172.21.15.72:0/1736532725 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222d40e00 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e375d0 con 0x565222d40e00 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4baed58640 1 -- 172.21.15.72:0/1736532725 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222d40e00 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e3c880 0x565222e3ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e3f340 con 0x565222e3c880 2024-04-26T12:50:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4bae557640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e3c880 0x565222e3ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.252+0000 7f4bae557640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e3c880 0x565222e3ec70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bae557640 1 -- 172.21.15.72:0/1736532725 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ba00e4040 con 0x565222e3c880 2024-04-26T12:50:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e3b720 con 0x565222d40e00 2024-04-26T12:50:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4baed58640 1 -- 172.21.15.72:0/1736532725 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222d40e00 2024-04-26T12:50:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e407a0 0x565222e42b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e43290 con 0x565222e407a0 2024-04-26T12:50:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4badd56640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e407a0 0x565222e42b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4badd56640 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e407a0 0x565222e42b90 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4badd56640 1 -- 172.21.15.72:0/1736532725 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e407a0 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bb0a3c980 1 Processor -- start 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bb0a3c980 1 -- start start 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bb0a3c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e51320 0x565222e51740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bb0a3c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565222c45ab0 con 0x565222e51320 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e51320 0x565222e51740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e51320 0x565222e51740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34662/0 (socket says 172.21.15.72:34662) 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bae557640 1 -- 172.21.15.72:0/2958100198 learned_addr learned my addr 172.21.15.72:0/2958100198 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.256+0000 7f4bae557640 1 -- 172.21.15.72:0/2958100198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565222e51c80 con 0x565222e51320 2024-04-26T12:50:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bae557640 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e51320 0x565222e51740 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00b4a90 tx=0x7f4ba00c9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4a93fff640 1 -- 172.21.15.72:0/2958100198 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00e9070 con 0x565222e51320 2024-04-26T12:50:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4a93fff640 1 -- 172.21.15.72:0/2958100198 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00b4d40 con 0x565222e51320 2024-04-26T12:50:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4a93fff640 1 -- 172.21.15.72:0/2958100198 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00c9880 con 0x565222e51320 2024-04-26T12:50:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565222e52720 con 0x565222e51320 2024-04-26T12:50:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565222e52720 con 0x565222e51320 2024-04-26T12:50:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4a93fff640 1 -- 172.21.15.72:0/2958100198 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4ba00ec070 con 0x565222e51320 2024-04-26T12:50:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4a93fff640 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a88034650 0x7f4a88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4a93fff640 1 -- 172.21.15.72:0/2958100198 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f4ba00df030 con 0x565222e51320 2024-04-26T12:50:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4badd56640 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a88034650 0x7f4a88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bb0a3c980 1 Processor -- start 2024-04-26T12:50:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bb0a3c980 1 -- start start 2024-04-26T12:50:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4badd56640 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a88034650 0x7f4a88036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400bf60 tx=0x7f4ba400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bb0a3c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e5e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bb0a3c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565222e2c600 con 0x565222e5e100 2024-04-26T12:50:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e5e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e5e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34664/0 (socket says 172.21.15.72:34664) 2024-04-26T12:50:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bae557640 1 -- 172.21.15.72:0/1323938865 learned_addr learned my addr 172.21.15.72:0/1323938865 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.260+0000 7f4bae557640 1 -- 172.21.15.72:0/1323938865 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565222e5eaf0 con 0x565222e5e100 2024-04-26T12:50:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bae557640 1 --2- 172.21.15.72:0/1323938865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e5e520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00b6d10 tx=0x7f4ba00d8b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6710a07a4cee833a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4a91ffb640 1 -- 172.21.15.72:0/1323938865 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00aaa50 con 0x565222e5e100 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4a91ffb640 1 -- 172.21.15.72:0/1323938865 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00e1260 con 0x565222e5e100 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4a91ffb640 1 -- 172.21.15.72:0/1323938865 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00aabf0 con 0x565222e5e100 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1323938865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 msgr2=0x565222e5e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1323938865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e5e520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00b6d10 tx=0x7f4ba00d8b40 comp rx=0 tx=0).stop 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1323938865 shutdown_connections 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1323938865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e5e520 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1323938865 >> 172.21.15.72:0/1323938865 conn(0x565222e5a440 msgr2=0x565222e584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1323938865 shutdown_connections 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1323938865 wait complete. 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 Processor -- start 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- start start 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e65290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565222e5f030 con 0x565222e5e100 2024-04-26T12:50:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e65290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bae557640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e65290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:34666/0 (socket says 172.21.15.72:34666) 2024-04-26T12:50:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 learned_addr learned my addr 172.21.15.72:0/785150839 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565222e657d0 con 0x565222e5e100 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bae557640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e65290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00d8dd0 tx=0x7f4ba00d8e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4a7ffff640 1 -- 172.21.15.72:0/785150839 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00d87a0 con 0x565222e5e100 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4a7ffff640 1 -- 172.21.15.72:0/785150839 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00b5850 con 0x565222e5e100 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565222e657d0 con 0x565222e5e100 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4a7ffff640 1 -- 172.21.15.72:0/785150839 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00b5b30 con 0x565222e5e100 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.264+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565222e657d0 con 0x565222e5e100 2024-04-26T12:50:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4a7ffff640 1 -- 172.21.15.72:0/785150839 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4ba00fa070 con 0x565222e5e100 2024-04-26T12:50:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4a7ffff640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a78034650 0x7f4a78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4a7ffff640 1 -- 172.21.15.72:0/785150839 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6110+0+0 (secure 0 0 0) 0x7f4ba0100070 con 0x565222e5e100 2024-04-26T12:50:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4badd56640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a78034650 0x7f4a78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222e70180 0x565222e72640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e72d90 con 0x565222e70180 2024-04-26T12:50:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4baed58640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222e70180 0x565222e72640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4badd56640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a78034650 0x7f4a78036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x565222e3ae30 tx=0x7f4ba4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4baed58640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222e70180 0x565222e72640 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 realm 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e731a0 con 0x565222e70180 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e73a70 con 0x565222e70180 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e74b70 0x565222e76f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e77570 con 0x565222e74b70 2024-04-26T12:50:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.268+0000 7f4bae557640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e74b70 0x565222e76f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bae557640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e74b70 0x565222e76f60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bb0a3c980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bb0a3c980 20 searching for the correct realm 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e794c0 0x565222e7b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e7bfa0 con 0x565222e794c0 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4badd56640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e794c0 0x565222e7b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4badd56640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e794c0 0x565222e7b8d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4badd56640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4ba4037040 0x7f4ba4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e7bfa0 con 0x7f4ba4037040 2024-04-26T12:50:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4baed58640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4ba4037040 0x7f4ba4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4baed58640 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4ba4037040 0x7f4ba4036410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.272+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x7f4ba4037040 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.276+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x7f4ba4037040 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.280+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x7f4ba4037040 2024-04-26T12:50:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x7f4ba4037040 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e794c0 2024-04-26T12:50:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e74b70 2024-04-26T12:50:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.284+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x565222e70180 2024-04-26T12:50:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565222e73e10 con 0x7f4ba4037040 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e77e30 con 0x565222e70180 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e77e30 con 0x565222e70180 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e77e30 con 0x565222e794c0 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 zone default found 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 4 Realm: () 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 zonegroup default 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e787b0 con 0x565222e74b70 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e7de90 con 0x565222e794c0 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e7e300 con 0x565222e794c0 2024-04-26T12:50:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 started sync module instance, tier type = 2024-04-26T12:50:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.288+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e7d2a0 con 0x7f4ba4037040 2024-04-26T12:50:22.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.292+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(44 notify.0 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.292+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94910772926400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e7d2a0 con 0x7f4ba4037040 2024-04-26T12:50:22.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.292+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e7ede0 con 0x565222e70180 2024-04-26T12:50:22.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.292+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94910772926400] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.292+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.292+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94910772930736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e7d2a0 con 0x565222e70180 2024-04-26T12:50:22.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.292+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e7f7f0 con 0x565222e794c0 2024-04-26T12:50:22.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94910772930736] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94910772923888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e7d210 con 0x565222e794c0 2024-04-26T12:50:22.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e80530 con 0x7f4ba4037040 2024-04-26T12:50:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(50 notify.3 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94910772936768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e80e00 con 0x7f4ba4037040 2024-04-26T12:50:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e817c0 con 0x565222e70180 2024-04-26T12:50:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94910772923888] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.296+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94910772936768] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.300+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.300+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94910772941584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e80d70 con 0x565222e70180 2024-04-26T12:50:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.300+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e81730 con 0x565222e74b70 2024-04-26T12:50:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.300+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94910772941584] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.300+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(54 notify.5 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.300+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94910772939216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e82090 con 0x565222e74b70 2024-04-26T12:50:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.300+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e828e0 con 0x565222e74b70 2024-04-26T12:50:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94910772939216] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(56 notify.6 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94910772943840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e83130 con 0x565222e74b70 2024-04-26T12:50:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e83af0 con 0x565222e74b70 2024-04-26T12:50:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94910772943840] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(58 notify.7 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94910772948368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e83af0 con 0x565222e74b70 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 20 add_watcher() i=0 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 20 add_watcher() i=1 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 20 add_watcher() i=2 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 20 add_watcher() i=3 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 20 add_watcher() i=4 2024-04-26T12:50:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 20 add_watcher() i=5 2024-04-26T12:50:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.304+0000 7f4bb0a3c980 20 add_watcher() i=6 2024-04-26T12:50:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94910772948368] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 20 add_watcher() i=7 2024-04-26T12:50:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222e86e40 con 0x565222e70180 2024-04-26T12:50:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94910772963408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222e83c60 con 0x565222e70180 2024-04-26T12:50:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94910772963408] v33'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4a64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 5 note: GC not initialized 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f49df7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.308+0000 7f4bb0a3c980 20 Filter name: none 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f49dd7fa640 20 reqs_thread_entry: start 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222eaa7a0 con 0x565222e70180 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222eaa280 con 0x7f4ba4037040 2024-04-26T12:50:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 20 enabling bucket name=myfoo 2024-04-26T12:50:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222eab210 con 0x7f4ba4037040 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 : miss 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 20 rados->read ofs=0 len=0 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222eada50 con 0x7f4ba4037040 2024-04-26T12:50:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(65 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv33 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 2024-04-26T12:50:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.312+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 8.9 8:94850267:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222eb55e0 con 0x7f4ba4037040 2024-04-26T12:50:22.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(66 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'34 uv34 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:22.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:22.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:22.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1, ofs0, ns] 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94910773125328 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222eb0c50 con 0x565222e74b70 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== watch-notify(notify (1) cookie 94910772939216 notify 141733920784 ret 0) ==== 794+0+0 (crc 0 0 0) 0x565222e51c80 con 0x565222e74b70 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4a91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920784 cookie 94910772939216 notifier 4608 bl.length()=752 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4a91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 info.flags=0x17 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4a91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1 to cache LRU end 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4a91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(67 notify.5 [notify cookie 94910773125328 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4a91ffb640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4a74003eb0 con 0x565222e74b70 2024-04-26T12:50:22.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== watch-notify(notify_complete (2) cookie 94910773125328 notify 141733920784 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565222e363b0 con 0x565222e74b70 2024-04-26T12:50:22.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_sources= new_sources= 2024-04-26T12:50:22.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential sources added=[] removed=[] 2024-04-26T12:50:22.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): orig_dests= new_dests= 2024-04-26T12:50:22.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 20 handle_bi_update(): bucket=:myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1]): potential dests added=[] removed=[] 2024-04-26T12:50:22.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.316+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222eb2e80 con 0x565222e70180 2024-04-26T12:50:22.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4bb0a3c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:22.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4bb0a3c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4bb0a3c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94910773146720 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565222eb2e80 con 0x565222e70180 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94910772941584 notify 141733920785 ret 0) ==== 609+0+0 (crc 0 0 0) 0x565222eade40 con 0x565222e70180 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4a91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920785 cookie 94910772941584 notifier 4608 bl.length()=567 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4a91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4a91ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(70 notify.4 [notify cookie 94910773146720 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4a91ffb640 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4a74003eb0 con 0x565222e70180 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94910773146720 notify 141733920785 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565222eacee0 con 0x565222e70180 2024-04-26T12:50:22.319 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:22.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4a64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:22.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94910772963408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x565222e70180 2024-04-26T12:50:22.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94910772963408] v33'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.320+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94910772926400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x7f4ba4037040 2024-04-26T12:50:22.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.324+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94910772926400] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.324+0000 7f4bb0a3c980 20 remove_watcher() i=0 2024-04-26T12:50:22.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.324+0000 7f4bb0a3c980 2 removed watcher, disabling cache 2024-04-26T12:50:22.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.324+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94910772930736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x565222e70180 2024-04-26T12:50:22.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.324+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94910772930736] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.324+0000 7f4bb0a3c980 20 remove_watcher() i=1 2024-04-26T12:50:22.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.324+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94910772923888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x565222e794c0 2024-04-26T12:50:22.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.328+0000 7f4badd56640 1 -- 172.21.15.72:0/785150839 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94910772923888] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba400e620 con 0x565222e794c0 2024-04-26T12:50:22.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.328+0000 7f4bb0a3c980 20 remove_watcher() i=2 2024-04-26T12:50:22.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.328+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94910772936768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x7f4ba4037040 2024-04-26T12:50:22.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.328+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94910772936768] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x7f4ba4037040 2024-04-26T12:50:22.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.328+0000 7f4bb0a3c980 20 remove_watcher() i=3 2024-04-26T12:50:22.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.328+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94910772941584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x565222e70180 2024-04-26T12:50:22.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.332+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94910772941584] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba800a4d0 con 0x565222e70180 2024-04-26T12:50:22.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.332+0000 7f4bb0a3c980 20 remove_watcher() i=4 2024-04-26T12:50:22.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.332+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94910772939216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x565222e74b70 2024-04-26T12:50:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.332+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94910772939216] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.332+0000 7f4bb0a3c980 20 remove_watcher() i=5 2024-04-26T12:50:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.332+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94910772943840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x565222e74b70 2024-04-26T12:50:22.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94910772943840] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 20 remove_watcher() i=6 2024-04-26T12:50:22.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94910772948368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565222ea84d0 con 0x565222e74b70 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bae557640 1 -- 172.21.15.72:0/785150839 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94910772948368] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ba00f9030 con 0x565222e74b70 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 20 remove_watcher() i=7 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e74b70 msgr2=0x565222e76f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e74b70 0x565222e76f60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222e70180 msgr2=0x565222e72640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222e70180 0x565222e72640 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4ba4037040 msgr2=0x7f4ba4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4ba4037040 0x7f4ba4036410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e794c0 msgr2=0x565222e7b8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e794c0 0x565222e7b8d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a78034650 msgr2=0x7f4a78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a78034650 0x7f4a78036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x565222e3ae30 tx=0x7f4ba4010000 comp rx=0 tx=0).stop 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 msgr2=0x565222e65290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/785150839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e5e100 0x565222e65290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00d8dd0 tx=0x7f4ba00d8e90 comp rx=0 tx=0).stop 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4baed58640 1 -- 172.21.15.72:0/785150839 reap_dead start 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 shutdown_connections 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 >> 172.21.15.72:0/785150839 conn(0x565222e5a440 msgr2=0x565222e58470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 shutdown_connections 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/785150839 wait complete. 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a88034650 msgr2=0x7f4a88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a88034650 0x7f4a88036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400bf60 tx=0x7f4ba400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e51320 msgr2=0x565222e51740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e51320 0x565222e51740 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00b4a90 tx=0x7f4ba00c9690 comp rx=0 tx=0).stop 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 shutdown_connections 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a88034650 0x7f4a88036b10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/2958100198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222e51320 0x565222e51740 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 >> 172.21.15.72:0/2958100198 conn(0x565222e46130 msgr2=0x565222e46c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 shutdown_connections 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/2958100198 wait complete. 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e3c880 msgr2=0x565222e3ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565222e3c880 0x565222e3ec70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222d40e00 msgr2=0x565222e39e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565222d40e00 0x565222e39e90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e407a0 msgr2=0x565222e42b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565222e407a0 0x565222e42b90 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a94034650 msgr2=0x7f4a94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4a94034650 0x7f4a94036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4000f70 tx=0x7f4ba40012c0 comp rx=0 tx=0).stop 2024-04-26T12:50:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 msgr2=0x565222e32fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 --2- 172.21.15.72:0/1736532725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565222d404e0 0x565222e32fa0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4ba001b2c0 tx=0x7f4ba0018020 comp rx=0 tx=0).stop 2024-04-26T12:50:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4baed58640 1 -- 172.21.15.72:0/1736532725 reap_dead start 2024-04-26T12:50:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 shutdown_connections 2024-04-26T12:50:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.336+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 >> 172.21.15.72:0/1736532725 conn(0x565222cb3bc0 msgr2=0x565222e26440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.340+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 shutdown_connections 2024-04-26T12:50:22.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:22.340+0000 7f4bb0a3c980 1 -- 172.21.15.72:0/1736532725 wait complete. 2024-04-26T12:50:22.349 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:22.360 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:50:22.713 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-26T12:50:22.728 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:37.729 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-26T12:50:37.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-26T12:50:37.730 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-26T12:50:37.767 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:37.767 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:37.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf1c126980 1 Processor -- start 2024-04-26T12:50:37.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf1c126980 1 -- start start 2024-04-26T12:50:37.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf1c126980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fc6c9634e0 0x55fc6c9638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf1c126980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc6c80e510 con 0x55fc6c963e00 2024-04-26T12:50:37.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf1c126980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55fc6c815430 con 0x55fc6c9634e0 2024-04-26T12:50:37.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf19c41640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fc6c9634e0 0x55fc6c9638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf19c41640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55fc6c9634e0 0x55fc6c9638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57892/0 (socket says 172.21.15.72:57892) 2024-04-26T12:50:37.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf19440640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55fc6c963e00 0x55fc6c9647c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48200/0 (socket says 172.21.15.72:48200) 2024-04-26T12:50:37.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf19c41640 1 -- 172.21.15.72:0/86444347 learned_addr learned my addr 172.21.15.72:0/86444347 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:37.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf19c41640 1 -- 172.21.15.72:0/86444347 >> v1:172.21.15.29:6789/0 conn(0x55fc6c963e00 legacy=0x55fc6c9647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.767+0000 7fbf19c41640 1 -- 172.21.15.72:0/86444347 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6c7eaae0 con 0x55fc6c9634e0 2024-04-26T12:50:37.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf19c41640 1 --2- 172.21.15.72:0/86444347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6c9638c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a5c0 tx=0x7fbf0c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed39e16d3153ec3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf18c3f640 1 -- 172.21.15.72:0/86444347 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0a6070 con 0x55fc6c9634e0 2024-04-26T12:50:37.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf18c3f640 1 -- 172.21.15.72:0/86444347 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0af070 con 0x55fc6c9634e0 2024-04-26T12:50:37.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf18c3f640 1 -- 172.21.15.72:0/86444347 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0aa5c0 con 0x55fc6c9634e0 2024-04-26T12:50:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf1c126980 1 -- 172.21.15.72:0/86444347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 msgr2=0x55fc6c9638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf1c126980 1 --2- 172.21.15.72:0/86444347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6c9638c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a5c0 tx=0x7fbf0c01b340 comp rx=0 tx=0).stop 2024-04-26T12:50:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf1c126980 1 -- 172.21.15.72:0/86444347 shutdown_connections 2024-04-26T12:50:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf1c126980 1 --2- 172.21.15.72:0/86444347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6c9638c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf1c126980 1 -- 172.21.15.72:0/86444347 >> 172.21.15.72:0/86444347 conn(0x55fc6c8d6bc0 msgr2=0x55fc6c8d6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf1c126980 1 -- 172.21.15.72:0/86444347 shutdown_connections 2024-04-26T12:50:37.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.771+0000 7fbf1c126980 1 -- 172.21.15.72:0/86444347 wait complete. 2024-04-26T12:50:37.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.787+0000 7fbf1c126980 1 Processor -- start 2024-04-26T12:50:37.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.787+0000 7fbf1c126980 1 -- start start 2024-04-26T12:50:37.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.787+0000 7fbf1c126980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca4ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.787+0000 7fbf1c126980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fc6c864a70 con 0x55fc6c9634e0 2024-04-26T12:50:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.787+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca4ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.787+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca4ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57894/0 (socket says 172.21.15.72:57894) 2024-04-26T12:50:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.787+0000 7fbf19c41640 1 -- 172.21.15.72:0/2337320660 learned_addr learned my addr 172.21.15.72:0/2337320660 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf19c41640 1 -- 172.21.15.72:0/2337320660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6ca4f310 con 0x55fc6c9634e0 2024-04-26T12:50:37.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf19c41640 1 --2- 172.21.15.72:0/2337320660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca4ed40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0199f0 tx=0x7fbf0c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eddff71e60829a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbe07e07640 1 -- 172.21.15.72:0/2337320660 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0aaa00 con 0x55fc6c9634e0 2024-04-26T12:50:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbe07e07640 1 -- 172.21.15.72:0/2337320660 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0aaba0 con 0x55fc6c9634e0 2024-04-26T12:50:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbe07e07640 1 -- 172.21.15.72:0/2337320660 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0bd3f0 con 0x55fc6c9634e0 2024-04-26T12:50:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- 172.21.15.72:0/2337320660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 msgr2=0x55fc6ca4ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 --2- 172.21.15.72:0/2337320660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca4ed40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0199f0 tx=0x7fbf0c003030 comp rx=0 tx=0).stop 2024-04-26T12:50:37.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- 172.21.15.72:0/2337320660 shutdown_connections 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 --2- 172.21.15.72:0/2337320660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca4ed40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- 172.21.15.72:0/2337320660 >> 172.21.15.72:0/2337320660 conn(0x55fc6c8d6bc0 msgr2=0x55fc6ca4a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- 172.21.15.72:0/2337320660 shutdown_connections 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- 172.21.15.72:0/2337320660 wait complete. 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 Processor -- start 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- start start 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca55e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fc6c96d530 con 0x55fc6c9634e0 2024-04-26T12:50:37.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca55e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca55e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57902/0 (socket says 172.21.15.72:57902) 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf19c41640 1 -- 172.21.15.72:0/3900591571 learned_addr learned my addr 172.21.15.72:0/3900591571 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf19c41640 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6ca563a0 con 0x55fc6c9634e0 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf19c41640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca55e60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c01b170 tx=0x7fbf0c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbe06604640 1 -- 172.21.15.72:0/3900591571 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0bd7c0 con 0x55fc6c9634e0 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc6ca56630 con 0x55fc6c9634e0 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbe06604640 1 -- 172.21.15.72:0/3900591571 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0bd960 con 0x55fc6c9634e0 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.791+0000 7fbe06604640 1 -- 172.21.15.72:0/3900591571 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0bdc40 con 0x55fc6c9634e0 2024-04-26T12:50:37.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6ca59240 con 0x55fc6c9634e0 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbe06604640 1 -- 172.21.15.72:0/3900591571 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbf0c0ce020 con 0x55fc6c9634e0 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbe06604640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbe00034650 0x7fbe00036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbe06604640 1 -- 172.21.15.72:0/3900591571 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fbf0c0cc020 con 0x55fc6c9634e0 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf19440640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbe00034650 0x7fbe00036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6c963e00 0x55fc6ca5ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca5d3d0 con 0x55fc6c963e00 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1a442640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6c963e00 0x55fc6ca5ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf19440640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbe00034650 0x7fbe00036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbf10000f70 tx=0x7fbf10001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1a442640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6c963e00 0x55fc6ca5ce90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1a442640 1 -- 172.21.15.72:0/3900591571 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6c963e00 2024-04-26T12:50:37.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca5a460 con 0x55fc6c963e00 2024-04-26T12:50:37.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1a442640 1 -- 172.21.15.72:0/3900591571 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6c963e00 2024-04-26T12:50:37.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca5f6c0 0x55fc6ca61ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca62180 con 0x55fc6ca5f6c0 2024-04-26T12:50:37.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.795+0000 7fbf19c41640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca5f6c0 0x55fc6ca61ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19c41640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca5f6c0 0x55fc6ca61ab0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19c41640 1 -- 172.21.15.72:0/3900591571 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca5f6c0 2024-04-26T12:50:37.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca5e560 con 0x55fc6c963e00 2024-04-26T12:50:37.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1a442640 1 -- 172.21.15.72:0/3900591571 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6c963e00 2024-04-26T12:50:37.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca635c0 0x55fc6ca659b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca66140 con 0x55fc6ca635c0 2024-04-26T12:50:37.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19440640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca635c0 0x55fc6ca659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19440640 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca635c0 0x55fc6ca659b0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19440640 1 -- 172.21.15.72:0/3900591571 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf1000f6a0 con 0x55fc6ca635c0 2024-04-26T12:50:37.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1c126980 1 Processor -- start 2024-04-26T12:50:37.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1c126980 1 -- start start 2024-04-26T12:50:37.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1c126980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca74190 0x55fc6ca745b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf1c126980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fc6c868ab0 con 0x55fc6ca74190 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca74190 0x55fc6ca745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca74190 0x55fc6ca745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57914/0 (socket says 172.21.15.72:57914) 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.799+0000 7fbf19c41640 1 -- 172.21.15.72:0/1528671744 learned_addr learned my addr 172.21.15.72:0/1528671744 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19c41640 1 -- 172.21.15.72:0/1528671744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6ca74af0 con 0x55fc6ca74190 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19c41640 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca74190 0x55fc6ca745b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0e3890 tx=0x7fbf0c0bc830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbdff7fe640 1 -- 172.21.15.72:0/1528671744 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0c5870 con 0x55fc6ca74190 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc6ca75590 con 0x55fc6ca74190 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6ca75a60 con 0x55fc6ca74190 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbdff7fe640 1 -- 172.21.15.72:0/1528671744 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0c5ae0 con 0x55fc6ca74190 2024-04-26T12:50:37.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbdff7fe640 1 -- 172.21.15.72:0/1528671744 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0f2060 con 0x55fc6ca74190 2024-04-26T12:50:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbdff7fe640 1 -- 172.21.15.72:0/1528671744 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbf0c0bc9e0 con 0x55fc6ca74190 2024-04-26T12:50:37.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbdff7fe640 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbdf4034650 0x7fbdf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbdff7fe640 1 -- 172.21.15.72:0/1528671744 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fbf0c0a4410 con 0x55fc6ca74190 2024-04-26T12:50:37.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19440640 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbdf4034650 0x7fbdf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf1c126980 1 Processor -- start 2024-04-26T12:50:37.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf1c126980 1 -- start start 2024-04-26T12:50:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf1c126980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca81540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf1c126980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fc6ca4f5a0 con 0x55fc6ca81160 2024-04-26T12:50:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19440640 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbdf4034650 0x7fbdf4036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55fc6ca66540 tx=0x7fbf1000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca81540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca81540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57916/0 (socket says 172.21.15.72:57916) 2024-04-26T12:50:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19c41640 1 -- 172.21.15.72:0/3935680761 learned_addr learned my addr 172.21.15.72:0/3935680761 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:37.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.803+0000 7fbf19c41640 1 -- 172.21.15.72:0/3935680761 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6ca81b10 con 0x55fc6ca81160 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf19c41640 1 --2- 172.21.15.72:0/3935680761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca81540 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0c5f70 tx=0x7fbf0c0c95f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4bb74fb6b14cd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbdfd7fa640 1 -- 172.21.15.72:0/3935680761 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0e3aa0 con 0x55fc6ca81160 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbdfd7fa640 1 -- 172.21.15.72:0/3935680761 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0c6480 con 0x55fc6ca81160 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbdfd7fa640 1 -- 172.21.15.72:0/3935680761 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0bccd0 con 0x55fc6ca81160 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- 172.21.15.72:0/3935680761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 msgr2=0x55fc6ca81540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3935680761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca81540 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0c5f70 tx=0x7fbf0c0c95f0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- 172.21.15.72:0/3935680761 shutdown_connections 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3935680761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca81540 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- 172.21.15.72:0/3935680761 >> 172.21.15.72:0/3935680761 conn(0x55fc6ca7d4f0 msgr2=0x55fc6ca7b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- 172.21.15.72:0/3935680761 shutdown_connections 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- 172.21.15.72:0/3935680761 wait complete. 2024-04-26T12:50:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 Processor -- start 2024-04-26T12:50:37.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- start start 2024-04-26T12:50:37.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca88450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55fc6ca820e0 con 0x55fc6ca81160 2024-04-26T12:50:37.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca88450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf19c41640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca88450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57926/0 (socket says 172.21.15.72:57926) 2024-04-26T12:50:37.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 learned_addr learned my addr 172.21.15.72:0/821441300 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:37.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6ca88990 con 0x55fc6ca81160 2024-04-26T12:50:37.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf19c41640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca88450 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0c5f70 tx=0x7fbf0c0a4160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbdeb7fe640 1 -- 172.21.15.72:0/821441300 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c110070 con 0x55fc6ca81160 2024-04-26T12:50:37.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc6ca88990 con 0x55fc6ca81160 2024-04-26T12:50:37.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbdeb7fe640 1 -- 172.21.15.72:0/821441300 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0b3c20 con 0x55fc6ca81160 2024-04-26T12:50:37.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbdeb7fe640 1 -- 172.21.15.72:0/821441300 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0c99d0 con 0x55fc6ca81160 2024-04-26T12:50:37.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.807+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6ca88990 con 0x55fc6ca81160 2024-04-26T12:50:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbdeb7fe640 1 -- 172.21.15.72:0/821441300 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbf0c109040 con 0x55fc6ca81160 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbdeb7fe640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbde4034650 0x7fbde4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbdeb7fe640 1 -- 172.21.15.72:0/821441300 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fbf0c0cb630 con 0x55fc6ca81160 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf19440640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbde4034650 0x7fbde4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6ca93510 0x55fc6ca959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca96120 con 0x55fc6ca93510 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1a442640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6ca93510 0x55fc6ca959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf19440640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbde4034650 0x7fbde4036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000c010 tx=0x7fbf10010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1a442640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6ca93510 0x55fc6ca959d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:37.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 realm 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca96530 con 0x55fc6ca93510 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca96dd0 con 0x55fc6ca93510 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:37.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca97ed0 0x55fc6ca9a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca9a840 con 0x55fc6ca97ed0 2024-04-26T12:50:37.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.811+0000 7fbf19c41640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca97ed0 0x55fc6ca9a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19c41640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca97ed0 0x55fc6ca9a2c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1c126980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1c126980 20 searching for the correct realm 2024-04-26T12:50:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca9c770 0x55fc6ca9ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca9f300 con 0x55fc6ca9c770 2024-04-26T12:50:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19440640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca9c770 0x55fc6ca9ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19440640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca9c770 0x55fc6ca9ec30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19440640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbf1001fbe0 0x7fbf1003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca9f300 con 0x7fbf1001fbe0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1a442640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbf1001fbe0 0x7fbf1003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1a442640 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbf1001fbe0 0x7fbf1003a3c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.815+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x7fbf1001fbe0 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x7fbf1001fbe0 2024-04-26T12:50:37.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x55fc6ca93510 2024-04-26T12:50:37.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x7fbf1001fbe0 2024-04-26T12:50:37.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf14032040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.819+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf14032040 con 0x55fc6ca93510 2024-04-26T12:50:37.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf14032040 con 0x55fc6ca93510 2024-04-26T12:50:37.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x7fbf1001fbe0 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf14032040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.823+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf14032040 con 0x55fc6ca93510 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x7fbf1001fbe0 2024-04-26T12:50:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf14032040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca9c770 2024-04-26T12:50:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca97ed0 2024-04-26T12:50:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x55fc6ca93510 2024-04-26T12:50:37.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf14032040 con 0x55fc6ca93510 2024-04-26T12:50:37.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca97170 con 0x7fbf1001fbe0 2024-04-26T12:50:37.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf14032040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:37.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:37.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.827+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca9b090 con 0x55fc6ca93510 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf14032040 con 0x55fc6ca93510 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca9b090 con 0x55fc6ca93510 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf14032040 con 0x55fc6ca93510 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca9b090 con 0x55fc6ca9c770 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 zone default found 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 4 Realm: () 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 zonegroup default 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6ca9b930 con 0x55fc6ca97ed0 2024-04-26T12:50:37.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa1160 con 0x55fc6ca9c770 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados->read ofs=0 len=0 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa1500 con 0x55fc6ca9c770 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 started sync module instance, tier type = 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa0600 con 0x7fbf1001fbe0 2024-04-26T12:50:37.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14032040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542643202816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa0600 con 0x7fbf1001fbe0 2024-04-26T12:50:37.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.831+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa1f90 con 0x55fc6ca93510 2024-04-26T12:50:37.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.835+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542643202816] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.835+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.835+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542643206752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa0600 con 0x55fc6ca93510 2024-04-26T12:50:37.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.835+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa29a0 con 0x55fc6ca9c770 2024-04-26T12:50:37.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542643206752] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542643209456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa2d90 con 0x55fc6ca9c770 2024-04-26T12:50:37.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa3750 con 0x7fbf1001fbe0 2024-04-26T12:50:37.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542643213264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa3ff0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa49b0 con 0x55fc6ca93510 2024-04-26T12:50:37.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542643213264] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.839+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542643209456] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.843+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.843+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542643217664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa3f60 con 0x55fc6ca93510 2024-04-26T12:50:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.843+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa4920 con 0x55fc6ca97ed0 2024-04-26T12:50:37.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.843+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542643217664] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.843+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.843+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542643215328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa5250 con 0x55fc6ca97ed0 2024-04-26T12:50:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.843+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa5aa0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542643215328] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542643222000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa5ec0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa6880 con 0x55fc6ca97ed0 2024-04-26T12:50:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542643225552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa6ca0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 20 add_watcher() i=0 2024-04-26T12:50:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 20 add_watcher() i=1 2024-04-26T12:50:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 20 add_watcher() i=2 2024-04-26T12:50:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 20 add_watcher() i=3 2024-04-26T12:50:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 20 add_watcher() i=4 2024-04-26T12:50:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 20 add_watcher() i=5 2024-04-26T12:50:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542643222000] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.847+0000 7fbf1c126980 20 add_watcher() i=6 2024-04-26T12:50:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.851+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542643225552] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.851+0000 7fbf1c126980 20 add_watcher() i=7 2024-04-26T12:50:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.851+0000 7fbf1c126980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.851+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa6ca0 con 0x55fc6ca93510 2024-04-26T12:50:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.851+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.851+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542643226608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa6c10 con 0x55fc6ca93510 2024-04-26T12:50:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.855+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542643226608] v35'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.855+0000 7fbdcffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.855+0000 7fbf1c126980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.855+0000 7fbf1c126980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.855+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab2440 con 0x55fc6ca93510 2024-04-26T12:50:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.855+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.855+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab2af0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.859+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.859+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab2af0 con 0x55fc6ca9c770 2024-04-26T12:50:37.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.859+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.859+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab3590 con 0x55fc6ca93510 2024-04-26T12:50:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.859+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.859+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caae2a0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.863+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.863+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caae2a0 con 0x55fc6ca9c770 2024-04-26T12:50:37.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.863+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.863+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab42c0 con 0x55fc6ca93510 2024-04-26T12:50:37.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.867+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.867+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4350 con 0x55fc6ca97ed0 2024-04-26T12:50:37.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.867+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.867+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4420 con 0x7fbf1001fbe0 2024-04-26T12:50:37.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.871+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.871+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab44d0 con 0x55fc6ca9c770 2024-04-26T12:50:37.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.871+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.871+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4b50 con 0x7fbf1001fbe0 2024-04-26T12:50:37.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.875+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.875+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4ad0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.875+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.875+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4ad0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.879+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.879+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4ad0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.879+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.879+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4ad0 con 0x55fc6ca93510 2024-04-26T12:50:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.883+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'154 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.883+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4ad0 con 0x55fc6ca9c770 2024-04-26T12:50:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.883+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.883+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.883+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'47 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.887+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca9c770 2024-04-26T12:50:37.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.887+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.887+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca93510 2024-04-26T12:50:37.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.887+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.887+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4ad0 con 0x55fc6ca93510 2024-04-26T12:50:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.891+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'155 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.891+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4ad0 con 0x55fc6ca9c770 2024-04-26T12:50:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.891+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.891+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.895+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.895+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca9c770 2024-04-26T12:50:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.895+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.895+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca9c770 2024-04-26T12:50:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.895+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.895+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca9c770 2024-04-26T12:50:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.899+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.899+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca9c770 2024-04-26T12:50:37.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.899+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.899+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.903+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.903+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca9c770 2024-04-26T12:50:37.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.903+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.903+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.907+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.907+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca9c770 2024-04-26T12:50:37.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.907+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.907+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.911+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.911+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cab4eb0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbdcefe5640 20 reqs_thread_entry: start 2024-04-26T12:50:37.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1c126980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:37.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1c126980 20 Filter name: none 2024-04-26T12:50:37.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbdccfe1640 20 reqs_thread_entry: start 2024-04-26T12:50:37.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca93510 2024-04-26T12:50:37.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.915+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca93510 2024-04-26T12:50:37.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.919+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca93510 2024-04-26T12:50:37.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.923+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.927+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.931+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.935+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca93510 2024-04-26T12:50:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca93510 2024-04-26T12:50:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.939+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x55fc6ca9c770 2024-04-26T12:50:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caad0c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad08c0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(144 gc.16 [call out=1701b] v0'0 uv44 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10037040 con 0x55fc6ca9c770 2024-04-26T12:50:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca93510 2024-04-26T12:50:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca93510 2024-04-26T12:50:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca93510 2024-04-26T12:50:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.943+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca93510 2024-04-26T12:50:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca93510 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca93510 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x7fbf1001fbe0 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x7fbf1001fbe0 2024-04-26T12:50:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x7fbf1001fbe0 2024-04-26T12:50:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.947+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.951+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca97ed0 2024-04-26T12:50:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca97ed0 2024-04-26T12:50:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca97ed0 2024-04-26T12:50:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.955+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca97ed0 2024-04-26T12:50:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca97ed0 2024-04-26T12:50:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca97ed0 2024-04-26T12:50:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca9c770 2024-04-26T12:50:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca9c770 2024-04-26T12:50:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.959+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca97ed0 2024-04-26T12:50:37.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x55fc6ca97ed0 2024-04-26T12:50:37.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x55fc6ca97ed0 2024-04-26T12:50:37.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x7fbf1001fbe0 2024-04-26T12:50:37.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad0410 con 0x7fbf1001fbe0 2024-04-26T12:50:37.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc6cad1420 con 0x7fbf1001fbe0 2024-04-26T12:50:37.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.963+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.967+0000 7fbdcffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:37.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.967+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542643226608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caac410 con 0x55fc6ca93510 2024-04-26T12:50:37.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.967+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94542643226608] v35'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.967+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542643202816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa67f0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.971+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94542643202816] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.971+0000 7fbf1c126980 20 remove_watcher() i=0 2024-04-26T12:50:37.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.971+0000 7fbf1c126980 2 removed watcher, disabling cache 2024-04-26T12:50:37.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.971+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542643206752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa67f0 con 0x55fc6ca93510 2024-04-26T12:50:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.971+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94542643206752] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.971+0000 7fbf1c126980 20 remove_watcher() i=1 2024-04-26T12:50:37.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.971+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542643209456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa67f0 con 0x55fc6ca9c770 2024-04-26T12:50:37.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.975+0000 7fbf19440640 1 -- 172.21.15.72:0/821441300 <== osd.3 v2:172.21.15.72:6808/671626845 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94542643209456] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf10055040 con 0x55fc6ca9c770 2024-04-26T12:50:37.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.975+0000 7fbf1c126980 20 remove_watcher() i=2 2024-04-26T12:50:37.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.975+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542643213264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa24f0 con 0x7fbf1001fbe0 2024-04-26T12:50:37.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.975+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.2 v2:172.21.15.72:6800/1931234624 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94542643213264] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x7fbf1001fbe0 2024-04-26T12:50:37.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.975+0000 7fbf1c126980 20 remove_watcher() i=3 2024-04-26T12:50:37.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.975+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542643217664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa67f0 con 0x55fc6ca93510 2024-04-26T12:50:37.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.979+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 <== osd.1 v2:172.21.15.72:6816/1811201389 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94542643217664] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf14040040 con 0x55fc6ca93510 2024-04-26T12:50:37.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.979+0000 7fbf1c126980 20 remove_watcher() i=4 2024-04-26T12:50:37.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.979+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542643215328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa24f0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.979+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94542643215328] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.979+0000 7fbf1c126980 20 remove_watcher() i=5 2024-04-26T12:50:37.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.979+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542643222000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa4500 con 0x55fc6ca97ed0 2024-04-26T12:50:37.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.983+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94542643222000] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.983+0000 7fbf1c126980 20 remove_watcher() i=6 2024-04-26T12:50:37.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.983+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542643225552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc6caa67f0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf19c41640 1 -- 172.21.15.72:0/821441300 <== osd.0 v2:172.21.15.29:6800/1895601642 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94542643225552] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c0c6cd0 con 0x55fc6ca97ed0 2024-04-26T12:50:37.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 20 remove_watcher() i=7 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca97ed0 msgr2=0x55fc6ca9a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca97ed0 0x55fc6ca9a2c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6ca93510 msgr2=0x55fc6ca959d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6ca93510 0x55fc6ca959d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbf1001fbe0 msgr2=0x7fbf1003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbf1001fbe0 0x7fbf1003a3c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca9c770 msgr2=0x55fc6ca9ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca9c770 0x55fc6ca9ec30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbde4034650 msgr2=0x7fbde4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbde4034650 0x7fbde4036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000c010 tx=0x7fbf10010000 comp rx=0 tx=0).stop 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 msgr2=0x55fc6ca88450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1a442640 1 -- 172.21.15.72:0/821441300 reap_dead start 2024-04-26T12:50:37.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca88450 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0c5f70 tx=0x7fbf0c0a4160 comp rx=0 tx=0).stop 2024-04-26T12:50:37.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 shutdown_connections 2024-04-26T12:50:37.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/821441300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca81160 0x55fc6ca88450 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 >> 172.21.15.72:0/821441300 conn(0x55fc6ca7d4f0 msgr2=0x55fc6ca7ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:37.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 shutdown_connections 2024-04-26T12:50:37.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/821441300 wait complete. 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbdf4034650 msgr2=0x7fbdf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbdf4034650 0x7fbdf4036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55fc6ca66540 tx=0x7fbf1000f000 comp rx=0 tx=0).stop 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca74190 msgr2=0x55fc6ca745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca74190 0x55fc6ca745b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0e3890 tx=0x7fbf0c0bc830 comp rx=0 tx=0).stop 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 shutdown_connections 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbdf4034650 0x7fbdf4036b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/1528671744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6ca74190 0x55fc6ca745b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 >> 172.21.15.72:0/1528671744 conn(0x55fc6ca68fa0 msgr2=0x55fc6ca69ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 shutdown_connections 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/1528671744 wait complete. 2024-04-26T12:50:37.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca5f6c0 msgr2=0x55fc6ca61ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55fc6ca5f6c0 0x55fc6ca61ab0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6c963e00 msgr2=0x55fc6ca5ce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55fc6c963e00 0x55fc6ca5ce90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca635c0 msgr2=0x55fc6ca659b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55fc6ca635c0 0x55fc6ca659b0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbe00034650 msgr2=0x7fbe00036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbe00034650 0x7fbe00036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbf10000f70 tx=0x7fbf10001380 comp rx=0 tx=0).stop 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 msgr2=0x55fc6ca55e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 --2- 172.21.15.72:0/3900591571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55fc6c9634e0 0x55fc6ca55e60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c01b170 tx=0x7fbf0c0180e0 comp rx=0 tx=0).stop 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1a442640 1 -- 172.21.15.72:0/3900591571 reap_dead start 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 shutdown_connections 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 >> 172.21.15.72:0/3900591571 conn(0x55fc6c8d6bc0 msgr2=0x55fc6ca493e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 shutdown_connections 2024-04-26T12:50:37.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:37.987+0000 7fbf1c126980 1 -- 172.21.15.72:0/3900591571 wait complete. 2024-04-26T12:50:38.005 INFO:teuthology.orchestra.run.smithi072.stdout:[{"tag":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5603233619200630719\u0000","time":"2024-04-26T12:50:37.728093+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_7","key":"","instance":""}]}] 2024-04-26T12:50:38.005 DEBUG:tasks.util.rgw: json result: [{'tag': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5603233619200630719\x00', 'time': '2024-04-26T12:50:37.728093+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_7', 'key': '', 'instance': ''}]}] 2024-04-26T12:50:38.006 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-26T12:50:38.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-26T12:50:38.006 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-26T12:50:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:38.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.079+0000 7f2cc1aa6980 1 Processor -- start 2024-04-26T12:50:38.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.079+0000 7f2cc1aa6980 1 -- start start 2024-04-26T12:50:38.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.079+0000 7f2cc1aa6980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55be4be2e7c0 0x55be4be30bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.079+0000 7f2cc1aa6980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be4bcd7510 con 0x55be4be2a2b0 2024-04-26T12:50:38.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.079+0000 7f2cc1aa6980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55be4bcde430 con 0x55be4be2e7c0 2024-04-26T12:50:38.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.083+0000 7f2cbedc0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55be4be2e7c0 0x55be4be30bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.083+0000 7f2cbf5c1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55be4be2a2b0 0x55be4be2a690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48208/0 (socket says 172.21.15.72:48208) 2024-04-26T12:50:38.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.083+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/2484505239 learned_addr learned my addr 172.21.15.72:0/2484505239 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:38.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.083+0000 7f2cbedc0640 1 -- 172.21.15.72:0/2484505239 >> v1:172.21.15.29:6789/0 conn(0x55be4be2a2b0 legacy=0x55be4be2a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.083+0000 7f2cbedc0640 1 -- 172.21.15.72:0/2484505239 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4bcb3ae0 con 0x55be4be2e7c0 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.083+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/2484505239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2e7c0 0x55be4be30bb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000a420 tx=0x7f2cb001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8659c023c3460a1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cbe5bf640 1 -- 172.21.15.72:0/2484505239 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb00af070 con 0x55be4be2e7c0 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cbe5bf640 1 -- 172.21.15.72:0/2484505239 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb00aa530 con 0x55be4be2e7c0 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cbe5bf640 1 -- 172.21.15.72:0/2484505239 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb00aa850 con 0x55be4be2e7c0 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/2484505239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2e7c0 msgr2=0x55be4be30bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/2484505239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2e7c0 0x55be4be30bb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000a420 tx=0x7f2cb001afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/2484505239 shutdown_connections 2024-04-26T12:50:38.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/2484505239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2e7c0 0x55be4be30bb0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/2484505239 >> 172.21.15.72:0/2484505239 conn(0x55be4be25b80 msgr2=0x55be4be27fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/2484505239 shutdown_connections 2024-04-26T12:50:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.087+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/2484505239 wait complete. 2024-04-26T12:50:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cc1aa6980 1 Processor -- start 2024-04-26T12:50:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cc1aa6980 1 -- start start 2024-04-26T12:50:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cc1aa6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bda06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cc1aa6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55be4bd2da70 con 0x55be4be2a2b0 2024-04-26T12:50:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bda06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bda06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57944/0 (socket says 172.21.15.72:57944) 2024-04-26T12:50:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/640346315 learned_addr learned my addr 172.21.15.72:0/640346315 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/640346315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4bda0cc0 con 0x55be4be2a2b0 2024-04-26T12:50:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/640346315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bda06f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001e20 tx=0x7f2ca800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07fa102344c8ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2bad60a640 1 -- 172.21.15.72:0/640346315 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8012020 con 0x55be4be2a2b0 2024-04-26T12:50:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2bad60a640 1 -- 172.21.15.72:0/640346315 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca800e7c0 con 0x55be4be2a2b0 2024-04-26T12:50:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.103+0000 7f2bad60a640 1 -- 172.21.15.72:0/640346315 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca800eb00 con 0x55be4be2a2b0 2024-04-26T12:50:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/640346315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 msgr2=0x55be4bda06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/640346315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bda06f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001e20 tx=0x7f2ca800b790 comp rx=0 tx=0).stop 2024-04-26T12:50:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/640346315 shutdown_connections 2024-04-26T12:50:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/640346315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bda06f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/640346315 >> 172.21.15.72:0/640346315 conn(0x55be4be25b80 msgr2=0x55be4bf10fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/640346315 shutdown_connections 2024-04-26T12:50:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/640346315 wait complete. 2024-04-26T12:50:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 Processor -- start 2024-04-26T12:50:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- start start 2024-04-26T12:50:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bf1e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55be4be33be0 con 0x55be4be2a2b0 2024-04-26T12:50:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bf1e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bf1e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57958/0 (socket says 172.21.15.72:57958) 2024-04-26T12:50:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/323768810 learned_addr learned my addr 172.21.15.72:0/323768810 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4bf1ede0 con 0x55be4be2a2b0 2024-04-26T12:50:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bf1e8a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001e20 tx=0x7f2ca8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2babe07640 1 -- 172.21.15.72:0/323768810 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8012030 con 0x55be4be2a2b0 2024-04-26T12:50:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2babe07640 1 -- 172.21.15.72:0/323768810 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8001480 con 0x55be4be2a2b0 2024-04-26T12:50:38.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be4bf1f070 con 0x55be4be2a2b0 2024-04-26T12:50:38.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2babe07640 1 -- 172.21.15.72:0/323768810 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca801a940 con 0x55be4be2a2b0 2024-04-26T12:50:38.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.107+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4bf21d50 con 0x55be4be2a2b0 2024-04-26T12:50:38.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2babe07640 1 -- 172.21.15.72:0/323768810 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ca8015020 con 0x55be4be2a2b0 2024-04-26T12:50:38.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2babe07640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ba4034650 0x7f2ba4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2babe07640 1 -- 172.21.15.72:0/323768810 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2ca8020030 con 0x55be4be2a2b0 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ba4034650 0x7f2ba4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4be2e7c0 0x55be4bf25830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf25e50 con 0x55be4be2e7c0 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbfdc2640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4be2e7c0 0x55be4bf25830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ba4034650 0x7f2ba4036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ac000 tx=0x7f2cb00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbfdc2640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4be2e7c0 0x55be4bf25830 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/323768810 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4be2e7c0 2024-04-26T12:50:38.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf22f50 con 0x55be4be2e7c0 2024-04-26T12:50:38.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/323768810 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4be2e7c0 2024-04-26T12:50:38.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf28180 0x55be4bf2a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf2ac40 con 0x55be4bf28180 2024-04-26T12:50:38.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf28180 0x55be4bf2a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.111+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf28180 0x55be4bf2a570 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/323768810 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ca8008030 con 0x55be4bf28180 2024-04-26T12:50:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf27020 con 0x55be4be2e7c0 2024-04-26T12:50:38.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/323768810 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4be2e7c0 2024-04-26T12:50:38.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf2c0a0 0x55be4bf2e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf2eb90 con 0x55be4bf2c0a0 2024-04-26T12:50:38.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf2c0a0 0x55be4bf2e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf2c0a0 0x55be4bf2e490 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbedc0640 1 -- 172.21.15.72:0/323768810 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2cb00b2070 con 0x55be4bf2c0a0 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cc1aa6980 1 Processor -- start 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cc1aa6980 1 -- start start 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cc1aa6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf3cc20 0x55be4bf3d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cc1aa6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55be4bd31ab0 con 0x55be4bf3cc20 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf3cc20 0x55be4bf3d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf3cc20 0x55be4bf3d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57960/0 (socket says 172.21.15.72:57960) 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1509684517 learned_addr learned my addr 172.21.15.72:0/1509684517 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1509684517 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4bf3d580 con 0x55be4bf3cc20 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.115+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf3cc20 0x55be4bf3d040 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800d010 tx=0x7f2ca8016680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba9602640 1 -- 172.21.15.72:0/1509684517 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8042130 con 0x55be4bf3cc20 2024-04-26T12:50:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be4bf3e020 con 0x55be4bf3cc20 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba9602640 1 -- 172.21.15.72:0/1509684517 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca800c580 con 0x55be4bf3cc20 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4bf3e4f0 con 0x55be4bf3cc20 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba9602640 1 -- 172.21.15.72:0/1509684517 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca800c860 con 0x55be4bf3cc20 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba9602640 1 -- 172.21.15.72:0/1509684517 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ca8009070 con 0x55be4bf3cc20 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba9602640 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b98034650 0x7f2b98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba9602640 1 -- 172.21.15.72:0/1509684517 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2ca8005050 con 0x55be4bf3cc20 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b98034650 0x7f2b98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cc1aa6980 1 Processor -- start 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cc1aa6980 1 -- start start 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cc1aa6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf4a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cc1aa6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55be4bd9eeb0 con 0x55be4bf49c00 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b98034650 0x7f2b98036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55be4bf26730 tx=0x7f2cb0005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf4a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf4a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57974/0 (socket says 172.21.15.72:57974) 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1318173041 learned_addr learned my addr 172.21.15.72:0/1318173041 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1318173041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4bf4a5f0 con 0x55be4bf49c00 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/1318173041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf4a020 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8032fd0 tx=0x7f2ca80249d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731511ca8c338253 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba2ffd640 1 -- 172.21.15.72:0/1318173041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8041880 con 0x55be4bf49c00 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba2ffd640 1 -- 172.21.15.72:0/1318173041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca805e070 con 0x55be4bf49c00 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.119+0000 7f2ba2ffd640 1 -- 172.21.15.72:0/1318173041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8041360 con 0x55be4bf49c00 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1318173041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 msgr2=0x55be4bf4a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1318173041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf4a020 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8032fd0 tx=0x7f2ca80249d0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1318173041 shutdown_connections 2024-04-26T12:50:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1318173041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf4a020 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1318173041 >> 172.21.15.72:0/1318173041 conn(0x55be4bf45f40 msgr2=0x55be4bf43ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1318173041 shutdown_connections 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1318173041 wait complete. 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 Processor -- start 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- start start 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf50f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55be4bf4ab00 con 0x55be4bf49c00 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf50f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cbf5c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf50f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57988/0 (socket says 172.21.15.72:57988) 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 learned_addr learned my addr 172.21.15.72:0/1712743886 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be4bf514b0 con 0x55be4bf49c00 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf50f70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2ca804a5b0 tx=0x7f2ca804af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2ba17fa640 1 -- 172.21.15.72:0/1712743886 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8071070 con 0x55be4bf49c00 2024-04-26T12:50:38.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be4bf514b0 con 0x55be4bf49c00 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be4bf51980 con 0x55be4bf49c00 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2ba17fa640 1 -- 172.21.15.72:0/1712743886 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca802d3f0 con 0x55be4bf49c00 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2ba17fa640 1 -- 172.21.15.72:0/1712743886 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca802d6d0 con 0x55be4bf49c00 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.123+0000 7f2ba17fa640 1 -- 172.21.15.72:0/1712743886 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ca8074070 con 0x55be4bf49c00 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2ba17fa640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b88034650 0x7f2b88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2ba17fa640 1 -- 172.21.15.72:0/1712743886 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2ca8077d30 con 0x55be4bf49c00 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b88034650 0x7f2b88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4bf5c090 0x55be4bf5e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5eca0 con 0x55be4bf5c090 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbfdc2640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4bf5c090 0x55be4bf5e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b88034650 0x7f2b88036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ad040 tx=0x7f2cb00b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbfdc2640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4bf5c090 0x55be4bf5e550 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4bf5c090 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 realm 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5f0b0 con 0x55be4bf5c090 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4bf5c090 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5f980 con 0x55be4bf5c090 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4bf5c090 2024-04-26T12:50:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf5c090 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4bf5c090 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf60a80 0x55be4bf62e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf63480 con 0x55be4bf60a80 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf60a80 0x55be4bf62e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.127+0000 7f2cbf5c1640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf60a80 0x55be4bf62e70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cc1aa6980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cc1aa6980 20 searching for the correct realm 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf653d0 0x55be4bf677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf67eb0 con 0x55be4bf653d0 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf653d0 0x55be4bf677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf653d0 0x55be4bf677e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbedc0640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2cb00cc040 0x7f2cb00d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf67eb0 con 0x7f2cb00cc040 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2cb00cc040 0x7f2cb00d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2cb00cc040 0x7f2cb00d9410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb80083f0 con 0x7f2cb00cc040 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf60a80 2024-04-26T12:50:38.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf5c090 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb80083f0 con 0x55be4bf5c090 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf5c090 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.131+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf60a80 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf60a80 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x7f2cb00cc040 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf653d0 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf5c090 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x7f2cb00cc040 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb802b040 con 0x55be4bf5c090 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb802b040 con 0x7f2cb00cc040 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb802b040 con 0x55be4bf653d0 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf653d0 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.135+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf60a80 2024-04-26T12:50:38.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf653d0 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf653d0 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf5c090 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf5c090 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf60a80 2024-04-26T12:50:38.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf653d0 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x7f2cb00cc040 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf5c090 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.139+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf60a80 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf653d0 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf60a80 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x7f2cb00cc040 2024-04-26T12:50:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf653d0 2024-04-26T12:50:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf60a80 2024-04-26T12:50:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x55be4bf5c090 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2cb00e6040 con 0x7f2cb00cc040 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf5c090 2024-04-26T12:50:38.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.143+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf5c090 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf5fd20 con 0x55be4bf653d0 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 zone default found 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 4 Realm: () 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 zonegroup default 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf642d0 con 0x55be4bf60a80 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf69d10 con 0x55be4bf653d0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6a0b0 con 0x55be4bf653d0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 started sync module instance, tier type = 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf691b0 con 0x7f2cb00cc040 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94275806598560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf691b0 con 0x7f2cb00cc040 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.147+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6a900 con 0x55be4bf5c090 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.151+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94275806598560] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.151+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.151+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94275806602592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf691b0 con 0x55be4bf5c090 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.151+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6b310 con 0x55be4bf653d0 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94275806604896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6bbb0 con 0x55be4bf653d0 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6c5d0 con 0x7f2cb00cc040 2024-04-26T12:50:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94275806602592] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94275806609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6c9f0 con 0x7f2cb00cc040 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6d3b0 con 0x55be4bf5c090 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94275806604896] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94275806609600] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94275806596352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6cf00 con 0x55be4bf5c090 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.155+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6d750 con 0x55be4bf60a80 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.159+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94275806596352] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.159+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.159+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94275806613248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6d320 con 0x55be4bf60a80 2024-04-26T12:50:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.159+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6e450 con 0x55be4bf60a80 2024-04-26T12:50:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94275806613248] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94275806616784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6e6c0 con 0x55be4bf60a80 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f1e0 con 0x55be4bf60a80 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94275806620848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f650 con 0x55be4bf60a80 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 20 add_watcher() i=0 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 20 add_watcher() i=1 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 20 add_watcher() i=2 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 20 add_watcher() i=3 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 20 add_watcher() i=4 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 20 add_watcher() i=5 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94275806616784] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.163+0000 7f2cc1aa6980 20 add_watcher() i=6 2024-04-26T12:50:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94275806620848] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cc1aa6980 20 add_watcher() i=7 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cc1aa6980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f650 con 0x55be4bf5c090 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94275806622112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f5c0 con 0x55be4bf5c090 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94275806622112] v35'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2b75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cc1aa6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cc1aa6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.167+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7b1b0 con 0x55be4bf5c090 2024-04-26T12:50:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.171+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.171+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7b880 con 0x55be4bf60a80 2024-04-26T12:50:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.171+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.171+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7b880 con 0x55be4bf653d0 2024-04-26T12:50:38.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.171+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.171+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7be70 con 0x55be4bf5c090 2024-04-26T12:50:38.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.175+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.175+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7c250 con 0x7f2cb00cc040 2024-04-26T12:50:38.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.175+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.175+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7c7c0 con 0x55be4bf653d0 2024-04-26T12:50:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.175+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.175+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7cc70 con 0x55be4bf5c090 2024-04-26T12:50:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.179+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.179+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7cb30 con 0x55be4bf60a80 2024-04-26T12:50:38.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.183+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.183+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7cbc0 con 0x7f2cb00cc040 2024-04-26T12:50:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.183+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.183+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7cbc0 con 0x55be4bf653d0 2024-04-26T12:50:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.183+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.183+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d1f0 con 0x7f2cb00cc040 2024-04-26T12:50:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.187+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.187+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d170 con 0x55be4bf60a80 2024-04-26T12:50:38.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.187+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.187+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d170 con 0x7f2cb00cc040 2024-04-26T12:50:38.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.191+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.191+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d170 con 0x55be4bf60a80 2024-04-26T12:50:38.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.191+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.191+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d170 con 0x55be4bf5c090 2024-04-26T12:50:38.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.195+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'159 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.195+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d170 con 0x55be4bf653d0 2024-04-26T12:50:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.195+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.195+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d170 con 0x7f2cb00cc040 2024-04-26T12:50:38.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.195+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'50 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.195+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d170 con 0x55be4bf653d0 2024-04-26T12:50:38.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.199+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.199+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf5c090 2024-04-26T12:50:38.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.199+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.199+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf5c090 2024-04-26T12:50:38.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.203+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.203+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf653d0 2024-04-26T12:50:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.203+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.203+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x7f2cb00cc040 2024-04-26T12:50:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.203+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.203+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf653d0 2024-04-26T12:50:38.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.207+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.207+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf653d0 2024-04-26T12:50:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.207+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.207+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf653d0 2024-04-26T12:50:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.207+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.207+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d240 con 0x55be4bf653d0 2024-04-26T12:50:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.211+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.211+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf60a80 2024-04-26T12:50:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.211+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.211+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf653d0 2024-04-26T12:50:38.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.211+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.211+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf60a80 2024-04-26T12:50:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.215+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.215+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf653d0 2024-04-26T12:50:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.219+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.219+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x55be4bf60a80 2024-04-26T12:50:38.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.219+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.219+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf7d200 con 0x7f2cb00cc040 2024-04-26T12:50:38.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.223+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x7f2cb00cc040 2024-04-26T12:50:38.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.223+0000 7f2b74fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:38.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.223+0000 7f2cc1aa6980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:38.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.223+0000 7f2cc1aa6980 20 Filter name: none 2024-04-26T12:50:38.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.223+0000 7f2aee7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:38.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.223+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-26T12:50:38.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.223+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 gc.18 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(95 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf5c090 2024-04-26T12:50:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(96 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(97 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:98 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(98 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(99 gc.18 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-26T12:50:38.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.227+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(100 gc.19 [call] v35'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:101 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(101 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:102 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf5c090 2024-04-26T12:50:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(102 gc.19 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(103 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:104 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(104 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8026040 con 0x55be4bf5c090 2024-04-26T12:50:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(105 gc.19 [call] v35'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-26T12:50:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.231+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:106 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(106 gc.20 [call] v35'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:107 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(107 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:108 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(108 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:109 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(109 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:110 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(110 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.235+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:111 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(111 gc.20 [call] v35'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-26T12:50:38.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:112 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(112 gc.21 [call] v35'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:113 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(113 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:114 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x7f2cb00cc040 2024-04-26T12:50:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(114 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.239+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:115 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(115 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:116 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(116 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:117 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(117 gc.21 [call] v35'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-26T12:50:38.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:118 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(118 gc.22 [call] v35'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:119 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(119 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.243+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:120 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(120 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:121 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(121 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:122 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(122 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:123 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(123 gc.22 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-26T12:50:38.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:124 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== osd_op_reply(124 gc.23 [call] v35'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:125 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 40 ==== osd_op_reply(125 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:126 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.247+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 41 ==== osd_op_reply(126 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:127 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 42 ==== osd_op_reply(127 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:128 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 43 ==== osd_op_reply(128 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:129 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 44 ==== osd_op_reply(129 gc.23 [call] v35'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-26T12:50:38.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:130 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 45 ==== osd_op_reply(130 gc.24 [call] v35'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:131 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 46 ==== osd_op_reply(131 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:132 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.251+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 47 ==== osd_op_reply(132 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:133 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 48 ==== osd_op_reply(133 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:134 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 49 ==== osd_op_reply(134 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:135 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 50 ==== osd_op_reply(135 gc.24 [call] v35'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-26T12:50:38.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:136 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 51 ==== osd_op_reply(136 gc.25 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:137 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 52 ==== osd_op_reply(137 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:138 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 53 ==== osd_op_reply(138 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.255+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:139 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 54 ==== osd_op_reply(139 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:140 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 55 ==== osd_op_reply(140 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:141 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 56 ==== osd_op_reply(141 gc.25 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-26T12:50:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:142 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(142 gc.26 [call] v35'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.259+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:143 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(143 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:144 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf60a80 2024-04-26T12:50:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(144 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:145 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(145 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:146 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(146 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.263+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:147 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(147 gc.26 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-26T12:50:38.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:148 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 57 ==== osd_op_reply(148 gc.27 [call] v35'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:149 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 58 ==== osd_op_reply(149 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:150 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 59 ==== osd_op_reply(150 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:151 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 60 ==== osd_op_reply(151 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:152 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.267+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 61 ==== osd_op_reply(152 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.271+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.271+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:153 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.271+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 62 ==== osd_op_reply(153 gc.27 [call] v35'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.271+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-26T12:50:38.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.271+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:154 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.271+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(154 gc.28 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.271+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:155 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(155 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:156 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf60a80 2024-04-26T12:50:38.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== osd_op_reply(156 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:157 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(157 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:158 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(158 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.275+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:159 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(159 gc.28 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-26T12:50:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:160 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 63 ==== osd_op_reply(160 gc.29 [call] v35'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:161 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 64 ==== osd_op_reply(161 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:162 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 65 ==== osd_op_reply(162 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:163 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 66 ==== osd_op_reply(163 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.279+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:164 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.283+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 67 ==== osd_op_reply(164 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.283+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.283+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:165 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.283+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 68 ==== osd_op_reply(165 gc.29 [call] v35'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.283+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-26T12:50:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.283+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:166 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== osd_op_reply(166 gc.30 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:167 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(167 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:168 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf60a80 2024-04-26T12:50:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(168 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:169 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== osd_op_reply(169 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.287+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:170 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.291+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(170 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.291+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.291+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:171 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.291+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== osd_op_reply(171 gc.30 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.291+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-26T12:50:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.291+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:172 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(172 gc.31 [call] v35'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:173 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(173 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:174 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x7f2cb00cc040 2024-04-26T12:50:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(174 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:175 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(175 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:176 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(176 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.295+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:177 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.299+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(177 gc.31 [call] v35'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.299+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-26T12:50:38.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.299+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:178 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.299+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(178 gc.0 [call] v35'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.299+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:179 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 40 ==== osd_op_reply(179 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:180 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf5c090 2024-04-26T12:50:38.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 41 ==== osd_op_reply(180 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:181 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 42 ==== osd_op_reply(181 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:182 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 43 ==== osd_op_reply(182 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.303+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:183 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 44 ==== osd_op_reply(183 gc.0 [call] v35'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-26T12:50:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:184 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(184 gc.1 [call] v35'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:185 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 43 ==== osd_op_reply(185 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.307+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:186 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf60a80 2024-04-26T12:50:38.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 44 ==== osd_op_reply(186 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:187 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 45 ==== osd_op_reply(187 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:188 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 46 ==== osd_op_reply(188 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.311+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:189 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.315+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 47 ==== osd_op_reply(189 gc.1 [call] v35'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.315+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-26T12:50:38.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.315+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:190 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.315+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 69 ==== osd_op_reply(190 gc.2 [call] v35'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.315+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:191 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 70 ==== osd_op_reply(191 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:192 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 71 ==== osd_op_reply(192 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:193 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 72 ==== osd_op_reply(193 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:194 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 73 ==== osd_op_reply(194 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.319+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:195 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 74 ==== osd_op_reply(195 gc.2 [call] v35'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-26T12:50:38.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:196 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 45 ==== osd_op_reply(196 gc.3 [call] v35'163 uv163 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:197 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 46 ==== osd_op_reply(197 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:198 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf5c090 2024-04-26T12:50:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 47 ==== osd_op_reply(198 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:199 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 48 ==== osd_op_reply(199 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.323+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:200 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 49 ==== osd_op_reply(200 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:201 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 50 ==== osd_op_reply(201 gc.3 [call] v35'164 uv164 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-26T12:50:38.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:202 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(202 gc.4 [call] v35'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.327+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:203 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== osd_op_reply(203 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:204 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(204 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:205 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== osd_op_reply(205 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:206 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== osd_op_reply(206 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:207 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== osd_op_reply(207 gc.4 [call] v35'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-26T12:50:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.331+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:208 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 75 ==== osd_op_reply(208 gc.5 [call] v35'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:209 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 76 ==== osd_op_reply(209 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:210 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 77 ==== osd_op_reply(210 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:211 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 78 ==== osd_op_reply(211 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:212 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 79 ==== osd_op_reply(212 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.335+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:213 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.339+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 80 ==== osd_op_reply(213 gc.5 [call] v35'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.339+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-26T12:50:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.339+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:214 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.339+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 51 ==== osd_op_reply(214 gc.6 [call] v35'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.339+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:215 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 52 ==== osd_op_reply(215 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:216 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf5c090 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 53 ==== osd_op_reply(216 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:217 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 54 ==== osd_op_reply(217 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:218 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 55 ==== osd_op_reply(218 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:219 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 56 ==== osd_op_reply(219 gc.6 [call] v35'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-26T12:50:38.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.343+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:220 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.347+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 48 ==== osd_op_reply(220 gc.7 [call] v35'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.347+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:221 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.347+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 49 ==== osd_op_reply(221 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.347+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.347+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:222 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf60a80 2024-04-26T12:50:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 50 ==== osd_op_reply(222 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:223 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 51 ==== osd_op_reply(223 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:224 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 52 ==== osd_op_reply(224 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.351+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:225 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.355+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 53 ==== osd_op_reply(225 gc.7 [call] v35'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.355+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-26T12:50:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.355+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:226 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.355+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(226 gc.8 [call] v35'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.355+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:227 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== osd_op_reply(227 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:228 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x7f2cb00cc040 2024-04-26T12:50:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(228 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:229 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(229 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:230 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 41 ==== osd_op_reply(230 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.359+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:231 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.363+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 42 ==== osd_op_reply(231 gc.8 [call] v35'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.363+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-26T12:50:38.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.363+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:232 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.363+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 81 ==== osd_op_reply(232 gc.9 [call] v35'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.363+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:233 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 82 ==== osd_op_reply(233 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:234 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 83 ==== osd_op_reply(234 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:235 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 84 ==== osd_op_reply(235 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:236 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 85 ==== osd_op_reply(236 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:237 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 86 ==== osd_op_reply(237 gc.9 [call] v35'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.367+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-26T12:50:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:238 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 43 ==== osd_op_reply(238 gc.10 [call] v35'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:239 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 44 ==== osd_op_reply(239 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:240 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x7f2cb00cc040 2024-04-26T12:50:38.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 45 ==== osd_op_reply(240 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.371+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:241 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 46 ==== osd_op_reply(241 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:242 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 47 ==== osd_op_reply(242 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:243 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 48 ==== osd_op_reply(243 gc.10 [call] v35'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-26T12:50:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.375+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:244 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.379+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 54 ==== osd_op_reply(244 gc.11 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.379+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:245 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.379+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 55 ==== osd_op_reply(245 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.379+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.379+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:246 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf60a80 2024-04-26T12:50:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 56 ==== osd_op_reply(246 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:247 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 57 ==== osd_op_reply(247 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:248 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 58 ==== osd_op_reply(248 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.383+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:249 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.387+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 59 ==== osd_op_reply(249 gc.11 [call] v35'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.387+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-26T12:50:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.387+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:250 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 49 ==== osd_op_reply(250 gc.12 [call] v35'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:251 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 50 ==== osd_op_reply(251 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:252 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x7f2cb00cc040 2024-04-26T12:50:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 51 ==== osd_op_reply(252 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:253 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 52 ==== osd_op_reply(253 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:254 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 53 ==== osd_op_reply(254 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.391+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:255 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.395+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 54 ==== osd_op_reply(255 gc.12 [call] v35'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.395+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-26T12:50:38.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.395+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:256 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 60 ==== osd_op_reply(256 gc.13 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:257 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 61 ==== osd_op_reply(257 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:258 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf60a80 2024-04-26T12:50:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 62 ==== osd_op_reply(258 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:259 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 63 ==== osd_op_reply(259 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.399+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:260 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.403+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 64 ==== osd_op_reply(260 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.403+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.403+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:261 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf60a80 2024-04-26T12:50:38.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 65 ==== osd_op_reply(261 gc.13 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-26T12:50:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:262 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 57 ==== osd_op_reply(262 gc.14 [call] v35'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:263 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 58 ==== osd_op_reply(263 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.407+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:264 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf5c090 2024-04-26T12:50:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 59 ==== osd_op_reply(264 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:265 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 60 ==== osd_op_reply(265 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:266 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 61 ==== osd_op_reply(266 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.411+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:267 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf5c090 2024-04-26T12:50:38.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.415+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 62 ==== osd_op_reply(267 gc.14 [call] v35'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.415+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-26T12:50:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.415+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:268 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.415+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 87 ==== osd_op_reply(268 gc.15 [call] v35'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.415+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:269 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 88 ==== osd_op_reply(269 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:270 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x55be4bf653d0 2024-04-26T12:50:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 89 ==== osd_op_reply(270 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:271 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 90 ==== osd_op_reply(271 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:272 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 91 ==== osd_op_reply(272 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.419+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:273 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x55be4bf653d0 2024-04-26T12:50:38.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.423+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 92 ==== osd_op_reply(273 gc.15 [call] v35'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.423+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-26T12:50:38.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.423+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:274 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 55 ==== osd_op_reply(274 gc.16 [call] v35'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:275 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 56 ==== osd_op_reply(275 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:276 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98970 con 0x7f2cb00cc040 2024-04-26T12:50:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 57 ==== osd_op_reply(276 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:277 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 58 ==== osd_op_reply(277 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:278 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99980 con 0x7f2cb00cc040 2024-04-26T12:50:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 59 ==== osd_op_reply(278 gc.16 [call out=1701b] v0'0 uv55 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-26T12:50:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process iterating over entry tag='fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5603233619200630719', time=2024-04-26T12:50:37.728093+0000, chain.objs.size()=7 2024-04-26T12:50:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_1 2024-04-26T12:50:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:279 3.2as0 3:55387247:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf99e30 con 0x55be4bf5c090 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_2 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:280 3.3ds0 3:be3de8f5:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9c9e0 con 0x55be4bf653d0 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_3 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:281 3.3ds0 3:be85d88a:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9f340 con 0x55be4bf653d0 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_4 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:282 3.0s0 3:01772c9d:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bfa1bb0 con 0x55be4bf60a80 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_5 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:283 3.27s0 3:e705e487:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bfa4420 con 0x55be4bf60a80 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_6 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:284 3.fs0 3:f1ab94f4:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bfa1bb0 con 0x7f2cb00cc040 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_7 2024-04-26T12:50:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.427+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:285 3.10s0 3:0955803d:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bfa91d0 con 0x55be4bf5c090 2024-04-26T12:50:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.435+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 63 ==== osd_op_reply(285 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_7 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.435+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 64 ==== osd_op_reply(279 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_1 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.435+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 66 ==== osd_op_reply(282 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_4 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.435+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 60 ==== osd_op_reply(284 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_6 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.435+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 67 ==== osd_op_reply(283 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_5 [call] v35'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.439+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 93 ==== osd_op_reply(280 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_2 [call] v35'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.439+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 94 ==== osd_op_reply(281 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.1__shadow_.HarBCtGwtNN2Nh1nnOw0-TtfEJIapNu_3 [call] v35'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.439+0000 7f2cc1aa6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-26T12:50:38.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.439+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:286 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9ce70 con 0x7f2cb00cc040 2024-04-26T12:50:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.447+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 61 ==== osd_op_reply(286 gc.16 [call] v35'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.447+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:287 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9ce70 con 0x7f2cb00cc040 2024-04-26T12:50:38.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 62 ==== osd_op_reply(287 gc.16 [call] v35'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-26T12:50:38.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:288 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9a330 con 0x55be4bf653d0 2024-04-26T12:50:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 95 ==== osd_op_reply(288 gc.17 [call] v35'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:289 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9a2e0 con 0x55be4bf653d0 2024-04-26T12:50:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 96 ==== osd_op_reply(289 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.451+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:290 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf98e20 con 0x55be4bf653d0 2024-04-26T12:50:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 97 ==== osd_op_reply(290 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:291 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9a2e0 con 0x55be4bf653d0 2024-04-26T12:50:38.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 98 ==== osd_op_reply(291 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:50:38.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:292 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9a2e0 con 0x55be4bf653d0 2024-04-26T12:50:38.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 99 ==== osd_op_reply(292 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cc1aa6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:50:38.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.455+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:293 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf9cde0 con 0x55be4bf653d0 2024-04-26T12:50:38.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.459+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 100 ==== osd_op_reply(293 gc.17 [call] v35'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.459+0000 7f2b75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:38.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.459+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94275806622112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf778a0 con 0x55be4bf5c090 2024-04-26T12:50:38.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.463+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94275806622112] v35'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.463+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94275806598560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f1a0 con 0x7f2cb00cc040 2024-04-26T12:50:38.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.463+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94275806598560] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.463+0000 7f2cc1aa6980 20 remove_watcher() i=0 2024-04-26T12:50:38.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.463+0000 7f2cc1aa6980 2 removed watcher, disabling cache 2024-04-26T12:50:38.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.463+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94275806602592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f1a0 con 0x55be4bf5c090 2024-04-26T12:50:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.467+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94275806602592] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.467+0000 7f2cc1aa6980 20 remove_watcher() i=1 2024-04-26T12:50:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.467+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94275806604896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f1a0 con 0x55be4bf653d0 2024-04-26T12:50:38.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.471+0000 7f2cbedc0640 1 -- 172.21.15.72:0/1712743886 <== osd.3 v2:172.21.15.72:6808/671626845 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94275806604896] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb00d7070 con 0x55be4bf653d0 2024-04-26T12:50:38.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.471+0000 7f2cc1aa6980 20 remove_watcher() i=2 2024-04-26T12:50:38.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.471+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94275806609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f1a0 con 0x7f2cb00cc040 2024-04-26T12:50:38.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.471+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.2 v2:172.21.15.72:6800/1931234624 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94275806609600] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x7f2cb00cc040 2024-04-26T12:50:38.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.471+0000 7f2cc1aa6980 20 remove_watcher() i=3 2024-04-26T12:50:38.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.471+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94275806596352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6c0c0 con 0x55be4bf5c090 2024-04-26T12:50:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.475+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 <== osd.1 v2:172.21.15.72:6816/1811201389 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94275806596352] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb8042040 con 0x55be4bf5c090 2024-04-26T12:50:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.475+0000 7f2cc1aa6980 20 remove_watcher() i=4 2024-04-26T12:50:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.475+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94275806613248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f1a0 con 0x55be4bf60a80 2024-04-26T12:50:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.475+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94275806613248] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.475+0000 7f2cc1aa6980 20 remove_watcher() i=5 2024-04-26T12:50:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.475+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94275806616784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6cf00 con 0x55be4bf60a80 2024-04-26T12:50:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.479+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94275806616784] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.479+0000 7f2cc1aa6980 20 remove_watcher() i=6 2024-04-26T12:50:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.479+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94275806620848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55be4bf6f1a0 con 0x55be4bf60a80 2024-04-26T12:50:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cbf5c1640 1 -- 172.21.15.72:0/1712743886 <== osd.0 v2:172.21.15.29:6800/1895601642 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94275806620848] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca8073030 con 0x55be4bf60a80 2024-04-26T12:50:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 20 remove_watcher() i=7 2024-04-26T12:50:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf60a80 msgr2=0x55be4bf62e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf60a80 0x55be4bf62e70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4bf5c090 msgr2=0x55be4bf5e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4bf5c090 0x55be4bf5e550 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2cb00cc040 msgr2=0x7f2cb00d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2cb00cc040 0x7f2cb00d9410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf653d0 msgr2=0x55be4bf677e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf653d0 0x55be4bf677e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b88034650 msgr2=0x7f2b88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b88034650 0x7f2b88036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ad040 tx=0x7f2cb00b8040 comp rx=0 tx=0).stop 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 msgr2=0x55be4bf50f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1712743886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf49c00 0x55be4bf50f70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2ca804a5b0 tx=0x7f2ca804af30 comp rx=0 tx=0).stop 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 reap_dead start 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/1712743886 reap_dead start 2024-04-26T12:50:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 shutdown_connections 2024-04-26T12:50:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 >> 172.21.15.72:0/1712743886 conn(0x55be4bf45f40 msgr2=0x55be4bf435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 shutdown_connections 2024-04-26T12:50:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1712743886 wait complete. 2024-04-26T12:50:38.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b98034650 msgr2=0x7f2b98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b98034650 0x7f2b98036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55be4bf26730 tx=0x7f2cb0005d90 comp rx=0 tx=0).stop 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf3cc20 msgr2=0x55be4bf3d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf3cc20 0x55be4bf3d040 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800d010 tx=0x7f2ca8016680 comp rx=0 tx=0).stop 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 shutdown_connections 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2b98034650 0x7f2b98036b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/1509684517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4bf3cc20 0x55be4bf3d040 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 >> 172.21.15.72:0/1509684517 conn(0x55be4bf31a30 msgr2=0x55be4bf32540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 shutdown_connections 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/1509684517 wait complete. 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf28180 msgr2=0x55be4bf2a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55be4bf28180 0x55be4bf2a570 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4be2e7c0 msgr2=0x55be4bf25830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55be4be2e7c0 0x55be4bf25830 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf2c0a0 msgr2=0x55be4bf2e490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55be4bf2c0a0 0x55be4bf2e490 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ba4034650 msgr2=0x7f2ba4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ba4034650 0x7f2ba4036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ac000 tx=0x7f2cb00a5000 comp rx=0 tx=0).stop 2024-04-26T12:50:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 msgr2=0x55be4bf1e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 --2- 172.21.15.72:0/323768810 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55be4be2a2b0 0x55be4bf1e8a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001e20 tx=0x7f2ca8000ee0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cbfdc2640 1 -- 172.21.15.72:0/323768810 reap_dead start 2024-04-26T12:50:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 shutdown_connections 2024-04-26T12:50:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 >> 172.21.15.72:0/323768810 conn(0x55be4be25b80 msgr2=0x55be4bd9f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 shutdown_connections 2024-04-26T12:50:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.483+0000 7f2cc1aa6980 1 -- 172.21.15.72:0/323768810 wait complete. 2024-04-26T12:50:38.501 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-26T12:50:38.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-26T12:50:38.502 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-26T12:50:38.581 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:38.582 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:38.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f7445ea4980 1 Processor -- start 2024-04-26T12:50:38.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f7445ea4980 1 -- start start 2024-04-26T12:50:38.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f7445ea4980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c90296fd80 0x55c902a04310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f7445ea4980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9028a8510 con 0x55c902971070 2024-04-26T12:50:38.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f7445ea4980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c9028af430 con 0x55c90296fd80 2024-04-26T12:50:38.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f74431be640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c90296fd80 0x55c902a04310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f74431be640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c90296fd80 0x55c902a04310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:57998/0 (socket says 172.21.15.72:57998) 2024-04-26T12:50:38.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f74431be640 1 -- 172.21.15.72:0/4201251761 learned_addr learned my addr 172.21.15.72:0/4201251761 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f74439bf640 1 --1- 172.21.15.72:0/4201251761 >> v1:172.21.15.29:6789/0 conn(0x55c902971070 0x55c90296f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48222/0 (socket says 172.21.15.72:48222) 2024-04-26T12:50:38.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f74431be640 1 -- 172.21.15.72:0/4201251761 >> v1:172.21.15.29:6789/0 conn(0x55c902971070 legacy=0x55c90296f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f74431be640 1 -- 172.21.15.72:0/4201251761 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c902884ae0 con 0x55c90296fd80 2024-04-26T12:50:38.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.583+0000 7f74431be640 1 --2- 172.21.15.72:0/4201251761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902a04310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f743800a5c0 tx=0x7f743801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baaa82ff365ddf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f74429bd640 1 -- 172.21.15.72:0/4201251761 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74380a6070 con 0x55c90296fd80 2024-04-26T12:50:38.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f74429bd640 1 -- 172.21.15.72:0/4201251761 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74380af070 con 0x55c90296fd80 2024-04-26T12:50:38.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f74429bd640 1 -- 172.21.15.72:0/4201251761 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74380aa5c0 con 0x55c90296fd80 2024-04-26T12:50:38.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f7445ea4980 1 -- 172.21.15.72:0/4201251761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 msgr2=0x55c902a04310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4201251761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902a04310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f743800a5c0 tx=0x7f743801b340 comp rx=0 tx=0).stop 2024-04-26T12:50:38.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f7445ea4980 1 -- 172.21.15.72:0/4201251761 shutdown_connections 2024-04-26T12:50:38.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4201251761 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902a04310 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f7445ea4980 1 -- 172.21.15.72:0/4201251761 >> 172.21.15.72:0/4201251761 conn(0x55c9029f6bd0 msgr2=0x55c9029f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f7445ea4980 1 -- 172.21.15.72:0/4201251761 shutdown_connections 2024-04-26T12:50:38.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.587+0000 7f7445ea4980 1 -- 172.21.15.72:0/4201251761 wait complete. 2024-04-26T12:50:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 Processor -- start 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- start start 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902ae8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9028fea70 con 0x55c90296fd80 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902ae8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902ae8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58010/0 (socket says 172.21.15.72:58010) 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f74439bf640 1 -- 172.21.15.72:0/340968651 learned_addr learned my addr 172.21.15.72:0/340968651 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f74439bf640 1 -- 172.21.15.72:0/340968651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c902ae90d0 con 0x55c90296fd80 2024-04-26T12:50:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f74439bf640 1 --2- 172.21.15.72:0/340968651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902ae8b00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f743c0015f0 tx=0x7f743c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41560af5eaa3515 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7331e0b640 1 -- 172.21.15.72:0/340968651 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c013420 con 0x55c90296fd80 2024-04-26T12:50:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7331e0b640 1 -- 172.21.15.72:0/340968651 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c0135e0 con 0x55c90296fd80 2024-04-26T12:50:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7331e0b640 1 -- 172.21.15.72:0/340968651 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c013940 con 0x55c90296fd80 2024-04-26T12:50:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- 172.21.15.72:0/340968651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 msgr2=0x55c902ae8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 --2- 172.21.15.72:0/340968651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902ae8b00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f743c0015f0 tx=0x7f743c001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- 172.21.15.72:0/340968651 shutdown_connections 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 --2- 172.21.15.72:0/340968651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902ae8b00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- 172.21.15.72:0/340968651 >> 172.21.15.72:0/340968651 conn(0x55c9029f6bd0 msgr2=0x55c902ae4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- 172.21.15.72:0/340968651 shutdown_connections 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- 172.21.15.72:0/340968651 wait complete. 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 Processor -- start 2024-04-26T12:50:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- start start 2024-04-26T12:50:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902aefdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.603+0000 7f7445ea4980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c902a07310 con 0x55c90296fd80 2024-04-26T12:50:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902aefdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902aefdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58012/0 (socket says 172.21.15.72:58012) 2024-04-26T12:50:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74439bf640 1 -- 172.21.15.72:0/4002112602 learned_addr learned my addr 172.21.15.72:0/4002112602 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74439bf640 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c902af02f0 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74439bf640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902aefdb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f743c006640 tx=0x7f743c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f732bfff640 1 -- 172.21.15.72:0/4002112602 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c022020 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f732bfff640 1 -- 172.21.15.72:0/4002112602 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c006320 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c902af0580 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f732bfff640 1 -- 172.21.15.72:0/4002112602 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c004af0 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c902af31c0 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f732bfff640 1 -- 172.21.15.72:0/4002112602 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f743c025020 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f732bfff640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f732c034650 0x7f732c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f732bfff640 1 -- 172.21.15.72:0/4002112602 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f743c018030 con 0x55c90296fd80 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74431be640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f732c034650 0x7f732c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902971070 0x55c902af6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902af7350 con 0x55c902971070 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74441c0640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902971070 0x55c902af6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74431be640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f732c034650 0x7f732c036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f74380ae000 tx=0x7f74380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.607+0000 7f74441c0640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902971070 0x55c902af6ce0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74441c0640 1 -- 172.21.15.72:0/4002112602 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74340083f0 con 0x55c902971070 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902af43c0 con 0x55c902971070 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74441c0640 1 -- 172.21.15.72:0/4002112602 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74340083f0 con 0x55c902971070 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902af9680 0x55c902afba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902afc140 con 0x55c902af9680 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74439bf640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902af9680 0x55c902afba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74439bf640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902af9680 0x55c902afba70 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74439bf640 1 -- 172.21.15.72:0/4002112602 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f743c01b070 con 0x55c902af9680 2024-04-26T12:50:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902af8520 con 0x55c902971070 2024-04-26T12:50:38.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74441c0640 1 -- 172.21.15.72:0/4002112602 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74340083f0 con 0x55c902971070 2024-04-26T12:50:38.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902afd5a0 0x55c902aff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b00090 con 0x55c902afd5a0 2024-04-26T12:50:38.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74431be640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902afd5a0 0x55c902aff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74431be640 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902afd5a0 0x55c902aff990 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.611+0000 7f74431be640 1 -- 172.21.15.72:0/4002112602 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902afd5a0 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f7445ea4980 1 Processor -- start 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f7445ea4980 1 -- start start 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f7445ea4980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b0e120 0x55c902b0e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f7445ea4980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c902902ab0 con 0x55c902b0e120 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b0e120 0x55c902b0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b0e120 0x55c902b0e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58014/0 (socket says 172.21.15.72:58014) 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f74439bf640 1 -- 172.21.15.72:0/2303372695 learned_addr learned my addr 172.21.15.72:0/2303372695 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f74439bf640 1 -- 172.21.15.72:0/2303372695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c902b0ea80 con 0x55c902b0e120 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f74439bf640 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b0e120 0x55c902b0e540 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f743c014fd0 tx=0x7f743c028eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f73297fa640 1 -- 172.21.15.72:0/2303372695 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c040070 con 0x55c902b0e120 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f73297fa640 1 -- 172.21.15.72:0/2303372695 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c01db60 con 0x55c902b0e120 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c902b0f520 con 0x55c902b0e120 2024-04-26T12:50:38.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f73297fa640 1 -- 172.21.15.72:0/2303372695 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c01de40 con 0x55c902b0e120 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c902b0f9f0 con 0x55c902b0e120 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f73297fa640 1 -- 172.21.15.72:0/2303372695 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f743c04b030 con 0x55c902b0e120 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f73297fa640 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f731c034600 0x7f731c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f73297fa640 1 -- 172.21.15.72:0/2303372695 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f743c01f070 con 0x55c902b0e120 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f74431be640 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f731c034600 0x7f731c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.615+0000 7f7445ea4980 1 Processor -- start 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- start start 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74431be640 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f731c034600 0x7f731c036ac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55c902af7c30 tx=0x7f7438005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b1b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c902ae9420 con 0x55c902b1b010 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b1b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b1b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58022/0 (socket says 172.21.15.72:58022) 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 -- 172.21.15.72:0/2258035568 learned_addr learned my addr 172.21.15.72:0/2258035568 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 -- 172.21.15.72:0/2258035568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c902b1ba00 con 0x55c902b1b010 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 --2- 172.21.15.72:0/2258035568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b1b430 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f743c03eff0 tx=0x7f743c0319e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb15751c8f5993c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7322ffd640 1 -- 172.21.15.72:0/2258035568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c005410 con 0x55c902b1b010 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7322ffd640 1 -- 172.21.15.72:0/2258035568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c04d410 con 0x55c902b1b010 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7322ffd640 1 -- 172.21.15.72:0/2258035568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c0055b0 con 0x55c902b1b010 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- 172.21.15.72:0/2258035568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 msgr2=0x55c902b1b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 --2- 172.21.15.72:0/2258035568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b1b430 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f743c03eff0 tx=0x7f743c0319e0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- 172.21.15.72:0/2258035568 shutdown_connections 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 --2- 172.21.15.72:0/2258035568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b1b430 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- 172.21.15.72:0/2258035568 >> 172.21.15.72:0/2258035568 conn(0x55c902b173e0 msgr2=0x55c902b15440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- 172.21.15.72:0/2258035568 shutdown_connections 2024-04-26T12:50:38.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- 172.21.15.72:0/2258035568 wait complete. 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 Processor -- start 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- start start 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f7445ea4980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c902b1bfd0 con 0x55c902b1b010 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b223d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58030/0 (socket says 172.21.15.72:58030) 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 learned_addr learned my addr 172.21.15.72:0/1234430119 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.619+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c902b22910 con 0x55c902b1b010 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74439bf640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b223d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f743c005950 tx=0x7f743c030ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f73217fa640 1 -- 172.21.15.72:0/1234430119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c066040 con 0x55c902b1b010 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f73217fa640 1 -- 172.21.15.72:0/1234430119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c071070 con 0x55c902b1b010 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c902b22910 con 0x55c902b1b010 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c902b22910 con 0x55c902b1b010 2024-04-26T12:50:38.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f73217fa640 1 -- 172.21.15.72:0/1234430119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c04d7a0 con 0x55c902b1b010 2024-04-26T12:50:38.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f73217fa640 1 -- 172.21.15.72:0/1234430119 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f743c046040 con 0x55c902b1b010 2024-04-26T12:50:38.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f73217fa640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f730c034650 0x7f730c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f73217fa640 1 -- 172.21.15.72:0/1234430119 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f743c023220 con 0x55c902b1b010 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74431be640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f730c034650 0x7f730c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902b2d420 0x55c902b2f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b30030 con 0x55c902b2d420 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74441c0640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902b2d420 0x55c902b2f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74431be640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f730c034650 0x7f730c036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7438018f70 tx=0x7f74380c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74441c0640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902b2d420 0x55c902b2f8e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74340083f0 con 0x55c902b2d420 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 realm 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b30440 con 0x55c902b2d420 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74340083f0 con 0x55c902b2d420 2024-04-26T12:50:38.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b30ce0 con 0x55c902b2d420 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74340083f0 con 0x55c902b2d420 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b2d420 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74340083f0 con 0x55c902b2d420 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.623+0000 7f7445ea4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902b31de0 0x55c902b341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b34710 con 0x55c902b31de0 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74439bf640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902b31de0 0x55c902b341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74439bf640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902b31de0 0x55c902b341d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f7445ea4980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f7445ea4980 20 searching for the correct realm 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902b36680 0x55c902b38b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b39210 con 0x55c902b36680 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74431be640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902b36680 0x55c902b38b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74431be640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902b36680 0x55c902b38b40 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74431be640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74380e0040 0x7f74380e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b39210 con 0x7f74380e0040 2024-04-26T12:50:38.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74441c0640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74380e0040 0x7f74380e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74441c0640 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74380e0040 0x7f74380e0420 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74340083f0 con 0x7f74380e0040 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.627+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b31de0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b2d420 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74340083f0 con 0x55c902b2d420 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b2d420 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b31de0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b31de0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x7f74380e0040 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b36680 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b2d420 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x7f74380e0040 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.631+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b2d420 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x7f74380e0040 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b36680 2024-04-26T12:50:38.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b36680 2024-04-26T12:50:38.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b31de0 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b36680 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b36680 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b2d420 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b2d420 2024-04-26T12:50:38.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b31de0 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.635+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b36680 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x7f74380e0040 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b2d420 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b31de0 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b36680 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b31de0 2024-04-26T12:50:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x7f74380e0040 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b36680 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.639+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b31de0 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x55c902b2d420 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f743402b040 con 0x7f74380e0040 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b2d420 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b2d420 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b31080 con 0x55c902b36680 2024-04-26T12:50:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 zone default found 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 4 Realm: () 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 zonegroup default 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b352a0 con 0x55c902b31de0 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b35b90 con 0x55c902b36680 2024-04-26T12:50:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3b070 con 0x55c902b36680 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 started sync module instance, tier type = 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.643+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3a510 con 0x7f74380e0040 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.647+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.647+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94321822116448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3a510 con 0x7f74380e0040 2024-04-26T12:50:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.647+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3bac0 con 0x55c902b2d420 2024-04-26T12:50:38.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.647+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94321822116448] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.647+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.647+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94321822119376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3a510 con 0x55c902b2d420 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.647+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3c4d0 con 0x55c902b36680 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94321822122016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3cd20 con 0x55c902b36680 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3d720 con 0x7f74380e0040 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94321822119376] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94321822113888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3db10 con 0x7f74380e0040 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3e4d0 con 0x55c902b2d420 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94321822122016] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.651+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94321822113888] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.655+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.655+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94321822126640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3e020 con 0x55c902b2d420 2024-04-26T12:50:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.655+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3ed70 con 0x55c902b31de0 2024-04-26T12:50:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.655+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94321822126640] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.655+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.655+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94321822132416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3e020 con 0x55c902b31de0 2024-04-26T12:50:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.655+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3f5c0 con 0x55c902b31de0 2024-04-26T12:50:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94321822136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b40230 con 0x55c902b31de0 2024-04-26T12:50:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94321822132416] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b40c80 con 0x55c902b31de0 2024-04-26T12:50:38.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94321822140272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b40c40 con 0x55c902b31de0 2024-04-26T12:50:38.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 20 add_watcher() i=0 2024-04-26T12:50:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 20 add_watcher() i=1 2024-04-26T12:50:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 20 add_watcher() i=2 2024-04-26T12:50:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 20 add_watcher() i=3 2024-04-26T12:50:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 20 add_watcher() i=4 2024-04-26T12:50:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 20 add_watcher() i=5 2024-04-26T12:50:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94321822136672] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.659+0000 7f7445ea4980 20 add_watcher() i=6 2024-04-26T12:50:38.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94321822140272] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f7445ea4980 20 add_watcher() i=7 2024-04-26T12:50:38.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f7445ea4980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:38.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3fd80 con 0x55c902b2d420 2024-04-26T12:50:38.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94321822137728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b410d0 con 0x55c902b2d420 2024-04-26T12:50:38.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94321822137728] v35'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f72f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:38.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f7445ea4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:38.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f7445ea4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:38.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.663+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4c360 con 0x55c902b2d420 2024-04-26T12:50:38.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.667+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.667+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4c9f0 con 0x55c902b31de0 2024-04-26T12:50:38.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.667+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.667+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4c9f0 con 0x55c902b36680 2024-04-26T12:50:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.671+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.671+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4cfa0 con 0x55c902b2d420 2024-04-26T12:50:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.671+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'169 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.671+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4d510 con 0x7f74380e0040 2024-04-26T12:50:38.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.671+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'58 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.671+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4d9c0 con 0x55c902b36680 2024-04-26T12:50:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.671+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.675+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b48280 con 0x55c902b2d420 2024-04-26T12:50:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.675+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.675+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b48280 con 0x55c902b31de0 2024-04-26T12:50:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.679+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.679+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b48250 con 0x7f74380e0040 2024-04-26T12:50:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.679+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.679+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b48420 con 0x55c902b36680 2024-04-26T12:50:38.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.679+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.679+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x7f74380e0040 2024-04-26T12:50:38.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.683+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'59 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.683+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b31de0 2024-04-26T12:50:38.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.683+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.683+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x7f74380e0040 2024-04-26T12:50:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.687+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.687+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b31de0 2024-04-26T12:50:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.687+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.687+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b2d420 2024-04-26T12:50:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.691+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'170 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.691+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b36680 2024-04-26T12:50:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.691+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'51 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.691+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x7f74380e0040 2024-04-26T12:50:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.695+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'60 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.695+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b36680 2024-04-26T12:50:38.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.695+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.695+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b2d420 2024-04-26T12:50:38.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.699+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.699+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b2d420 2024-04-26T12:50:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.699+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'171 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.699+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b36680 2024-04-26T12:50:38.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.703+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'52 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.703+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x7f74380e0040 2024-04-26T12:50:38.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.703+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.703+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b36680 2024-04-26T12:50:38.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.707+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.707+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b36680 2024-04-26T12:50:38.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.707+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.707+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b36680 2024-04-26T12:50:38.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.707+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.707+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b36680 2024-04-26T12:50:38.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.711+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.711+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4e520 con 0x55c902b31de0 2024-04-26T12:50:38.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.711+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.711+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b47c10 con 0x55c902b36680 2024-04-26T12:50:38.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.715+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.715+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b47c10 con 0x55c902b31de0 2024-04-26T12:50:38.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.719+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.719+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b47c10 con 0x55c902b36680 2024-04-26T12:50:38.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.719+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'53 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.719+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b47c10 con 0x55c902b31de0 2024-04-26T12:50:38.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.723+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.723+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b47c10 con 0x7f74380e0040 2024-04-26T12:50:38.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f72f8fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:38.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f7445ea4980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:38.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f7445ea4980 20 Filter name: none 2024-04-26T12:50:38.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f72727fc640 20 reqs_thread_entry: start 2024-04-26T12:50:38.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a1c0 con 0x55c902b2d420 2024-04-26T12:50:38.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49d10 con 0x55c902b31de0 2024-04-26T12:50:38.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.727+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49d10 con 0x55c902b31de0 2024-04-26T12:50:38.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49d10 con 0x55c902b31de0 2024-04-26T12:50:38.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a1c0 con 0x55c902b36680 2024-04-26T12:50:38.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49d10 con 0x55c902b36680 2024-04-26T12:50:38.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49d10 con 0x55c902b36680 2024-04-26T12:50:38.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a1c0 con 0x55c902b2d420 2024-04-26T12:50:38.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.731+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x55c902b2d420 2024-04-26T12:50:38.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv164 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x55c902b2d420 2024-04-26T12:50:38.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x7f74380e0040 2024-04-26T12:50:38.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x7f74380e0040 2024-04-26T12:50:38.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b2d420 2024-04-26T12:50:38.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.735+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b31de0 2024-04-26T12:50:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x7f74380e0040 2024-04-26T12:50:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.739+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x7f74380e0040 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x7f74380e0040 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x55c902b31de0 2024-04-26T12:50:38.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x55c902b31de0 2024-04-26T12:50:38.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.743+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x55c902b31de0 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x7f74380e0040 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b49cc0 con 0x7f74380e0040 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.747+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b31de0 2024-04-26T12:50:38.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b2d420 2024-04-26T12:50:38.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.751+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x7f74380e0040 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.755+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b2d420 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x7f74380e0040 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.759+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.763+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b31de0 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.767+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b31de0 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b36680 2024-04-26T12:50:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.771+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b36680 2024-04-26T12:50:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b31de0 2024-04-26T12:50:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x55c902b31de0 2024-04-26T12:50:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.775+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x7f74380e0040 2024-04-26T12:50:38.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.779+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.779+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c902b69f90 con 0x7f74380e0040 2024-04-26T12:50:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.779+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.779+0000 7f72f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.779+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94321822137728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b4a170 con 0x55c902b2d420 2024-04-26T12:50:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.779+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94321822137728] v35'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.779+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94321822116448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3fd80 con 0x7f74380e0040 2024-04-26T12:50:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.783+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94321822116448] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.783+0000 7f7445ea4980 20 remove_watcher() i=0 2024-04-26T12:50:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.783+0000 7f7445ea4980 2 removed watcher, disabling cache 2024-04-26T12:50:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.783+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94321822119376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3aa60 con 0x55c902b2d420 2024-04-26T12:50:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.783+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94321822119376] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.783+0000 7f7445ea4980 20 remove_watcher() i=1 2024-04-26T12:50:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.783+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94321822122016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3aa60 con 0x55c902b36680 2024-04-26T12:50:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.787+0000 7f74431be640 1 -- 172.21.15.72:0/1234430119 <== osd.3 v2:172.21.15.72:6808/671626845 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94321822122016] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74380aaac0 con 0x55c902b36680 2024-04-26T12:50:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.787+0000 7f7445ea4980 20 remove_watcher() i=2 2024-04-26T12:50:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.787+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94321822113888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3b5d0 con 0x7f74380e0040 2024-04-26T12:50:38.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.787+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.2 v2:172.21.15.72:6800/1931234624 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94321822113888] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x7f74380e0040 2024-04-26T12:50:38.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.787+0000 7f7445ea4980 20 remove_watcher() i=3 2024-04-26T12:50:38.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.787+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94321822126640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3b5d0 con 0x55c902b2d420 2024-04-26T12:50:38.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.791+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 <== osd.1 v2:172.21.15.72:6816/1811201389 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94321822126640] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434026040 con 0x55c902b2d420 2024-04-26T12:50:38.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.791+0000 7f7445ea4980 20 remove_watcher() i=4 2024-04-26T12:50:38.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.791+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94321822132416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3d230 con 0x55c902b31de0 2024-04-26T12:50:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.791+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94321822132416] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.791+0000 7f7445ea4980 20 remove_watcher() i=5 2024-04-26T12:50:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.791+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94321822136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3b5d0 con 0x55c902b31de0 2024-04-26T12:50:38.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.795+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94321822136672] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.795+0000 7f7445ea4980 20 remove_watcher() i=6 2024-04-26T12:50:38.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.795+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94321822140272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c902b3b5d0 con 0x55c902b31de0 2024-04-26T12:50:38.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.795+0000 7f74439bf640 1 -- 172.21.15.72:0/1234430119 <== osd.0 v2:172.21.15.29:6800/1895601642 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94321822140272] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c01b070 con 0x55c902b31de0 2024-04-26T12:50:38.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 20 remove_watcher() i=7 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902b31de0 msgr2=0x55c902b341d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902b31de0 0x55c902b341d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902b2d420 msgr2=0x55c902b2f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902b2d420 0x55c902b2f8e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74380e0040 msgr2=0x7f74380e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f74380e0040 0x7f74380e0420 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902b36680 msgr2=0x55c902b38b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902b36680 0x55c902b38b40 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f730c034650 msgr2=0x7f730c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f730c034650 0x7f730c036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7438018f70 tx=0x7f74380c1040 comp rx=0 tx=0).stop 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f74441c0640 1 -- 172.21.15.72:0/1234430119 reap_dead start 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 msgr2=0x55c902b223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b223d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f743c005950 tx=0x7f743c030ef0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 shutdown_connections 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/1234430119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b1b010 0x55c902b223d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 >> 172.21.15.72:0/1234430119 conn(0x55c902b173e0 msgr2=0x55c902b15410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 shutdown_connections 2024-04-26T12:50:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/1234430119 wait complete. 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f731c034600 msgr2=0x7f731c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f731c034600 0x7f731c036ac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55c902af7c30 tx=0x7f7438005ad0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b0e120 msgr2=0x55c902b0e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b0e120 0x55c902b0e540 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f743c014fd0 tx=0x7f743c028eb0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 shutdown_connections 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f731c034600 0x7f731c036ac0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/2303372695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c902b0e120 0x55c902b0e540 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 >> 172.21.15.72:0/2303372695 conn(0x55c902b02f30 msgr2=0x55c902b03a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 shutdown_connections 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/2303372695 wait complete. 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902af9680 msgr2=0x55c902afba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c902af9680 0x55c902afba70 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902971070 msgr2=0x55c902af6ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c902971070 0x55c902af6ce0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902afd5a0 msgr2=0x55c902aff990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c902afd5a0 0x55c902aff990 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f732c034650 msgr2=0x7f732c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f732c034650 0x7f732c036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f74380ae000 tx=0x7f74380a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 msgr2=0x55c902aefdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 --2- 172.21.15.72:0/4002112602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c90296fd80 0x55c902aefdb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f743c006640 tx=0x7f743c000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f74441c0640 1 -- 172.21.15.72:0/4002112602 reap_dead start 2024-04-26T12:50:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 shutdown_connections 2024-04-26T12:50:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 >> 172.21.15.72:0/4002112602 conn(0x55c9029f6bd0 msgr2=0x55c902ae31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 shutdown_connections 2024-04-26T12:50:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.799+0000 7f7445ea4980 1 -- 172.21.15.72:0/4002112602 wait complete. 2024-04-26T12:50:38.813 INFO:teuthology.orchestra.run.smithi072.stdout:[] 2024-04-26T12:50:38.813 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:50:38.813 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T12:50:38.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T12:50:38.814 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T12:50:38.892 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:38.892 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:38.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c3174b980 1 Processor -- start 2024-04-26T12:50:38.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c3174b980 1 -- start start 2024-04-26T12:50:38.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c3174b980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564eaee8b030 0x564eaef1c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c3174b980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564eaedc4510 con 0x564eaef1c890 2024-04-26T12:50:38.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c3174b980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564eaedcb430 con 0x564eaee8b030 2024-04-26T12:50:38.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c2f266640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564eaee8b030 0x564eaef1c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c2f266640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564eaee8b030 0x564eaef1c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58042/0 (socket says 172.21.15.72:58042) 2024-04-26T12:50:38.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c2f266640 1 -- 172.21.15.72:0/2197934368 learned_addr learned my addr 172.21.15.72:0/2197934368 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.891+0000 7f4c2ea65640 1 --1- 172.21.15.72:0/2197934368 >> v1:172.21.15.29:6789/0 conn(0x564eaef1c890 0x564eaef1ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48236/0 (socket says 172.21.15.72:48236) 2024-04-26T12:50:38.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c2f266640 1 -- 172.21.15.72:0/2197934368 >> v1:172.21.15.29:6789/0 conn(0x564eaef1c890 legacy=0x564eaef1ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c2f266640 1 -- 172.21.15.72:0/2197934368 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaeda0ae0 con 0x564eaee8b030 2024-04-26T12:50:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c2f266640 1 --2- 172.21.15.72:0/2197934368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaef1c350 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000a4e0 tx=0x7f4c2001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f357849e21db08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c2e264640 1 -- 172.21.15.72:0/2197934368 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200aa540 con 0x564eaee8b030 2024-04-26T12:50:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c2e264640 1 -- 172.21.15.72:0/2197934368 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c200aa6e0 con 0x564eaee8b030 2024-04-26T12:50:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c2e264640 1 -- 172.21.15.72:0/2197934368 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200aaa40 con 0x564eaee8b030 2024-04-26T12:50:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c3174b980 1 -- 172.21.15.72:0/2197934368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 msgr2=0x564eaef1c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c3174b980 1 --2- 172.21.15.72:0/2197934368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaef1c350 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000a4e0 tx=0x7f4c2001b090 comp rx=0 tx=0).stop 2024-04-26T12:50:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c3174b980 1 -- 172.21.15.72:0/2197934368 shutdown_connections 2024-04-26T12:50:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c3174b980 1 --2- 172.21.15.72:0/2197934368 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaef1c350 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c3174b980 1 -- 172.21.15.72:0/2197934368 >> 172.21.15.72:0/2197934368 conn(0x564eaef11a70 msgr2=0x564eaef13e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c3174b980 1 -- 172.21.15.72:0/2197934368 shutdown_connections 2024-04-26T12:50:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.895+0000 7f4c3174b980 1 -- 172.21.15.72:0/2197934368 wait complete. 2024-04-26T12:50:38.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.911+0000 7f4c3174b980 1 Processor -- start 2024-04-26T12:50:38.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.911+0000 7f4c3174b980 1 -- start start 2024-04-26T12:50:38.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.911+0000 7f4c3174b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaf004680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.911+0000 7f4c3174b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564eaee1aa70 con 0x564eaee8b030 2024-04-26T12:50:38.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.911+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaf004680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.911+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaf004680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58046/0 (socket says 172.21.15.72:58046) 2024-04-26T12:50:38.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.911+0000 7f4c2f266640 1 -- 172.21.15.72:0/1541253784 learned_addr learned my addr 172.21.15.72:0/1541253784 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c2f266640 1 -- 172.21.15.72:0/1541253784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaf004c50 con 0x564eaee8b030 2024-04-26T12:50:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c2f266640 1 --2- 172.21.15.72:0/1541253784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaf004680 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4c20017ca0 tx=0x7f4c200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5a244c68a3fe19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4b1d60a640 1 -- 172.21.15.72:0/1541253784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200b9030 con 0x564eaee8b030 2024-04-26T12:50:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4b1d60a640 1 -- 172.21.15.72:0/1541253784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c200aaac0 con 0x564eaee8b030 2024-04-26T12:50:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4b1d60a640 1 -- 172.21.15.72:0/1541253784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200aada0 con 0x564eaee8b030 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- 172.21.15.72:0/1541253784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 msgr2=0x564eaf004680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 --2- 172.21.15.72:0/1541253784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaf004680 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4c20017ca0 tx=0x7f4c200033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- 172.21.15.72:0/1541253784 shutdown_connections 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 --2- 172.21.15.72:0/1541253784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaee8b030 0x564eaf004680 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- 172.21.15.72:0/1541253784 >> 172.21.15.72:0/1541253784 conn(0x564eaef11a70 msgr2=0x564eaf000210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- 172.21.15.72:0/1541253784 shutdown_connections 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- 172.21.15.72:0/1541253784 wait complete. 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 Processor -- start 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- start start 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaef1c890 0x564eaf00b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564eaef22e60 con 0x564eaef1c890 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaef1c890 0x564eaf00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaef1c890 0x564eaf00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58054/0 (socket says 172.21.15.72:58054) 2024-04-26T12:50:38.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c2f266640 1 -- 172.21.15.72:0/3767538648 learned_addr learned my addr 172.21.15.72:0/3767538648 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c2f266640 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaf00bec0 con 0x564eaef1c890 2024-04-26T12:50:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c2f266640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaef1c890 0x564eaf00b980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4c2001b0d0 tx=0x7f4c20017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4b1be07640 1 -- 172.21.15.72:0/3767538648 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200b9030 con 0x564eaef1c890 2024-04-26T12:50:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4b1be07640 1 -- 172.21.15.72:0/3767538648 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c200c3070 con 0x564eaef1c890 2024-04-26T12:50:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eaf00c150 con 0x564eaef1c890 2024-04-26T12:50:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4b1be07640 1 -- 172.21.15.72:0/3767538648 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200c7540 con 0x564eaef1c890 2024-04-26T12:50:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.915+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eaf00edd0 con 0x564eaef1c890 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4b1be07640 1 -- 172.21.15.72:0/3767538648 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c200c5030 con 0x564eaef1c890 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4b1be07640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b14034650 0x7f4b14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4b1be07640 1 -- 172.21.15.72:0/3767538648 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f4c200ba070 con 0x564eaef1c890 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b14034650 0x7f4b14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0108a0 0x564eaf012c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf013260 con 0x564eaf0108a0 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2fa67640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0108a0 0x564eaf012c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b14034650 0x7f4b14036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c24000f70 tx=0x7f4c24001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2fa67640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0108a0 0x564eaf012c90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2fa67640 1 -- 172.21.15.72:0/3767538648 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0108a0 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf00ffd0 con 0x564eaf0108a0 2024-04-26T12:50:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2fa67640 1 -- 172.21.15.72:0/3767538648 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0108a0 2024-04-26T12:50:38.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf015590 0x564eaf017980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf018050 con 0x564eaf015590 2024-04-26T12:50:38.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2f266640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf015590 0x564eaf017980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.919+0000 7f4c2f266640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf015590 0x564eaf017980 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2f266640 1 -- 172.21.15.72:0/3767538648 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c200bfcd0 con 0x564eaf015590 2024-04-26T12:50:38.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf014430 con 0x564eaf0108a0 2024-04-26T12:50:38.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2fa67640 1 -- 172.21.15.72:0/3767538648 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0108a0 2024-04-26T12:50:38.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf019490 0x564eaf01b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf01c010 con 0x564eaf019490 2024-04-26T12:50:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf019490 0x564eaf01b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf019490 0x564eaf01b880 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2ea65640 1 -- 172.21.15.72:0/3767538648 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c2400f6a0 con 0x564eaf019490 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 Processor -- start 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 -- start start 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf02a060 0x564eaf02a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564eaee1eab0 con 0x564eaf02a060 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf02a060 0x564eaf02a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf02a060 0x564eaf02a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58070/0 (socket says 172.21.15.72:58070) 2024-04-26T12:50:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2f266640 1 -- 172.21.15.72:0/2012226567 learned_addr learned my addr 172.21.15.72:0/2012226567 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2f266640 1 -- 172.21.15.72:0/2012226567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaf02a9c0 con 0x564eaf02a060 2024-04-26T12:50:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c2f266640 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf02a060 0x564eaf02a480 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4c200a9990 tx=0x7f4c200d0850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4b19602640 1 -- 172.21.15.72:0/2012226567 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200e2070 con 0x564eaf02a060 2024-04-26T12:50:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eaf02b460 con 0x564eaf02a060 2024-04-26T12:50:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4b19602640 1 -- 172.21.15.72:0/2012226567 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c200a9c10 con 0x564eaf02a060 2024-04-26T12:50:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.923+0000 7f4b19602640 1 -- 172.21.15.72:0/2012226567 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200bf410 con 0x564eaf02a060 2024-04-26T12:50:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eaf02b930 con 0x564eaf02a060 2024-04-26T12:50:38.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4b19602640 1 -- 172.21.15.72:0/2012226567 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c200b3040 con 0x564eaf02a060 2024-04-26T12:50:38.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4b19602640 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b08034650 0x7f4b08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4b19602640 1 -- 172.21.15.72:0/2012226567 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f4c200db040 con 0x564eaf02a060 2024-04-26T12:50:38.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b08034650 0x7f4b08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c3174b980 1 Processor -- start 2024-04-26T12:50:38.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c3174b980 1 -- start start 2024-04-26T12:50:38.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c3174b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf0374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c3174b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564eaf004ee0 con 0x564eaf0370e0 2024-04-26T12:50:38.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b08034650 0x7f4b08036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x564eaf01c410 tx=0x7f4c2400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf0374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf0374c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58074/0 (socket says 172.21.15.72:58074) 2024-04-26T12:50:38.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c2f266640 1 -- 172.21.15.72:0/425638488 learned_addr learned my addr 172.21.15.72:0/425638488 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c2f266640 1 -- 172.21.15.72:0/425638488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaf037a90 con 0x564eaf0370e0 2024-04-26T12:50:38.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4c2f266640 1 --2- 172.21.15.72:0/425638488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf0374c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c200b7010 tx=0x7f4c200e23c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4928a448f20c1e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4b12ffd640 1 -- 172.21.15.72:0/425638488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200c77a0 con 0x564eaf0370e0 2024-04-26T12:50:38.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4b12ffd640 1 -- 172.21.15.72:0/425638488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c200c7940 con 0x564eaf0370e0 2024-04-26T12:50:38.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.927+0000 7f4b12ffd640 1 -- 172.21.15.72:0/425638488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200e4fa0 con 0x564eaf0370e0 2024-04-26T12:50:38.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- 172.21.15.72:0/425638488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 msgr2=0x564eaf0374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:38.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 --2- 172.21.15.72:0/425638488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf0374c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c200b7010 tx=0x7f4c200e23c0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- 172.21.15.72:0/425638488 shutdown_connections 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 --2- 172.21.15.72:0/425638488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf0374c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- 172.21.15.72:0/425638488 >> 172.21.15.72:0/425638488 conn(0x564eaf033420 msgr2=0x564eaf031480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- 172.21.15.72:0/425638488 shutdown_connections 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- 172.21.15.72:0/425638488 wait complete. 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 Processor -- start 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- start start 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf03e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564eaf038010 con 0x564eaf0370e0 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf03e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c2f266640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf03e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58088/0 (socket says 172.21.15.72:58088) 2024-04-26T12:50:38.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 learned_addr learned my addr 172.21.15.72:0/612832297 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:38.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaf03e8b0 con 0x564eaf0370e0 2024-04-26T12:50:38.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c2f266640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf03e370 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4c200b7010 tx=0x7f4c200d1ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4b117fa640 1 -- 172.21.15.72:0/612832297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200d1ab0 con 0x564eaf0370e0 2024-04-26T12:50:38.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eaf03e8b0 con 0x564eaf0370e0 2024-04-26T12:50:38.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4b117fa640 1 -- 172.21.15.72:0/612832297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c200bf7e0 con 0x564eaf0370e0 2024-04-26T12:50:38.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eaf03e8b0 con 0x564eaf0370e0 2024-04-26T12:50:38.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4b117fa640 1 -- 172.21.15.72:0/612832297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c200b91d0 con 0x564eaf0370e0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.931+0000 7f4b117fa640 1 -- 172.21.15.72:0/612832297 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c200b9370 con 0x564eaf0370e0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4b117fa640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4af8034650 0x7f4af8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4b117fa640 1 -- 172.21.15.72:0/612832297 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f4c20117d00 con 0x564eaf0370e0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4af8034650 0x7f4af8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0494d0 0x564eaf04b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04c0c0 con 0x564eaf0494d0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2fa67640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0494d0 0x564eaf04b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4af8034650 0x7f4af8036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c010 tx=0x7f4c24010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2fa67640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0494d0 0x564eaf04b970 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0494d0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 realm 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04c4d0 con 0x564eaf0494d0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0494d0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04cd70 con 0x564eaf0494d0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0494d0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0494d0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0494d0 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf04de70 0x564eaf050260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf050900 con 0x564eaf04de70 2024-04-26T12:50:38.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2f266640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf04de70 0x564eaf050260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2f266640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf04de70 0x564eaf050260 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 20 searching for the correct realm 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf0527e0 0x564eaf054c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0552d0 con 0x564eaf0527e0 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.935+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf0527e0 0x564eaf054c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf0527e0 0x564eaf054c50 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2ea65640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4c2401fbe0 0x7f4c2403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0552d0 con 0x7f4c2401fbe0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4c2401fbe0 0x7f4c2403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4c2401fbe0 0x7f4c2403a3c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c280083f0 con 0x7f4c2401fbe0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf04de70 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0494d0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c280083f0 con 0x564eaf0494d0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0494d0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf04de70 2024-04-26T12:50:38.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.939+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf04de70 2024-04-26T12:50:38.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x7f4c2401fbe0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0527e0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0494d0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x7f4c2401fbe0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0494d0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0527e0 2024-04-26T12:50:38.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0527e0 2024-04-26T12:50:38.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf04de70 2024-04-26T12:50:38.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0527e0 2024-04-26T12:50:38.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0527e0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.943+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0494d0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0494d0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf04de70 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0527e0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0494d0 2024-04-26T12:50:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf04de70 2024-04-26T12:50:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0527e0 2024-04-26T12:50:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf04de70 2024-04-26T12:50:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.947+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0527e0 2024-04-26T12:50:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf04de70 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x564eaf0494d0 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f4c2802b040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0494d0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0494d0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf04d110 con 0x564eaf0527e0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 zone default found 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 4 Realm: () 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 zonegroup default 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf051770 con 0x564eaf04de70 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf057130 con 0x564eaf0527e0 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.951+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:38.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0574d0 con 0x564eaf0527e0 2024-04-26T12:50:38.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:38.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 20 started sync module instance, tier type = 2024-04-26T12:50:38.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0565d0 con 0x7f4c2401fbe0 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94895943805680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0565d0 con 0x7f4c2401fbe0 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf057e90 con 0x564eaf0494d0 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94895943805680] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94895943803440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf057e90 con 0x564eaf0494d0 2024-04-26T12:50:38.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.955+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf058850 con 0x564eaf0527e0 2024-04-26T12:50:38.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.959+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94895943803440] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.959+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.959+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94895943809504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf057e00 con 0x564eaf0527e0 2024-04-26T12:50:38.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.959+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf059550 con 0x7f4c2401fbe0 2024-04-26T12:50:38.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.959+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.959+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94895943815600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf059c20 con 0x7f4c2401fbe0 2024-04-26T12:50:38.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.959+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05a740 con 0x564eaf0494d0 2024-04-26T12:50:38.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94895943809504] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94895943815600] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94895943819792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05a700 con 0x564eaf0494d0 2024-04-26T12:50:38.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05ab30 con 0x564eaf04de70 2024-04-26T12:50:38.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94895943816816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05b3d0 con 0x564eaf04de70 2024-04-26T12:50:38.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.963+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05bd90 con 0x564eaf04de70 2024-04-26T12:50:38.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94895943819792] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94895943816816] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94895943825632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05c130 con 0x564eaf04de70 2024-04-26T12:50:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05c980 con 0x564eaf04de70 2024-04-26T12:50:38.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94895943825632] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94895943828688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05cda0 con 0x564eaf04de70 2024-04-26T12:50:38.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c3174b980 20 add_watcher() i=0 2024-04-26T12:50:38.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c3174b980 20 add_watcher() i=1 2024-04-26T12:50:38.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.967+0000 7f4c3174b980 20 add_watcher() i=2 2024-04-26T12:50:38.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 20 add_watcher() i=3 2024-04-26T12:50:38.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 20 add_watcher() i=4 2024-04-26T12:50:38.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 20 add_watcher() i=5 2024-04-26T12:50:38.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 20 add_watcher() i=6 2024-04-26T12:50:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94895943828688] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 20 add_watcher() i=7 2024-04-26T12:50:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0600d0 con 0x564eaf0494d0 2024-04-26T12:50:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94895943842496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05cf10 con 0x564eaf0494d0 2024-04-26T12:50:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94895943842496] v35'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.971+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05f5d0 con 0x564eaf0494d0 2024-04-26T12:50:38.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.975+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.975+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0693b0 con 0x564eaf04de70 2024-04-26T12:50:38.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.975+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.975+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0693b0 con 0x564eaf0527e0 2024-04-26T12:50:38.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.979+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.979+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf069eb0 con 0x564eaf0494d0 2024-04-26T12:50:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.979+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'174 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.979+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06a420 con 0x7f4c2401fbe0 2024-04-26T12:50:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.979+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.979+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06a8d0 con 0x564eaf0527e0 2024-04-26T12:50:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.983+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.983+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf068930 con 0x564eaf0494d0 2024-04-26T12:50:38.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.983+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.983+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf068930 con 0x564eaf04de70 2024-04-26T12:50:38.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.987+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.987+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf068930 con 0x7f4c2401fbe0 2024-04-26T12:50:38.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.987+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.987+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf068b30 con 0x564eaf0527e0 2024-04-26T12:50:38.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.991+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:38.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.991+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x7f4c2401fbe0 2024-04-26T12:50:38.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.991+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.991+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf04de70 2024-04-26T12:50:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.995+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.995+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x7f4c2401fbe0 2024-04-26T12:50:38.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.995+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:38.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.995+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf04de70 2024-04-26T12:50:38.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.995+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:38.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.995+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf0494d0 2024-04-26T12:50:38.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.999+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'175 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:38.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.999+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf0527e0 2024-04-26T12:50:39.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.999+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'54 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:38.999+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x7f4c2401fbe0 2024-04-26T12:50:39.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.003+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:39.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.003+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf0527e0 2024-04-26T12:50:39.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.003+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.003+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf0494d0 2024-04-26T12:50:39.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.007+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:39.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.007+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf0494d0 2024-04-26T12:50:39.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.007+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'176 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.007+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b430 con 0x564eaf0527e0 2024-04-26T12:50:39.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.007+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'55 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.007+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b4c0 con 0x7f4c2401fbe0 2024-04-26T12:50:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.011+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.011+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b4c0 con 0x564eaf0527e0 2024-04-26T12:50:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.011+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.011+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b4c0 con 0x564eaf0527e0 2024-04-26T12:50:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.011+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.011+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x564eaf0527e0 2024-04-26T12:50:39.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.015+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.015+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x564eaf0527e0 2024-04-26T12:50:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.015+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.015+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x564eaf04de70 2024-04-26T12:50:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.019+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.019+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x564eaf0527e0 2024-04-26T12:50:39.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.019+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.019+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x564eaf04de70 2024-04-26T12:50:39.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.023+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:39.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.023+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x564eaf0527e0 2024-04-26T12:50:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.023+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'56 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.023+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x564eaf04de70 2024-04-26T12:50:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.027+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.027+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf06b540 con 0x7f4c2401fbe0 2024-04-26T12:50:39.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.027+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.027+0000 7f4ae4fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.027+0000 7f4c3174b980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.027+0000 7f4c3174b980 20 Filter name: none 2024-04-26T12:50:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.027+0000 7f4a5e7fc640 20 reqs_thread_entry: start 2024-04-26T12:50:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf068070 con 0x564eaf0494d0 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564eaf067bb0 con 0x7f4c2401fbe0 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:39.033 INFO:teuthology.orchestra.run.smithi072.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T12:50:39.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:39.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94895943842496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf043a80 con 0x564eaf0494d0 2024-04-26T12:50:39.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.031+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94895943842496] v35'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:39.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94895943805680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf05fac0 con 0x7f4c2401fbe0 2024-04-26T12:50:39.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94895943805680] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:39.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c3174b980 20 remove_watcher() i=0 2024-04-26T12:50:39.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c3174b980 2 removed watcher, disabling cache 2024-04-26T12:50:39.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94895943803440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf056af0 con 0x564eaf0494d0 2024-04-26T12:50:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94895943803440] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c3174b980 20 remove_watcher() i=1 2024-04-26T12:50:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.035+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94895943809504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf056af0 con 0x564eaf0527e0 2024-04-26T12:50:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.039+0000 7f4c2ea65640 1 -- 172.21.15.72:0/612832297 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94895943809504] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c24037040 con 0x564eaf0527e0 2024-04-26T12:50:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.039+0000 7f4c3174b980 20 remove_watcher() i=2 2024-04-26T12:50:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.039+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94895943815600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf056af0 con 0x7f4c2401fbe0 2024-04-26T12:50:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.039+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94895943815600] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x7f4c2401fbe0 2024-04-26T12:50:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.039+0000 7f4c3174b980 20 remove_watcher() i=3 2024-04-26T12:50:39.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.039+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94895943819792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0591b0 con 0x564eaf0494d0 2024-04-26T12:50:39.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.043+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94895943819792] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c28026040 con 0x564eaf0494d0 2024-04-26T12:50:39.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.043+0000 7f4c3174b980 20 remove_watcher() i=4 2024-04-26T12:50:39.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.043+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94895943816816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf056af0 con 0x564eaf04de70 2024-04-26T12:50:39.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.043+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94895943816816] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:39.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.043+0000 7f4c3174b980 20 remove_watcher() i=5 2024-04-26T12:50:39.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.043+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94895943825632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf0591b0 con 0x564eaf04de70 2024-04-26T12:50:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94895943825632] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 20 remove_watcher() i=6 2024-04-26T12:50:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94895943828688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564eaf056af0 con 0x564eaf04de70 2024-04-26T12:50:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c2f266640 1 -- 172.21.15.72:0/612832297 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94895943828688] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c20113020 con 0x564eaf04de70 2024-04-26T12:50:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 20 remove_watcher() i=7 2024-04-26T12:50:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf04de70 msgr2=0x564eaf050260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf04de70 0x564eaf050260 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0494d0 msgr2=0x564eaf04b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0494d0 0x564eaf04b970 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4c2401fbe0 msgr2=0x7f4c2403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f4c2401fbe0 0x7f4c2403a3c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf0527e0 msgr2=0x564eaf054c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf0527e0 0x564eaf054c50 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4af8034650 msgr2=0x7f4af8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4af8034650 0x7f4af8036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c010 tx=0x7f4c24010000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 msgr2=0x564eaf03e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 --2- 172.21.15.72:0/612832297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf0370e0 0x564eaf03e370 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4c200b7010 tx=0x7f4c200d1ea0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 reap_dead start 2024-04-26T12:50:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c2fa67640 1 -- 172.21.15.72:0/612832297 reap_dead start 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 shutdown_connections 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 >> 172.21.15.72:0/612832297 conn(0x564eaf033420 msgr2=0x564eaf030a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 shutdown_connections 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.047+0000 7f4c3174b980 1 -- 172.21.15.72:0/612832297 wait complete. 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b08034650 msgr2=0x7f4b08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b08034650 0x7f4b08036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x564eaf01c410 tx=0x7f4c2400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf02a060 msgr2=0x564eaf02a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf02a060 0x564eaf02a480 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4c200a9990 tx=0x7f4c200d0850 comp rx=0 tx=0).stop 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 shutdown_connections 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b08034650 0x7f4b08036b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/2012226567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaf02a060 0x564eaf02a480 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 >> 172.21.15.72:0/2012226567 conn(0x564eaf01ee70 msgr2=0x564eaf01f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 shutdown_connections 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/2012226567 wait complete. 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf015590 msgr2=0x564eaf017980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564eaf015590 0x564eaf017980 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0108a0 msgr2=0x564eaf012c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564eaf0108a0 0x564eaf012c90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf019490 msgr2=0x564eaf01b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564eaf019490 0x564eaf01b880 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b14034650 msgr2=0x7f4b14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f4b14034650 0x7f4b14036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c24000f70 tx=0x7f4c24001380 comp rx=0 tx=0).stop 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaef1c890 msgr2=0x564eaf00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 --2- 172.21.15.72:0/3767538648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564eaef1c890 0x564eaf00b980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4c2001b0d0 tx=0x7f4c20017e30 comp rx=0 tx=0).stop 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c2fa67640 1 -- 172.21.15.72:0/3767538648 reap_dead start 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 shutdown_connections 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 >> 172.21.15.72:0/3767538648 conn(0x564eaef11a70 msgr2=0x564eaeffed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 shutdown_connections 2024-04-26T12:50:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.051+0000 7f4c3174b980 1 -- 172.21.15.72:0/3767538648 wait complete. 2024-04-26T12:50:39.062 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:50:39.075 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-26T12:50:39.084 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:39.138 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:39.159 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:39.203 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-26T12:50:39.214 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:39.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:50:39.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:50:39.214 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:50:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b6e0b980 1 Processor -- start 2024-04-26T12:50:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b6e0b980 1 -- start start 2024-04-26T12:50:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b6e0b980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5630e8e89a00 0x5630e8e8bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b6e0b980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630e8d30510 con 0x5630e8e854f0 2024-04-26T12:50:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b6e0b980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5630e8d37430 con 0x5630e8e89a00 2024-04-26T12:50:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b4125640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5630e8e89a00 0x5630e8e8bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b4926640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5630e8e854f0 0x5630e8e858d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48240/0 (socket says 172.21.15.72:48240) 2024-04-26T12:50:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b4926640 1 -- 172.21.15.72:0/1422419324 learned_addr learned my addr 172.21.15.72:0/1422419324 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b4125640 1 -- 172.21.15.72:0/1422419324 >> v1:172.21.15.29:6789/0 conn(0x5630e8e854f0 legacy=0x5630e8e858d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.255+0000 7f09b4125640 1 -- 172.21.15.72:0/1422419324 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8d0cae0 con 0x5630e8e89a00 2024-04-26T12:50:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b4125640 1 --2- 172.21.15.72:0/1422419324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e89a00 0x5630e8e8bdf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f09a800a480 tx=0x7f09a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d235dacc5295d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b3924640 1 -- 172.21.15.72:0/1422419324 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a80b0070 con 0x5630e8e89a00 2024-04-26T12:50:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b3924640 1 -- 172.21.15.72:0/1422419324 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a80ab540 con 0x5630e8e89a00 2024-04-26T12:50:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b3924640 1 -- 172.21.15.72:0/1422419324 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a80ab840 con 0x5630e8e89a00 2024-04-26T12:50:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1422419324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e89a00 msgr2=0x5630e8e8bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1422419324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e89a00 0x5630e8e8bdf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f09a800a480 tx=0x7f09a801b280 comp rx=0 tx=0).stop 2024-04-26T12:50:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1422419324 shutdown_connections 2024-04-26T12:50:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1422419324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e89a00 0x5630e8e8bdf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1422419324 >> 172.21.15.72:0/1422419324 conn(0x5630e8df8bd0 msgr2=0x5630e8df8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1422419324 shutdown_connections 2024-04-26T12:50:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.259+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1422419324 wait complete. 2024-04-26T12:50:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b6e0b980 1 Processor -- start 2024-04-26T12:50:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b6e0b980 1 -- start start 2024-04-26T12:50:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b6e0b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b6e0b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630e8d86a70 con 0x5630e8e854f0 2024-04-26T12:50:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58118/0 (socket says 172.21.15.72:58118) 2024-04-26T12:50:39.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b4926640 1 -- 172.21.15.72:0/1779674771 learned_addr learned my addr 172.21.15.72:0/1779674771 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.275+0000 7f09b4926640 1 -- 172.21.15.72:0/1779674771 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8f70c70 con 0x5630e8e854f0 2024-04-26T12:50:39.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b4926640 1 --2- 172.21.15.72:0/1779674771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f706a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0017b0 tx=0x7f09ac001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c2aedc9fc1b82f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f08a2e0d640 1 -- 172.21.15.72:0/1779674771 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac016070 con 0x5630e8e854f0 2024-04-26T12:50:39.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f08a2e0d640 1 -- 172.21.15.72:0/1779674771 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac004530 con 0x5630e8e854f0 2024-04-26T12:50:39.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f08a2e0d640 1 -- 172.21.15.72:0/1779674771 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac004870 con 0x5630e8e854f0 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1779674771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 msgr2=0x5630e8f706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1779674771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f706a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0017b0 tx=0x7f09ac001c70 comp rx=0 tx=0).stop 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1779674771 shutdown_connections 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1779674771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f706a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1779674771 >> 172.21.15.72:0/1779674771 conn(0x5630e8df8bd0 msgr2=0x5630e8f6c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1779674771 shutdown_connections 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1779674771 wait complete. 2024-04-26T12:50:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 Processor -- start 2024-04-26T12:50:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- start start 2024-04-26T12:50:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f77900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630e8e8ee20 con 0x5630e8e854f0 2024-04-26T12:50:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f77900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f77900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58122/0 (socket says 172.21.15.72:58122) 2024-04-26T12:50:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b4926640 1 -- 172.21.15.72:0/403241068 learned_addr learned my addr 172.21.15.72:0/403241068 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b4926640 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8f77e40 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b4926640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f77900 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000f90 tx=0x7f09ac001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f08a160a640 1 -- 172.21.15.72:0/403241068 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac020070 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f08a160a640 1 -- 172.21.15.72:0/403241068 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac011400 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630e8f780d0 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f08a160a640 1 -- 172.21.15.72:0/403241068 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac016040 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.279+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e8f7ad10 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f08a160a640 1 -- 172.21.15.72:0/403241068 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f09ac023070 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f08a160a640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f089c0346a0 0x7f089c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f08a160a640 1 -- 172.21.15.72:0/403241068 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f09ac0492c0 con 0x5630e8e854f0 2024-04-26T12:50:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b4125640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f089c0346a0 0x7f089c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8e89a00 0x5630e8f7e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8f7eea0 con 0x5630e8e89a00 2024-04-26T12:50:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b5127640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8e89a00 0x5630e8f7e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b4125640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f089c0346a0 0x7f089c036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f09a80ad000 tx=0x7f09a80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b5127640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8e89a00 0x5630e8f7e960 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b5127640 1 -- 172.21.15.72:0/403241068 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8e89a00 2024-04-26T12:50:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8f7bf10 con 0x5630e8e89a00 2024-04-26T12:50:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b5127640 1 -- 172.21.15.72:0/403241068 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8e89a00 2024-04-26T12:50:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8f81170 0x5630e8f83560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8f83c50 con 0x5630e8f81170 2024-04-26T12:50:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b4926640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8f81170 0x5630e8f83560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.283+0000 7f09b4926640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8f81170 0x5630e8f83560 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4926640 1 -- 172.21.15.72:0/403241068 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f09ac02c070 con 0x5630e8f81170 2024-04-26T12:50:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8f7ffe0 con 0x5630e8e89a00 2024-04-26T12:50:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b5127640 1 -- 172.21.15.72:0/403241068 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8e89a00 2024-04-26T12:50:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8f850b0 0x5630e8f874a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8f87ba0 con 0x5630e8f850b0 2024-04-26T12:50:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4125640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8f850b0 0x5630e8f874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4125640 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8f850b0 0x5630e8f874a0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4125640 1 -- 172.21.15.72:0/403241068 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f09a80b3040 con 0x5630e8f850b0 2024-04-26T12:50:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 Processor -- start 2024-04-26T12:50:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 -- start start 2024-04-26T12:50:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8f95c30 0x5630e8f96050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630e8d8aab0 con 0x5630e8f95c30 2024-04-26T12:50:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8f95c30 0x5630e8f96050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8f95c30 0x5630e8f96050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58128/0 (socket says 172.21.15.72:58128) 2024-04-26T12:50:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4926640 1 -- 172.21.15.72:0/3429958015 learned_addr learned my addr 172.21.15.72:0/3429958015 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4926640 1 -- 172.21.15.72:0/3429958015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8f96590 con 0x5630e8f95c30 2024-04-26T12:50:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b4926640 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8f95c30 0x5630e8f96050 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0475c0 tx=0x7f09ac023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f089a7fc640 1 -- 172.21.15.72:0/3429958015 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac02a040 con 0x5630e8f95c30 2024-04-26T12:50:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f089a7fc640 1 -- 172.21.15.72:0/3429958015 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac0116e0 con 0x5630e8f95c30 2024-04-26T12:50:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.287+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630e8f97030 con 0x5630e8f95c30 2024-04-26T12:50:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f089a7fc640 1 -- 172.21.15.72:0/3429958015 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac02a420 con 0x5630e8f95c30 2024-04-26T12:50:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e8f97500 con 0x5630e8f95c30 2024-04-26T12:50:39.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f089a7fc640 1 -- 172.21.15.72:0/3429958015 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f09ac0119c0 con 0x5630e8f95c30 2024-04-26T12:50:39.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f089a7fc640 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f088c0346a0 0x7f088c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f089a7fc640 1 -- 172.21.15.72:0/3429958015 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f09ac036070 con 0x5630e8f95c30 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b4125640 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f088c0346a0 0x7f088c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b6e0b980 1 Processor -- start 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b6e0b980 1 -- start start 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b6e0b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b4125640 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f088c0346a0 0x7f088c036b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5630e8f7f310 tx=0x7f09a8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b6e0b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630e8f70fc0 con 0x5630e8fa2bb0 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58136/0 (socket says 172.21.15.72:58136) 2024-04-26T12:50:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b4926640 1 -- 172.21.15.72:0/3662386858 learned_addr learned my addr 172.21.15.72:0/3662386858 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b4926640 1 -- 172.21.15.72:0/3662386858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8fa3560 con 0x5630e8fa2bb0 2024-04-26T12:50:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f09b4926640 1 --2- 172.21.15.72:0/3662386858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa2f90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f09ac023c10 tx=0x7f09ac03abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7463ebd2c7688e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f088bfff640 1 -- 172.21.15.72:0/3662386858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac054040 con 0x5630e8fa2bb0 2024-04-26T12:50:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f088bfff640 1 -- 172.21.15.72:0/3662386858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac02dd30 con 0x5630e8fa2bb0 2024-04-26T12:50:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.291+0000 7f088bfff640 1 -- 172.21.15.72:0/3662386858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac03acf0 con 0x5630e8fa2bb0 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3662386858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 msgr2=0x5630e8fa2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/3662386858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa2f90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f09ac023c10 tx=0x7f09ac03abb0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3662386858 shutdown_connections 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/3662386858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa2f90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3662386858 >> 172.21.15.72:0/3662386858 conn(0x5630e8f9ef40 msgr2=0x5630e8f9cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3662386858 shutdown_connections 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3662386858 wait complete. 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 Processor -- start 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- start start 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5630e8fa3b30 con 0x5630e8fa2bb0 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b4926640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58138/0 (socket says 172.21.15.72:58138) 2024-04-26T12:50:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 learned_addr learned my addr 172.21.15.72:0/1160125504 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8faa390 con 0x5630e8fa2bb0 2024-04-26T12:50:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b4926640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa9e50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f09ac002210 tx=0x7f09ac055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f088a7fc640 1 -- 172.21.15.72:0/1160125504 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac066070 con 0x5630e8fa2bb0 2024-04-26T12:50:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630e8faa390 con 0x5630e8fa2bb0 2024-04-26T12:50:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f088a7fc640 1 -- 172.21.15.72:0/1160125504 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac054040 con 0x5630e8fa2bb0 2024-04-26T12:50:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e8faa800 con 0x5630e8fa2bb0 2024-04-26T12:50:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.295+0000 7f088a7fc640 1 -- 172.21.15.72:0/1160125504 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac070060 con 0x5630e8fa2bb0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f088a7fc640 1 -- 172.21.15.72:0/1160125504 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f09ac069070 con 0x5630e8fa2bb0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f088a7fc640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f08800345b0 0x7f0880036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f088a7fc640 1 -- 172.21.15.72:0/1160125504 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f09ac029170 con 0x5630e8fa2bb0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b4125640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f08800345b0 0x7f0880036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8fb4fd0 0x5630e8fb7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb7be0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b5127640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8fb4fd0 0x5630e8fb7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b4125640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f08800345b0 0x7f0880036a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09a8000c10 tx=0x7f09a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b5127640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8fb4fd0 0x5630e8fb7490 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 realm 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb7ff0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8890 con 0x5630e8fb4fd0 2024-04-26T12:50:39.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb4fd0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8fb9990 0x5630e8fbbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fbc3d0 con 0x5630e8fb9990 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b4926640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8fb9990 0x5630e8fbbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.299+0000 7f09b4926640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8fb9990 0x5630e8fbbd80 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b6e0b980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b6e0b980 20 searching for the correct realm 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8fbe2b0 0x5630e8fc0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc0da0 con 0x5630e8fbe2b0 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4125640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8fbe2b0 0x5630e8fc0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4125640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8fbe2b0 0x5630e8fc0720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4125640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f09a80ab030 0x7f09a80d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc0da0 con 0x7f09a80ab030 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f09a80ab030 0x7f09a80d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f09a80ab030 0x7f09a80d1400 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a40083f0 con 0x7f09a80ab030 2024-04-26T12:50:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb9990 2024-04-26T12:50:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb4fd0 2024-04-26T12:50:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a40083f0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb4fd0 2024-04-26T12:50:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.303+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb9990 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb9990 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x7f09a80ab030 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fbe2b0 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb4fd0 2024-04-26T12:50:39.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x7f09a80ab030 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x7f09a80ab030 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.307+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb9990 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb9990 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x7f09a80ab030 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.311+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb9990 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb9990 2024-04-26T12:50:39.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x7f09a80ab030 2024-04-26T12:50:39.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb9990 2024-04-26T12:50:39.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f09a402b040 con 0x7f09a80ab030 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb4fd0 2024-04-26T12:50:39.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.315+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fb4fd0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fb8c30 con 0x5630e8fbe2b0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 zone default found 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 4 Realm: () 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:39.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 zonegroup default 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fbd240 con 0x5630e8fb9990 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc2c00 con 0x5630e8fbe2b0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc2fa0 con 0x5630e8fbe2b0 2024-04-26T12:50:39.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 started sync module instance, tier type = 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc20a0 con 0x7f09a80ab030 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94768067257808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc20a0 con 0x7f09a80ab030 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.319+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc3960 con 0x5630e8fb4fd0 2024-04-26T12:50:39.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94768067257808] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94768067255552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc3960 con 0x5630e8fb4fd0 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc4320 con 0x5630e8fbe2b0 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94768067255552] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94768067261616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc38d0 con 0x5630e8fbe2b0 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.323+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc5020 con 0x7f09a80ab030 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94768067267712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc58c0 con 0x7f09a80ab030 2024-04-26T12:50:39.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc6280 con 0x5630e8fb4fd0 2024-04-26T12:50:39.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94768067261616] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94768067267712] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94768067272144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc61f0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.327+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc5810 con 0x5630e8fb9990 2024-04-26T12:50:39.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.331+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.331+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94768067274352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc6f40 con 0x5630e8fb9990 2024-04-26T12:50:39.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.331+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc7900 con 0x5630e8fb9990 2024-04-26T12:50:39.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.331+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94768067272144] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94768067269472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc81a0 con 0x5630e8fb9990 2024-04-26T12:50:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc8a70 con 0x5630e8fb9990 2024-04-26T12:50:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94768067274352] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94768067282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc8cf0 con 0x5630e8fb9990 2024-04-26T12:50:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=0 2024-04-26T12:50:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=1 2024-04-26T12:50:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=2 2024-04-26T12:50:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=3 2024-04-26T12:50:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=4 2024-04-26T12:50:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=5 2024-04-26T12:50:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94768067269472] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=6 2024-04-26T12:50:39.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94768067282240] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 20 add_watcher() i=7 2024-04-26T12:50:39.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:39.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.335+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc7cf0 con 0x5630e8fb4fd0 2024-04-26T12:50:39.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94768067280112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fc9270 con 0x5630e8fb4fd0 2024-04-26T12:50:39.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94768067280112] v35'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f086afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:39.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:39.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:39.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 5 note: GC not initialized 2024-04-26T12:50:39.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f0869fe3640 20 reqs_thread_entry: start 2024-04-26T12:50:39.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:39.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 20 Filter name: none 2024-04-26T12:50:39.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f07db7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:39.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:39.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8fef9d0 con 0x7f09a80ab030 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 : miss 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.339+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:9676ff39:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff1590 con 0x7f09a80ab030 2024-04-26T12:50:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(63 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv41 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 info.flags=0x17 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 to cache LRU end 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 20 get_obj_state: octx=0x7f09a4008c70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5630e8ff3c18 s->prefetch_data=0 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 3.37s0 3:ee1a1644:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fb4fd0 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(64 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 10 manifest: total_size = 5 2024-04-26T12:50:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 20 get_obj_state: setting s->obj_tag to _W-XeWbawTukaz-CHuCa78oHvBJGlKzO 2024-04-26T12:50:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f086afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94768067280112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fb4fd0 2024-04-26T12:50:39.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94768067280112] v35'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.343+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94768067257808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x7f09a80ab030 2024-04-26T12:50:39.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.347+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94768067257808] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.347+0000 7f09b6e0b980 20 remove_watcher() i=0 2024-04-26T12:50:39.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.347+0000 7f09b6e0b980 2 removed watcher, disabling cache 2024-04-26T12:50:39.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.347+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94768067255552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fb4fd0 2024-04-26T12:50:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.347+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94768067255552] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.347+0000 7f09b6e0b980 20 remove_watcher() i=1 2024-04-26T12:50:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.347+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94768067261616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fbe2b0 2024-04-26T12:50:39.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.351+0000 7f09b4125640 1 -- 172.21.15.72:0/1160125504 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94768067261616] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a80d8040 con 0x5630e8fbe2b0 2024-04-26T12:50:39.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.351+0000 7f09b6e0b980 20 remove_watcher() i=2 2024-04-26T12:50:39.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.351+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94768067267712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x7f09a80ab030 2024-04-26T12:50:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.351+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94768067267712] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x7f09a80ab030 2024-04-26T12:50:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.351+0000 7f09b6e0b980 20 remove_watcher() i=3 2024-04-26T12:50:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.351+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94768067272144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fb4fd0 2024-04-26T12:50:39.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.355+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94768067272144] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09a4026040 con 0x5630e8fb4fd0 2024-04-26T12:50:39.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.355+0000 7f09b6e0b980 20 remove_watcher() i=4 2024-04-26T12:50:39.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.355+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94768067274352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fb9990 2024-04-26T12:50:39.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.355+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94768067274352] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.355+0000 7f09b6e0b980 20 remove_watcher() i=5 2024-04-26T12:50:39.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.355+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94768067269472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fb9990 2024-04-26T12:50:39.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94768067269472] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 20 remove_watcher() i=6 2024-04-26T12:50:39.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94768067282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630e8ff4d20 con 0x5630e8fb9990 2024-04-26T12:50:39.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b4926640 1 -- 172.21.15.72:0/1160125504 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94768067282240] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ac072070 con 0x5630e8fb9990 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 20 remove_watcher() i=7 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8fb9990 msgr2=0x5630e8fbbd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8fb9990 0x5630e8fbbd80 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8fb4fd0 msgr2=0x5630e8fb7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8fb4fd0 0x5630e8fb7490 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f09a80ab030 msgr2=0x7f09a80d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f09a80ab030 0x7f09a80d1400 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8fbe2b0 msgr2=0x5630e8fc0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8fbe2b0 0x5630e8fc0720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f08800345b0 msgr2=0x7f0880036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f08800345b0 0x7f0880036a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09a8000c10 tx=0x7f09a80a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 msgr2=0x5630e8fa9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b5127640 1 -- 172.21.15.72:0/1160125504 reap_dead start 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa9e50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f09ac002210 tx=0x7f09ac055000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 shutdown_connections 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/1160125504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8fa2bb0 0x5630e8fa9e50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 >> 172.21.15.72:0/1160125504 conn(0x5630e8f9ef40 msgr2=0x5630e8f9c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 shutdown_connections 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.359+0000 7f09b6e0b980 1 -- 172.21.15.72:0/1160125504 wait complete. 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f088c0346a0 msgr2=0x7f088c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f088c0346a0 0x7f088c036b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5630e8f7f310 tx=0x7f09a8005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8f95c30 msgr2=0x5630e8f96050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8f95c30 0x5630e8f96050 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0475c0 tx=0x7f09ac023ac0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 shutdown_connections 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f088c0346a0 0x7f088c036b60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/3429958015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8f95c30 0x5630e8f96050 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 >> 172.21.15.72:0/3429958015 conn(0x5630e8f8aa40 msgr2=0x5630e8f8b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 shutdown_connections 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/3429958015 wait complete. 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8f81170 msgr2=0x5630e8f83560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5630e8f81170 0x5630e8f83560 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8e89a00 msgr2=0x5630e8f7e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5630e8e89a00 0x5630e8f7e960 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8f850b0 msgr2=0x5630e8f874a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5630e8f850b0 0x5630e8f874a0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f089c0346a0 msgr2=0x7f089c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f089c0346a0 0x7f089c036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f09a80ad000 tx=0x7f09a80a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 msgr2=0x5630e8f77900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 --2- 172.21.15.72:0/403241068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5630e8e854f0 0x5630e8f77900 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000f90 tx=0x7f09ac001260 comp rx=0 tx=0).stop 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b5127640 1 -- 172.21.15.72:0/403241068 reap_dead start 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 shutdown_connections 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 >> 172.21.15.72:0/403241068 conn(0x5630e8df8bd0 msgr2=0x5630e8f6ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 shutdown_connections 2024-04-26T12:50:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.363+0000 7f09b6e0b980 1 -- 172.21.15.72:0/403241068 wait complete. 2024-04-26T12:50:39.375 INFO:teuthology.orchestra.run.smithi072.stdout:fooFoofooFooFULL_CONTROL 2024-04-26T12:50:39.376 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-26T12:50:39.379 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-26T12:50:39.385 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:39.385 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:50:39.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:50:39.385 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:50:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1775538980 1 Processor -- start 2024-04-26T12:50:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1775538980 1 -- start start 2024-04-26T12:50:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1775538980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c0feb4d890 0x55c0febde380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1775538980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0fea86510 con 0x55c0febde8c0 2024-04-26T12:50:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1775538980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c0fea8d430 con 0x55c0feb4d890 2024-04-26T12:50:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1773053640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c0feb4d890 0x55c0febde380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1772852640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55c0febde8c0 0x55c0febe0cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48246/0 (socket says 172.21.15.72:48246) 2024-04-26T12:50:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1772852640 1 -- 172.21.15.72:0/1308689547 learned_addr learned my addr 172.21.15.72:0/1308689547 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1773053640 1 -- 172.21.15.72:0/1308689547 >> v1:172.21.15.29:6789/0 conn(0x55c0febde8c0 legacy=0x55c0febe0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.451+0000 7f1773053640 1 -- 172.21.15.72:0/1308689547 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fea62ae0 con 0x55c0feb4d890 2024-04-26T12:50:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1773053640 1 --2- 172.21.15.72:0/1308689547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0febde380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f176c00a420 tx=0x7f176c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84f4aac3a255a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1772051640 1 -- 172.21.15.72:0/1308689547 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0af070 con 0x55c0feb4d890 2024-04-26T12:50:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1772051640 1 -- 172.21.15.72:0/1308689547 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0aa530 con 0x55c0feb4d890 2024-04-26T12:50:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1772051640 1 -- 172.21.15.72:0/1308689547 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0aa850 con 0x55c0feb4d890 2024-04-26T12:50:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1775538980 1 -- 172.21.15.72:0/1308689547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 msgr2=0x55c0febde380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1775538980 1 --2- 172.21.15.72:0/1308689547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0febde380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f176c00a420 tx=0x7f176c01afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1775538980 1 -- 172.21.15.72:0/1308689547 shutdown_connections 2024-04-26T12:50:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1775538980 1 --2- 172.21.15.72:0/1308689547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0febde380 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1775538980 1 -- 172.21.15.72:0/1308689547 >> 172.21.15.72:0/1308689547 conn(0x55c0febd3a60 msgr2=0x55c0febd5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1775538980 1 -- 172.21.15.72:0/1308689547 shutdown_connections 2024-04-26T12:50:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.455+0000 7f1775538980 1 -- 172.21.15.72:0/1308689547 wait complete. 2024-04-26T12:50:39.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1775538980 1 Processor -- start 2024-04-26T12:50:39.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1775538980 1 -- start start 2024-04-26T12:50:39.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1775538980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0fecc66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1775538980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c0feadca70 con 0x55c0feb4d890 2024-04-26T12:50:39.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0fecc66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0fecc66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58158/0 (socket says 172.21.15.72:58158) 2024-04-26T12:50:39.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1773053640 1 -- 172.21.15.72:0/3322997126 learned_addr learned my addr 172.21.15.72:0/3322997126 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1773053640 1 -- 172.21.15.72:0/3322997126 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fecc6c90 con 0x55c0feb4d890 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f1773053640 1 --2- 172.21.15.72:0/3322997126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0fecc66c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f176c0aa500 tx=0x7f176c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60944ac9cd24660e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f166160a640 1 -- 172.21.15.72:0/3322997126 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0af040 con 0x55c0feb4d890 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f166160a640 1 -- 172.21.15.72:0/3322997126 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0abb80 con 0x55c0feb4d890 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.471+0000 7f166160a640 1 -- 172.21.15.72:0/3322997126 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0b5470 con 0x55c0feb4d890 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- 172.21.15.72:0/3322997126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 msgr2=0x55c0fecc66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 --2- 172.21.15.72:0/3322997126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0fecc66c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f176c0aa500 tx=0x7f176c0033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- 172.21.15.72:0/3322997126 shutdown_connections 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 --2- 172.21.15.72:0/3322997126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0feb4d890 0x55c0fecc66c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- 172.21.15.72:0/3322997126 >> 172.21.15.72:0/3322997126 conn(0x55c0febd3a60 msgr2=0x55c0fecc2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- 172.21.15.72:0/3322997126 shutdown_connections 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- 172.21.15.72:0/3322997126 wait complete. 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 Processor -- start 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- start start 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0febde8c0 0x55c0feccd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c0febe4e30 con 0x55c0febde8c0 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0febde8c0 0x55c0feccd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0febde8c0 0x55c0feccd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58160/0 (socket says 172.21.15.72:58160) 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1773053640 1 -- 172.21.15.72:0/1525399723 learned_addr learned my addr 172.21.15.72:0/1525399723 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1773053640 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0feccded0 con 0x55c0febde8c0 2024-04-26T12:50:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1773053640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0febde8c0 0x55c0feccd990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f176c017be0 tx=0x7f176c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f165fe07640 1 -- 172.21.15.72:0/1525399723 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0b5680 con 0x55c0febde8c0 2024-04-26T12:50:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f165fe07640 1 -- 172.21.15.72:0/1525399723 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0c6070 con 0x55c0febde8c0 2024-04-26T12:50:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0fecce160 con 0x55c0febde8c0 2024-04-26T12:50:39.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f165fe07640 1 -- 172.21.15.72:0/1525399723 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0b5950 con 0x55c0febde8c0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.475+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0fecd0de0 con 0x55c0febde8c0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f165fe07640 1 -- 172.21.15.72:0/1525399723 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f176c0b5af0 con 0x55c0febde8c0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f165fe07640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1658034650 0x7f1658036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f165fe07640 1 -- 172.21.15.72:0/1525399723 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f176c0bb070 con 0x55c0febde8c0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1772852640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1658034650 0x7f1658036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fecd28b0 0x55c0fecd4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fecd52c0 con 0x55c0fecd28b0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1773854640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fecd28b0 0x55c0fecd4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1772852640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1658034650 0x7f1658036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1768000f70 tx=0x7f17680012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1773854640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fecd28b0 0x55c0fecd4ca0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1773854640 1 -- 172.21.15.72:0/1525399723 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fecd28b0 2024-04-26T12:50:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fecd2000 con 0x55c0fecd28b0 2024-04-26T12:50:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1773854640 1 -- 172.21.15.72:0/1525399723 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fecd28b0 2024-04-26T12:50:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fecd7660 0x55c0fecd9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fecda120 con 0x55c0fecd7660 2024-04-26T12:50:39.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1773053640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fecd7660 0x55c0fecd9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1773053640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fecd7660 0x55c0fecd9a50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.479+0000 7f1773053640 1 -- 172.21.15.72:0/1525399723 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f176c0d2070 con 0x55c0fecd7660 2024-04-26T12:50:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fecd6500 con 0x55c0fecd28b0 2024-04-26T12:50:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1773854640 1 -- 172.21.15.72:0/1525399723 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fecd28b0 2024-04-26T12:50:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fecdb560 0x55c0fecdd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fecde0e0 con 0x55c0fecdb560 2024-04-26T12:50:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1772852640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fecdb560 0x55c0fecdd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1772852640 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fecdb560 0x55c0fecdd950 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1772852640 1 -- 172.21.15.72:0/1525399723 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f176800e620 con 0x55c0fecdb560 2024-04-26T12:50:39.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 Processor -- start 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 -- start start 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecec130 0x55c0fecec550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c0feae0ab0 con 0x55c0fecec130 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecec130 0x55c0fecec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecec130 0x55c0fecec550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58166/0 (socket says 172.21.15.72:58166) 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1773053640 1 -- 172.21.15.72:0/3839516337 learned_addr learned my addr 172.21.15.72:0/3839516337 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1773053640 1 -- 172.21.15.72:0/3839516337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fececa90 con 0x55c0fecec130 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1773053640 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecec130 0x55c0fecec550 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f176c0e3490 tx=0x7f176c0be8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f165d602640 1 -- 172.21.15.72:0/3839516337 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0e3780 con 0x55c0fecec130 2024-04-26T12:50:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0feced530 con 0x55c0fecec130 2024-04-26T12:50:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f165d602640 1 -- 172.21.15.72:0/3839516337 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0e3920 con 0x55c0fecec130 2024-04-26T12:50:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f165d602640 1 -- 172.21.15.72:0/3839516337 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0e3c20 con 0x55c0fecec130 2024-04-26T12:50:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.483+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0feceda00 con 0x55c0fecec130 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f165d602640 1 -- 172.21.15.72:0/3839516337 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f176c0df070 con 0x55c0fecec130 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f165d602640 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f164c034650 0x7f164c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f165d602640 1 -- 172.21.15.72:0/3839516337 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f176c0e9d10 con 0x55c0fecec130 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1772852640 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f164c034650 0x7f164c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 Processor -- start 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 -- start start 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fecf9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c0fecc6f20 con 0x55c0fecf9140 2024-04-26T12:50:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1772852640 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f164c034650 0x7f164c036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f176800bf60 tx=0x7f176800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fecf9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fecf9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58178/0 (socket says 172.21.15.72:58178) 2024-04-26T12:50:39.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1773053640 1 -- 172.21.15.72:0/3870396094 learned_addr learned my addr 172.21.15.72:0/3870396094 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1773053640 1 -- 172.21.15.72:0/3870396094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fecf9af0 con 0x55c0fecf9140 2024-04-26T12:50:39.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1773053640 1 --2- 172.21.15.72:0/3870396094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fecf9520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f176c0d7fd0 tx=0x7f176c0bf5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d99577306138041 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1656ffd640 1 -- 172.21.15.72:0/3870396094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0b4e30 con 0x55c0fecf9140 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1656ffd640 1 -- 172.21.15.72:0/3870396094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0e0d20 con 0x55c0fecf9140 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1656ffd640 1 -- 172.21.15.72:0/3870396094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c0e0400 con 0x55c0fecf9140 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 -- 172.21.15.72:0/3870396094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 msgr2=0x55c0fecf9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 --2- 172.21.15.72:0/3870396094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fecf9520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f176c0d7fd0 tx=0x7f176c0bf5b0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 -- 172.21.15.72:0/3870396094 shutdown_connections 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 --2- 172.21.15.72:0/3870396094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fecf9520 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.487+0000 7f1775538980 1 -- 172.21.15.72:0/3870396094 >> 172.21.15.72:0/3870396094 conn(0x55c0fecf5480 msgr2=0x55c0fecf34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 -- 172.21.15.72:0/3870396094 shutdown_connections 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 -- 172.21.15.72:0/3870396094 wait complete. 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 Processor -- start 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 -- start start 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fed004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c0fecfa1f0 con 0x55c0fecf9140 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fed004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1773053640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fed004a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58186/0 (socket says 172.21.15.72:58186) 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 learned_addr learned my addr 172.21.15.72:0/1158745576 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fed009e0 con 0x55c0fecf9140 2024-04-26T12:50:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1773053640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fed004a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f176c0cafb0 tx=0x7f176c0caf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f16557fa640 1 -- 172.21.15.72:0/1158745576 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c10f070 con 0x55c0fecf9140 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0fed009e0 con 0x55c0fecf9140 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0fed009e0 con 0x55c0fecf9140 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f16557fa640 1 -- 172.21.15.72:0/1158745576 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0cf170 con 0x55c0fecf9140 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f16557fa640 1 -- 172.21.15.72:0/1158745576 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c103040 con 0x55c0fecf9140 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f16557fa640 1 -- 172.21.15.72:0/1158745576 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f176c112070 con 0x55c0fecf9140 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f16557fa640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f163c034650 0x7f163c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.491+0000 7f16557fa640 1 -- 172.21.15.72:0/1158745576 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f176c115d30 con 0x55c0fecf9140 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1772852640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f163c034650 0x7f163c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fed0b5a0 0x55c0fed0da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0e1b0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773854640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fed0b5a0 0x55c0fed0da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1772852640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f163c034650 0x7f163c036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c0fecde4e0 tx=0x7f1768010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773854640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fed0b5a0 0x55c0fed0da60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 realm 2024-04-26T12:50:39.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0e5c0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0ee90 con 0x55c0fed0b5a0 2024-04-26T12:50:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0b5a0 2024-04-26T12:50:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fed0ff90 0x55c0fed12380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed12990 con 0x55c0fed0ff90 2024-04-26T12:50:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773053640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fed0ff90 0x55c0fed12380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773053640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fed0ff90 0x55c0fed12380 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:39.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 20 searching for the correct realm 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fed148e0 0x55c0fed16d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.495+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed173e0 con 0x55c0fed148e0 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1772852640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fed148e0 0x55c0fed16d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1772852640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fed148e0 0x55c0fed16d10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1772852640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1768037040 0x7f1768036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed173e0 con 0x7f1768037040 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1768037040 0x7f1768036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1768037040 0x7f1768036410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17640083f0 con 0x7f1768037040 2024-04-26T12:50:39.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0ff90 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0b5a0 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17640083f0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0b5a0 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.499+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0ff90 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0ff90 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x7f1768037040 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed148e0 2024-04-26T12:50:39.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0b5a0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x7f1768037040 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x7f1768037040 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed148e0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed148e0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.503+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0ff90 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed148e0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed148e0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0ff90 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed148e0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x7f1768037040 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0ff90 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.507+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed148e0 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0ff90 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x7f1768037040 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed148e0 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0ff90 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f176402b040 con 0x7f1768037040 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0b5a0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed0b5a0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed0f230 con 0x55c0fed148e0 2024-04-26T12:50:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.511+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 zone default found 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 4 Realm: () 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 zonegroup default 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed138a0 con 0x55c0fed0ff90 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed19240 con 0x55c0fed148e0 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed195e0 con 0x55c0fed148e0 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 started sync module instance, tier type = 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed186e0 con 0x7f1768037040 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94287397227536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed186e0 con 0x7f1768037040 2024-04-26T12:50:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed19fa0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.515+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94287397227536] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.519+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.519+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94287397231616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed186e0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.519+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1a9b0 con 0x55c0fed148e0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.519+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94287397231616] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.519+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.519+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94287397225008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed18650 con 0x55c0fed148e0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.519+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1b700 con 0x7f1768037040 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94287397237632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1bfa0 con 0x7f1768037040 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1c960 con 0x55c0fed0b5a0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94287397225008] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94287397237632] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94287397242032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1c8d0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.523+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1bef0 con 0x55c0fed0ff90 2024-04-26T12:50:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94287397242032] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94287397239360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1d200 con 0x55c0fed0ff90 2024-04-26T12:50:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1da50 con 0x55c0fed0ff90 2024-04-26T12:50:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94287397239360] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94287397246368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1de70 con 0x55c0fed0ff90 2024-04-26T12:50:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.527+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1e830 con 0x55c0fed0ff90 2024-04-26T12:50:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94287397249920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1ec50 con 0x55c0fed0ff90 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 20 add_watcher() i=0 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 20 add_watcher() i=1 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 20 add_watcher() i=2 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 20 add_watcher() i=3 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 20 add_watcher() i=4 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 20 add_watcher() i=5 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94287397246368] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1775538980 20 add_watcher() i=6 2024-04-26T12:50:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.531+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94287397249920] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 add_watcher() i=7 2024-04-26T12:50:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1ec50 con 0x55c0fed0b5a0 2024-04-26T12:50:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94287397250976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed1ebc0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94287397250976] v35'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:39.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 5 note: GC not initialized 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1628fe1640 20 reqs_thread_entry: start 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 Filter name: none 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f15a27fc640 20 reqs_thread_entry: start 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed45960 con 0x7f1768037040 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 : miss 2024-04-26T12:50:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.9 8:9676ff39:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed47520 con 0x7f1768037040 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(63 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv41 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1764026040 con 0x7f1768037040 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 info.flags=0x17 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 to cache LRU end 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 20 get_obj_state: octx=0x7f1764008c70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c0fed49bc8 s->prefetch_data=0 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.535+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 3.37s0 3:ee1a1644:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(64 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1775538980 10 manifest: total_size = 5 2024-04-26T12:50:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1775538980 20 get_obj_state: setting s->obj_tag to _-zX5z12BQiPa5KIejK5zZ8XbSayX5Xs 2024-04-26T12:50:39.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:39.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94287397250976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94287397250976] v35'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1764026040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94287397227536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x7f1768037040 2024-04-26T12:50:39.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94287397227536] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764042040 con 0x7f1768037040 2024-04-26T12:50:39.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1775538980 20 remove_watcher() i=0 2024-04-26T12:50:39.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1775538980 2 removed watcher, disabling cache 2024-04-26T12:50:39.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.539+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94287397231616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.543+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94287397231616] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764042040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.543+0000 7f1775538980 20 remove_watcher() i=1 2024-04-26T12:50:39.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.543+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94287397225008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed148e0 2024-04-26T12:50:39.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.543+0000 7f1772852640 1 -- 172.21.15.72:0/1158745576 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94287397225008] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176800e620 con 0x55c0fed148e0 2024-04-26T12:50:39.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.543+0000 7f1775538980 20 remove_watcher() i=2 2024-04-26T12:50:39.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.543+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94287397237632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x7f1768037040 2024-04-26T12:50:39.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.547+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94287397237632] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764042040 con 0x7f1768037040 2024-04-26T12:50:39.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.547+0000 7f1775538980 20 remove_watcher() i=3 2024-04-26T12:50:39.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.547+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94287397242032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed0b5a0 2024-04-26T12:50:39.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.547+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94287397242032] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1764042040 con 0x55c0fed0b5a0 2024-04-26T12:50:39.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.547+0000 7f1775538980 20 remove_watcher() i=4 2024-04-26T12:50:39.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.547+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94287397239360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed0ff90 2024-04-26T12:50:39.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.551+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94287397239360] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.551+0000 7f1775538980 20 remove_watcher() i=5 2024-04-26T12:50:39.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.551+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94287397246368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed0ff90 2024-04-26T12:50:39.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.551+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94287397246368] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.551+0000 7f1775538980 20 remove_watcher() i=6 2024-04-26T12:50:39.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.551+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94287397249920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0fed4acd0 con 0x55c0fed0ff90 2024-04-26T12:50:39.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1773053640 1 -- 172.21.15.72:0/1158745576 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94287397249920] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176c111030 con 0x55c0fed0ff90 2024-04-26T12:50:39.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 20 remove_watcher() i=7 2024-04-26T12:50:39.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fed0ff90 msgr2=0x55c0fed12380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fed0ff90 0x55c0fed12380 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fed0b5a0 msgr2=0x55c0fed0da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fed0b5a0 0x55c0fed0da60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1768037040 msgr2=0x7f1768036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1768037040 0x7f1768036410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fed148e0 msgr2=0x55c0fed16d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fed148e0 0x55c0fed16d10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f163c034650 msgr2=0x7f163c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f163c034650 0x7f163c036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c0fecde4e0 tx=0x7f1768010000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 msgr2=0x55c0fed004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1773854640 1 -- 172.21.15.72:0/1158745576 reap_dead start 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fed004a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f176c0cafb0 tx=0x7f176c0caf40 comp rx=0 tx=0).stop 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 shutdown_connections 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1158745576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecf9140 0x55c0fed004a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 >> 172.21.15.72:0/1158745576 conn(0x55c0fecf5480 msgr2=0x55c0fecf2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 shutdown_connections 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1158745576 wait complete. 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f164c034650 msgr2=0x7f164c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f164c034650 0x7f164c036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f176800bf60 tx=0x7f176800f000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecec130 msgr2=0x55c0fecec550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecec130 0x55c0fecec550 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f176c0e3490 tx=0x7f176c0be8e0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 shutdown_connections 2024-04-26T12:50:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f164c034650 0x7f164c036b10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/3839516337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0fecec130 0x55c0fecec550 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 >> 172.21.15.72:0/3839516337 conn(0x55c0fece0f40 msgr2=0x55c0fece1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 shutdown_connections 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/3839516337 wait complete. 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fecd7660 msgr2=0x55c0fecd9a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0fecd7660 0x55c0fecd9a50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fecd28b0 msgr2=0x55c0fecd4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0fecd28b0 0x55c0fecd4ca0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fecdb560 msgr2=0x55c0fecdd950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0fecdb560 0x55c0fecdd950 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1658034650 msgr2=0x7f1658036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1658034650 0x7f1658036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1768000f70 tx=0x7f17680012c0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0febde8c0 msgr2=0x55c0feccd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 --2- 172.21.15.72:0/1525399723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0febde8c0 0x55c0feccd990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f176c017be0 tx=0x7f176c017d70 comp rx=0 tx=0).stop 2024-04-26T12:50:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1773854640 1 -- 172.21.15.72:0/1525399723 reap_dead start 2024-04-26T12:50:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 shutdown_connections 2024-04-26T12:50:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 >> 172.21.15.72:0/1525399723 conn(0x55c0febd3a60 msgr2=0x55c0fecc0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 shutdown_connections 2024-04-26T12:50:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.555+0000 7f1775538980 1 -- 172.21.15.72:0/1525399723 wait complete. 2024-04-26T12:50:39.568 INFO:teuthology.orchestra.run.smithi072.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-26T12:50:39.568 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-26T12:50:39.570 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-26T12:50:39.595 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:39.703 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-26T12:50:39.703 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-26T12:50:39.703 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:50:39.703 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-26T12:50:39.703 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-26T12:50:39.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-26T12:50:39.704 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-26T12:50:39.743 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:39.743 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:39.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ee581980 1 Processor -- start 2024-04-26T12:50:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ee581980 1 -- start start 2024-04-26T12:50:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ee581980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564670fda4f0 0x564670fda8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ee581980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564670e85510 con 0x564670fdae10 2024-04-26T12:50:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ee581980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x564670e8c430 con 0x564670fda4f0 2024-04-26T12:50:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ec09c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x564670fda4f0 0x564670fda8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8eb89b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x564670fdae10 0x564670fdb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48252/0 (socket says 172.21.15.72:48252) 2024-04-26T12:50:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8eb89b640 1 -- 172.21.15.72:0/1072366899 learned_addr learned my addr 172.21.15.72:0/1072366899 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ec09c640 1 -- 172.21.15.72:0/1072366899 >> v1:172.21.15.29:6789/0 conn(0x564670fdae10 legacy=0x564670fdb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.743+0000 7fd8ec09c640 1 -- 172.21.15.72:0/1072366899 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564670e61ae0 con 0x564670fda4f0 2024-04-26T12:50:39.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/1072366899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x564670fda8d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00a420 tx=0x7fd8dc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a146a50944e20238 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8eb09a640 1 -- 172.21.15.72:0/1072366899 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0af070 con 0x564670fda4f0 2024-04-26T12:50:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8eb09a640 1 -- 172.21.15.72:0/1072366899 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0aa530 con 0x564670fda4f0 2024-04-26T12:50:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8eb09a640 1 -- 172.21.15.72:0/1072366899 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0aa850 con 0x564670fda4f0 2024-04-26T12:50:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ee581980 1 -- 172.21.15.72:0/1072366899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 msgr2=0x564670fda8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ee581980 1 --2- 172.21.15.72:0/1072366899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x564670fda8d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00a420 tx=0x7fd8dc01afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ee581980 1 -- 172.21.15.72:0/1072366899 shutdown_connections 2024-04-26T12:50:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ee581980 1 --2- 172.21.15.72:0/1072366899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x564670fda8d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ee581980 1 -- 172.21.15.72:0/1072366899 >> 172.21.15.72:0/1072366899 conn(0x564670f4dbd0 msgr2=0x564670f4dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ee581980 1 -- 172.21.15.72:0/1072366899 shutdown_connections 2024-04-26T12:50:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.747+0000 7fd8ee581980 1 -- 172.21.15.72:0/1072366899 wait complete. 2024-04-26T12:50:39.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.763+0000 7fd8ee581980 1 Processor -- start 2024-04-26T12:50:39.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.763+0000 7fd8ee581980 1 -- start start 2024-04-26T12:50:39.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.763+0000 7fd8ee581980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.763+0000 7fd8ee581980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564670edba70 con 0x564670fda4f0 2024-04-26T12:50:39.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.763+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.763+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58204/0 (socket says 172.21.15.72:58204) 2024-04-26T12:50:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.763+0000 7fd8ec09c640 1 -- 172.21.15.72:0/2020667017 learned_addr learned my addr 172.21.15.72:0/2020667017 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ec09c640 1 -- 172.21.15.72:0/2020667017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646710c6330 con 0x564670fda4f0 2024-04-26T12:50:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/2020667017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710c5d60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0aa500 tx=0x7fd8dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155c1b3a4e8f25f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd7da60c640 1 -- 172.21.15.72:0/2020667017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0af040 con 0x564670fda4f0 2024-04-26T12:50:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd7da60c640 1 -- 172.21.15.72:0/2020667017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0abb80 con 0x564670fda4f0 2024-04-26T12:50:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd7da60c640 1 -- 172.21.15.72:0/2020667017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0b5470 con 0x564670fda4f0 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 -- 172.21.15.72:0/2020667017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 msgr2=0x5646710c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 --2- 172.21.15.72:0/2020667017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710c5d60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0aa500 tx=0x7fd8dc0033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 -- 172.21.15.72:0/2020667017 shutdown_connections 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 --2- 172.21.15.72:0/2020667017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710c5d60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 -- 172.21.15.72:0/2020667017 >> 172.21.15.72:0/2020667017 conn(0x564670f4dbd0 msgr2=0x5646710c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 -- 172.21.15.72:0/2020667017 shutdown_connections 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 -- 172.21.15.72:0/2020667017 wait complete. 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 Processor -- start 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 -- start start 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ee581980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564670fe4540 con 0x564670fda4f0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58214/0 (socket says 172.21.15.72:58214) 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ec09c640 1 -- 172.21.15.72:0/252336072 learned_addr learned my addr 172.21.15.72:0/252336072 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.767+0000 7fd8ec09c640 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646710cd440 con 0x564670fda4f0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710ccf00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc017be0 tx=0x7fd8dc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd7d8e09640 1 -- 172.21.15.72:0/252336072 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0b5830 con 0x564670fda4f0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd7d8e09640 1 -- 172.21.15.72:0/252336072 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0c6070 con 0x564670fda4f0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd7d8e09640 1 -- 172.21.15.72:0/252336072 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0b5b00 con 0x564670fda4f0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646710cd6d0 con 0x564670fda4f0 2024-04-26T12:50:39.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646710d0300 con 0x564670fda4f0 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd7d8e09640 1 -- 172.21.15.72:0/252336072 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8dc0b5ca0 con 0x564670fda4f0 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd7d8e09640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7d40346f0 0x7fd7d4036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd7d8e09640 1 -- 172.21.15.72:0/252336072 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fd8dc0bb070 con 0x564670fda4f0 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7d40346f0 0x7fd7d4036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564670fdae10 0x5646710d3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646710d4400 con 0x564670fdae10 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ec89d640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564670fdae10 0x5646710d3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7d40346f0 0x7fd7d4036bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4001da0 tx=0x7fd8d4001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ec89d640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564670fdae10 0x5646710d3de0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ec89d640 1 -- 172.21.15.72:0/252336072 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e40083f0 con 0x564670fdae10 2024-04-26T12:50:39.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646710d4cf0 con 0x564670fdae10 2024-04-26T12:50:39.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ec89d640 1 -- 172.21.15.72:0/252336072 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8e40083f0 con 0x564670fdae10 2024-04-26T12:50:39.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5646710d6640 0x5646710d8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.771+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646710d9260 con 0x5646710d6640 2024-04-26T12:50:39.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5646710d6640 0x5646710d8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5646710d6640 0x5646710d8ad0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ec09c640 1 -- 172.21.15.72:0/252336072 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8dc0d2070 con 0x5646710d6640 2024-04-26T12:50:39.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646710d5540 con 0x564670fdae10 2024-04-26T12:50:39.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ec89d640 1 -- 172.21.15.72:0/252336072 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8e40083f0 con 0x564670fdae10 2024-04-26T12:50:39.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5646710da6c0 0x5646710dcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646710dd1f0 con 0x5646710da6c0 2024-04-26T12:50:39.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5646710da6c0 0x5646710dcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5646710da6c0 0x5646710dcab0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8eb89b640 1 -- 172.21.15.72:0/252336072 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8d400e6c0 con 0x5646710da6c0 2024-04-26T12:50:39.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ee581980 1 Processor -- start 2024-04-26T12:50:39.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ee581980 1 -- start start 2024-04-26T12:50:39.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ee581980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710eb260 0x5646710eb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ee581980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564670edfab0 con 0x5646710eb260 2024-04-26T12:50:39.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710eb260 0x5646710eb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710eb260 0x5646710eb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58218/0 (socket says 172.21.15.72:58218) 2024-04-26T12:50:39.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.775+0000 7fd8ec09c640 1 -- 172.21.15.72:0/3164915149 learned_addr learned my addr 172.21.15.72:0/3164915149 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ec09c640 1 -- 172.21.15.72:0/3164915149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646710ebbc0 con 0x5646710eb260 2024-04-26T12:50:39.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710eb260 0x5646710eb680 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0e50d0 tx=0x7fd8dc0c0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd7d1ffb640 1 -- 172.21.15.72:0/3164915149 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0afc40 con 0x5646710eb260 2024-04-26T12:50:39.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd7d1ffb640 1 -- 172.21.15.72:0/3164915149 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0e35e0 con 0x5646710eb260 2024-04-26T12:50:39.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646710ec660 con 0x5646710eb260 2024-04-26T12:50:39.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd7d1ffb640 1 -- 172.21.15.72:0/3164915149 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0e38c0 con 0x5646710eb260 2024-04-26T12:50:39.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646710ec660 con 0x5646710eb260 2024-04-26T12:50:39.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd7d1ffb640 1 -- 172.21.15.72:0/3164915149 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8dc0e3a60 con 0x5646710eb260 2024-04-26T12:50:39.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd7d1ffb640 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7c4034650 0x7fd7c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd7d1ffb640 1 -- 172.21.15.72:0/3164915149 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fd8dc0e0d10 con 0x5646710eb260 2024-04-26T12:50:39.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7c4034650 0x7fd7c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ee581980 1 Processor -- start 2024-04-26T12:50:39.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ee581980 1 -- start start 2024-04-26T12:50:39.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7c4034650 0x7fd7c4036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5646710d1680 tx=0x7fd8d400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ee581980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710f8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ee581980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5646710c65c0 con 0x5646710f8070 2024-04-26T12:50:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710f8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58226/0 (socket says 172.21.15.72:58226) 2024-04-26T12:50:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.779+0000 7fd8ec09c640 1 -- 172.21.15.72:0/3368173597 learned_addr learned my addr 172.21.15.72:0/3368173597 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ec09c640 1 -- 172.21.15.72:0/3368173597 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646710f8a60 con 0x5646710f8070 2024-04-26T12:50:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/3368173597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710f8490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0ddfb0 tx=0x7fd8dc0d6f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa317ec1a6351f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd7cb7fe640 1 -- 172.21.15.72:0/3368173597 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0f7070 con 0x5646710f8070 2024-04-26T12:50:39.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd7cb7fe640 1 -- 172.21.15.72:0/3368173597 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0cbd60 con 0x5646710f8070 2024-04-26T12:50:39.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd7cb7fe640 1 -- 172.21.15.72:0/3368173597 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0c4e60 con 0x5646710f8070 2024-04-26T12:50:39.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 -- 172.21.15.72:0/3368173597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 msgr2=0x5646710f8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 --2- 172.21.15.72:0/3368173597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710f8490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0ddfb0 tx=0x7fd8dc0d6f40 comp rx=0 tx=0).stop 2024-04-26T12:50:39.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 -- 172.21.15.72:0/3368173597 shutdown_connections 2024-04-26T12:50:39.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 --2- 172.21.15.72:0/3368173597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710f8490 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 -- 172.21.15.72:0/3368173597 >> 172.21.15.72:0/3368173597 conn(0x5646710f4400 msgr2=0x5646710f2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 -- 172.21.15.72:0/3368173597 shutdown_connections 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 -- 172.21.15.72:0/3368173597 wait complete. 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 Processor -- start 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 -- start start 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710ff370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ee581980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5646710f9150 con 0x5646710f8070 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ec09c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58232/0 (socket says 172.21.15.72:58232) 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 learned_addr learned my addr 172.21.15.72:0/151669481 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:39.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646710ff8b0 con 0x5646710f8070 2024-04-26T12:50:39.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.783+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710ff370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0e22d0 tx=0x7fd8dc0b73b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/151669481 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc10c070 con 0x5646710f8070 2024-04-26T12:50:39.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/151669481 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0cb670 con 0x5646710f8070 2024-04-26T12:50:39.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646710ff8b0 con 0x5646710f8070 2024-04-26T12:50:39.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/151669481 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc0be5f0 con 0x5646710f8070 2024-04-26T12:50:39.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646710ff8b0 con 0x5646710f8070 2024-04-26T12:50:39.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/151669481 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8dc10f070 con 0x5646710f8070 2024-04-26T12:50:39.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd7c9ffb640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7bc0346a0 0x7fd7bc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd7c9ffb640 1 -- 172.21.15.72:0/151669481 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fd8dc103030 con 0x5646710f8070 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7bc0346a0 0x7fd7bc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56467110a450 0x56467110c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467110d060 con 0x56467110a450 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ec89d640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56467110a450 0x56467110c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7bc0346a0 0x7fd7bc036b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5646710dd5d0 tx=0x7fd8d4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ec89d640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56467110a450 0x56467110c910 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e40083f0 con 0x56467110a450 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 realm 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467110d470 con 0x56467110a450 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e40083f0 con 0x56467110a450 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467110dd40 con 0x56467110a450 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e40083f0 con 0x56467110a450 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110a450 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8e40083f0 con 0x56467110a450 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.787+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56467110ee40 0x564671111230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671111800 con 0x56467110ee40 2024-04-26T12:50:39.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56467110ee40 0x564671111230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ec09c640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56467110ee40 0x564671111230 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ee581980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ee581980 20 searching for the correct realm 2024-04-26T12:50:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564671113750 0x564671115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564671116250 con 0x564671113750 2024-04-26T12:50:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564671113750 0x564671115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564671113750 0x564671115b80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8eb89b640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd8d4037040 0x7fd8d4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564671116250 con 0x7fd8d4037040 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ec89d640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd8d4037040 0x7fd8d4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ec89d640 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd8d4037040 0x7fd8d4036410 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e40083f0 con 0x7fd8d4037040 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.791+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110ee40 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110a450 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e40083f0 con 0x56467110a450 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110a450 2024-04-26T12:50:39.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110ee40 2024-04-26T12:50:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110ee40 2024-04-26T12:50:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x7fd8d4037040 2024-04-26T12:50:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x564671113750 2024-04-26T12:50:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110a450 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x7fd8d4037040 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110a450 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.795+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x7fd8d4037040 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x564671113750 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x564671113750 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110ee40 2024-04-26T12:50:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x564671113750 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x564671113750 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110a450 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110a450 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110ee40 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x564671113750 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.799+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x7fd8d4037040 2024-04-26T12:50:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110a450 2024-04-26T12:50:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110ee40 2024-04-26T12:50:39.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x564671113750 2024-04-26T12:50:39.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110ee40 2024-04-26T12:50:39.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x7fd8d4037040 2024-04-26T12:50:39.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x564671113750 2024-04-26T12:50:39.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110ee40 2024-04-26T12:50:39.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.803+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x56467110a450 2024-04-26T12:50:39.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fd8e402b040 con 0x7fd8d4037040 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110a450 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x56467110a450 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467110e0e0 con 0x564671113750 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 zone default found 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 4 Realm: () 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 zonegroup default 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711126c0 con 0x56467110ee40 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711180b0 con 0x564671113750 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671118450 con 0x564671113750 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 started sync module instance, tier type = 2024-04-26T12:50:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.807+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671117550 con 0x7fd8d4037040 2024-04-26T12:50:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.811+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.811+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860544670320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671117550 con 0x7fd8d4037040 2024-04-26T12:50:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.811+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671118e10 con 0x56467110a450 2024-04-26T12:50:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.811+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860544670320] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.811+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.811+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860544668080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671118e10 con 0x56467110a450 2024-04-26T12:50:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.811+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711197d0 con 0x564671113750 2024-04-26T12:50:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860544668080] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860544674144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671118d80 con 0x564671113750 2024-04-26T12:50:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111a4d0 con 0x7fd8d4037040 2024-04-26T12:50:39.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860544680272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111ad70 con 0x7fd8d4037040 2024-04-26T12:50:39.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111b770 con 0x56467110a450 2024-04-26T12:50:39.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.815+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860544674144] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860544680272] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860544678768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111a850 con 0x56467110a450 2024-04-26T12:50:39.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111c010 con 0x56467110ee40 2024-04-26T12:50:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860544678768] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860544686944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111a850 con 0x56467110ee40 2024-04-26T12:50:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.819+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111c860 con 0x56467110ee40 2024-04-26T12:50:39.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.823+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.823+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860544689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111cc80 con 0x56467110ee40 2024-04-26T12:50:39.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.823+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111d780 con 0x56467110ee40 2024-04-26T12:50:39.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.823+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860544686944] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860544689072] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860544692848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111c810 con 0x56467110ee40 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=0 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=1 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=2 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=3 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=4 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=5 2024-04-26T12:50:39.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=6 2024-04-26T12:50:39.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860544692848] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 20 add_watcher() i=7 2024-04-26T12:50:39.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:39.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671120880 con 0x56467110a450 2024-04-26T12:50:39.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.827+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860544684672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467111dd00 con 0x56467110a450 2024-04-26T12:50:39.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.831+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860544684672] v35'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.831+0000 7fd7a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:39.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.831+0000 7fd8ee581980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:39.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.831+0000 7fd8ee581980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:39.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.831+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671129110 con 0x56467110a450 2024-04-26T12:50:39.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.831+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.831+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711297e0 con 0x56467110ee40 2024-04-26T12:50:39.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.835+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.835+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711297e0 con 0x564671113750 2024-04-26T12:50:39.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.835+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.835+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671129dd0 con 0x56467110a450 2024-04-26T12:50:39.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.835+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'183 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.839+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112a280 con 0x7fd8d4037040 2024-04-26T12:50:39.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.839+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'64 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.839+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112a7f0 con 0x564671113750 2024-04-26T12:50:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.839+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.839+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112aca0 con 0x56467110a450 2024-04-26T12:50:39.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.843+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.843+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112aad0 con 0x56467110ee40 2024-04-26T12:50:39.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.843+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.843+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112ab60 con 0x7fd8d4037040 2024-04-26T12:50:39.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.847+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.847+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112ab60 con 0x564671113750 2024-04-26T12:50:39.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.847+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.847+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b0f0 con 0x7fd8d4037040 2024-04-26T12:50:39.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.847+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'65 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.847+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b0d0 con 0x56467110ee40 2024-04-26T12:50:39.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.851+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.851+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b0d0 con 0x7fd8d4037040 2024-04-26T12:50:39.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.851+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.851+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b160 con 0x56467110ee40 2024-04-26T12:50:39.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.855+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.855+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b160 con 0x56467110a450 2024-04-26T12:50:39.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.855+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'184 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.859+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b160 con 0x564671113750 2024-04-26T12:50:39.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.859+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'57 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.859+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b160 con 0x7fd8d4037040 2024-04-26T12:50:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.859+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.859+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.863+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.863+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x56467110a450 2024-04-26T12:50:39.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.863+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.863+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x56467110a450 2024-04-26T12:50:39.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.867+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'185 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.867+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.867+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'58 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.867+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x7fd8d4037040 2024-04-26T12:50:39.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.867+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.867+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.871+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.871+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.871+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.871+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.871+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.871+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.875+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.875+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x56467110ee40 2024-04-26T12:50:39.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.875+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.875+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.875+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.875+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x56467110ee40 2024-04-26T12:50:39.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.879+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.879+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x564671113750 2024-04-26T12:50:39.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.883+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'59 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.883+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x56467110ee40 2024-04-26T12:50:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.883+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.883+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467112b660 con 0x7fd8d4037040 2024-04-26T12:50:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd7a17e2640 20 reqs_thread_entry: start 2024-04-26T12:50:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 20 Filter name: none 2024-04-26T12:50:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd712ffd640 20 reqs_thread_entry: start 2024-04-26T12:50:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:50:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711468a0 con 0x7fd8d4037040 2024-04-26T12:50:39.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 : miss 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 8.9 8:9676ff39:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671148360 con 0x7fd8d4037040 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(95 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv41 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 info.flags=0x17 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 to cache LRU end 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 2024-04-26T12:50:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:96 4.39 4:9e11500a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c5b50 con 0x564671113750 2024-04-26T12:50:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(96 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.887+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 4.3c 4:3d3d82f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c5b50 con 0x56467110a450 2024-04-26T12:50:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(97 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 4.b 4:d2d3d1f1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c5b50 con 0x7fd8d4037040 2024-04-26T12:50:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(98 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-26T12:50:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:99 4.11 4:88235f05:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c5b50 con 0x56467110ee40 2024-04-26T12:50:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(99 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:100 4.3b 4:dfeee523:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c5b50 con 0x7fd8d4037040 2024-04-26T12:50:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(100 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:101 4.13 4:c9864b7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c60d0 con 0x7fd8d4037040 2024-04-26T12:50:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(101 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:102 4.a 4:52d09f3c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c60d0 con 0x7fd8d4037040 2024-04-26T12:50:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(102 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-26T12:50:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.891+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 4.11 4:89feb1b7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c60d0 con 0x56467110ee40 2024-04-26T12:50:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(103 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:104 4.11 4:8aa63e15:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c60d0 con 0x56467110ee40 2024-04-26T12:50:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(104 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-26T12:50:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:105 4.3d 4:bcf9afc0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c60d0 con 0x564671113750 2024-04-26T12:50:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(105 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:106 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c60d0 con 0x7fd8d4037040 2024-04-26T12:50:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(106 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [call out=698b] v0'0 uv9 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-26T12:50:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:50:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:107 3.10s0 3:0b53d5e7:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c3850 con 0x56467110a450 2024-04-26T12:50:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(107 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fd8e4026040 con 0x56467110a450 2024-04-26T12:50:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 10 manifest: total_size = 6 2024-04-26T12:50:39.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.3995766105753285462 2024-04-26T12:50:39.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 20 prepare_atomic_modification: state is not atomic. state=0x5646711490f8 2024-04-26T12:50:39.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2 2024-04-26T12:50:39.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.895+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:108 4.b 4:d2d3d1f1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114df60 con 0x7fd8d4037040 2024-04-26T12:50:39.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.899+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(108 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2 [stat,call,call] v35'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd8e4026040 con 0x7fd8d4037040 2024-04-26T12:50:39.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.899+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:109 3.10s0 3:0b53d5e7:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114bf40 con 0x56467110a450 2024-04-26T12:50:39.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(109 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_9c8454ddf7aa50116496bac348d7550d [call] v35'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:110 4.b 4:d2d3d1f1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114df30 con 0x7fd8d4037040 2024-04-26T12:50:39.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:111 3.31s0 3:8c764d7d:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114df30 con 0x56467110ee40 2024-04-26T12:50:39.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(111 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 10 manifest: total_size = 3 2024-04-26T12:50:39.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.15163242973737418157 2024-04-26T12:50:39.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 20 prepare_atomic_modification: state is not atomic. state=0x5646711490f8 2024-04-26T12:50:39.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6 2024-04-26T12:50:39.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:112 4.a 4:52d09f3c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671153030 con 0x7fd8d4037040 2024-04-26T12:50:39.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(110 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2 [stat,call,call] v35'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd7cb7fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-26T12:50:39.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(112 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.903+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:113 3.31s0 3:8c764d7d:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671153030 con 0x56467110ee40 2024-04-26T12:50:39.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(113 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_b1b9a972ccd8c962a473909b97007eb4 [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:114 4.a 4:52d09f3c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114eb00 con 0x7fd8d4037040 2024-04-26T12:50:39.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:115 3.39s0 3:9cf3ee58:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114f780 con 0x564671113750 2024-04-26T12:50:39.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(115 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 10 manifest: total_size = 4 2024-04-26T12:50:39.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.4947767217244489365 2024-04-26T12:50:39.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 20 prepare_atomic_modification: state is not atomic. state=0x5646711490f8 2024-04-26T12:50:39.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8 2024-04-26T12:50:39.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:116 4.11 4:8aa63e15:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114eb00 con 0x56467110ee40 2024-04-26T12:50:39.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(114 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.907+0000 7fd7caffd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-26T12:50:39.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(116 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:117 3.39s0 3:9cf3ee58:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f780 con 0x564671113750 2024-04-26T12:50:39.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(117 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v35'3 uv3 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:118 4.11 4:8aa63e15:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114eb00 con 0x56467110ee40 2024-04-26T12:50:39.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:119 3.39s0 3:9f879cc6:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x564671113750 2024-04-26T12:50:39.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(119 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 10 manifest: total_size = 5 2024-04-26T12:50:39.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.16265938313078227860 2024-04-26T12:50:39.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 20 prepare_atomic_modification: state is not atomic. state=0x5646711490f8 2024-04-26T12:50:39.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.911+0000 7fd8ee581980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 2024-04-26T12:50:39.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.915+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:120 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114eb00 con 0x7fd8d4037040 2024-04-26T12:50:39.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.915+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(118 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.915+0000 7fd7cb7fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-26T12:50:39.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.915+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(120 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [stat,call,call] v35'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.915+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:121 3.39s0 3:9f879cc6:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114eb00 con 0x564671113750 2024-04-26T12:50:39.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(121 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_24d27c169c2c881eb09a065116f2aa5c [call] v35'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:122 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114eb00 con 0x7fd8d4037040 2024-04-26T12:50:39.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:123 3.37s0 3:ee1a1644:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114eb00 con 0x56467110a450 2024-04-26T12:50:39.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(123 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 10 manifest: total_size = 5 2024-04-26T12:50:39.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 20 get_obj_state: setting s->obj_tag to _-zX5z12BQiPa5KIejK5zZ8XbSayX5Xs 2024-04-26T12:50:39.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 20 get_obj_state: octx=0x7fd8e4008c50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5646711490f8 s->prefetch_data=0 2024-04-26T12:50:39.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 20 prepare_atomic_modification: state is not atomic. state=0x5646711490f8 2024-04-26T12:50:39.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 2024-04-26T12:50:39.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:124 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114d2b0 con 0x7fd8d4037040 2024-04-26T12:50:39.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(122 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [stat,call,call] v35'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.919+0000 7fd7caffd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-26T12:50:39.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== osd_op_reply(124 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [stat,call,call] v35'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:125 3.37s0 3:ee1a1644:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114c2a0 con 0x56467110a450 2024-04-26T12:50:39.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(125 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5_bb3aec0fdcdbc2974890f805c585d432 [call] v35'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:126 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711506d0 con 0x7fd8d4037040 2024-04-26T12:50:39.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 20 list_objects_ordered: starting attempt 1 2024-04-26T12:50:39.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:50:39.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:127 4.39 4:9e11500a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114d680 con 0x564671113750 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:128 4.3c 4:3d3d82f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671148f10 con 0x56467110a450 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:129 4.b 4:d2d3d1f1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114d680 con 0x7fd8d4037040 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:130 4.11 4:88235f05:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711522d0 con 0x56467110ee40 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:131 4.3b 4:dfeee523:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671152760 con 0x7fd8d4037040 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:132 4.13 4:c9864b7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467115f2f0 con 0x7fd8d4037040 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:133 4.a 4:52d09f3c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711620b0 con 0x7fd8d4037040 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:134 4.11 4:89feb1b7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671164ee0 con 0x56467110ee40 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(127 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:135 4.11 4:8aa63e15:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114d680 con 0x56467110ee40 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:136 4.3d 4:bcf9afc0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711620b0 con 0x564671113750 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:137 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467115f2f0 con 0x7fd8d4037040 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(128 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(130 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(133 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(136 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.923+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== osd_op_reply(129 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== osd_op_reply(131 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== osd_op_reply(134 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== osd_op_reply(132 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(126 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [stat,call,call] v35'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd7cb7fe640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:50:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(135 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== osd_op_reply(137 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5])"; uploads.size()=0; is_truncated=0 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:138 4.39 4:9e11500a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671152760 con 0x564671113750 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:139 4.3c 4:3d3d82f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711620b0 con 0x56467110a450 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:140 4.b 4:d2d3d1f1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671161a60 con 0x7fd8d4037040 2024-04-26T12:50:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:141 4.11 4:88235f05:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114a350 con 0x56467110ee40 2024-04-26T12:50:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:142 4.3b 4:dfeee523:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114a7e0 con 0x7fd8d4037040 2024-04-26T12:50:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:143 4.13 4:c9864b7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671152760 con 0x7fd8d4037040 2024-04-26T12:50:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:144 4.a 4:52d09f3c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711620b0 con 0x7fd8d4037040 2024-04-26T12:50:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:145 4.11 4:89feb1b7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671161a60 con 0x56467110ee40 2024-04-26T12:50:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:146 4.11 4:8aa63e15:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114a7e0 con 0x56467110ee40 2024-04-26T12:50:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:147 4.3d 4:bcf9afc0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671165860 con 0x564671113750 2024-04-26T12:50:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:148 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671168110 con 0x7fd8d4037040 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(139 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(140 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(142 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 41 ==== osd_op_reply(143 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 42 ==== osd_op_reply(144 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 43 ==== osd_op_reply(148 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(141 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(147 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(138 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(145 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== osd_op_reply(146 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.927+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671151d10 con 0x7fd8d4037040 2024-04-26T12:50:39.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 44 ==== osd_op_reply(149 foo.buckets [call] v35'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ee581980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671151d10 con 0x7fd8d4037040 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 45 ==== osd_op_reply(150 myfoo [call,call,delete] v35'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ee581980 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ee581980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94860544972992 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564671151d10 con 0x56467110ee40 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== watch-notify(notify (1) cookie 94860544689072 notify 150323855383 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56467112abb0 con 0x56467110ee40 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd7cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855383 cookie 94860544689072 notifier 4657 bl.length()=149 2024-04-26T12:50:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(151 notify.6 [notify cookie 94860544972992 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.931+0000 7fd7cb7fe640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd7b0003d70 con 0x56467110ee40 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== watch-notify(notify_complete (2) cookie 94860544972992 notify 150323855383 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd8dc0dc070 con 0x56467110ee40 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:153 8.9 8:9676ff39:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671151d10 con 0x7fd8d4037040 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 46 ==== osd_op_reply(153 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 [call,call,delete] v35'50 uv50 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ee581980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 from cache 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ee581980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5, ofs0, ns] 2024-04-26T12:50:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94860544870880 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5646711c3b00 con 0x56467110ee40 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.935+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== watch-notify(notify (1) cookie 94860544686944 notify 150323855384 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7fd8dc0dc070 con 0x56467110ee40 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd7caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855384 cookie 94860544686944 notifier 4657 bl.length()=206 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(154 notify.5 [notify cookie 94860544870880 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd7caffd640 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd7200032d0 con 0x56467110ee40 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 43 ==== watch-notify(notify_complete (2) cookie 94860544870880 notify 150323855384 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5646710d0300 con 0x56467110ee40 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 44 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:156 4.39 4:9e11500a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711618c0 con 0x564671113750 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:157 4.3c 4:3d3d82f0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114d1d0 con 0x56467110a450 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:158 4.b 4:d2d3d1f1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671124510 con 0x7fd8d4037040 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:159 4.11 4:88235f05:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671146d00 con 0x56467110ee40 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:160 4.3b 4:dfeee523:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711475d0 con 0x7fd8d4037040 2024-04-26T12:50:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:161 4.13 4:c9864b7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671151190 con 0x7fd8d4037040 2024-04-26T12:50:39.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:162 4.a 4:52d09f3c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671151aa0 con 0x7fd8d4037040 2024-04-26T12:50:39.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:163 4.11 4:89feb1b7:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x56467110ee40 2024-04-26T12:50:39.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:164 4.11 4:8aa63e15:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114fff0 con 0x56467110ee40 2024-04-26T12:50:39.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:165 4.3d 4:bcf9afc0:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711503d0 con 0x564671113750 2024-04-26T12:50:39.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:166 4.1b 4:d8200b28:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671124510 con 0x7fd8d4037040 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(165 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.9 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.939+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(157 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.1 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(156 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.0 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 47 ==== osd_op_reply(158 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.2 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 48 ==== osd_op_reply(162 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.6 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 49 ==== osd_op_reply(161 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.5 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 50 ==== osd_op_reply(160 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.4 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 45 ==== osd_op_reply(159 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.3 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 51 ==== osd_op_reply(166 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.10 [delete] v35'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 46 ==== osd_op_reply(163 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.7 [delete] v35'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 47 ==== osd_op_reply(164 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5.8 [delete] v35'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ee581980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 : miss 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ee581980 20 rados->read ofs=0 len=0 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:167 6.d 6:b16117f8:::pubsub..bucket.myfoo%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467114fff0 con 0x56467110a450 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(167 pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ee581980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ee581980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 info.flags=0x0 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ee581980 10 adding default.rgw.log++pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 to cache LRU end 2024-04-26T12:50:39.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.943+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:168 6.d 6:b16117f8:::pubsub..bucket.myfoo%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x56467110a450 2024-04-26T12:50:39.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.947+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(168 pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5 [delete] v35'33 uv29 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.947+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671151190 con 0x7fd8d4037040 2024-04-26T12:50:39.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.947+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 52 ==== osd_op_reply(169 foo.buckets [call] v35'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.951+0000 7fd7a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:39.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.951+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860544684672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5646711475d0 con 0x56467110a450 2024-04-26T12:50:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.951+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94860544684672] v35'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.951+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860544670320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564671146d00 con 0x7fd8d4037040 2024-04-26T12:50:39.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.955+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 53 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94860544670320] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.955+0000 7fd8ee581980 20 remove_watcher() i=0 2024-04-26T12:50:39.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.955+0000 7fd8ee581980 2 removed watcher, disabling cache 2024-04-26T12:50:39.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.955+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860544668080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x56467110a450 2024-04-26T12:50:39.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.955+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94860544668080] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.955+0000 7fd8ee581980 20 remove_watcher() i=1 2024-04-26T12:50:39.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.955+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860544674144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x564671113750 2024-04-26T12:50:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.959+0000 7fd8eb89b640 1 -- 172.21.15.72:0/151669481 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94860544674144] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d400e6c0 con 0x564671113750 2024-04-26T12:50:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.959+0000 7fd8ee581980 20 remove_watcher() i=2 2024-04-26T12:50:39.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.959+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860544680272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x7fd8d4037040 2024-04-26T12:50:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.959+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.2 v2:172.21.15.72:6800/1931234624 54 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94860544680272] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x7fd8d4037040 2024-04-26T12:50:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.959+0000 7fd8ee581980 20 remove_watcher() i=3 2024-04-26T12:50:39.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.959+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860544678768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x56467110a450 2024-04-26T12:50:39.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.963+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94860544678768] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e404b040 con 0x56467110a450 2024-04-26T12:50:39.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.963+0000 7fd8ee581980 20 remove_watcher() i=4 2024-04-26T12:50:39.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.963+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860544686944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x56467110ee40 2024-04-26T12:50:39.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.963+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 48 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94860544686944] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.963+0000 7fd8ee581980 20 remove_watcher() i=5 2024-04-26T12:50:39.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.963+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860544689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x56467110ee40 2024-04-26T12:50:39.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.967+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 49 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94860544689072] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.967+0000 7fd8ee581980 20 remove_watcher() i=6 2024-04-26T12:50:39.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.967+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860544692848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467114f6c0 con 0x56467110ee40 2024-04-26T12:50:39.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.967+0000 7fd8ec09c640 1 -- 172.21.15.72:0/151669481 <== osd.0 v2:172.21.15.29:6800/1895601642 50 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94860544692848] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc10e030 con 0x56467110ee40 2024-04-26T12:50:39.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.967+0000 7fd8ee581980 20 remove_watcher() i=7 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56467110ee40 msgr2=0x564671111230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56467110ee40 0x564671111230 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56467110a450 msgr2=0x56467110c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56467110a450 0x56467110c910 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd8d4037040 msgr2=0x7fd8d4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd8d4037040 0x7fd8d4036410 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564671113750 msgr2=0x564671115b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x564671113750 0x564671115b80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7bc0346a0 msgr2=0x7fd7bc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7bc0346a0 0x7fd7bc036b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5646710dd5d0 tx=0x7fd8d4010000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 msgr2=0x5646710ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ec89d640 1 -- 172.21.15.72:0/151669481 reap_dead start 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710ff370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0e22d0 tx=0x7fd8dc0b73b0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 shutdown_connections 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/151669481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710f8070 0x5646710ff370 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 >> 172.21.15.72:0/151669481 conn(0x5646710f4400 msgr2=0x5646710f1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 shutdown_connections 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/151669481 wait complete. 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7c4034650 msgr2=0x7fd7c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7c4034650 0x7fd7c4036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5646710d1680 tx=0x7fd8d400f000 comp rx=0 tx=0).stop 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710eb260 msgr2=0x5646710eb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710eb260 0x5646710eb680 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0e50d0 tx=0x7fd8dc0c0730 comp rx=0 tx=0).stop 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 shutdown_connections 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7c4034650 0x7fd7c4036b10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/3164915149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5646710eb260 0x5646710eb680 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 >> 172.21.15.72:0/3164915149 conn(0x5646710e0070 msgr2=0x5646710e0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 shutdown_connections 2024-04-26T12:50:39.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/3164915149 wait complete. 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5646710d6640 msgr2=0x5646710d8ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5646710d6640 0x5646710d8ad0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564670fdae10 msgr2=0x5646710d3de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x564670fdae10 0x5646710d3de0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5646710da6c0 msgr2=0x5646710dcab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5646710da6c0 0x5646710dcab0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7d40346f0 msgr2=0x7fd7d4036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd7d40346f0 0x7fd7d4036bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4001da0 tx=0x7fd8d4001300 comp rx=0 tx=0).stop 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 msgr2=0x5646710ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 --2- 172.21.15.72:0/252336072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564670fda4f0 0x5646710ccf00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc017be0 tx=0x7fd8dc017d70 comp rx=0 tx=0).stop 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ec89d640 1 -- 172.21.15.72:0/252336072 reap_dead start 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 shutdown_connections 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 >> 172.21.15.72:0/252336072 conn(0x564670f4dbd0 msgr2=0x5646710c0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 shutdown_connections 2024-04-26T12:50:39.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:39.971+0000 7fd8ee581980 1 -- 172.21.15.72:0/252336072 wait complete. 2024-04-26T12:50:39.990 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:50:39.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:50:39.990 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-26T12:50:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:40.075 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:40.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731cc12980 1 Processor -- start 2024-04-26T12:50:40.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731cc12980 1 -- start start 2024-04-26T12:50:40.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731cc12980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea0890a8d0 0x55ea08998f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731cc12980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea08843510 con 0x55ea08999480 2024-04-26T12:50:40.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731cc12980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ea0884a430 con 0x55ea0890a8d0 2024-04-26T12:50:40.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f7319f2c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55ea08999480 0x55ea0899b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48258/0 (socket says 172.21.15.72:48258) 2024-04-26T12:50:40.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731a72d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea0890a8d0 0x55ea08998f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f7319f2c640 1 -- 172.21.15.72:0/1604396720 learned_addr learned my addr 172.21.15.72:0/1604396720 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:40.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731a72d640 1 -- 172.21.15.72:0/1604396720 >> v1:172.21.15.29:6789/0 conn(0x55ea08999480 legacy=0x55ea0899b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.075+0000 7f731a72d640 1 -- 172.21.15.72:0/1604396720 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea0881fae0 con 0x55ea0890a8d0 2024-04-26T12:50:40.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731a72d640 1 --2- 172.21.15.72:0/1604396720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08998f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f731400a420 tx=0x7f731401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a103b70171bb1ba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731972b640 1 -- 172.21.15.72:0/1604396720 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140af070 con 0x55ea0890a8d0 2024-04-26T12:50:40.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731972b640 1 -- 172.21.15.72:0/1604396720 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73140aa530 con 0x55ea0890a8d0 2024-04-26T12:50:40.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731972b640 1 -- 172.21.15.72:0/1604396720 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140aa850 con 0x55ea0890a8d0 2024-04-26T12:50:40.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731cc12980 1 -- 172.21.15.72:0/1604396720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 msgr2=0x55ea08998f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731cc12980 1 --2- 172.21.15.72:0/1604396720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08998f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f731400a420 tx=0x7f731401afd0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731cc12980 1 -- 172.21.15.72:0/1604396720 shutdown_connections 2024-04-26T12:50:40.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731cc12980 1 --2- 172.21.15.72:0/1604396720 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08998f40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731cc12980 1 -- 172.21.15.72:0/1604396720 >> 172.21.15.72:0/1604396720 conn(0x55ea08990a60 msgr2=0x55ea08992e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731cc12980 1 -- 172.21.15.72:0/1604396720 shutdown_connections 2024-04-26T12:50:40.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.079+0000 7f731cc12980 1 -- 172.21.15.72:0/1604396720 wait complete. 2024-04-26T12:50:40.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731cc12980 1 Processor -- start 2024-04-26T12:50:40.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731cc12980 1 -- start start 2024-04-26T12:50:40.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731cc12980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea089966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731cc12980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea08899a70 con 0x55ea0890a8d0 2024-04-26T12:50:40.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea089966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea089966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58238/0 (socket says 172.21.15.72:58238) 2024-04-26T12:50:40.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731a72d640 1 -- 172.21.15.72:0/547645390 learned_addr learned my addr 172.21.15.72:0/547645390 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731a72d640 1 -- 172.21.15.72:0/547645390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea08996c70 con 0x55ea0890a8d0 2024-04-26T12:50:40.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f731a72d640 1 --2- 172.21.15.72:0/547645390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea089966a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f73140ad040 tx=0x7f73140033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae20ad4e8e2403fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f7208608640 1 -- 172.21.15.72:0/547645390 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140af050 con 0x55ea0890a8d0 2024-04-26T12:50:40.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f7208608640 1 -- 172.21.15.72:0/547645390 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73140b0040 con 0x55ea0890a8d0 2024-04-26T12:50:40.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.095+0000 7f7208608640 1 -- 172.21.15.72:0/547645390 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140aaca0 con 0x55ea0890a8d0 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- 172.21.15.72:0/547645390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 msgr2=0x55ea089966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 --2- 172.21.15.72:0/547645390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea089966a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f73140ad040 tx=0x7f73140033b0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- 172.21.15.72:0/547645390 shutdown_connections 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 --2- 172.21.15.72:0/547645390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea089966a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- 172.21.15.72:0/547645390 >> 172.21.15.72:0/547645390 conn(0x55ea08990a60 msgr2=0x55ea08a7d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- 172.21.15.72:0/547645390 shutdown_connections 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- 172.21.15.72:0/547645390 wait complete. 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 Processor -- start 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- start start 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08a8a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea0899daa0 con 0x55ea0890a8d0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08a8a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08a8a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58246/0 (socket says 172.21.15.72:58246) 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731a72d640 1 -- 172.21.15.72:0/1773698445 learned_addr learned my addr 172.21.15.72:0/1773698445 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731a72d640 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea08a8ad80 con 0x55ea0890a8d0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731a72d640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08a8a840 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7314018c00 tx=0x7f7314019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f7206e05640 1 -- 172.21.15.72:0/1773698445 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140c5070 con 0x55ea0890a8d0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f7206e05640 1 -- 172.21.15.72:0/1773698445 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73140b6d60 con 0x55ea0890a8d0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f7206e05640 1 -- 172.21.15.72:0/1773698445 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140c15f0 con 0x55ea0890a8d0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea08a8b010 con 0x55ea0890a8d0 2024-04-26T12:50:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.099+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea08a8dbd0 con 0x55ea0890a8d0 2024-04-26T12:50:40.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f7206e05640 1 -- 172.21.15.72:0/1773698445 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73140c8070 con 0x55ea0890a8d0 2024-04-26T12:50:40.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f7206e05640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7200034650 0x7f7200036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f7206e05640 1 -- 172.21.15.72:0/1773698445 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f73140bb070 con 0x55ea0890a8d0 2024-04-26T12:50:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7200034650 0x7f7200036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08999480 0x55ea08a916b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08a91d20 con 0x55ea08999480 2024-04-26T12:50:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731af2e640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08999480 0x55ea08a916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7200034650 0x7f7200036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7310000f70 tx=0x7f73100012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731af2e640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08999480 0x55ea08a916b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731af2e640 1 -- 172.21.15.72:0/1773698445 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08999480 2024-04-26T12:50:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08a8edd0 con 0x55ea08999480 2024-04-26T12:50:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731af2e640 1 -- 172.21.15.72:0/1773698445 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08999480 2024-04-26T12:50:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08a940a0 0x55ea08a96490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08a96b80 con 0x55ea08a940a0 2024-04-26T12:50:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731a72d640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08a940a0 0x55ea08a96490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.103+0000 7f731a72d640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08a940a0 0x55ea08a96490 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731a72d640 1 -- 172.21.15.72:0/1773698445 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73140d1070 con 0x55ea08a940a0 2024-04-26T12:50:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08a92f40 con 0x55ea08999480 2024-04-26T12:50:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731af2e640 1 -- 172.21.15.72:0/1773698445 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08999480 2024-04-26T12:50:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08a97fe0 0x55ea08a9a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08a9ab10 con 0x55ea08a97fe0 2024-04-26T12:50:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08a97fe0 0x55ea08a9a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08a97fe0 0x55ea08a9a3d0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f7319f2c640 1 -- 172.21.15.72:0/1773698445 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f731000e620 con 0x55ea08a97fe0 2024-04-26T12:50:40.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 Processor -- start 2024-04-26T12:50:40.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 -- start start 2024-04-26T12:50:40.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08aa8ba0 0x55ea08aa8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea0889dab0 con 0x55ea08aa8ba0 2024-04-26T12:50:40.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08aa8ba0 0x55ea08aa8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08aa8ba0 0x55ea08aa8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58258/0 (socket says 172.21.15.72:58258) 2024-04-26T12:50:40.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731a72d640 1 -- 172.21.15.72:0/3601275510 learned_addr learned my addr 172.21.15.72:0/3601275510 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731a72d640 1 -- 172.21.15.72:0/3601275510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea08aa9500 con 0x55ea08aa8ba0 2024-04-26T12:50:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731a72d640 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08aa8ba0 0x55ea08aa8fc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f73140e36f0 tx=0x7f73140bfd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f71fffff640 1 -- 172.21.15.72:0/3601275510 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140e20c0 con 0x55ea08aa8ba0 2024-04-26T12:50:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f71fffff640 1 -- 172.21.15.72:0/3601275510 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73140e2260 con 0x55ea08aa8ba0 2024-04-26T12:50:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea08aa9fa0 con 0x55ea08aa8ba0 2024-04-26T12:50:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f71fffff640 1 -- 172.21.15.72:0/3601275510 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140c1b60 con 0x55ea08aa8ba0 2024-04-26T12:50:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.107+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea08aaa470 con 0x55ea08aa8ba0 2024-04-26T12:50:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f71fffff640 1 -- 172.21.15.72:0/3601275510 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73140ec060 con 0x55ea08aa8ba0 2024-04-26T12:50:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f71fffff640 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71f40346a0 0x7f71f4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f71fffff640 1 -- 172.21.15.72:0/3601275510 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f73140e6e00 con 0x55ea08aa8ba0 2024-04-26T12:50:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f7319f2c640 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71f40346a0 0x7f71f4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731cc12980 1 Processor -- start 2024-04-26T12:50:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731cc12980 1 -- start start 2024-04-26T12:50:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f7319f2c640 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71f40346a0 0x7f71f4036b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f731000bf60 tx=0x7f731000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731cc12980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08ab5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731cc12980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea08994dd0 con 0x55ea08ab5b40 2024-04-26T12:50:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08ab5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08ab5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58262/0 (socket says 172.21.15.72:58262) 2024-04-26T12:50:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731a72d640 1 -- 172.21.15.72:0/3203469748 learned_addr learned my addr 172.21.15.72:0/3203469748 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731a72d640 1 -- 172.21.15.72:0/3203469748 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea08ab6530 con 0x55ea08ab5b40 2024-04-26T12:50:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731a72d640 1 --2- 172.21.15.72:0/3203469748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08ab5f60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f73140ea000 tx=0x7f73140ca6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1991a0f2ead346 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f71fdffb640 1 -- 172.21.15.72:0/3203469748 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140a93a0 con 0x55ea08ab5b40 2024-04-26T12:50:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f71fdffb640 1 -- 172.21.15.72:0/3203469748 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73140cac70 con 0x55ea08ab5b40 2024-04-26T12:50:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f71fdffb640 1 -- 172.21.15.72:0/3203469748 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73140a9540 con 0x55ea08ab5b40 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731cc12980 1 -- 172.21.15.72:0/3203469748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 msgr2=0x55ea08ab5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.111+0000 7f731cc12980 1 --2- 172.21.15.72:0/3203469748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08ab5f60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f73140ea000 tx=0x7f73140ca6f0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- 172.21.15.72:0/3203469748 shutdown_connections 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 --2- 172.21.15.72:0/3203469748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08ab5f60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- 172.21.15.72:0/3203469748 >> 172.21.15.72:0/3203469748 conn(0x55ea08ab1e80 msgr2=0x55ea08aafee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- 172.21.15.72:0/3203469748 shutdown_connections 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- 172.21.15.72:0/3203469748 wait complete. 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 Processor -- start 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- start start 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08abce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea08ab6bf0 con 0x55ea08ab5b40 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08abce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731a72d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08abce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58276/0 (socket says 172.21.15.72:58276) 2024-04-26T12:50:40.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 learned_addr learned my addr 172.21.15.72:0/1600953505 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea08abd3c0 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731a72d640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08abce80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f73140ca9d0 tx=0x7f7314009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f71ebfff640 1 -- 172.21.15.72:0/1600953505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7314108070 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea08abd3c0 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f71ebfff640 1 -- 172.21.15.72:0/1600953505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73140090d0 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea08abd830 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f71ebfff640 1 -- 172.21.15.72:0/1600953505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7314112060 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f71ebfff640 1 -- 172.21.15.72:0/1600953505 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f731410b070 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.115+0000 7f71ebfff640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71e4034650 0x7f71e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f71ebfff640 1 -- 172.21.15.72:0/1600953505 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f73140ff040 con 0x55ea08ab5b40 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71e4034650 0x7f71e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08ac7cf0 0x55ea08aca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aca8e0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731af2e640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08ac7cf0 0x55ea08aca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71e4034650 0x7f71e4036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55ea08a92240 tx=0x7f7310010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731af2e640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08ac7cf0 0x55ea08aca190 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 realm 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acacf0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb590 con 0x55ea08ac7cf0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ac7cf0 2024-04-26T12:50:40.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08acc690 0x55ea08acea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acf0d0 con 0x55ea08acc690 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731a72d640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08acc690 0x55ea08acea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731a72d640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08acc690 0x55ea08acea80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 20 searching for the correct realm 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08ad0fb0 0x55ea08ad3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.119+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad3aa0 con 0x55ea08ad0fb0 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08ad0fb0 0x55ea08ad3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08ad0fb0 0x55ea08ad3420 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f7319f2c640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7310037040 0x7f7310036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad3aa0 con 0x7f7310037040 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7310037040 0x7f7310036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7310037040 0x7f7310036410 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c0083f0 con 0x7f7310037040 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08acc690 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ac7cf0 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c0083f0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ac7cf0 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08acc690 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.123+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08acc690 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x7f7310037040 2024-04-26T12:50:40.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ad0fb0 2024-04-26T12:50:40.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ac7cf0 2024-04-26T12:50:40.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x7f7310037040 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x7f7310037040 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ad0fb0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ad0fb0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08acc690 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ad0fb0 2024-04-26T12:50:40.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.127+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ad0fb0 2024-04-26T12:50:40.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08acc690 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ad0fb0 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x7f7310037040 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08acc690 2024-04-26T12:50:40.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ad0fb0 2024-04-26T12:50:40.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.131+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08acc690 2024-04-26T12:50:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x7f7310037040 2024-04-26T12:50:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ad0fb0 2024-04-26T12:50:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08acc690 2024-04-26T12:50:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f730c02b040 con 0x7f7310037040 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ac7cf0 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ac7cf0 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acb930 con 0x55ea08ad0fb0 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 zone default found 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 4 Realm: () 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 zonegroup default 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08acff50 con 0x55ea08acc690 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.135+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad5900 con 0x55ea08ad0fb0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad5ca0 con 0x55ea08ad0fb0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 20 started sync module instance, tier type = 2024-04-26T12:50:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad4da0 con 0x7f7310037040 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94463656284912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad4da0 con 0x7f7310037040 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad6660 con 0x55ea08ac7cf0 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.139+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94463656284912] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.143+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.143+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94463656288960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad4da0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.143+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad7070 con 0x55ea08ad0fb0 2024-04-26T12:50:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.143+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94463656288960] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.143+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.143+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94463656282352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad4d10 con 0x55ea08ad0fb0 2024-04-26T12:50:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.143+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad7dc0 con 0x7f7310037040 2024-04-26T12:50:40.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94463656294944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad8660 con 0x7f7310037040 2024-04-26T12:50:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad9020 con 0x55ea08ac7cf0 2024-04-26T12:50:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94463656282352] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94463656294944] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94463656299376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad8f90 con 0x55ea08ac7cf0 2024-04-26T12:50:40.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.147+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad85b0 con 0x55ea08acc690 2024-04-26T12:50:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94463656299376] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94463656296704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad98c0 con 0x55ea08acc690 2024-04-26T12:50:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ada110 con 0x55ea08acc690 2024-04-26T12:50:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94463656303264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ada4f0 con 0x55ea08acc690 2024-04-26T12:50:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08adb010 con 0x55ea08acc690 2024-04-26T12:50:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.151+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94463656296704] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94463656303264] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94463656307424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ad9f40 con 0x55ea08acc690 2024-04-26T12:50:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=0 2024-04-26T12:50:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=1 2024-04-26T12:50:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=2 2024-04-26T12:50:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=3 2024-04-26T12:50:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=4 2024-04-26T12:50:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=5 2024-04-26T12:50:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=6 2024-04-26T12:50:40.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94463656307424] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 20 add_watcher() i=7 2024-04-26T12:50:40.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:40.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08ade000 con 0x55ea08ac7cf0 2024-04-26T12:50:40.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.155+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94463656301504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08adb480 con 0x55ea08ac7cf0 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94463656301504] v35'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f71d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 5 note: GC not initialized 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f714b7fe640 20 reqs_thread_entry: start 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 20 Filter name: none 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f71497fa640 20 reqs_thread_entry: start 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08b01750 con 0x55ea08ac7cf0 2024-04-26T12:50:40.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:40.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:40.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:40.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:40.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08b07900 con 0x55ea08ac7cf0 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v35'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.159+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94463656489856 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea08b031d0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94463656299376 notify 150323855378 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f730c010040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f71fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94463656299376 notifier 4664 bl.length()=579 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f71fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f71fdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(64 notify.4 [notify cookie 94463656489856 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f71fdffb640 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f71e0003eb0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== watch-notify(notify_complete (2) cookie 94463656489856 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f730c00acf0 con 0x55ea08ac7cf0 2024-04-26T12:50:40.164 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f71d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94463656301504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x55ea08ac7cf0 2024-04-26T12:50:40.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94463656301504] v35'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.163+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94463656284912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x7f7310037040 2024-04-26T12:50:40.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.167+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94463656284912] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.167+0000 7f731cc12980 20 remove_watcher() i=0 2024-04-26T12:50:40.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.167+0000 7f731cc12980 2 removed watcher, disabling cache 2024-04-26T12:50:40.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.167+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94463656288960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x55ea08ac7cf0 2024-04-26T12:50:40.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.167+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94463656288960] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.167+0000 7f731cc12980 20 remove_watcher() i=1 2024-04-26T12:50:40.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.167+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94463656282352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x55ea08ad0fb0 2024-04-26T12:50:40.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f7319f2c640 1 -- 172.21.15.72:0/1600953505 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94463656282352] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731000e620 con 0x55ea08ad0fb0 2024-04-26T12:50:40.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731cc12980 20 remove_watcher() i=2 2024-04-26T12:50:40.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94463656294944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x7f7310037040 2024-04-26T12:50:40.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94463656294944] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x7f7310037040 2024-04-26T12:50:40.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731cc12980 20 remove_watcher() i=3 2024-04-26T12:50:40.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94463656299376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x55ea08ac7cf0 2024-04-26T12:50:40.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94463656299376] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c026040 con 0x55ea08ac7cf0 2024-04-26T12:50:40.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731cc12980 20 remove_watcher() i=4 2024-04-26T12:50:40.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.171+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94463656296704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x55ea08acc690 2024-04-26T12:50:40.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.175+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94463656296704] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.175+0000 7f731cc12980 20 remove_watcher() i=5 2024-04-26T12:50:40.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.175+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94463656303264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x55ea08acc690 2024-04-26T12:50:40.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.175+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94463656303264] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.175+0000 7f731cc12980 20 remove_watcher() i=6 2024-04-26T12:50:40.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.175+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94463656307424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea08aff480 con 0x55ea08acc690 2024-04-26T12:50:40.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731a72d640 1 -- 172.21.15.72:0/1600953505 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94463656307424] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731410a030 con 0x55ea08acc690 2024-04-26T12:50:40.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 20 remove_watcher() i=7 2024-04-26T12:50:40.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08acc690 msgr2=0x55ea08acea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08acc690 0x55ea08acea80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08ac7cf0 msgr2=0x55ea08aca190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08ac7cf0 0x55ea08aca190 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7310037040 msgr2=0x7f7310036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7310037040 0x7f7310036410 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08ad0fb0 msgr2=0x55ea08ad3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08ad0fb0 0x55ea08ad3420 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71e4034650 msgr2=0x7f71e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71e4034650 0x7f71e4036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55ea08a92240 tx=0x7f7310010000 comp rx=0 tx=0).stop 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 msgr2=0x55ea08abce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731af2e640 1 -- 172.21.15.72:0/1600953505 reap_dead start 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08abce80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f73140ca9d0 tx=0x7f7314009640 comp rx=0 tx=0).stop 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 shutdown_connections 2024-04-26T12:50:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1600953505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08ab5b40 0x55ea08abce80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 >> 172.21.15.72:0/1600953505 conn(0x55ea08ab1e80 msgr2=0x55ea08aafeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 shutdown_connections 2024-04-26T12:50:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1600953505 wait complete. 2024-04-26T12:50:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71f40346a0 msgr2=0x7f71f4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71f40346a0 0x7f71f4036b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f731000bf60 tx=0x7f731000f000 comp rx=0 tx=0).stop 2024-04-26T12:50:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08aa8ba0 msgr2=0x55ea08aa8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08aa8ba0 0x55ea08aa8fc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f73140e36f0 tx=0x7f73140bfd00 comp rx=0 tx=0).stop 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 shutdown_connections 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f71f40346a0 0x7f71f4036b60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/3601275510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea08aa8ba0 0x55ea08aa8fc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 >> 172.21.15.72:0/3601275510 conn(0x55ea08a9d9b0 msgr2=0x55ea08a9e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 shutdown_connections 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/3601275510 wait complete. 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08a940a0 msgr2=0x55ea08a96490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea08a940a0 0x55ea08a96490 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08999480 msgr2=0x55ea08a916b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea08999480 0x55ea08a916b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08a97fe0 msgr2=0x55ea08a9a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea08a97fe0 0x55ea08a9a3d0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7200034650 msgr2=0x7f7200036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7200034650 0x7f7200036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7310000f70 tx=0x7f73100012c0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 msgr2=0x55ea08a8a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 --2- 172.21.15.72:0/1773698445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea0890a8d0 0x55ea08a8a840 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7314018c00 tx=0x7f7314019810 comp rx=0 tx=0).stop 2024-04-26T12:50:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731af2e640 1 -- 172.21.15.72:0/1773698445 reap_dead start 2024-04-26T12:50:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 shutdown_connections 2024-04-26T12:50:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 >> 172.21.15.72:0/1773698445 conn(0x55ea08990a60 msgr2=0x55ea089952f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 shutdown_connections 2024-04-26T12:50:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.179+0000 7f731cc12980 1 -- 172.21.15.72:0/1773698445 wait complete. 2024-04-26T12:50:40.193 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:40.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:50:40.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:50:40.193 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-26T12:50:40.275 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:40.276 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe92a98980 1 Processor -- start 2024-04-26T12:50:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe92a98980 1 -- start start 2024-04-26T12:50:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe92a98980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56009f8c24f0 0x56009f8c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe92a98980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56009f76d510 con 0x56009f8c2e10 2024-04-26T12:50:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe92a98980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56009f774430 con 0x56009f8c24f0 2024-04-26T12:50:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe905b3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56009f8c24f0 0x56009f8c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe87fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56009f8c2e10 0x56009f8c37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48266/0 (socket says 172.21.15.72:48266) 2024-04-26T12:50:40.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe87fff640 1 -- 172.21.15.72:0/3112241037 learned_addr learned my addr 172.21.15.72:0/3112241037 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:40.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe905b3640 1 -- 172.21.15.72:0/3112241037 >> v1:172.21.15.29:6789/0 conn(0x56009f8c2e10 legacy=0x56009f8c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.275+0000 7fbe905b3640 1 -- 172.21.15.72:0/3112241037 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f749ae0 con 0x56009f8c24f0 2024-04-26T12:50:40.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe905b3640 1 --2- 172.21.15.72:0/3112241037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f8c28d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a480 tx=0x7fbe8001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244d1ec8750c27fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe8fdb2640 1 -- 172.21.15.72:0/3112241037 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800b0070 con 0x56009f8c24f0 2024-04-26T12:50:40.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe8fdb2640 1 -- 172.21.15.72:0/3112241037 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe800ab540 con 0x56009f8c24f0 2024-04-26T12:50:40.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe8fdb2640 1 -- 172.21.15.72:0/3112241037 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800ab840 con 0x56009f8c24f0 2024-04-26T12:50:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe92a98980 1 -- 172.21.15.72:0/3112241037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 msgr2=0x56009f8c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe92a98980 1 --2- 172.21.15.72:0/3112241037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f8c28d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a480 tx=0x7fbe8001b280 comp rx=0 tx=0).stop 2024-04-26T12:50:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe92a98980 1 -- 172.21.15.72:0/3112241037 shutdown_connections 2024-04-26T12:50:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe92a98980 1 --2- 172.21.15.72:0/3112241037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f8c28d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe92a98980 1 -- 172.21.15.72:0/3112241037 >> 172.21.15.72:0/3112241037 conn(0x56009f835bd0 msgr2=0x56009f835fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe92a98980 1 -- 172.21.15.72:0/3112241037 shutdown_connections 2024-04-26T12:50:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.279+0000 7fbe92a98980 1 -- 172.21.15.72:0/3112241037 wait complete. 2024-04-26T12:50:40.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe92a98980 1 Processor -- start 2024-04-26T12:50:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe92a98980 1 -- start start 2024-04-26T12:50:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe92a98980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe92a98980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56009f7c3a70 con 0x56009f8c24f0 2024-04-26T12:50:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58294/0 (socket says 172.21.15.72:58294) 2024-04-26T12:50:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe905b3640 1 -- 172.21.15.72:0/4246342679 learned_addr learned my addr 172.21.15.72:0/4246342679 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.295+0000 7fbe905b3640 1 -- 172.21.15.72:0/4246342679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f9ae320 con 0x56009f8c24f0 2024-04-26T12:50:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe905b3640 1 --2- 172.21.15.72:0/4246342679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9add50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbe800ae040 tx=0x7fbe80003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5319f3ba4d736ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbd7e60c640 1 -- 172.21.15.72:0/4246342679 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800b0040 con 0x56009f8c24f0 2024-04-26T12:50:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbd7e60c640 1 -- 172.21.15.72:0/4246342679 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe800ab9b0 con 0x56009f8c24f0 2024-04-26T12:50:40.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbd7e60c640 1 -- 172.21.15.72:0/4246342679 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800abc90 con 0x56009f8c24f0 2024-04-26T12:50:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 -- 172.21.15.72:0/4246342679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 msgr2=0x56009f9add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 --2- 172.21.15.72:0/4246342679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9add50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbe800ae040 tx=0x7fbe80003030 comp rx=0 tx=0).stop 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 -- 172.21.15.72:0/4246342679 shutdown_connections 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 --2- 172.21.15.72:0/4246342679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9add50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 -- 172.21.15.72:0/4246342679 >> 172.21.15.72:0/4246342679 conn(0x56009f835bd0 msgr2=0x56009f9a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 -- 172.21.15.72:0/4246342679 shutdown_connections 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 -- 172.21.15.72:0/4246342679 wait complete. 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 Processor -- start 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 -- start start 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe92a98980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56009f8cc540 con 0x56009f8c24f0 2024-04-26T12:50:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58298/0 (socket says 172.21.15.72:58298) 2024-04-26T12:50:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe905b3640 1 -- 172.21.15.72:0/2868565857 learned_addr learned my addr 172.21.15.72:0/2868565857 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe905b3640 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f9b5490 con 0x56009f8c24f0 2024-04-26T12:50:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.299+0000 7fbe905b3640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9b4f50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbe800b9040 tx=0x7fbe80018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbd7ce09640 1 -- 172.21.15.72:0/2868565857 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800b0070 con 0x56009f8c24f0 2024-04-26T12:50:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbd7ce09640 1 -- 172.21.15.72:0/2868565857 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe800b6970 con 0x56009f8c24f0 2024-04-26T12:50:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56009f9b5720 con 0x56009f8c24f0 2024-04-26T12:50:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbd7ce09640 1 -- 172.21.15.72:0/2868565857 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800b6c50 con 0x56009f8c24f0 2024-04-26T12:50:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009f9b8310 con 0x56009f8c24f0 2024-04-26T12:50:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbd7ce09640 1 -- 172.21.15.72:0/2868565857 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe800bf3f0 con 0x56009f8c24f0 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbd7ce09640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd780346a0 0x7fbd78036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbd7ce09640 1 -- 172.21.15.72:0/2868565857 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fbe800bc070 con 0x56009f8c24f0 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd780346a0 0x7fbd78036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f8c2e10 0x56009f9bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9bc460 con 0x56009f8c2e10 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe90db4640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f8c2e10 0x56009f9bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd780346a0 0x7fbd78036b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f70 tx=0x7fbe780012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe90db4640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f8c2e10 0x56009f9bbdf0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.303+0000 7fbe90db4640 1 -- 172.21.15.72:0/2868565857 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f8c2e10 2024-04-26T12:50:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9b9530 con 0x56009f8c2e10 2024-04-26T12:50:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe90db4640 1 -- 172.21.15.72:0/2868565857 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f8c2e10 2024-04-26T12:50:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9be7b0 0x56009f9c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9c1290 con 0x56009f9be7b0 2024-04-26T12:50:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe905b3640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9be7b0 0x56009f9c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe905b3640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9be7b0 0x56009f9c0ba0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe905b3640 1 -- 172.21.15.72:0/2868565857 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe800b3040 con 0x56009f9be7b0 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9bd650 con 0x56009f8c2e10 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe90db4640 1 -- 172.21.15.72:0/2868565857 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f8c2e10 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9c26f0 0x56009f9c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9c5220 con 0x56009f9c26f0 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9c26f0 0x56009f9c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9c26f0 0x56009f9c4ae0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe87fff640 1 -- 172.21.15.72:0/2868565857 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9c26f0 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.307+0000 7fbe92a98980 1 Processor -- start 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe92a98980 1 -- start start 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe92a98980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9d32b0 0x56009f9d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe92a98980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56009f7c7ab0 con 0x56009f9d32b0 2024-04-26T12:50:40.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9d32b0 0x56009f9d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9d32b0 0x56009f9d36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58310/0 (socket says 172.21.15.72:58310) 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe905b3640 1 -- 172.21.15.72:0/80921707 learned_addr learned my addr 172.21.15.72:0/80921707 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe905b3640 1 -- 172.21.15.72:0/80921707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f9d3c10 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe905b3640 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9d32b0 0x56009f9d36d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe800e2bf0 tx=0x7fbe800b5fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbd75ffb640 1 -- 172.21.15.72:0/80921707 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800b5760 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbd75ffb640 1 -- 172.21.15.72:0/80921707 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe800b5900 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbd75ffb640 1 -- 172.21.15.72:0/80921707 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800b4a30 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56009f9d46b0 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009f9d4b80 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbd75ffb640 1 -- 172.21.15.72:0/80921707 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe800b4bd0 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbd75ffb640 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd68034650 0x7fbd68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbd75ffb640 1 -- 172.21.15.72:0/80921707 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fbe800a8070 con 0x56009f9d32b0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe87fff640 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd68034650 0x7fbd68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe92a98980 1 Processor -- start 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.311+0000 7fbe92a98980 1 -- start start 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe87fff640 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd68034650 0x7fbd68036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800bf60 tx=0x7fbe7800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56009f9ae5b0 con 0x56009f9e0260 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58324/0 (socket says 172.21.15.72:58324) 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 -- 172.21.15.72:0/1958145528 learned_addr learned my addr 172.21.15.72:0/1958145528 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 -- 172.21.15.72:0/1958145528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f9e0c50 con 0x56009f9e0260 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 --2- 172.21.15.72:0/1958145528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e0680 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbe800d5040 tx=0x7fbe800c0f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175526cc51783633 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbd677fe640 1 -- 172.21.15.72:0/1958145528 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800d2070 con 0x56009f9e0260 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbd677fe640 1 -- 172.21.15.72:0/1958145528 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe800f3070 con 0x56009f9e0260 2024-04-26T12:50:40.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbd677fe640 1 -- 172.21.15.72:0/1958145528 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800aad60 con 0x56009f9e0260 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- 172.21.15.72:0/1958145528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 msgr2=0x56009f9e0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 --2- 172.21.15.72:0/1958145528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e0680 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbe800d5040 tx=0x7fbe800c0f30 comp rx=0 tx=0).stop 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- 172.21.15.72:0/1958145528 shutdown_connections 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 --2- 172.21.15.72:0/1958145528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e0680 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- 172.21.15.72:0/1958145528 >> 172.21.15.72:0/1958145528 conn(0x56009f9dc5f0 msgr2=0x56009f9da650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- 172.21.15.72:0/1958145528 shutdown_connections 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- 172.21.15.72:0/1958145528 wait complete. 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 Processor -- start 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- start start 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe92a98980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56009f9e11c0 con 0x56009f9e0260 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58336/0 (socket says 172.21.15.72:58336) 2024-04-26T12:50:40.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 learned_addr learned my addr 172.21.15.72:0/2266822591 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.315+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009f9e7890 con 0x56009f9e0260 2024-04-26T12:50:40.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe905b3640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e7350 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe800d1ce0 tx=0x7fbe800bcf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbd65ffb640 1 -- 172.21.15.72:0/2266822591 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80108070 con 0x56009f9e0260 2024-04-26T12:50:40.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56009f9e7890 con 0x56009f9e0260 2024-04-26T12:50:40.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009f9e7d00 con 0x56009f9e0260 2024-04-26T12:50:40.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbd65ffb640 1 -- 172.21.15.72:0/2266822591 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe800be9f0 con 0x56009f9e0260 2024-04-26T12:50:40.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbd65ffb640 1 -- 172.21.15.72:0/2266822591 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80112060 con 0x56009f9e0260 2024-04-26T12:50:40.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbd65ffb640 1 -- 172.21.15.72:0/2266822591 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe8010b070 con 0x56009f9e0260 2024-04-26T12:50:40.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbd65ffb640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd580346a0 0x7fbd58036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbd65ffb640 1 -- 172.21.15.72:0/2266822591 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fbe800ff030 con 0x56009f9e0260 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd580346a0 0x7fbd58036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f9f2290 0x56009f9f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f4e30 con 0x56009f9f2290 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe90db4640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f9f2290 0x56009f9f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd580346a0 0x7fbd58036b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x56009f9bc930 tx=0x7fbe78010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe90db4640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f9f2290 0x56009f9f46e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 realm 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5240 con 0x56009f9f2290 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5ae0 con 0x56009f9f2290 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.319+0000 7fbe92a98980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9f6be0 0x56009f9f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f9670 con 0x56009f9f6be0 2024-04-26T12:50:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe905b3640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9f6be0 0x56009f9f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe905b3640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9f6be0 0x56009f9f8fd0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe92a98980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe92a98980 20 searching for the correct realm 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9fb550 0x56009f9fd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9fe040 con 0x56009f9fb550 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9fb550 0x56009f9fd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9fb550 0x56009f9fd9c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe87fff640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe78037040 0x7fbe78036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9fe040 con 0x7fbe78037040 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe90db4640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe78037040 0x7fbe78036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe90db4640 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe78037040 0x7fbe78036410 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4d0 con 0x7fbe78037040 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.323+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x7fbe78037040 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4d0 con 0x7fbe78037040 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x7fbe78037040 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4d0 con 0x7fbe78037040 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4d0 con 0x56009f9f2290 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.327+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x7fbe78037040 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe88032040 con 0x7fbe78037040 2024-04-26T12:50:40.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88032040 con 0x56009f9f2290 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe88032040 con 0x56009f9f2290 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.331+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x7fbe78037040 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88032040 con 0x7fbe78037040 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88032040 con 0x56009f9f2290 2024-04-26T12:50:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x7fbe78037040 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88032040 con 0x7fbe78037040 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9fb550 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.335+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f6be0 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x56009f9f2290 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe88032040 con 0x56009f9f2290 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f5e80 con 0x7fbe78037040 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88032040 con 0x7fbe78037040 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f9ec0 con 0x56009f9f2290 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe88032040 con 0x56009f9f2290 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f9ec0 con 0x56009f9f2290 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe88032040 con 0x56009f9f2290 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9f9ec0 con 0x56009f9fb550 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 zone default found 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 4 Realm: () 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 zonegroup default 2024-04-26T12:50:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009f9fa8d0 con 0x56009f9f6be0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009fa00350 con 0x56009f9fb550 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009fa006f0 con 0x56009f9fb550 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 started sync module instance, tier type = 2024-04-26T12:50:40.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:40.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.339+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009f9ff790 con 0x7fbe78037040 2024-04-26T12:50:40.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.343+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88032040 con 0x7fbe78037040 2024-04-26T12:50:40.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.343+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94560678050688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009f9fffa0 con 0x7fbe78037040 2024-04-26T12:50:40.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.343+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa00f40 con 0x56009f9f2290 2024-04-26T12:50:40.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.343+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94560678050688] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x7fbe78037040 2024-04-26T12:50:40.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.343+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.343+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94560678054544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa00eb0 con 0x56009f9f2290 2024-04-26T12:50:40.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.343+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa01cf0 con 0x56009f9fb550 2024-04-26T12:50:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94560678054544] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94560678056752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa02110 con 0x56009f9fb550 2024-04-26T12:50:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa02ad0 con 0x7fbe78037040 2024-04-26T12:50:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x7fbe78037040 2024-04-26T12:50:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94560678061872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa031a0 con 0x7fbe78037040 2024-04-26T12:50:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa03cc0 con 0x56009f9f2290 2024-04-26T12:50:40.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.347+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94560678056752] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94560678061872] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x7fbe78037040 2024-04-26T12:50:40.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94560678066064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa03c80 con 0x56009f9f2290 2024-04-26T12:50:40.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa040b0 con 0x56009f9f6be0 2024-04-26T12:50:40.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94560678066064] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94560678057808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa044a0 con 0x56009f9f6be0 2024-04-26T12:50:40.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.351+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa04d70 con 0x56009f9f6be0 2024-04-26T12:50:40.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94560678057808] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94560678063088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa04f70 con 0x56009f9f6be0 2024-04-26T12:50:40.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa057c0 con 0x56009f9f6be0 2024-04-26T12:50:40.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94560678063088] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94560678072688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa05be0 con 0x56009f9f6be0 2024-04-26T12:50:40.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 20 add_watcher() i=0 2024-04-26T12:50:40.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 20 add_watcher() i=1 2024-04-26T12:50:40.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 20 add_watcher() i=2 2024-04-26T12:50:40.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 20 add_watcher() i=3 2024-04-26T12:50:40.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 20 add_watcher() i=4 2024-04-26T12:50:40.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 20 add_watcher() i=5 2024-04-26T12:50:40.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.355+0000 7fbe92a98980 20 add_watcher() i=6 2024-04-26T12:50:40.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94560678072688] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe92a98980 20 add_watcher() i=7 2024-04-26T12:50:40.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe92a98980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:40.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009fa04560 con 0x56009f9f2290 2024-04-26T12:50:40.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94560678073968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa064b0 con 0x56009f9f2290 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94560678073968] v35'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbd467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe92a98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe92a98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.359+0000 7fbe92a98980 5 note: GC not initialized 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbd457e2640 20 reqs_thread_entry: start 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 20 Filter name: none 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbcb6ffd640 20 reqs_thread_entry: start 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2c400 con 0x56009f9f2290 2024-04-26T12:50:40.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 20 rados_obj.operate() r=0 bl.length=403 2024-04-26T12:50:40.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:40.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:40.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:40.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa325f0 con 0x56009f9f2290 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94560678256736 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2de80 con 0x56009f9f2290 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify (1) cookie 94560678066064 notify 150323855379 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fbe88018920 con 0x56009f9f2290 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbd677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94560678066064 notifier 4671 bl.length()=567 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbd677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbd677fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(64 notify.4 [notify cookie 94560678256736 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbd677fe640 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbd54003eb0 con 0x56009f9f2290 2024-04-26T12:50:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== watch-notify(notify_complete (2) cookie 94560678256736 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbe88018af0 con 0x56009f9f2290 2024-04-26T12:50:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.363+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.367 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:50:13.483410Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:50:13.483397Z","tags":[],"group_ids":[]} 2024-04-26T12:50:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbd467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94560678073968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x56009f9f2290 2024-04-26T12:50:40.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94560678073968] v35'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94560678050688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x7fbe78037040 2024-04-26T12:50:40.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94560678050688] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x7fbe78037040 2024-04-26T12:50:40.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbe92a98980 20 remove_watcher() i=0 2024-04-26T12:50:40.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbe92a98980 2 removed watcher, disabling cache 2024-04-26T12:50:40.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.367+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94560678054544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x56009f9f2290 2024-04-26T12:50:40.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.371+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94560678054544] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.371+0000 7fbe92a98980 20 remove_watcher() i=1 2024-04-26T12:50:40.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.371+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94560678056752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x56009f9fb550 2024-04-26T12:50:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.371+0000 7fbe87fff640 1 -- 172.21.15.72:0/2266822591 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94560678056752] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7800e620 con 0x56009f9fb550 2024-04-26T12:50:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.371+0000 7fbe92a98980 20 remove_watcher() i=2 2024-04-26T12:50:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.371+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94560678061872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x7fbe78037040 2024-04-26T12:50:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.375+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94560678061872] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x7fbe78037040 2024-04-26T12:50:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.375+0000 7fbe92a98980 20 remove_watcher() i=3 2024-04-26T12:50:40.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.375+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94560678066064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x56009f9f2290 2024-04-26T12:50:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.375+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94560678066064] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88040040 con 0x56009f9f2290 2024-04-26T12:50:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.375+0000 7fbe92a98980 20 remove_watcher() i=4 2024-04-26T12:50:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.375+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94560678057808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x56009f9f6be0 2024-04-26T12:50:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.379+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94560678057808] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.379+0000 7fbe92a98980 20 remove_watcher() i=5 2024-04-26T12:50:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.379+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94560678063088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x56009f9f6be0 2024-04-26T12:50:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94560678063088] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 20 remove_watcher() i=6 2024-04-26T12:50:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94560678072688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56009fa2a130 con 0x56009f9f6be0 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe905b3640 1 -- 172.21.15.72:0/2266822591 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94560678072688] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8010a030 con 0x56009f9f6be0 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 20 remove_watcher() i=7 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9f6be0 msgr2=0x56009f9f8fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9f6be0 0x56009f9f8fd0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f9f2290 msgr2=0x56009f9f46e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f9f2290 0x56009f9f46e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe78037040 msgr2=0x7fbe78036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fbe78037040 0x7fbe78036410 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9fb550 msgr2=0x56009f9fd9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9fb550 0x56009f9fd9c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd580346a0 msgr2=0x7fbd58036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd580346a0 0x7fbd58036b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x56009f9bc930 tx=0x7fbe78010000 comp rx=0 tx=0).stop 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe90db4640 1 -- 172.21.15.72:0/2266822591 reap_dead start 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 msgr2=0x56009f9e7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e7350 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe800d1ce0 tx=0x7fbe800bcf90 comp rx=0 tx=0).stop 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 shutdown_connections 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2266822591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9e0260 0x56009f9e7350 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 >> 172.21.15.72:0/2266822591 conn(0x56009f9dc5f0 msgr2=0x56009f9d9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 shutdown_connections 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/2266822591 wait complete. 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd68034650 msgr2=0x7fbd68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd68034650 0x7fbd68036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800bf60 tx=0x7fbe7800f000 comp rx=0 tx=0).stop 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9d32b0 msgr2=0x56009f9d36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9d32b0 0x56009f9d36d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe800e2bf0 tx=0x7fbe800b5fe0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 shutdown_connections 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd68034650 0x7fbd68036b10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 --2- 172.21.15.72:0/80921707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f9d32b0 0x56009f9d36d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 >> 172.21.15.72:0/80921707 conn(0x56009f9c80c0 msgr2=0x56009f9c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 shutdown_connections 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.383+0000 7fbe92a98980 1 -- 172.21.15.72:0/80921707 wait complete. 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9be7b0 msgr2=0x56009f9c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56009f9be7b0 0x56009f9c0ba0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f8c2e10 msgr2=0x56009f9bbdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56009f8c2e10 0x56009f9bbdf0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9c26f0 msgr2=0x56009f9c4ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56009f9c26f0 0x56009f9c4ae0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd780346a0 msgr2=0x7fbd78036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fbd780346a0 0x7fbd78036b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f70 tx=0x7fbe780012c0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 msgr2=0x56009f9b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 --2- 172.21.15.72:0/2868565857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56009f8c24f0 0x56009f9b4f50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbe800b9040 tx=0x7fbe80018020 comp rx=0 tx=0).stop 2024-04-26T12:50:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe90db4640 1 -- 172.21.15.72:0/2868565857 reap_dead start 2024-04-26T12:50:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 shutdown_connections 2024-04-26T12:50:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 >> 172.21.15.72:0/2868565857 conn(0x56009f835bd0 msgr2=0x56009f9a83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 shutdown_connections 2024-04-26T12:50:40.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.387+0000 7fbe92a98980 1 -- 172.21.15.72:0/2868565857 wait complete. 2024-04-26T12:50:40.398 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:50:13.483410Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:50:13.483397Z', 'tags': [], 'group_ids': []} 2024-04-26T12:50:40.414 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:40.414 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T12:50:40.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T12:50:40.414 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T12:50:40.474 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:50:40.474 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:50:40.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc832bfe980 1 Processor -- start 2024-04-26T12:50:40.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc832bfe980 1 -- start start 2024-04-26T12:50:40.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc832bfe980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5578bab66700 0x5578bab68af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc832bfe980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578baa10510 con 0x5578bab621a0 2024-04-26T12:50:40.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc832bfe980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5578baa17430 con 0x5578bab66700 2024-04-26T12:50:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc82ff18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5578bab66700 0x5578bab68af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc830719640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5578bab621a0 0x5578bab62580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48272/0 (socket says 172.21.15.72:48272) 2024-04-26T12:50:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc82ff18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5578bab66700 0x5578bab68af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58342/0 (socket says 172.21.15.72:58342) 2024-04-26T12:50:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc830719640 1 -- 172.21.15.72:0/1879305596 learned_addr learned my addr 172.21.15.72:0/1879305596 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:50:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc82ff18640 1 -- 172.21.15.72:0/1879305596 >> v1:172.21.15.29:6789/0 conn(0x5578bab621a0 legacy=0x5578bab62580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.475+0000 7fc82ff18640 1 -- 172.21.15.72:0/1879305596 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578ba9ecae0 con 0x5578bab66700 2024-04-26T12:50:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc82ff18640 1 --2- 172.21.15.72:0/1879305596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab66700 0x5578bab68af0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc81800a480 tx=0x7fc81801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfdcabc161e928c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc82f717640 1 -- 172.21.15.72:0/1879305596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8180b0070 con 0x5578bab66700 2024-04-26T12:50:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc82f717640 1 -- 172.21.15.72:0/1879305596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8180ab540 con 0x5578bab66700 2024-04-26T12:50:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc82f717640 1 -- 172.21.15.72:0/1879305596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8180ab840 con 0x5578bab66700 2024-04-26T12:50:40.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc832bfe980 1 -- 172.21.15.72:0/1879305596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab66700 msgr2=0x5578bab68af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1879305596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab66700 0x5578bab68af0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc81800a480 tx=0x7fc81801b280 comp rx=0 tx=0).stop 2024-04-26T12:50:40.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc832bfe980 1 -- 172.21.15.72:0/1879305596 shutdown_connections 2024-04-26T12:50:40.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1879305596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab66700 0x5578bab68af0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc832bfe980 1 -- 172.21.15.72:0/1879305596 >> 172.21.15.72:0/1879305596 conn(0x5578bab5da70 msgr2=0x5578bab5fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc832bfe980 1 -- 172.21.15.72:0/1879305596 shutdown_connections 2024-04-26T12:50:40.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.479+0000 7fc832bfe980 1 -- 172.21.15.72:0/1879305596 wait complete. 2024-04-26T12:50:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc832bfe980 1 Processor -- start 2024-04-26T12:50:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc832bfe980 1 -- start start 2024-04-26T12:50:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc832bfe980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578baad6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc832bfe980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5578baa66a70 con 0x5578bab621a0 2024-04-26T12:50:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578baad6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578baad6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58358/0 (socket says 172.21.15.72:58358) 2024-04-26T12:50:40.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc830719640 1 -- 172.21.15.72:0/2221419622 learned_addr learned my addr 172.21.15.72:0/2221419622 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc830719640 1 -- 172.21.15.72:0/2221419622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578baad6cd0 con 0x5578bab621a0 2024-04-26T12:50:40.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc830719640 1 --2- 172.21.15.72:0/2221419622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578baad6700 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc8200015f0 tx=0x7fc820001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0670c03b908d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc71e60c640 1 -- 172.21.15.72:0/2221419622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820004530 con 0x5578bab621a0 2024-04-26T12:50:40.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc71e60c640 1 -- 172.21.15.72:0/2221419622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8200046f0 con 0x5578bab621a0 2024-04-26T12:50:40.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc71e60c640 1 -- 172.21.15.72:0/2221419622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820004a90 con 0x5578bab621a0 2024-04-26T12:50:40.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc832bfe980 1 -- 172.21.15.72:0/2221419622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 msgr2=0x5578baad6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.495+0000 7fc832bfe980 1 --2- 172.21.15.72:0/2221419622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578baad6700 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc8200015f0 tx=0x7fc820001ab0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- 172.21.15.72:0/2221419622 shutdown_connections 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 --2- 172.21.15.72:0/2221419622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578baad6700 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- 172.21.15.72:0/2221419622 >> 172.21.15.72:0/2221419622 conn(0x5578bab5da70 msgr2=0x5578bac48f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- 172.21.15.72:0/2221419622 shutdown_connections 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- 172.21.15.72:0/2221419622 wait complete. 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 Processor -- start 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- start start 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578bac55760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5578bab6bb20 con 0x5578bab621a0 2024-04-26T12:50:40.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578bac55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578bac55760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58370/0 (socket says 172.21.15.72:58370) 2024-04-26T12:50:40.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc830719640 1 -- 172.21.15.72:0/332036731 learned_addr learned my addr 172.21.15.72:0/332036731 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc830719640 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bac55ca0 con 0x5578bab621a0 2024-04-26T12:50:40.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc830719640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578bac55760 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5578bac4f360 tx=0x7fc820000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc71ce09640 1 -- 172.21.15.72:0/332036731 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820013760 con 0x5578bab621a0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc71ce09640 1 -- 172.21.15.72:0/332036731 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc820013900 con 0x5578bab621a0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578bac55f30 con 0x5578bab621a0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc71ce09640 1 -- 172.21.15.72:0/332036731 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820013be0 con 0x5578bab621a0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578bac58b20 con 0x5578bab621a0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc71ce09640 1 -- 172.21.15.72:0/332036731 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc820010070 con 0x5578bab621a0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc71ce09640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc718034650 0x7fc718036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.499+0000 7fc71ce09640 1 -- 172.21.15.72:0/332036731 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fc820018070 con 0x5578bab621a0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc82ff18640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc718034650 0x7fc718036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bab66700 0x5578bac5c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac5ccf0 con 0x5578bab66700 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830f1a640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bab66700 0x5578bac5c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830f1a640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bab66700 0x5578bac5c680 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc82ff18640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc718034650 0x7fc718036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8180ad000 tx=0x7fc8180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830f1a640 1 -- 172.21.15.72:0/332036731 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bab66700 2024-04-26T12:50:40.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac59d20 con 0x5578bab66700 2024-04-26T12:50:40.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830f1a640 1 -- 172.21.15.72:0/332036731 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bab66700 2024-04-26T12:50:40.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac5f070 0x5578bac61460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac61b50 con 0x5578bac5f070 2024-04-26T12:50:40.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830719640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac5f070 0x5578bac61460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830719640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac5f070 0x5578bac61460 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830719640 1 -- 172.21.15.72:0/332036731 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac5f070 2024-04-26T12:50:40.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac5df10 con 0x5578bab66700 2024-04-26T12:50:40.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc830f1a640 1 -- 172.21.15.72:0/332036731 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bab66700 2024-04-26T12:50:40.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac62fb0 0x5578bac653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.503+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac65ae0 con 0x5578bac62fb0 2024-04-26T12:50:40.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc82ff18640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac62fb0 0x5578bac653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc82ff18640 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac62fb0 0x5578bac653a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc82ff18640 1 -- 172.21.15.72:0/332036731 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8180abc50 con 0x5578bac62fb0 2024-04-26T12:50:40.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc832bfe980 1 Processor -- start 2024-04-26T12:50:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc832bfe980 1 -- start start 2024-04-26T12:50:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc832bfe980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac73b30 0x5578bac73f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc832bfe980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5578baa6aab0 con 0x5578bac73b30 2024-04-26T12:50:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac73b30 0x5578bac73f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac73b30 0x5578bac73f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58386/0 (socket says 172.21.15.72:58386) 2024-04-26T12:50:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc830719640 1 -- 172.21.15.72:0/3332437973 learned_addr learned my addr 172.21.15.72:0/3332437973 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc830719640 1 -- 172.21.15.72:0/3332437973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bac74490 con 0x5578bac73b30 2024-04-26T12:50:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc830719640 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac73b30 0x5578bac73f50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc8200483b0 tx=0x7fc820012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc715ffb640 1 -- 172.21.15.72:0/3332437973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820039030 con 0x5578bac73b30 2024-04-26T12:50:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc715ffb640 1 -- 172.21.15.72:0/3332437973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8200413d0 con 0x5578bac73b30 2024-04-26T12:50:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578bac74f30 con 0x5578bac73b30 2024-04-26T12:50:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc715ffb640 1 -- 172.21.15.72:0/3332437973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820043040 con 0x5578bac73b30 2024-04-26T12:50:40.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.507+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578bac75400 con 0x5578bac73b30 2024-04-26T12:50:40.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc715ffb640 1 -- 172.21.15.72:0/3332437973 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc820041a10 con 0x5578bac73b30 2024-04-26T12:50:40.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc715ffb640 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc708034650 0x7fc708036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc715ffb640 1 -- 172.21.15.72:0/3332437973 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fc82003d070 con 0x5578bac73b30 2024-04-26T12:50:40.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc82ff18640 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc708034650 0x7fc708036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 Processor -- start 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- start start 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac80f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5578baad7020 con 0x5578bac80b50 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc82ff18640 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc708034650 0x7fc708036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5578bac5d210 tx=0x7fc818005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac80f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac80f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58398/0 (socket says 172.21.15.72:58398) 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc830719640 1 -- 172.21.15.72:0/2708421740 learned_addr learned my addr 172.21.15.72:0/2708421740 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc830719640 1 -- 172.21.15.72:0/2708421740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bac81520 con 0x5578bac80b50 2024-04-26T12:50:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc830719640 1 --2- 172.21.15.72:0/2708421740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac80f50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc82002bff0 tx=0x7fc82004f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65e39620e9d184b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc70f7fe640 1 -- 172.21.15.72:0/2708421740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820028d10 con 0x5578bac80b50 2024-04-26T12:50:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc70f7fe640 1 -- 172.21.15.72:0/2708421740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8200287f0 con 0x5578bac80b50 2024-04-26T12:50:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc70f7fe640 1 -- 172.21.15.72:0/2708421740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8200080e0 con 0x5578bac80b50 2024-04-26T12:50:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- 172.21.15.72:0/2708421740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 msgr2=0x5578bac80f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 --2- 172.21.15.72:0/2708421740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac80f50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc82002bff0 tx=0x7fc82004f440 comp rx=0 tx=0).stop 2024-04-26T12:50:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- 172.21.15.72:0/2708421740 shutdown_connections 2024-04-26T12:50:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 --2- 172.21.15.72:0/2708421740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac80f50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- 172.21.15.72:0/2708421740 >> 172.21.15.72:0/2708421740 conn(0x5578bac7ce90 msgr2=0x5578bac7aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- 172.21.15.72:0/2708421740 shutdown_connections 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- 172.21.15.72:0/2708421740 wait complete. 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 Processor -- start 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.511+0000 7fc832bfe980 1 -- start start 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc832bfe980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac4ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc832bfe980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5578bac81c00 con 0x5578bac80b50 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac4ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc830719640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac4ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:58404/0 (socket says 172.21.15.72:58404) 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 learned_addr learned my addr 172.21.15.72:0/1691744565 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bac4d2d0 con 0x5578bac80b50 2024-04-26T12:50:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc830719640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac4ebb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc8200471b0 tx=0x7fc82002ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc70dffb640 1 -- 172.21.15.72:0/1691744565 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820074070 con 0x5578bac80b50 2024-04-26T12:50:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578bac4d2d0 con 0x5578bac80b50 2024-04-26T12:50:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc70dffb640 1 -- 172.21.15.72:0/1691744565 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc820041f10 con 0x5578bac80b50 2024-04-26T12:50:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578bac4d740 con 0x5578bac80b50 2024-04-26T12:50:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc70dffb640 1 -- 172.21.15.72:0/1691744565 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820034b10 con 0x5578bac80b50 2024-04-26T12:50:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc70dffb640 1 -- 172.21.15.72:0/1691744565 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc820034cb0 con 0x5578bac80b50 2024-04-26T12:50:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc70dffb640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc700034650 0x7fc700036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc70dffb640 1 -- 172.21.15.72:0/1691744565 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fc82006c070 con 0x5578bac80b50 2024-04-26T12:50:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc82ff18640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc700034650 0x7fc700036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bac950a0 0x5578bac97560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac97cb0 con 0x5578bac950a0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc830f1a640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bac950a0 0x5578bac97560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.515+0000 7fc82ff18640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc700034650 0x7fc700036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc8180ca040 tx=0x7fc8180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830f1a640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bac950a0 0x5578bac97560 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bac950a0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 realm 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac980c0 con 0x5578bac950a0 2024-04-26T12:50:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bac950a0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98990 con 0x5578bac950a0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bac950a0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac950a0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bac950a0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac99a90 0x5578bac9be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac9c450 con 0x5578bac99a90 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830719640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac99a90 0x5578bac9be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830719640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac99a90 0x5578bac9be80 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 20 searching for the correct realm 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac9e3a0 0x5578baca07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578baca0ea0 con 0x5578bac9e3a0 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc82ff18640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac9e3a0 0x5578baca07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.519+0000 7fc82ff18640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac9e3a0 0x5578baca07d0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc82ff18640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc8180ab030 0x7fc8180d3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:50:40.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578baca0ea0 con 0x7fc8180ab030 2024-04-26T12:50:40.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc8180ab030 0x7fc8180d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc8180ab030 0x7fc8180d3910 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8280083f0 con 0x7fc8180ab030 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac99a90 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac950a0 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8280083f0 con 0x5578bac950a0 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac950a0 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac99a90 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac99a90 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.523+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x7fc8180ab030 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac9e3a0 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac950a0 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x7fc8180ab030 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac950a0 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x7fc8180ab030 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac9e3a0 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac9e3a0 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac99a90 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac9e3a0 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac9e3a0 2024-04-26T12:50:40.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.527+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac950a0 2024-04-26T12:50:40.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac950a0 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac99a90 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac9e3a0 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x7fc8180ab030 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac950a0 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac99a90 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac9e3a0 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac99a90 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.531+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x7fc8180ab030 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac9e3a0 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac99a90 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x5578bac950a0 2024-04-26T12:50:40.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fc82802b040 con 0x7fc8180ab030 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac950a0 2024-04-26T12:50:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac950a0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac98d30 con 0x5578bac9e3a0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 zone default found 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 4 Realm: () 2024-04-26T12:50:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 zonegroup default 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bac9d2c0 con 0x5578bac99a90 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.535+0000 7fc832bfe980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578baca2d00 con 0x5578bac9e3a0 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578baca30a0 con 0x5578bac9e3a0 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 20 started sync module instance, tier type = 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca21a0 con 0x7fc8180ab030 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93977018246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca21a0 con 0x7fc8180ab030 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca3930 con 0x5578bac950a0 2024-04-26T12:50:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.539+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93977018246592] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.543+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.543+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93977018250304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca21a0 con 0x5578bac950a0 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.543+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca4340 con 0x5578bac9e3a0 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.543+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93977018250304] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.543+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.543+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93977018244336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca2110 con 0x5578bac9e3a0 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.543+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca5090 con 0x7fc8180ab030 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93977018256624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca5930 con 0x7fc8180ab030 2024-04-26T12:50:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca62f0 con 0x5578bac950a0 2024-04-26T12:50:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93977018244336] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93977018256624] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93977018261056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca58a0 con 0x5578bac950a0 2024-04-26T12:50:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.547+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca6260 con 0x5578bac99a90 2024-04-26T12:50:40.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93977018261056] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93977018258688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca6b90 con 0x5578bac99a90 2024-04-26T12:50:40.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca73e0 con 0x5578bac99a90 2024-04-26T12:50:40.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93977018264944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca7800 con 0x5578bac99a90 2024-04-26T12:50:40.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca8320 con 0x5578bac99a90 2024-04-26T12:50:40.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.551+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93977018258688] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93977018264944] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93977018269168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca7250 con 0x5578bac99a90 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=0 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=1 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=2 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=3 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=4 2024-04-26T12:50:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=5 2024-04-26T12:50:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=6 2024-04-26T12:50:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93977018269168] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 20 add_watcher() i=7 2024-04-26T12:50:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 2 all 8 watchers are set, enabling cache 2024-04-26T12:50:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.555+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bacab310 con 0x5578bac950a0 2024-04-26T12:50:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93977018263184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca87c0 con 0x5578bac950a0 2024-04-26T12:50:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93977018263184] v35'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc6e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc832bfe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:50:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc832bfe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:50:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb3ca0 con 0x5578bac950a0 2024-04-26T12:50:40.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.559+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb42f0 con 0x5578bac99a90 2024-04-26T12:50:40.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.563+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.563+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb42f0 con 0x5578bac9e3a0 2024-04-26T12:50:40.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.563+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.563+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb4dd0 con 0x5578bac950a0 2024-04-26T12:50:40.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.567+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'192 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.567+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacaf980 con 0x7fc8180ab030 2024-04-26T12:50:40.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.567+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.567+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacaf980 con 0x5578bac9e3a0 2024-04-26T12:50:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.567+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.567+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb5b00 con 0x5578bac950a0 2024-04-26T12:50:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.571+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.571+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb5b00 con 0x5578bac99a90 2024-04-26T12:50:40.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.575+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.575+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb5b00 con 0x7fc8180ab030 2024-04-26T12:50:40.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.575+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.575+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb5b00 con 0x5578bac9e3a0 2024-04-26T12:50:40.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.575+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.579+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb5f00 con 0x7fc8180ab030 2024-04-26T12:50:40.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.579+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.579+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb5db0 con 0x5578bac99a90 2024-04-26T12:50:40.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.583+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.583+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacafb50 con 0x7fc8180ab030 2024-04-26T12:50:40.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.583+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.583+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacafb50 con 0x5578bac99a90 2024-04-26T12:50:40.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.587+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.587+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacafb50 con 0x5578bac950a0 2024-04-26T12:50:40.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.587+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'193 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.587+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacafb50 con 0x5578bac9e3a0 2024-04-26T12:50:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.591+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'60 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.591+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacafb50 con 0x7fc8180ab030 2024-04-26T12:50:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.591+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.591+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb61f0 con 0x5578bac9e3a0 2024-04-26T12:50:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.591+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.591+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb61f0 con 0x5578bac950a0 2024-04-26T12:50:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.595+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.595+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb61f0 con 0x5578bac950a0 2024-04-26T12:50:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.599+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'194 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.599+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb61f0 con 0x5578bac9e3a0 2024-04-26T12:50:40.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.599+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'61 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.599+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb6280 con 0x7fc8180ab030 2024-04-26T12:50:40.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.603+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.603+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb6450 con 0x5578bac9e3a0 2024-04-26T12:50:40.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.603+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.603+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb6450 con 0x5578bac9e3a0 2024-04-26T12:50:40.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.603+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.603+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb63c0 con 0x5578bac9e3a0 2024-04-26T12:50:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.607+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.607+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb63c0 con 0x5578bac9e3a0 2024-04-26T12:50:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.607+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.607+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb68d0 con 0x5578bac99a90 2024-04-26T12:50:40.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.611+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.611+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb68d0 con 0x5578bac9e3a0 2024-04-26T12:50:40.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.611+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.611+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb68d0 con 0x5578bac99a90 2024-04-26T12:50:40.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.615+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.615+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacaf4d0 con 0x5578bac9e3a0 2024-04-26T12:50:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.615+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'62 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.615+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacaf4d0 con 0x5578bac99a90 2024-04-26T12:50:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.619+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.619+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacaf4d0 con 0x7fc8180ab030 2024-04-26T12:50:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc6e57e2640 20 reqs_thread_entry: start 2024-04-26T12:50:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 20 init_complete bucket index max shards: 11 2024-04-26T12:50:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 20 Filter name: none 2024-04-26T12:50:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc65effd640 20 reqs_thread_entry: start 2024-04-26T12:50:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:50:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 20 rados->read ofs=0 len=0 2024-04-26T12:50:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bacd1900 con 0x5578bac950a0 2024-04-26T12:50:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:50:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:50:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:50:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:50:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578bacd3dd0 con 0x7fc8180ab030 2024-04-26T12:50:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv53 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T12:50:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc6e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:50:40.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.623+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93977018263184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578bacb0920 con 0x5578bac950a0 2024-04-26T12:50:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.627+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93977018263184] v35'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.627+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93977018246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca6690 con 0x7fc8180ab030 2024-04-26T12:50:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.627+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93977018246592] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.627+0000 7fc832bfe980 20 remove_watcher() i=0 2024-04-26T12:50:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.627+0000 7fc832bfe980 2 removed watcher, disabling cache 2024-04-26T12:50:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.627+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93977018250304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca25c0 con 0x5578bac950a0 2024-04-26T12:50:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.631+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93977018250304] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.631+0000 7fc832bfe980 20 remove_watcher() i=1 2024-04-26T12:50:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.631+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93977018244336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca25c0 con 0x5578bac9e3a0 2024-04-26T12:50:40.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.631+0000 7fc82ff18640 1 -- 172.21.15.72:0/1691744565 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93977018244336] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8180da040 con 0x5578bac9e3a0 2024-04-26T12:50:40.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.631+0000 7fc832bfe980 20 remove_watcher() i=2 2024-04-26T12:50:40.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.631+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93977018256624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca1cf0 con 0x7fc8180ab030 2024-04-26T12:50:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.635+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93977018256624] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x7fc8180ab030 2024-04-26T12:50:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.635+0000 7fc832bfe980 20 remove_watcher() i=3 2024-04-26T12:50:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.635+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93977018261056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca25c0 con 0x5578bac950a0 2024-04-26T12:50:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.635+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93977018261056] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828026040 con 0x5578bac950a0 2024-04-26T12:50:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.635+0000 7fc832bfe980 20 remove_watcher() i=4 2024-04-26T12:50:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.635+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93977018258688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca4cf0 con 0x5578bac99a90 2024-04-26T12:50:40.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.639+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93977018258688] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.639+0000 7fc832bfe980 20 remove_watcher() i=5 2024-04-26T12:50:40.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.639+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93977018264944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca1cf0 con 0x5578bac99a90 2024-04-26T12:50:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.639+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93977018264944] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.639+0000 7fc832bfe980 20 remove_watcher() i=6 2024-04-26T12:50:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.639+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93977018269168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578baca5e40 con 0x5578bac99a90 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc830719640 1 -- 172.21.15.72:0/1691744565 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93977018269168] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82001b030 con 0x5578bac99a90 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 20 remove_watcher() i=7 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac99a90 msgr2=0x5578bac9be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac99a90 0x5578bac9be80 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bac950a0 msgr2=0x5578bac97560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bac950a0 0x5578bac97560 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc8180ab030 msgr2=0x7fc8180d3910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fc8180ab030 0x7fc8180d3910 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac9e3a0 msgr2=0x5578baca07d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac9e3a0 0x5578baca07d0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc700034650 msgr2=0x7fc700036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc700034650 0x7fc700036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc8180ca040 tx=0x7fc8180a6000 comp rx=0 tx=0).stop 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 msgr2=0x5578bac4ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac4ebb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc8200471b0 tx=0x7fc82002ba40 comp rx=0 tx=0).stop 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc830f1a640 1 -- 172.21.15.72:0/1691744565 reap_dead start 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 shutdown_connections 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/1691744565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac80b50 0x5578bac4ebb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 >> 172.21.15.72:0/1691744565 conn(0x5578bac7ce90 msgr2=0x5578bac7a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 shutdown_connections 2024-04-26T12:50:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/1691744565 wait complete. 2024-04-26T12:50:40.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc708034650 msgr2=0x7fc708036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc708034650 0x7fc708036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5578bac5d210 tx=0x7fc818005a10 comp rx=0 tx=0).stop 2024-04-26T12:50:40.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac73b30 msgr2=0x5578bac73f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac73b30 0x5578bac73f50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc8200483b0 tx=0x7fc820012ef0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 shutdown_connections 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc708034650 0x7fc708036b10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 --2- 172.21.15.72:0/3332437973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bac73b30 0x5578bac73f50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 >> 172.21.15.72:0/3332437973 conn(0x5578bac68940 msgr2=0x5578bac69450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 shutdown_connections 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/3332437973 wait complete. 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.643+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac5f070 msgr2=0x5578bac61460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5578bac5f070 0x5578bac61460 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bab66700 msgr2=0x5578bac5c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5578bab66700 0x5578bac5c680 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac62fb0 msgr2=0x5578bac653a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5578bac62fb0 0x5578bac653a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc718034650 msgr2=0x7fc718036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc718034650 0x7fc718036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8180ad000 tx=0x7fc8180a5040 comp rx=0 tx=0).stop 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 msgr2=0x5578bac55760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 --2- 172.21.15.72:0/332036731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5578bab621a0 0x5578bac55760 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5578bac4f360 tx=0x7fc820000f50 comp rx=0 tx=0).stop 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc830f1a640 1 -- 172.21.15.72:0/332036731 reap_dead start 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 shutdown_connections 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 >> 172.21.15.72:0/332036731 conn(0x5578bab5da70 msgr2=0x5578bac47a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 shutdown_connections 2024-04-26T12:50:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:50:40.647+0000 7fc832bfe980 1 -- 172.21.15.72:0/332036731 wait complete. 2024-04-26T12:50:40.658 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:50:40.682 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:50:40.688 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-26T12:51:15.689 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-26T12:51:15.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-26T12:51:15.690 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-26T12:51:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:15.730 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01bb41f980 1 Processor -- start 2024-04-26T12:51:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01bb41f980 1 -- start start 2024-04-26T12:51:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01bb41f980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565187d9f030 0x565187e2df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01bb41f980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565187cd8510 con 0x565187e2e490 2024-04-26T12:51:15.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01bb41f980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x565187cdf430 con 0x565187d9f030 2024-04-26T12:51:15.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01b8f3a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565187d9f030 0x565187e2df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01b8f3a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x565187d9f030 0x565187e2df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42020/0 (socket says 172.21.15.72:42020) 2024-04-26T12:51:15.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01b8739640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x565187e2e490 0x565187e30880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:49924/0 (socket says 172.21.15.72:49924) 2024-04-26T12:51:15.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01b8f3a640 1 -- 172.21.15.72:0/1096869341 learned_addr learned my addr 172.21.15.72:0/1096869341 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01b8f3a640 1 -- 172.21.15.72:0/1096869341 >> v1:172.21.15.29:6789/0 conn(0x565187e2e490 legacy=0x565187e30880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.730+0000 7f01b8f3a640 1 -- 172.21.15.72:0/1096869341 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565187cb4ae0 con 0x565187d9f030 2024-04-26T12:51:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/1096869341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187e2df50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f01a800a5c0 tx=0x7f01a801b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f468a3e4b2215c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01b7f38640 1 -- 172.21.15.72:0/1096869341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80af070 con 0x565187d9f030 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01b7f38640 1 -- 172.21.15.72:0/1096869341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80aa530 con 0x565187d9f030 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01b7f38640 1 -- 172.21.15.72:0/1096869341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80aa830 con 0x565187d9f030 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01bb41f980 1 -- 172.21.15.72:0/1096869341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 msgr2=0x565187e2df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01bb41f980 1 --2- 172.21.15.72:0/1096869341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187e2df50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f01a800a5c0 tx=0x7f01a801b1d0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01bb41f980 1 -- 172.21.15.72:0/1096869341 shutdown_connections 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01bb41f980 1 --2- 172.21.15.72:0/1096869341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187e2df50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01bb41f980 1 -- 172.21.15.72:0/1096869341 >> 172.21.15.72:0/1096869341 conn(0x565187e25a70 msgr2=0x565187e27e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01bb41f980 1 -- 172.21.15.72:0/1096869341 shutdown_connections 2024-04-26T12:51:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.734+0000 7f01bb41f980 1 -- 172.21.15.72:0/1096869341 wait complete. 2024-04-26T12:51:15.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01bb41f980 1 Processor -- start 2024-04-26T12:51:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01bb41f980 1 -- start start 2024-04-26T12:51:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01bb41f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f16530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01bb41f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565187d2ea70 con 0x565187d9f030 2024-04-26T12:51:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f16530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f16530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42032/0 (socket says 172.21.15.72:42032) 2024-04-26T12:51:15.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01b8f3a640 1 -- 172.21.15.72:0/3028109085 learned_addr learned my addr 172.21.15.72:0/3028109085 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01b8f3a640 1 -- 172.21.15.72:0/3028109085 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565187f16b00 con 0x565187d9f030 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/3028109085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f16530 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f01a8018e00 tx=0x7f01a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4058bab50131dfec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f00a6e0d640 1 -- 172.21.15.72:0/3028109085 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80af040 con 0x565187d9f030 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f00a6e0d640 1 -- 172.21.15.72:0/3028109085 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80aa9c0 con 0x565187d9f030 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.750+0000 7f00a6e0d640 1 -- 172.21.15.72:0/3028109085 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80aacc0 con 0x565187d9f030 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- 172.21.15.72:0/3028109085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 msgr2=0x565187f16530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 --2- 172.21.15.72:0/3028109085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f16530 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f01a8018e00 tx=0x7f01a8003030 comp rx=0 tx=0).stop 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- 172.21.15.72:0/3028109085 shutdown_connections 2024-04-26T12:51:15.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 --2- 172.21.15.72:0/3028109085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f16530 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- 172.21.15.72:0/3028109085 >> 172.21.15.72:0/3028109085 conn(0x565187e25a70 msgr2=0x565187f120c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- 172.21.15.72:0/3028109085 shutdown_connections 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- 172.21.15.72:0/3028109085 wait complete. 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 Processor -- start 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- start start 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f1d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565187e32ab0 con 0x565187d9f030 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f1d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f1d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42048/0 (socket says 172.21.15.72:42048) 2024-04-26T12:51:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01b8f3a640 1 -- 172.21.15.72:0/429152699 learned_addr learned my addr 172.21.15.72:0/429152699 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01b8f3a640 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565187f1dc10 con 0x565187d9f030 2024-04-26T12:51:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f1d6d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f01a801b210 tx=0x7f01a8017f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f00a560a640 1 -- 172.21.15.72:0/429152699 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80c3020 con 0x565187d9f030 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f00a560a640 1 -- 172.21.15.72:0/429152699 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80b5bb0 con 0x565187d9f030 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565187f1dea0 con 0x565187d9f030 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f00a560a640 1 -- 172.21.15.72:0/429152699 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80af070 con 0x565187d9f030 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565187f20ad0 con 0x565187d9f030 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.754+0000 7f00a560a640 1 -- 172.21.15.72:0/429152699 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01a80c6020 con 0x565187d9f030 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f00a560a640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00a00346a0 0x7f00a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f00a560a640 1 -- 172.21.15.72:0/429152699 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f01a80ba070 con 0x565187d9f030 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b8739640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00a00346a0 0x7f00a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187e2e490 0x565187f245b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f24c00 con 0x565187e2e490 2024-04-26T12:51:15.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b973b640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187e2e490 0x565187f245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b8739640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00a00346a0 0x7f00a0036b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0017b0 tx=0x7f01ac0066a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b973b640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187e2e490 0x565187f245b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b973b640 1 -- 172.21.15.72:0/429152699 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01b00083f0 con 0x565187e2e490 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f21cd0 con 0x565187e2e490 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b973b640 1 -- 172.21.15.72:0/429152699 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01b00083f0 con 0x565187e2e490 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f26f40 0x565187f29330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f29a20 con 0x565187f26f40 2024-04-26T12:51:15.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f26f40 0x565187f29330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f26f40 0x565187f29330 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b8f3a640 1 -- 172.21.15.72:0/429152699 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01a80b2040 con 0x565187f26f40 2024-04-26T12:51:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f25de0 con 0x565187e2e490 2024-04-26T12:51:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01b973b640 1 -- 172.21.15.72:0/429152699 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01b00083f0 con 0x565187e2e490 2024-04-26T12:51:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f2ae80 0x565187f2d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.758+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f2d9b0 con 0x565187f2ae80 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8739640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f2ae80 0x565187f2d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8739640 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f2ae80 0x565187f2d270 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8739640 1 -- 172.21.15.72:0/429152699 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01ac00f070 con 0x565187f2ae80 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01bb41f980 1 Processor -- start 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01bb41f980 1 -- start start 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01bb41f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187f3ba40 0x565187f3be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01bb41f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565187d32ab0 con 0x565187f3ba40 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187f3ba40 0x565187f3be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187f3ba40 0x565187f3be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42062/0 (socket says 172.21.15.72:42062) 2024-04-26T12:51:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8f3a640 1 -- 172.21.15.72:0/1284872148 learned_addr learned my addr 172.21.15.72:0/1284872148 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8f3a640 1 -- 172.21.15.72:0/1284872148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565187f3c3a0 con 0x565187f3ba40 2024-04-26T12:51:15.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187f3ba40 0x565187f3be60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f01a80e2f50 tx=0x7f01a80bd360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f009e7fc640 1 -- 172.21.15.72:0/1284872148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80b49e0 con 0x565187f3ba40 2024-04-26T12:51:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565187f3ce40 con 0x565187f3ba40 2024-04-26T12:51:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f009e7fc640 1 -- 172.21.15.72:0/1284872148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80b4b80 con 0x565187f3ba40 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f009e7fc640 1 -- 172.21.15.72:0/1284872148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80b4ea0 con 0x565187f3ba40 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.762+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565187f3d310 con 0x565187f3ba40 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f009e7fc640 1 -- 172.21.15.72:0/1284872148 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01a80bf470 con 0x565187f3ba40 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f009e7fc640 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0090034650 0x7f0090036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f009e7fc640 1 -- 172.21.15.72:0/1284872148 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f01a80dd070 con 0x565187f3ba40 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01b8739640 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0090034650 0x7f0090036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 Processor -- start 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 -- start start 2024-04-26T12:51:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01b8739640 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0090034650 0x7f0090036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x565187f29df0 tx=0x7f01ac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187e2b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565187f16d90 con 0x565187e2b500 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187e2b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187e2b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42078/0 (socket says 172.21.15.72:42078) 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01b8f3a640 1 -- 172.21.15.72:0/3893197149 learned_addr learned my addr 172.21.15.72:0/3893197149 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01b8f3a640 1 -- 172.21.15.72:0/3893197149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565187e29d30 con 0x565187e2b500 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/3893197149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187e2b900 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f01a80effd0 tx=0x7f01a80bdea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7459b55e89bf8868 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f008ffff640 1 -- 172.21.15.72:0/3893197149 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80fb020 con 0x565187e2b500 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f008ffff640 1 -- 172.21.15.72:0/3893197149 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80c9410 con 0x565187e2b500 2024-04-26T12:51:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f008ffff640 1 -- 172.21.15.72:0/3893197149 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80bf990 con 0x565187e2b500 2024-04-26T12:51:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 -- 172.21.15.72:0/3893197149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 msgr2=0x565187e2b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 --2- 172.21.15.72:0/3893197149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187e2b900 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f01a80effd0 tx=0x7f01a80bdea0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 -- 172.21.15.72:0/3893197149 shutdown_connections 2024-04-26T12:51:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 --2- 172.21.15.72:0/3893197149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187e2b900 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 -- 172.21.15.72:0/3893197149 >> 172.21.15.72:0/3893197149 conn(0x565187f44ba0 msgr2=0x565187f42c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 -- 172.21.15.72:0/3893197149 shutdown_connections 2024-04-26T12:51:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 -- 172.21.15.72:0/3893197149 wait complete. 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.766+0000 7f01bb41f980 1 Processor -- start 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 1 -- start start 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187f51cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x565187e2a0e0 con 0x565187e2b500 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187f51cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01b8f3a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187f51cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42084/0 (socket says 172.21.15.72:42084) 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 learned_addr learned my addr 172.21.15.72:0/376586249 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565187f521f0 con 0x565187e2b500 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187f51cb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f01a80e2610 tx=0x7f01a80aff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f008e7fc640 1 -- 172.21.15.72:0/376586249 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a810f070 con 0x565187e2b500 2024-04-26T12:51:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f008e7fc640 1 -- 172.21.15.72:0/376586249 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80d3420 con 0x565187e2b500 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565187f521f0 con 0x565187e2b500 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f008e7fc640 1 -- 172.21.15.72:0/376586249 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80a9910 con 0x565187e2b500 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565187f52660 con 0x565187e2b500 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f008e7fc640 1 -- 172.21.15.72:0/376586249 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01a8112070 con 0x565187e2b500 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f008e7fc640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00840346a0 0x7f0084036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f008e7fc640 1 -- 172.21.15.72:0/376586249 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f01a80f3070 con 0x565187e2b500 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01b8739640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00840346a0 0x7f0084036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187f5cc70 0x565187f5f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f5f880 con 0x565187f5cc70 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.770+0000 7f01b973b640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187f5cc70 0x565187f5f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b8739640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00840346a0 0x7f0084036b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0063c0 tx=0x7f01ac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b973b640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187f5cc70 0x565187f5f130 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01b00083f0 con 0x565187f5cc70 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 realm 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f5fc90 con 0x565187f5cc70 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01b00083f0 con 0x565187f5cc70 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f60530 con 0x565187f5cc70 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01b00083f0 con 0x565187f5cc70 2024-04-26T12:51:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f5cc70 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01b00083f0 con 0x565187f5cc70 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f61630 0x565187f63a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f63fa0 con 0x565187f61630 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f61630 0x565187f63a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b8f3a640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f61630 0x565187f63a20 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 20 searching for the correct realm 2024-04-26T12:51:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f65ed0 0x565187f68360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f68a30 con 0x565187f65ed0 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b8739640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f65ed0 0x565187f68360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.774+0000 7f01b8739640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f65ed0 0x565187f68360 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac00f070 con 0x565187f65ed0 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8739640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f01ac024070 0x7f01ac031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f68a30 con 0x7f01ac024070 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f01ac024070 0x7f01ac031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f01ac024070 0x7f01ac031970 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b00083f0 con 0x7f01ac024070 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f61630 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f5cc70 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b00083f0 con 0x565187f5cc70 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f5cc70 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f61630 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f61630 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x7f01ac024070 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.778+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f65ed0 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac00f070 con 0x565187f65ed0 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f5cc70 2024-04-26T12:51:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x7f01ac024070 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f5cc70 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x7f01ac024070 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f65ed0 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f65ed0 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f61630 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f65ed0 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f65ed0 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f5cc70 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f5cc70 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.782+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f61630 2024-04-26T12:51:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f65ed0 2024-04-26T12:51:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x7f01ac024070 2024-04-26T12:51:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f5cc70 2024-04-26T12:51:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f61630 2024-04-26T12:51:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f65ed0 2024-04-26T12:51:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f61630 2024-04-26T12:51:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x7f01ac024070 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.786+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f65ed0 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f61630 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x565187f5cc70 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f01b002b040 con 0x7f01ac024070 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f5cc70 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f5cc70 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f608d0 con 0x565187f65ed0 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 zone default found 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 4 Realm: () 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 zonegroup default 2024-04-26T12:51:15.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f64b50 con 0x565187f61630 2024-04-26T12:51:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f65420 con 0x565187f65ed0 2024-04-26T12:51:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.790+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f6a890 con 0x565187f65ed0 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 20 started sync module instance, tier type = 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f69d30 con 0x7f01ac024070 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94908173427296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f69d30 con 0x7f01ac024070 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6b350 con 0x565187f5cc70 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.794+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94908173427296] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94908173430336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f69d30 con 0x565187f5cc70 2024-04-26T12:51:15.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6bd60 con 0x565187f65ed0 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94908173430336] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94908173424768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f69ca0 con 0x565187f65ed0 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6cab0 con 0x7f01ac024070 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94908173436688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6d1a0 con 0x7f01ac024070 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.798+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6dc90 con 0x565187f5cc70 2024-04-26T12:51:15.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.802+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94908173424768] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.802+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94908173436688] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.802+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.802+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94908173440864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6dc50 con 0x565187f5cc70 2024-04-26T12:51:15.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.802+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6e530 con 0x565187f61630 2024-04-26T12:51:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94908173440864] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94908173443200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6dc50 con 0x565187f61630 2024-04-26T12:51:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6eda0 con 0x565187f61630 2024-04-26T12:51:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94908173443200] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94908173435216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6f640 con 0x565187f61630 2024-04-26T12:51:15.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.806+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6fed0 con 0x565187f61630 2024-04-26T12:51:15.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94908173435216] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94908173448048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6fdc0 con 0x565187f61630 2024-04-26T12:51:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=0 2024-04-26T12:51:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=1 2024-04-26T12:51:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=2 2024-04-26T12:51:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=3 2024-04-26T12:51:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=4 2024-04-26T12:51:15.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=5 2024-04-26T12:51:15.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=6 2024-04-26T12:51:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94908173448048] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 20 add_watcher() i=7 2024-04-26T12:51:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f73300 con 0x565187f5cc70 2024-04-26T12:51:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.810+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94908173449296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f70850 con 0x565187f5cc70 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94908173449296] v35'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f006efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 5 note: GC not initialized 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f006dfe3640 20 reqs_thread_entry: start 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 20 Filter name: none 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7effdf7fe640 20 reqs_thread_entry: start 2024-04-26T12:51:15.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f96fa0 con 0x565187f5cc70 2024-04-26T12:51:15.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f96fa0 con 0x7f01ac024070 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f96f60 con 0x565187f5cc70 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f96f60 con 0x565187f65ed0 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f97420 con 0x565187f65ed0 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f97420 con 0x565187f65ed0 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.814+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f97420 con 0x565187f5cc70 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f973a0 con 0x565187f5cc70 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f97360 con 0x565187f65ed0 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f97360 con 0x565187f65ed0 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f97360 con 0x565187f61630 2024-04-26T12:51:15.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98ea0 con 0x565187f5cc70 2024-04-26T12:51:15.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98ea0 con 0x7f01ac024070 2024-04-26T12:51:15.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98ea0 con 0x565187f65ed0 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.818+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98ea0 con 0x565187f61630 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98ea0 con 0x565187f61630 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98e50 con 0x565187f65ed0 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98e50 con 0x565187f61630 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98de0 con 0x565187f5cc70 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98de0 con 0x565187f65ed0 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.822+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98de0 con 0x565187f61630 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x7f01ac024070 2024-04-26T12:51:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f61630 2024-04-26T12:51:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f5cc70 2024-04-26T12:51:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f5cc70 2024-04-26T12:51:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f65ed0 2024-04-26T12:51:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f5cc70 2024-04-26T12:51:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f5cc70 2024-04-26T12:51:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f65ed0 2024-04-26T12:51:15.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f65ed0 2024-04-26T12:51:15.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f65ed0 2024-04-26T12:51:15.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.826+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565187f98dc0 con 0x565187f61630 2024-04-26T12:51:15.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.830+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.830+0000 7f006efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:15.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.830+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94908173449296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f94bb0 con 0x565187f5cc70 2024-04-26T12:51:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.830+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94908173449296] v35'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.830+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94908173427296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6f810 con 0x7f01ac024070 2024-04-26T12:51:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.834+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94908173427296] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.834+0000 7f01bb41f980 20 remove_watcher() i=0 2024-04-26T12:51:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.834+0000 7f01bb41f980 2 removed watcher, disabling cache 2024-04-26T12:51:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.834+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94908173430336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6a260 con 0x565187f5cc70 2024-04-26T12:51:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.834+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94908173430336] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.834+0000 7f01bb41f980 20 remove_watcher() i=1 2024-04-26T12:51:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.834+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94908173424768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6a260 con 0x565187f65ed0 2024-04-26T12:51:15.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01b8739640 1 -- 172.21.15.72:0/376586249 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94908173424768] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ac040040 con 0x565187f65ed0 2024-04-26T12:51:15.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01bb41f980 20 remove_watcher() i=2 2024-04-26T12:51:15.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94908173436688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f69880 con 0x7f01ac024070 2024-04-26T12:51:15.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94908173436688] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x7f01ac024070 2024-04-26T12:51:15.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01bb41f980 20 remove_watcher() i=3 2024-04-26T12:51:15.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94908173440864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6a260 con 0x565187f5cc70 2024-04-26T12:51:15.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94908173440864] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01b0026040 con 0x565187f5cc70 2024-04-26T12:51:15.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01bb41f980 20 remove_watcher() i=4 2024-04-26T12:51:15.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.838+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94908173443200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6c710 con 0x565187f61630 2024-04-26T12:51:15.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.842+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94908173443200] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.842+0000 7f01bb41f980 20 remove_watcher() i=5 2024-04-26T12:51:15.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.842+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94908173435216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f69880 con 0x565187f61630 2024-04-26T12:51:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94908173435216] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 20 remove_watcher() i=6 2024-04-26T12:51:15.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94908173448048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565187f6d760 con 0x565187f61630 2024-04-26T12:51:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01b8f3a640 1 -- 172.21.15.72:0/376586249 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94908173448048] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8111030 con 0x565187f61630 2024-04-26T12:51:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 20 remove_watcher() i=7 2024-04-26T12:51:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f61630 msgr2=0x565187f63a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f61630 0x565187f63a20 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187f5cc70 msgr2=0x565187f5f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187f5cc70 0x565187f5f130 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f01ac024070 msgr2=0x7f01ac031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f01ac024070 0x7f01ac031970 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f65ed0 msgr2=0x565187f68360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f65ed0 0x565187f68360 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00840346a0 msgr2=0x7f0084036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00840346a0 0x7f0084036b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0063c0 tx=0x7f01ac010000 comp rx=0 tx=0).stop 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 msgr2=0x565187f51cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01b973b640 1 -- 172.21.15.72:0/376586249 reap_dead start 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187f51cb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f01a80e2610 tx=0x7f01a80aff70 comp rx=0 tx=0).stop 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 shutdown_connections 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/376586249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187e2b500 0x565187f51cb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 >> 172.21.15.72:0/376586249 conn(0x565187f44ba0 msgr2=0x565187f42200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 shutdown_connections 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/376586249 wait complete. 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0090034650 msgr2=0x7f0090036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0090034650 0x7f0090036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x565187f29df0 tx=0x7f01ac00f000 comp rx=0 tx=0).stop 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187f3ba40 msgr2=0x565187f3be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187f3ba40 0x565187f3be60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f01a80e2f50 tx=0x7f01a80bd360 comp rx=0 tx=0).stop 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 shutdown_connections 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f0090034650 0x7f0090036b10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/1284872148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187f3ba40 0x565187f3be60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 >> 172.21.15.72:0/1284872148 conn(0x565187f30850 msgr2=0x565187f31360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 shutdown_connections 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/1284872148 wait complete. 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f26f40 msgr2=0x565187f29330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x565187f26f40 0x565187f29330 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187e2e490 msgr2=0x565187f245b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x565187e2e490 0x565187f245b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f2ae80 msgr2=0x565187f2d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x565187f2ae80 0x565187f2d270 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00a00346a0 msgr2=0x7f00a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f00a00346a0 0x7f00a0036b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0017b0 tx=0x7f01ac0066a0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 msgr2=0x565187f1d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 --2- 172.21.15.72:0/429152699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x565187d9f030 0x565187f1d6d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f01a801b210 tx=0x7f01a8017f70 comp rx=0 tx=0).stop 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01b973b640 1 -- 172.21.15.72:0/429152699 reap_dead start 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 shutdown_connections 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 >> 172.21.15.72:0/429152699 conn(0x565187e25a70 msgr2=0x565187f10bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 shutdown_connections 2024-04-26T12:51:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.846+0000 7f01bb41f980 1 -- 172.21.15.72:0/429152699 wait complete. 2024-04-26T12:51:15.861 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-26T12:51:15.862 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-26T12:51:15.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-26T12:51:15.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-26T12:51:15.862 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-26T12:51:15.933 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.930+0000 7f70f1f1d980 1 Processor -- start 2024-04-26T12:51:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.930+0000 7f70f1f1d980 1 -- start start 2024-04-26T12:51:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70f1f1d980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56432aa2f6f0 0x56432aa31ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70f1f1d980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56432a8d9510 con 0x56432aa2b190 2024-04-26T12:51:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70f1f1d980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56432a8e0430 con 0x56432aa2f6f0 2024-04-26T12:51:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70ef237640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56432aa2f6f0 0x56432aa31ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70efa38640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56432aa2b190 0x56432aa2b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:49932/0 (socket says 172.21.15.72:49932) 2024-04-26T12:51:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70efa38640 1 -- 172.21.15.72:0/3776311178 learned_addr learned my addr 172.21.15.72:0/3776311178 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70ef237640 1 --2- 172.21.15.72:0/3776311178 >> v2:172.21.15.29:3300/0 conn(0x56432aa2f6f0 0x56432aa31ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42088/0 (socket says 172.21.15.72:42088) 2024-04-26T12:51:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70ef237640 1 -- 172.21.15.72:0/3776311178 >> v1:172.21.15.29:6789/0 conn(0x56432aa2b190 legacy=0x56432aa2b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70ef237640 1 -- 172.21.15.72:0/3776311178 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432a8b5ae0 con 0x56432aa2f6f0 2024-04-26T12:51:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.934+0000 7f70ef237640 1 --2- 172.21.15.72:0/3776311178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2f6f0 0x56432aa31ae0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f70e400a480 tx=0x7f70e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bd695aa1aa198f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70eea36640 1 -- 172.21.15.72:0/3776311178 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e40b0070 con 0x56432aa2f6f0 2024-04-26T12:51:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70eea36640 1 -- 172.21.15.72:0/3776311178 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e40ab540 con 0x56432aa2f6f0 2024-04-26T12:51:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70eea36640 1 -- 172.21.15.72:0/3776311178 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e40ab840 con 0x56432aa2f6f0 2024-04-26T12:51:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70f1f1d980 1 -- 172.21.15.72:0/3776311178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2f6f0 msgr2=0x56432aa31ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/3776311178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2f6f0 0x56432aa31ae0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f70e400a480 tx=0x7f70e401b280 comp rx=0 tx=0).stop 2024-04-26T12:51:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70f1f1d980 1 -- 172.21.15.72:0/3776311178 shutdown_connections 2024-04-26T12:51:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/3776311178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2f6f0 0x56432aa31ae0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70f1f1d980 1 -- 172.21.15.72:0/3776311178 >> 172.21.15.72:0/3776311178 conn(0x56432aa26a60 msgr2=0x56432aa28e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70f1f1d980 1 -- 172.21.15.72:0/3776311178 shutdown_connections 2024-04-26T12:51:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.938+0000 7f70f1f1d980 1 -- 172.21.15.72:0/3776311178 wait complete. 2024-04-26T12:51:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 Processor -- start 2024-04-26T12:51:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- start start 2024-04-26T12:51:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab163a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56432a92fa70 con 0x56432aa2b190 2024-04-26T12:51:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab163a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42092/0 (socket says 172.21.15.72:42092) 2024-04-26T12:51:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70efa38640 1 -- 172.21.15.72:0/2302442243 learned_addr learned my addr 172.21.15.72:0/2302442243 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70efa38640 1 -- 172.21.15.72:0/2302442243 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ab16970 con 0x56432aa2b190 2024-04-26T12:51:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70efa38640 1 --2- 172.21.15.72:0/2302442243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab163a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f70e80017b0 tx=0x7f70e8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3619384b0b196178 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f6fdde0b640 1 -- 172.21.15.72:0/2302442243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8016070 con 0x56432aa2b190 2024-04-26T12:51:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f6fdde0b640 1 -- 172.21.15.72:0/2302442243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8004530 con 0x56432aa2b190 2024-04-26T12:51:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f6fdde0b640 1 -- 172.21.15.72:0/2302442243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8004870 con 0x56432aa2b190 2024-04-26T12:51:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2302442243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 msgr2=0x56432ab163a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2302442243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab163a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f70e80017b0 tx=0x7f70e8001c70 comp rx=0 tx=0).stop 2024-04-26T12:51:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2302442243 shutdown_connections 2024-04-26T12:51:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2302442243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab163a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2302442243 >> 172.21.15.72:0/2302442243 conn(0x56432aa26a60 msgr2=0x56432ab11f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2302442243 shutdown_connections 2024-04-26T12:51:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2302442243 wait complete. 2024-04-26T12:51:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 Processor -- start 2024-04-26T12:51:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- start start 2024-04-26T12:51:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab1c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70f1f1d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56432aa34b10 con 0x56432aa2b190 2024-04-26T12:51:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.954+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab1c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab1c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42102/0 (socket says 172.21.15.72:42102) 2024-04-26T12:51:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70efa38640 1 -- 172.21.15.72:0/695436927 learned_addr learned my addr 172.21.15.72:0/695436927 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70efa38640 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ab1ca10 con 0x56432aa2b190 2024-04-26T12:51:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70efa38640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab1c4d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000f90 tx=0x7f70e8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f6fd7fff640 1 -- 172.21.15.72:0/695436927 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8020070 con 0x56432aa2b190 2024-04-26T12:51:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f6fd7fff640 1 -- 172.21.15.72:0/695436927 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8011400 con 0x56432aa2b190 2024-04-26T12:51:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432ab1cca0 con 0x56432aa2b190 2024-04-26T12:51:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f6fd7fff640 1 -- 172.21.15.72:0/695436927 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8016040 con 0x56432aa2b190 2024-04-26T12:51:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432ab1f900 con 0x56432aa2b190 2024-04-26T12:51:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f6fd7fff640 1 -- 172.21.15.72:0/695436927 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f70e8023070 con 0x56432aa2b190 2024-04-26T12:51:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f6fd7fff640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fd80368b0 0x7f6fd8038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f6fd7fff640 1 -- 172.21.15.72:0/695436927 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f70e80492c0 con 0x56432aa2b190 2024-04-26T12:51:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70ef237640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fd80368b0 0x7f6fd8038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432aa2f6f0 0x56432ab23550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab23a90 con 0x56432aa2f6f0 2024-04-26T12:51:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70f0239640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432aa2f6f0 0x56432ab23550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70ef237640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fd80368b0 0x7f6fd8038d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f70e40ad000 tx=0x7f70e40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.958+0000 7f70f0239640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432aa2f6f0 0x56432ab23550 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f0239640 1 -- 172.21.15.72:0/695436927 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70e00083f0 con 0x56432aa2f6f0 2024-04-26T12:51:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab20b00 con 0x56432aa2f6f0 2024-04-26T12:51:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f0239640 1 -- 172.21.15.72:0/695436927 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70e00083f0 con 0x56432aa2f6f0 2024-04-26T12:51:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab25d30 0x56432ab28120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab287f0 con 0x56432ab25d30 2024-04-26T12:51:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70efa38640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab25d30 0x56432ab28120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70efa38640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab25d30 0x56432ab28120 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70efa38640 1 -- 172.21.15.72:0/695436927 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f70e802c070 con 0x56432ab25d30 2024-04-26T12:51:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab24ba0 con 0x56432aa2f6f0 2024-04-26T12:51:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f0239640 1 -- 172.21.15.72:0/695436927 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70e00083f0 con 0x56432aa2f6f0 2024-04-26T12:51:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab29c30 0x56432ab2c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab2c790 con 0x56432ab29c30 2024-04-26T12:51:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70ef237640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab29c30 0x56432ab2c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70ef237640 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab29c30 0x56432ab2c020 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.962+0000 7f70ef237640 1 -- 172.21.15.72:0/695436927 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70e40b3040 con 0x56432ab29c30 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 Processor -- start 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 -- start start 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab3a7c0 0x56432ab3abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56432a933ab0 con 0x56432ab3a7c0 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab3a7c0 0x56432ab3abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab3a7c0 0x56432ab3abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42108/0 (socket says 172.21.15.72:42108) 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70efa38640 1 -- 172.21.15.72:0/2848989077 learned_addr learned my addr 172.21.15.72:0/2848989077 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70efa38640 1 -- 172.21.15.72:0/2848989077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ab3b120 con 0x56432ab3a7c0 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70efa38640 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab3a7c0 0x56432ab3abe0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f70e802f3f0 tx=0x7f70e8023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f6fd57fa640 1 -- 172.21.15.72:0/2848989077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e803e070 con 0x56432ab3a7c0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432ab3bbc0 con 0x56432ab3a7c0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f6fd57fa640 1 -- 172.21.15.72:0/2848989077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8011810 con 0x56432ab3a7c0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f6fd57fa640 1 -- 172.21.15.72:0/2848989077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e802a040 con 0x56432ab3a7c0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432ab3c090 con 0x56432ab3a7c0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f6fd57fa640 1 -- 172.21.15.72:0/2848989077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f70e8026970 con 0x56432ab3a7c0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f6fd57fa640 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fc8034650 0x7f6fc8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f6fd57fa640 1 -- 172.21.15.72:0/2848989077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f70e8036070 con 0x56432ab3a7c0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70ef237640 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fc8034650 0x7f6fc8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 Processor -- start 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.966+0000 7f70f1f1d980 1 -- start start 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70ef237640 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fc8034650 0x7f6fc8036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70e4000c10 tx=0x7f70e4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab4bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56432ab16cc0 con 0x56432ab4bb50 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab4bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab4bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42116/0 (socket says 172.21.15.72:42116) 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 -- 172.21.15.72:0/2947279892 learned_addr learned my addr 172.21.15.72:0/2947279892 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 -- 172.21.15.72:0/2947279892 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ab4c500 con 0x56432ab4bb50 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 --2- 172.21.15.72:0/2947279892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab4bf30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f70e8030fd0 tx=0x7f70e8048a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ae04cb78c3ee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f6fceffd640 1 -- 172.21.15.72:0/2947279892 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8049ce0 con 0x56432ab4bb50 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f6fceffd640 1 -- 172.21.15.72:0/2947279892 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e805c070 con 0x56432ab4bb50 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f6fceffd640 1 -- 172.21.15.72:0/2947279892 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8040bf0 con 0x56432ab4bb50 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2947279892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 msgr2=0x56432ab4bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2947279892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab4bf30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f70e8030fd0 tx=0x7f70e8048a10 comp rx=0 tx=0).stop 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2947279892 shutdown_connections 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2947279892 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab4bf30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2947279892 >> 172.21.15.72:0/2947279892 conn(0x56432ab43ad0 msgr2=0x56432ab41b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2947279892 shutdown_connections 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2947279892 wait complete. 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 Processor -- start 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- start start 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab52df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70f1f1d980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56432ab4cad0 con 0x56432ab4bb50 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab52df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab52df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42120/0 (socket says 172.21.15.72:42120) 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 learned_addr learned my addr 172.21.15.72:0/2321079472 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.970+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ab53330 con 0x56432ab4bb50 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70efa38640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab52df0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f70e80267c0 tx=0x7f70e8032050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f6fcd7fa640 1 -- 172.21.15.72:0/2321079472 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e802de20 con 0x56432ab4bb50 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f6fcd7fa640 1 -- 172.21.15.72:0/2321079472 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8026c60 con 0x56432ab4bb50 2024-04-26T12:51:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f6fcd7fa640 1 -- 172.21.15.72:0/2321079472 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8026e30 con 0x56432ab4bb50 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432ab53330 con 0x56432ab4bb50 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432ab53330 con 0x56432ab4bb50 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f6fcd7fa640 1 -- 172.21.15.72:0/2321079472 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f70e8072060 con 0x56432ab4bb50 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f6fcd7fa640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fb80347f0 0x7f6fb8036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f6fcd7fa640 1 -- 172.21.15.72:0/2321079472 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f70e806cce0 con 0x56432ab4bb50 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70ef237640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fb80347f0 0x7f6fb8036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432ab5de10 0x56432ab602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab60a20 con 0x56432ab5de10 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f0239640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432ab5de10 0x56432ab602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70ef237640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fb80347f0 0x7f6fb8036cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70e40ae040 tx=0x7f70e40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f0239640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432ab5de10 0x56432ab602d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70e00083f0 con 0x56432ab5de10 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 realm 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab60e30 con 0x56432ab5de10 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70e00083f0 con 0x56432ab5de10 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab616d0 con 0x56432ab5de10 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70e00083f0 con 0x56432ab5de10 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab5de10 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70e00083f0 con 0x56432ab5de10 2024-04-26T12:51:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab627d0 0x56432ab64bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.974+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab65140 con 0x56432ab627d0 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70efa38640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab627d0 0x56432ab64bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70efa38640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab627d0 0x56432ab64bc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f1f1d980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f1f1d980 20 searching for the correct realm 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab67070 0x56432ab69510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab69be0 con 0x56432ab67070 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70ef237640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab67070 0x56432ab69510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70ef237640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab67070 0x56432ab69510 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70ef237640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f70e40ab030 0x7f70e40d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab69be0 con 0x7f70e40ab030 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f0239640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f70e40ab030 0x7f70e40d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f0239640 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f70e40ab030 0x7f70e40d1400 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e00083f0 con 0x7f70e40ab030 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.978+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab627d0 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab5de10 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e00083f0 con 0x56432ab5de10 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab5de10 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab627d0 2024-04-26T12:51:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab627d0 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x7f70e40ab030 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab67070 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab5de10 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x7f70e40ab030 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.982+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab5de10 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x7f70e40ab030 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab627d0 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab5de10 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab5de10 2024-04-26T12:51:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab627d0 2024-04-26T12:51:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.986+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab67070 2024-04-26T12:51:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x7f70e40ab030 2024-04-26T12:51:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab5de10 2024-04-26T12:51:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab627d0 2024-04-26T12:51:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab67070 2024-04-26T12:51:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab627d0 2024-04-26T12:51:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x7f70e40ab030 2024-04-26T12:51:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab67070 2024-04-26T12:51:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab627d0 2024-04-26T12:51:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.990+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x56432ab5de10 2024-04-26T12:51:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f70e002b040 con 0x7f70e40ab030 2024-04-26T12:51:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab5de10 2024-04-26T12:51:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab5de10 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab61a70 con 0x56432ab67070 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 zone default found 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 4 Realm: () 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 zonegroup default 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab65cc0 con 0x56432ab627d0 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab665b0 con 0x56432ab67070 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6ba40 con 0x56432ab67070 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 started sync module instance, tier type = 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.994+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6aee0 con 0x7f70e40ab030 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.998+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.998+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846479414320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6aee0 con 0x7f70e40ab030 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.998+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6c440 con 0x56432ab5de10 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.998+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846479414320] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.998+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.998+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846479417168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6aee0 con 0x56432ab5de10 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:15.998+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6ce50 con 0x56432ab67070 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846479417168] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846479411760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6ae50 con 0x56432ab67070 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6dbc0 con 0x7f70e40ab030 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846479423216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6e460 con 0x7f70e40ab030 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6ee20 con 0x56432ab5de10 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846479411760] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846479423216] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846479427952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6ed90 con 0x56432ab5de10 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.002+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6e3c0 con 0x56432ab627d0 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.006+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.006+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846479430160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6fae0 con 0x56432ab627d0 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.006+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab704a0 con 0x56432ab627d0 2024-04-26T12:51:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.006+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846479427952] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846479430160] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846479425296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab70cf0 con 0x56432ab627d0 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6f630 con 0x56432ab627d0 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846479425296] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846479435840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab71110 con 0x56432ab627d0 2024-04-26T12:51:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 20 add_watcher() i=0 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 20 add_watcher() i=1 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 20 add_watcher() i=2 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 20 add_watcher() i=3 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 20 add_watcher() i=4 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 20 add_watcher() i=5 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.010+0000 7f70f1f1d980 20 add_watcher() i=6 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846479435840] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f1f1d980 20 add_watcher() i=7 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f1f1d980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab743f0 con 0x56432ab5de10 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846479437264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab716a0 con 0x56432ab5de10 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846479437264] v35'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f6fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f1f1d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f1f1d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.014+0000 7f70f1f1d980 5 note: GC not initialized 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f6fa4fe1640 20 reqs_thread_entry: start 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 20 Filter name: none 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f6f1e7fc640 20 reqs_thread_entry: start 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980f0 con 0x56432ab5de10 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x7f70e40ab030 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab5de10 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab67070 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab67070 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab67070 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab5de10 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab5de10 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab67070 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab67070 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.018+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab980b0 con 0x56432ab627d0 2024-04-26T12:51:16.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99c50 con 0x56432ab5de10 2024-04-26T12:51:16.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99c50 con 0x7f70e40ab030 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99c50 con 0x56432ab67070 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99c50 con 0x56432ab627d0 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99c50 con 0x56432ab627d0 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99c50 con 0x56432ab67070 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.022+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99bb0 con 0x56432ab627d0 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99bb0 con 0x56432ab5de10 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99bb0 con 0x56432ab67070 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab627d0 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x7f70e40ab030 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab627d0 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab5de10 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab5de10 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab67070 2024-04-26T12:51:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.026+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab5de10 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab5de10 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab67070 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab67070 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab67070 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ab99b60 con 0x56432ab627d0 2024-04-26T12:51:16.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f6fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.030+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846479437264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab95ee0 con 0x56432ab5de10 2024-04-26T12:51:16.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94846479437264] v35'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846479414320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab70dd0 con 0x7f70e40ab030 2024-04-26T12:51:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94846479414320] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f1f1d980 20 remove_watcher() i=0 2024-04-26T12:51:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f1f1d980 2 removed watcher, disabling cache 2024-04-26T12:51:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846479417168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab70dd0 con 0x56432ab5de10 2024-04-26T12:51:16.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94846479417168] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f1f1d980 20 remove_watcher() i=1 2024-04-26T12:51:16.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.034+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846479411760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6bf50 con 0x56432ab67070 2024-04-26T12:51:16.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.038+0000 7f70ef237640 1 -- 172.21.15.72:0/2321079472 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94846479411760] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e40d8040 con 0x56432ab67070 2024-04-26T12:51:16.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.038+0000 7f70f1f1d980 20 remove_watcher() i=2 2024-04-26T12:51:16.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.038+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846479423216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab70dd0 con 0x7f70e40ab030 2024-04-26T12:51:16.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.038+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94846479423216] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x7f70e40ab030 2024-04-26T12:51:16.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.038+0000 7f70f1f1d980 20 remove_watcher() i=3 2024-04-26T12:51:16.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.038+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846479427952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6aa30 con 0x56432ab5de10 2024-04-26T12:51:16.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.042+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94846479427952] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e0026040 con 0x56432ab5de10 2024-04-26T12:51:16.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.042+0000 7f70f1f1d980 20 remove_watcher() i=4 2024-04-26T12:51:16.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.042+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846479430160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6bf50 con 0x56432ab627d0 2024-04-26T12:51:16.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.042+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94846479430160] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.042+0000 7f70f1f1d980 20 remove_watcher() i=5 2024-04-26T12:51:16.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.042+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846479425296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab70dd0 con 0x56432ab627d0 2024-04-26T12:51:16.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94846479425296] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 20 remove_watcher() i=6 2024-04-26T12:51:16.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846479435840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ab6e970 con 0x56432ab627d0 2024-04-26T12:51:16.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70efa38640 1 -- 172.21.15.72:0/2321079472 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94846479435840] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8040030 con 0x56432ab627d0 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 20 remove_watcher() i=7 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab627d0 msgr2=0x56432ab64bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab627d0 0x56432ab64bc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432ab5de10 msgr2=0x56432ab602d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432ab5de10 0x56432ab602d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f70e40ab030 msgr2=0x7f70e40d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f70e40ab030 0x7f70e40d1400 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab67070 msgr2=0x56432ab69510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab67070 0x56432ab69510 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fb80347f0 msgr2=0x7f6fb8036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fb80347f0 0x7f6fb8036cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70e40ae040 tx=0x7f70e40a6000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 msgr2=0x56432ab52df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2321079472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab4bb50 0x56432ab52df0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f70e80267c0 tx=0x7f70e8032050 comp rx=0 tx=0).stop 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 reap_dead start 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.046+0000 7f70f0239640 1 -- 172.21.15.72:0/2321079472 reap_dead start 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 shutdown_connections 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 >> 172.21.15.72:0/2321079472 conn(0x56432ab43ad0 msgr2=0x56432ab41130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 shutdown_connections 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2321079472 wait complete. 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fc8034650 msgr2=0x7f6fc8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fc8034650 0x7f6fc8036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70e4000c10 tx=0x7f70e4005a10 comp rx=0 tx=0).stop 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab3a7c0 msgr2=0x56432ab3abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab3a7c0 0x56432ab3abe0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f70e802f3f0 tx=0x7f70e8023ac0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 shutdown_connections 2024-04-26T12:51:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fc8034650 0x7f6fc8036b10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/2848989077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432ab3a7c0 0x56432ab3abe0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 >> 172.21.15.72:0/2848989077 conn(0x56432ab2f5d0 msgr2=0x56432ab300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 shutdown_connections 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/2848989077 wait complete. 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab25d30 msgr2=0x56432ab28120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56432ab25d30 0x56432ab28120 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432aa2f6f0 msgr2=0x56432ab23550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56432aa2f6f0 0x56432ab23550 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab29c30 msgr2=0x56432ab2c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56432ab29c30 0x56432ab2c020 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fd80368b0 msgr2=0x7f6fd8038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6fd80368b0 0x7f6fd8038d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f70e40ad000 tx=0x7f70e40a5040 comp rx=0 tx=0).stop 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 msgr2=0x56432ab1c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 --2- 172.21.15.72:0/695436927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56432aa2b190 0x56432ab1c4d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000f90 tx=0x7f70e8001260 comp rx=0 tx=0).stop 2024-04-26T12:51:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f0239640 1 -- 172.21.15.72:0/695436927 reap_dead start 2024-04-26T12:51:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 shutdown_connections 2024-04-26T12:51:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 >> 172.21.15.72:0/695436927 conn(0x56432aa26a60 msgr2=0x56432ab10a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 shutdown_connections 2024-04-26T12:51:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.050+0000 7f70f1f1d980 1 -- 172.21.15.72:0/695436927 wait complete. 2024-04-26T12:51:16.062 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-26T12:51:16.063 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-26T12:51:16.063 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-26T12:51:16.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-26T12:51:16.063 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-26T12:51:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07e29ac980 1 Processor -- start 2024-04-26T12:51:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07e29ac980 1 -- start start 2024-04-26T12:51:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07e29ac980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558e9a6b4ab0 0x558e9a6b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07e29ac980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e9a55b510 con 0x558e9a621ff0 2024-04-26T12:51:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07e29ac980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x558e9a562430 con 0x558e9a6b4ab0 2024-04-26T12:51:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07dfcc6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558e9a6b4ab0 0x558e9a6b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07dfcc6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x558e9a6b4ab0 0x558e9a6b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42128/0 (socket says 172.21.15.72:42128) 2024-04-26T12:51:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07dfcc6640 1 -- 172.21.15.72:0/3566404688 learned_addr learned my addr 172.21.15.72:0/3566404688 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07dfcc6640 1 -- 172.21.15.72:0/3566404688 >> v1:172.21.15.29:6789/0 conn(0x558e9a621ff0 legacy=0x558e9a6b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.138+0000 7f07dfcc6640 1 -- 172.21.15.72:0/3566404688 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9a537ae0 con 0x558e9a6b4ab0 2024-04-26T12:51:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/3566404688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a6b4ab0 0x558e9a6b6ea0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f07d400a5c0 tx=0x7f07d401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f27f10bb1e71f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07df4c5640 1 -- 172.21.15.72:0/3566404688 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d40a6070 con 0x558e9a6b4ab0 2024-04-26T12:51:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07df4c5640 1 -- 172.21.15.72:0/3566404688 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d40af070 con 0x558e9a6b4ab0 2024-04-26T12:51:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07df4c5640 1 -- 172.21.15.72:0/3566404688 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d40aa5c0 con 0x558e9a6b4ab0 2024-04-26T12:51:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07e29ac980 1 -- 172.21.15.72:0/3566404688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a6b4ab0 msgr2=0x558e9a6b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07e29ac980 1 --2- 172.21.15.72:0/3566404688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a6b4ab0 0x558e9a6b6ea0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f07d400a5c0 tx=0x7f07d401b340 comp rx=0 tx=0).stop 2024-04-26T12:51:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07e29ac980 1 -- 172.21.15.72:0/3566404688 shutdown_connections 2024-04-26T12:51:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07e29ac980 1 --2- 172.21.15.72:0/3566404688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a6b4ab0 0x558e9a6b6ea0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07e29ac980 1 -- 172.21.15.72:0/3566404688 >> 172.21.15.72:0/3566404688 conn(0x558e9a6a8a70 msgr2=0x558e9a6aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07e29ac980 1 -- 172.21.15.72:0/3566404688 shutdown_connections 2024-04-26T12:51:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.142+0000 7f07e29ac980 1 -- 172.21.15.72:0/3566404688 wait complete. 2024-04-26T12:51:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e29ac980 1 Processor -- start 2024-04-26T12:51:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e29ac980 1 -- start start 2024-04-26T12:51:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e29ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a79b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e29ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e9a5b1a70 con 0x558e9a621ff0 2024-04-26T12:51:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a79b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a79b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42130/0 (socket says 172.21.15.72:42130) 2024-04-26T12:51:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e04c7640 1 -- 172.21.15.72:0/2122788344 learned_addr learned my addr 172.21.15.72:0/2122788344 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e04c7640 1 -- 172.21.15.72:0/2122788344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9a79bc10 con 0x558e9a621ff0 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f07e04c7640 1 --2- 172.21.15.72:0/2122788344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a79b640 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f07d000b1f0 tx=0x7f07d000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a604fc8c8b4f61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f06ce60c640 1 -- 172.21.15.72:0/2122788344 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d000a040 con 0x558e9a621ff0 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f06ce60c640 1 -- 172.21.15.72:0/2122788344 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d000f750 con 0x558e9a621ff0 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.158+0000 7f06ce60c640 1 -- 172.21.15.72:0/2122788344 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d000fa70 con 0x558e9a621ff0 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- 172.21.15.72:0/2122788344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 msgr2=0x558e9a79b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 --2- 172.21.15.72:0/2122788344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a79b640 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f07d000b1f0 tx=0x7f07d000b6b0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- 172.21.15.72:0/2122788344 shutdown_connections 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 --2- 172.21.15.72:0/2122788344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a79b640 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- 172.21.15.72:0/2122788344 >> 172.21.15.72:0/2122788344 conn(0x558e9a6a8a70 msgr2=0x558e9a7971d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- 172.21.15.72:0/2122788344 shutdown_connections 2024-04-26T12:51:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- 172.21.15.72:0/2122788344 wait complete. 2024-04-26T12:51:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 Processor -- start 2024-04-26T12:51:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- start start 2024-04-26T12:51:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a7a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e9a6b9e40 con 0x558e9a621ff0 2024-04-26T12:51:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a7a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a7a28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42134/0 (socket says 172.21.15.72:42134) 2024-04-26T12:51:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e04c7640 1 -- 172.21.15.72:0/89134580 learned_addr learned my addr 172.21.15.72:0/89134580 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e04c7640 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9a7a2e10 con 0x558e9a621ff0 2024-04-26T12:51:16.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e04c7640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a7a28d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f07d000b6f0 tx=0x7f07d0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f06cce09640 1 -- 172.21.15.72:0/89134580 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d0001300 con 0x558e9a621ff0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f06cce09640 1 -- 172.21.15.72:0/89134580 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d001c9c0 con 0x558e9a621ff0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e9a7a30a0 con 0x558e9a621ff0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f06cce09640 1 -- 172.21.15.72:0/89134580 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d001cca0 con 0x558e9a621ff0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e9a7a5ce0 con 0x558e9a621ff0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f06cce09640 1 -- 172.21.15.72:0/89134580 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d0017050 con 0x558e9a621ff0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f06cce09640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06c8034650 0x7f06c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f06cce09640 1 -- 172.21.15.72:0/89134580 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f07d0015020 con 0x558e9a621ff0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.162+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06c8034650 0x7f06c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a6b4ab0 0x558e9a7a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7a9e70 con 0x558e9a6b4ab0 2024-04-26T12:51:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e0cc8640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a6b4ab0 0x558e9a7a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06c8034650 0x7f06c8036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ae000 tx=0x7f07d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e0cc8640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a6b4ab0 0x558e9a7a9930 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e0cc8640 1 -- 172.21.15.72:0/89134580 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a6b4ab0 2024-04-26T12:51:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7a6f00 con 0x558e9a6b4ab0 2024-04-26T12:51:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e0cc8640 1 -- 172.21.15.72:0/89134580 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a6b4ab0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7ac1f0 0x558e9a7ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7aecb0 con 0x558e9a7ac1f0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e04c7640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7ac1f0 0x558e9a7ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e04c7640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7ac1f0 0x558e9a7ae5e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e04c7640 1 -- 172.21.15.72:0/89134580 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07d002e070 con 0x558e9a7ac1f0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ab090 con 0x558e9a6b4ab0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e0cc8640 1 -- 172.21.15.72:0/89134580 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a6b4ab0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7b00f0 0x558e9a7b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7b2c70 con 0x558e9a7b00f0 2024-04-26T12:51:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.166+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7b00f0 0x558e9a7b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7b00f0 0x558e9a7b24e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07dfcc6640 1 -- 172.21.15.72:0/89134580 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7b00f0 2024-04-26T12:51:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e29ac980 1 Processor -- start 2024-04-26T12:51:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e29ac980 1 -- start start 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e29ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7c0c80 0x558e9a7c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e29ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e9a5b5ab0 con 0x558e9a7c0c80 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7c0c80 0x558e9a7c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7c0c80 0x558e9a7c10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42136/0 (socket says 172.21.15.72:42136) 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e04c7640 1 -- 172.21.15.72:0/3472097996 learned_addr learned my addr 172.21.15.72:0/3472097996 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e04c7640 1 -- 172.21.15.72:0/3472097996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9a7c15e0 con 0x558e9a7c0c80 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e04c7640 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7c0c80 0x558e9a7c10a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f07d001ced0 tx=0x7f07d00474a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f06c5ffb640 1 -- 172.21.15.72:0/3472097996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d002f720 con 0x558e9a7c0c80 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e9a7c2080 con 0x558e9a7c0c80 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f06c5ffb640 1 -- 172.21.15.72:0/3472097996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d0018980 con 0x558e9a7c0c80 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f06c5ffb640 1 -- 172.21.15.72:0/3472097996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d0018ca0 con 0x558e9a7c0c80 2024-04-26T12:51:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e9a7c2550 con 0x558e9a7c0c80 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.170+0000 7f06c5ffb640 1 -- 172.21.15.72:0/3472097996 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d003a070 con 0x558e9a7c0c80 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f06c5ffb640 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b8034650 0x7f06b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f06c5ffb640 1 -- 172.21.15.72:0/3472097996 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f07d00323b0 con 0x558e9a7c0c80 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b8034650 0x7f06b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 Processor -- start 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- start start 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e9a79bf60 con 0x558e9a7cdc30 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b8034650 0x7f06b8036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07d401b380 tx=0x7f07d4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42146/0 (socket says 172.21.15.72:42146) 2024-04-26T12:51:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 -- 172.21.15.72:0/776831638 learned_addr learned my addr 172.21.15.72:0/776831638 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 -- 172.21.15.72:0/776831638 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9a7ce5e0 con 0x558e9a7cdc30 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 --2- 172.21.15.72:0/776831638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7ce010 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f07d0048a90 tx=0x7f07d0042a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1e3ed604e76408 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f06bf7fe640 1 -- 172.21.15.72:0/776831638 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d0032170 con 0x558e9a7cdc30 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f06bf7fe640 1 -- 172.21.15.72:0/776831638 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d005a030 con 0x558e9a7cdc30 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f06bf7fe640 1 -- 172.21.15.72:0/776831638 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d001a480 con 0x558e9a7cdc30 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- 172.21.15.72:0/776831638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 msgr2=0x558e9a7ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 --2- 172.21.15.72:0/776831638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7ce010 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f07d0048a90 tx=0x7f07d0042a40 comp rx=0 tx=0).stop 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- 172.21.15.72:0/776831638 shutdown_connections 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 --2- 172.21.15.72:0/776831638 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7ce010 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- 172.21.15.72:0/776831638 >> 172.21.15.72:0/776831638 conn(0x558e9a7c9fc0 msgr2=0x558e9a7c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- 172.21.15.72:0/776831638 shutdown_connections 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- 172.21.15.72:0/776831638 wait complete. 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 Processor -- start 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- start start 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7d4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e29ac980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558e9a7cebb0 con 0x558e9a7cdc30 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7d4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7d4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42154/0 (socket says 172.21.15.72:42154) 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.174+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 learned_addr learned my addr 172.21.15.72:0/1740807955 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9a7d5420 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e04c7640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7d4ee0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f07d0048a90 tx=0x7f07d00320a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f06bdffb640 1 -- 172.21.15.72:0/1740807955 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d006e070 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e9a7d5420 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f06bdffb640 1 -- 172.21.15.72:0/1740807955 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d0013130 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f06bdffb640 1 -- 172.21.15.72:0/1740807955 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d001a7b0 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e9a7d5420 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f06bdffb640 1 -- 172.21.15.72:0/1740807955 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d0071070 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f06bdffb640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b0034650 0x7f06b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f06bdffb640 1 -- 172.21.15.72:0/1740807955 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f07d0066070 con 0x558e9a7cdc30 2024-04-26T12:51:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b0034650 0x7f06b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a7dffa0 0x558e9a7e2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e2b90 con 0x558e9a7dffa0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e0cc8640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a7dffa0 0x558e9a7e2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b0034650 0x7f06b0036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ac040 tx=0x7f07d40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e0cc8640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a7dffa0 0x558e9a7e2440 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 20 realm 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e2fa0 con 0x558e9a7dffa0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3840 con 0x558e9a7dffa0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.178+0000 7f07e29ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7e4940 0x558e9a7e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e72b0 con 0x558e9a7e4940 2024-04-26T12:51:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e04c7640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7e4940 0x558e9a7e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e04c7640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7e4940 0x558e9a7e6d30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 20 searching for the correct realm 2024-04-26T12:51:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7e91e0 0x558e9a7eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ebd70 con 0x558e9a7e91e0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7e91e0 0x558e9a7eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7e91e0 0x558e9a7eb6a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07dfcc6640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f07d40e0040 0x7f07d40e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ebd70 con 0x7f07d40e0040 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e0cc8640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f07d40e0040 0x7f07d40e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e0cc8640 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f07d40e0040 0x7f07d40e0420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d800a4d0 con 0x7f07d40e0040 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.182+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x7f07d40e0040 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d800a4d0 con 0x7f07d40e0040 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x7f07d40e0040 2024-04-26T12:51:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d800a4d0 con 0x7f07d40e0040 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d800a4d0 con 0x558e9a7dffa0 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.186+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x7f07d40e0040 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07d8032040 con 0x7f07d40e0040 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8032040 con 0x558e9a7dffa0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07d8032040 con 0x558e9a7dffa0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.190+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x7f07d40e0040 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8032040 con 0x7f07d40e0040 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8032040 con 0x558e9a7dffa0 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x7f07d40e0040 2024-04-26T12:51:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8032040 con 0x7f07d40e0040 2024-04-26T12:51:16.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e91e0 2024-04-26T12:51:16.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7e4940 2024-04-26T12:51:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x558e9a7dffa0 2024-04-26T12:51:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07d8032040 con 0x558e9a7dffa0 2024-04-26T12:51:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.194+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e3be0 con 0x7f07d40e0040 2024-04-26T12:51:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8032040 con 0x7f07d40e0040 2024-04-26T12:51:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e7b00 con 0x558e9a7dffa0 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07d8032040 con 0x558e9a7dffa0 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e7b00 con 0x558e9a7dffa0 2024-04-26T12:51:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07d8032040 con 0x558e9a7dffa0 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e7b00 con 0x558e9a7e91e0 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 zone default found 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 4 Realm: () 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:16.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 zonegroup default 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7e83a0 con 0x558e9a7e4940 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7edbd0 con 0x558e9a7e91e0 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7edf70 con 0x558e9a7e91e0 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 started sync module instance, tier type = 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.198+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ed070 con 0x7f07d40e0040 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.202+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8032040 con 0x7f07d40e0040 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.202+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94070965720432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ed070 con 0x7f07d40e0040 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.202+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ee930 con 0x558e9a7dffa0 2024-04-26T12:51:16.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.202+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94070965720432] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x7f07d40e0040 2024-04-26T12:51:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.202+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.202+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94070965724560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ed070 con 0x558e9a7dffa0 2024-04-26T12:51:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.202+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ef370 con 0x558e9a7e91e0 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94070965726912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7efbc0 con 0x558e9a7e91e0 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94070965724560] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ecbc0 con 0x7f07d40e0040 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x7f07d40e0040 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94070965731536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f09a0 con 0x7f07d40e0040 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f1360 con 0x558e9a7dffa0 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94070965726912] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.206+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94070965731536] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x7f07d40e0040 2024-04-26T12:51:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.210+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.210+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94070965732592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7ef820 con 0x558e9a7dffa0 2024-04-26T12:51:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.210+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f1810 con 0x558e9a7e4940 2024-04-26T12:51:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.210+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94070965732592] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.210+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.210+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94070965735088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f1bb0 con 0x558e9a7e4940 2024-04-26T12:51:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.210+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f2400 con 0x558e9a7e4940 2024-04-26T12:51:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94070965739856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f2be0 con 0x558e9a7e4940 2024-04-26T12:51:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f36d0 con 0x558e9a7e4940 2024-04-26T12:51:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94070965735088] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94070965744032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f3690 con 0x558e9a7e4940 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 20 add_watcher() i=0 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 20 add_watcher() i=1 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 20 add_watcher() i=2 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 20 add_watcher() i=3 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 20 add_watcher() i=4 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 20 add_watcher() i=5 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94070965739856] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.214+0000 7f07e29ac980 20 add_watcher() i=6 2024-04-26T12:51:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94070965744032] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 20 add_watcher() i=7 2024-04-26T12:51:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f26c0 con 0x558e9a7dffa0 2024-04-26T12:51:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94070965741200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f13e0 con 0x558e9a7dffa0 2024-04-26T12:51:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94070965741200] v35'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f06967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 5 note: GC not initialized 2024-04-26T12:51:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f06957e2640 20 reqs_thread_entry: start 2024-04-26T12:51:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.218+0000 7f07e29ac980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e29ac980 20 Filter name: none 2024-04-26T12:51:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f0606ffd640 20 reqs_thread_entry: start 2024-04-26T12:51:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e29ac980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a819990 con 0x558e9a7dffa0 2024-04-26T12:51:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e29ac980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:51:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558e9a81aee0 con 0x558e9a7e4940 2024-04-26T12:51:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f06967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.222+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94070965741200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f8b50 con 0x558e9a7dffa0 2024-04-26T12:51:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.226+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94070965741200] v35'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.226+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94070965720432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f2690 con 0x7f07d40e0040 2024-04-26T12:51:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.226+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94070965720432] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x7f07d40e0040 2024-04-26T12:51:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.226+0000 7f07e29ac980 20 remove_watcher() i=0 2024-04-26T12:51:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.226+0000 7f07e29ac980 2 removed watcher, disabling cache 2024-04-26T12:51:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.226+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94070965724560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f2690 con 0x558e9a7dffa0 2024-04-26T12:51:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94070965724560] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e29ac980 20 remove_watcher() i=1 2024-04-26T12:51:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94070965726912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f2690 con 0x558e9a7e91e0 2024-04-26T12:51:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07dfcc6640 1 -- 172.21.15.72:0/1740807955 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94070965726912] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d40aaab0 con 0x558e9a7e91e0 2024-04-26T12:51:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e29ac980 20 remove_watcher() i=2 2024-04-26T12:51:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94070965731536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7eeec0 con 0x7f07d40e0040 2024-04-26T12:51:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94070965731536] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x7f07d40e0040 2024-04-26T12:51:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e29ac980 20 remove_watcher() i=3 2024-04-26T12:51:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.230+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94070965732592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f2690 con 0x558e9a7dffa0 2024-04-26T12:51:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.234+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94070965732592] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8040040 con 0x558e9a7dffa0 2024-04-26T12:51:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.234+0000 7f07e29ac980 20 remove_watcher() i=4 2024-04-26T12:51:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.234+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94070965735088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7eeec0 con 0x558e9a7e4940 2024-04-26T12:51:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.234+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94070965735088] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.234+0000 7f07e29ac980 20 remove_watcher() i=5 2024-04-26T12:51:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.234+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94070965739856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7f2690 con 0x558e9a7e4940 2024-04-26T12:51:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.238+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94070965739856] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.238+0000 7f07e29ac980 20 remove_watcher() i=6 2024-04-26T12:51:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.238+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94070965744032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558e9a7eeec0 con 0x558e9a7e4940 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.238+0000 7f07e04c7640 1 -- 172.21.15.72:0/1740807955 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94070965744032] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d0070030 con 0x558e9a7e4940 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 20 remove_watcher() i=7 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7e4940 msgr2=0x558e9a7e6d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7e4940 0x558e9a7e6d30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a7dffa0 msgr2=0x558e9a7e2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a7dffa0 0x558e9a7e2440 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f07d40e0040 msgr2=0x7f07d40e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f07d40e0040 0x7f07d40e0420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7e91e0 msgr2=0x558e9a7eb6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7e91e0 0x558e9a7eb6a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b0034650 msgr2=0x7f06b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b0034650 0x7f06b0036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ac040 tx=0x7f07d40c1040 comp rx=0 tx=0).stop 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 msgr2=0x558e9a7d4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e0cc8640 1 -- 172.21.15.72:0/1740807955 reap_dead start 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7d4ee0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f07d0048a90 tx=0x7f07d00320a0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 shutdown_connections 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/1740807955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7cdc30 0x558e9a7d4ee0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 >> 172.21.15.72:0/1740807955 conn(0x558e9a7c9fc0 msgr2=0x558e9a7c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 shutdown_connections 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/1740807955 wait complete. 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b8034650 msgr2=0x7f06b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b8034650 0x7f06b8036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07d401b380 tx=0x7f07d4005ad0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7c0c80 msgr2=0x558e9a7c10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7c0c80 0x558e9a7c10a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f07d001ced0 tx=0x7f07d00474a0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 shutdown_connections 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06b8034650 0x7f06b8036b10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/3472097996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a7c0c80 0x558e9a7c10a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 >> 172.21.15.72:0/3472097996 conn(0x558e9a7b5a90 msgr2=0x558e9a7b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 shutdown_connections 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/3472097996 wait complete. 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7ac1f0 msgr2=0x558e9a7ae5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x558e9a7ac1f0 0x558e9a7ae5e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a6b4ab0 msgr2=0x558e9a7a9930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x558e9a6b4ab0 0x558e9a7a9930 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7b00f0 msgr2=0x558e9a7b24e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x558e9a7b00f0 0x558e9a7b24e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06c8034650 msgr2=0x7f06c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f06c8034650 0x7f06c8036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ae000 tx=0x7f07d40a6000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 msgr2=0x558e9a7a28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 --2- 172.21.15.72:0/89134580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558e9a621ff0 0x558e9a7a28d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f07d000b6f0 tx=0x7f07d0000ee0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e0cc8640 1 -- 172.21.15.72:0/89134580 reap_dead start 2024-04-26T12:51:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 shutdown_connections 2024-04-26T12:51:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 >> 172.21.15.72:0/89134580 conn(0x558e9a6a8a70 msgr2=0x558e9a795ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 shutdown_connections 2024-04-26T12:51:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.242+0000 7f07e29ac980 1 -- 172.21.15.72:0/89134580 wait complete. 2024-04-26T12:51:16.254 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-26T12:51:16.255 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-26T12:51:16.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-26T12:51:16.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-26T12:51:16.255 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-26T12:51:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:16.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca894a980 1 Processor -- start 2024-04-26T12:51:16.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca894a980 1 -- start start 2024-04-26T12:51:16.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca894a980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d79fedb2d0 0x55d79fedb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca894a980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d79fd88510 con 0x55d79fedbbf0 2024-04-26T12:51:16.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca894a980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55d79fd8f430 con 0x55d79fedb2d0 2024-04-26T12:51:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca6465640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d79fedb2d0 0x55d79fedb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca6465640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d79fedb2d0 0x55d79fedb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42164/0 (socket says 172.21.15.72:42164) 2024-04-26T12:51:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca6465640 1 -- 172.21.15.72:0/1822135474 learned_addr learned my addr 172.21.15.72:0/1822135474 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.326+0000 7f7ca5c64640 1 --1- 172.21.15.72:0/1822135474 >> v1:172.21.15.29:6789/0 conn(0x55d79fedbbf0 0x55d79fedc5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:49954/0 (socket says 172.21.15.72:49954) 2024-04-26T12:51:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.330+0000 7f7ca6465640 1 -- 172.21.15.72:0/1822135474 >> v1:172.21.15.29:6789/0 conn(0x55d79fedbbf0 legacy=0x55d79fedc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.330+0000 7f7ca6465640 1 -- 172.21.15.72:0/1822135474 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79fd64ae0 con 0x55d79fedb2d0 2024-04-26T12:51:16.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.330+0000 7f7ca6465640 1 --2- 172.21.15.72:0/1822135474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79fedb6b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000a4e0 tx=0x7f7ca001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9900888080039f21 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca5463640 1 -- 172.21.15.72:0/1822135474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00aa540 con 0x55d79fedb2d0 2024-04-26T12:51:16.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca5463640 1 -- 172.21.15.72:0/1822135474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00aa6e0 con 0x55d79fedb2d0 2024-04-26T12:51:16.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca5463640 1 -- 172.21.15.72:0/1822135474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00aaa40 con 0x55d79fedb2d0 2024-04-26T12:51:16.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca894a980 1 -- 172.21.15.72:0/1822135474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 msgr2=0x55d79fedb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca894a980 1 --2- 172.21.15.72:0/1822135474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79fedb6b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000a4e0 tx=0x7f7ca001b090 comp rx=0 tx=0).stop 2024-04-26T12:51:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca894a980 1 -- 172.21.15.72:0/1822135474 shutdown_connections 2024-04-26T12:51:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca894a980 1 --2- 172.21.15.72:0/1822135474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79fedb6b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca894a980 1 -- 172.21.15.72:0/1822135474 >> 172.21.15.72:0/1822135474 conn(0x55d79fed6ba0 msgr2=0x55d79fed8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca894a980 1 -- 172.21.15.72:0/1822135474 shutdown_connections 2024-04-26T12:51:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.334+0000 7f7ca894a980 1 -- 172.21.15.72:0/1822135474 wait complete. 2024-04-26T12:51:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 Processor -- start 2024-04-26T12:51:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- start start 2024-04-26T12:51:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffc6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d79fddea70 con 0x55d79fedb2d0 2024-04-26T12:51:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffc6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffc6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42174/0 (socket says 172.21.15.72:42174) 2024-04-26T12:51:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 -- 172.21.15.72:0/2917821192 learned_addr learned my addr 172.21.15.72:0/2917821192 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 -- 172.21.15.72:0/2917821192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79ffc7170 con 0x55d79fedb2d0 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 --2- 172.21.15.72:0/2917821192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffc6ba0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0017ca0 tx=0x7f7ca00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41435e8556d8aafc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7b94608640 1 -- 172.21.15.72:0/2917821192 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00b9070 con 0x55d79fedb2d0 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7b94608640 1 -- 172.21.15.72:0/2917821192 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00aaa80 con 0x55d79fedb2d0 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7b94608640 1 -- 172.21.15.72:0/2917821192 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00aad60 con 0x55d79fedb2d0 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- 172.21.15.72:0/2917821192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 msgr2=0x55d79ffc6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2917821192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffc6ba0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0017ca0 tx=0x7f7ca00033b0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- 172.21.15.72:0/2917821192 shutdown_connections 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2917821192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffc6ba0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- 172.21.15.72:0/2917821192 >> 172.21.15.72:0/2917821192 conn(0x55d79fed6ba0 msgr2=0x55d79ffc2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- 172.21.15.72:0/2917821192 shutdown_connections 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- 172.21.15.72:0/2917821192 wait complete. 2024-04-26T12:51:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 Processor -- start 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- start start 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffcdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca894a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d79fee5320 con 0x55d79fedb2d0 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffcdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffcdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42176/0 (socket says 172.21.15.72:42176) 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.350+0000 7f7ca6465640 1 -- 172.21.15.72:0/3386576065 learned_addr learned my addr 172.21.15.72:0/3386576065 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca6465640 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79ffce220 con 0x55d79fedb2d0 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca6465640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffcdce0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0017ca0 tx=0x7f7ca0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7b92e05640 1 -- 172.21.15.72:0/3386576065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00b9070 con 0x55d79fedb2d0 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7b92e05640 1 -- 172.21.15.72:0/3386576065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00c7410 con 0x55d79fedb2d0 2024-04-26T12:51:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d79ffce4b0 con 0x55d79fedb2d0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7b92e05640 1 -- 172.21.15.72:0/3386576065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00c7730 con 0x55d79fedb2d0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79ffd10f0 con 0x55d79fedb2d0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7b92e05640 1 -- 172.21.15.72:0/3386576065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ca00b3040 con 0x55d79fedb2d0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7b92e05640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b8c034650 0x7f7b8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7b92e05640 1 -- 172.21.15.72:0/3386576065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f7ca00c4070 con 0x55d79fedb2d0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b8c034650 0x7f7b8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d79fedbbf0 0x55d79ffd4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d79ffd52a0 con 0x55d79fedbbf0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca6c66640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d79fedbbf0 0x55d79ffd4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b8c034650 0x7f7b8c036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000f70 tx=0x7f7c90001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca6c66640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d79fedbbf0 0x55d79ffd4c30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca6c66640 1 -- 172.21.15.72:0/3386576065 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c980083f0 con 0x55d79fedbbf0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d79ffd22f0 con 0x55d79fedbbf0 2024-04-26T12:51:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca6c66640 1 -- 172.21.15.72:0/3386576065 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c980083f0 con 0x55d79fedbbf0 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d79ffd7620 0x55d79ffd9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d79ffda100 con 0x55d79ffd7620 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.354+0000 7f7ca6465640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d79ffd7620 0x55d79ffd9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca6465640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d79ffd7620 0x55d79ffd9a10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca6465640 1 -- 172.21.15.72:0/3386576065 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ca00cd060 con 0x55d79ffd7620 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d79ffd6490 con 0x55d79fedbbf0 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca6c66640 1 -- 172.21.15.72:0/3386576065 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c980083f0 con 0x55d79fedbbf0 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d79ffdb560 0x55d79ffdd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d79ffde050 con 0x55d79ffdb560 2024-04-26T12:51:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d79ffdb560 0x55d79ffdd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d79ffdb560 0x55d79ffdd950 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca5c64640 1 -- 172.21.15.72:0/3386576065 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c9000f6a0 con 0x55d79ffdb560 2024-04-26T12:51:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca894a980 1 Processor -- start 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca894a980 1 -- start start 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca894a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79ffec0e0 0x55d79ffec500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca894a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d79fde2ab0 con 0x55d79ffec0e0 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79ffec0e0 0x55d79ffec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79ffec0e0 0x55d79ffec500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42184/0 (socket says 172.21.15.72:42184) 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca6465640 1 -- 172.21.15.72:0/1380032348 learned_addr learned my addr 172.21.15.72:0/1380032348 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.358+0000 7f7ca6465640 1 -- 172.21.15.72:0/1380032348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79ffeca40 con 0x55d79ffec0e0 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca6465640 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79ffec0e0 0x55d79ffec500 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b3900 tx=0x7f7ca00c6820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b8bfff640 1 -- 172.21.15.72:0/1380032348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00bde30 con 0x55d79ffec0e0 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b8bfff640 1 -- 172.21.15.72:0/1380032348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00b3b80 con 0x55d79ffec0e0 2024-04-26T12:51:16.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d79ffed4e0 con 0x55d79ffec0e0 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b8bfff640 1 -- 172.21.15.72:0/1380032348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00c79a0 con 0x55d79ffec0e0 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79ffed4e0 con 0x55d79ffec0e0 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b8bfff640 1 -- 172.21.15.72:0/1380032348 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ca00e4040 con 0x55d79ffec0e0 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b8bfff640 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b80034650 0x7f7b80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b8bfff640 1 -- 172.21.15.72:0/1380032348 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f7ca00de070 con 0x55d79ffec0e0 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b80034650 0x7f7b80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca894a980 1 Processor -- start 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca894a980 1 -- start start 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca894a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d79fff9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b80034650 0x7f7b80036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55d79ffd57c0 tx=0x7f7c9000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca894a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d79ffc7400 con 0x55d79fff8f40 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d79fff9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d79fff9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42190/0 (socket says 172.21.15.72:42190) 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca6465640 1 -- 172.21.15.72:0/273243746 learned_addr learned my addr 172.21.15.72:0/273243746 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca6465640 1 -- 172.21.15.72:0/273243746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79fff98f0 con 0x55d79fff8f40 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7ca6465640 1 --2- 172.21.15.72:0/273243746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d79fff9320 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00c1fd0 tx=0x7f7ca00ce410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dde2bc4129ef710 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b89ffb640 1 -- 172.21.15.72:0/273243746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00f4040 con 0x55d79fff8f40 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b89ffb640 1 -- 172.21.15.72:0/273243746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00fe070 con 0x55d79fff8f40 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.362+0000 7f7b89ffb640 1 -- 172.21.15.72:0/273243746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00d6a60 con 0x55d79fff8f40 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- 172.21.15.72:0/273243746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 msgr2=0x55d79fff9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 --2- 172.21.15.72:0/273243746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d79fff9320 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00c1fd0 tx=0x7f7ca00ce410 comp rx=0 tx=0).stop 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- 172.21.15.72:0/273243746 shutdown_connections 2024-04-26T12:51:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 --2- 172.21.15.72:0/273243746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d79fff9320 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- 172.21.15.72:0/273243746 >> 172.21.15.72:0/273243746 conn(0x55d79fff5280 msgr2=0x55d79fff32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- 172.21.15.72:0/273243746 shutdown_connections 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- 172.21.15.72:0/273243746 wait complete. 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 Processor -- start 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- start start 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d7a00001b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d79fff9e70 con 0x55d79fff8f40 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d7a00001b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca6465640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d7a00001b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42196/0 (socket says 172.21.15.72:42196) 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 learned_addr learned my addr 172.21.15.72:0/2939690563 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a00006f0 con 0x55d79fff8f40 2024-04-26T12:51:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca6465640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d7a00001b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00d63f0 tx=0x7f7ca00abdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7b77fff640 1 -- 172.21.15.72:0/2939690563 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00c7e50 con 0x55d79fff8f40 2024-04-26T12:51:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7a00006f0 con 0x55d79fff8f40 2024-04-26T12:51:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7b77fff640 1 -- 172.21.15.72:0/2939690563 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca0108070 con 0x55d79fff8f40 2024-04-26T12:51:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7b77fff640 1 -- 172.21.15.72:0/2939690563 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00a9970 con 0x55d79fff8f40 2024-04-26T12:51:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a0000b60 con 0x55d79fff8f40 2024-04-26T12:51:16.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.366+0000 7f7b77fff640 1 -- 172.21.15.72:0/2939690563 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ca00bd5e0 con 0x55d79fff8f40 2024-04-26T12:51:16.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7b77fff640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b70034750 0x7f7b70036c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7b77fff640 1 -- 172.21.15.72:0/2939690563 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f7ca010ed60 con 0x55d79fff8f40 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b70034750 0x7f7b70036c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d7a000b240 0x55d7a000d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000de50 con 0x55d7a000b240 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6c66640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d7a000b240 0x55d7a000d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b70034750 0x7f7b70036c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000ffd0 tx=0x7f7c90010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6c66640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d7a000b240 0x55d7a000d700 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c980083f0 con 0x55d7a000b240 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 realm 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000e260 con 0x55d7a000b240 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c980083f0 con 0x55d7a000b240 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eb00 con 0x55d7a000b240 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c980083f0 con 0x55d7a000b240 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000b240 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c980083f0 con 0x55d7a000b240 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d7a000fc00 0x55d7a0011ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0012570 con 0x55d7a000fc00 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6465640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d7a000fc00 0x55d7a0011ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6465640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d7a000fc00 0x55d7a0011ff0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 20 searching for the correct realm 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d7a00144a0 0x55d7a0016940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0017010 con 0x55d7a00144a0 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d7a00144a0 0x55d7a0016940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.370+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d7a00144a0 0x55d7a0016940 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca5c64640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7c9001fbe0 0x7f7c9003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0017010 con 0x7f7c9001fbe0 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7c9001fbe0 0x7f7c9003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7c9001fbe0 0x7f7c9003a3c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c980083f0 con 0x7f7c9001fbe0 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000fc00 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000b240 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c980083f0 con 0x55d7a000b240 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000b240 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000fc00 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000fc00 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x7f7c9001fbe0 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a00144a0 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.374+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000b240 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x7f7c9001fbe0 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000b240 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000fc00 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000b240 2024-04-26T12:51:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000b240 2024-04-26T12:51:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000fc00 2024-04-26T12:51:16.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.378+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a00144a0 2024-04-26T12:51:16.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000b240 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000fc00 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a00144a0 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000fc00 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a00144a0 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000fc00 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x55d7a000b240 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.382+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f7c9802b040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:16.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000b240 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a000b240 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a000eea0 con 0x55d7a00144a0 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 zone default found 2024-04-26T12:51:16.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 4 Realm: () 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 zonegroup default 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0013130 con 0x55d7a000fc00 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0013a20 con 0x55d7a00144a0 2024-04-26T12:51:16.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0018e70 con 0x55d7a00144a0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 started sync module instance, tier type = 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0018310 con 0x7f7c9001fbe0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94384590784608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0018310 con 0x7f7c9001fbe0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.386+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0019940 con 0x55d7a000b240 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94384590784608] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94384590787632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0018310 con 0x55d7a000b240 2024-04-26T12:51:16.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001a350 con 0x55d7a00144a0 2024-04-26T12:51:16.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94384590790304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001abf0 con 0x55d7a00144a0 2024-04-26T12:51:16.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001b5b0 con 0x7f7c9001fbe0 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.390+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94384590787632] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94384590795008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001b520 con 0x7f7c9001fbe0 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001c330 con 0x55d7a000b240 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94384590790304] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94384590795008] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94384590792512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001bdf0 con 0x55d7a000b240 2024-04-26T12:51:16.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.394+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001c640 con 0x55d7a000fc00 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94384590792512] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94384590797392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001ca30 con 0x55d7a000fc00 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001d3f0 con 0x55d7a000fc00 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94384590797392] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94384590798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001d3f0 con 0x55d7a000fc00 2024-04-26T12:51:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.398+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001ddb0 con 0x55d7a000fc00 2024-04-26T12:51:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94384590798512] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94384590803024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001ddb0 con 0x55d7a000fc00 2024-04-26T12:51:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=0 2024-04-26T12:51:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=1 2024-04-26T12:51:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=2 2024-04-26T12:51:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=3 2024-04-26T12:51:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=4 2024-04-26T12:51:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=5 2024-04-26T12:51:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=6 2024-04-26T12:51:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94384590803024] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 20 add_watcher() i=7 2024-04-26T12:51:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.402+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a00210e0 con 0x55d7a000b240 2024-04-26T12:51:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94384590818064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001df20 con 0x55d7a000b240 2024-04-26T12:51:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94384590818064] v35'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7b5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 5 note: GC not initialized 2024-04-26T12:51:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ad77fe640 20 reqs_thread_entry: start 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 20 Filter name: none 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ad57fa640 20 reqs_thread_entry: start 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0046700 con 0x55d7a000b240 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:51:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0047c50 con 0x55d7a000fc00 2024-04-26T12:51:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.406+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7b5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94384590818064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a00451b0 con 0x55d7a000b240 2024-04-26T12:51:16.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94384590818064] v35'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94384590784608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0020aa0 con 0x7f7c9001fbe0 2024-04-26T12:51:16.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94384590784608] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7ca894a980 20 remove_watcher() i=0 2024-04-26T12:51:16.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7ca894a980 2 removed watcher, disabling cache 2024-04-26T12:51:16.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.410+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94384590787632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0018840 con 0x55d7a000b240 2024-04-26T12:51:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94384590787632] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca894a980 20 remove_watcher() i=1 2024-04-26T12:51:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94384590790304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0019430 con 0x55d7a00144a0 2024-04-26T12:51:16.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca5c64640 1 -- 172.21.15.72:0/2939690563 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94384590790304] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c90037040 con 0x55d7a00144a0 2024-04-26T12:51:16.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca894a980 20 remove_watcher() i=2 2024-04-26T12:51:16.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94384590795008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a0019ea0 con 0x7f7c9001fbe0 2024-04-26T12:51:16.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94384590795008] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x7f7c9001fbe0 2024-04-26T12:51:16.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca894a980 20 remove_watcher() i=3 2024-04-26T12:51:16.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.414+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94384590792512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001b100 con 0x55d7a000b240 2024-04-26T12:51:16.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.418+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94384590792512] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c98026040 con 0x55d7a000b240 2024-04-26T12:51:16.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.418+0000 7f7ca894a980 20 remove_watcher() i=4 2024-04-26T12:51:16.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.418+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94384590797392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001b100 con 0x55d7a000fc00 2024-04-26T12:51:16.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.418+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94384590797392] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.418+0000 7f7ca894a980 20 remove_watcher() i=5 2024-04-26T12:51:16.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.418+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94384590798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001ba50 con 0x55d7a000fc00 2024-04-26T12:51:16.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94384590798512] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 20 remove_watcher() i=6 2024-04-26T12:51:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94384590803024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7a001ba50 con 0x55d7a000fc00 2024-04-26T12:51:16.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca6465640 1 -- 172.21.15.72:0/2939690563 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94384590803024] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ca00f7040 con 0x55d7a000fc00 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 20 remove_watcher() i=7 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d7a000fc00 msgr2=0x55d7a0011ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d7a000fc00 0x55d7a0011ff0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d7a000b240 msgr2=0x55d7a000d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d7a000b240 0x55d7a000d700 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7c9001fbe0 msgr2=0x7f7c9003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f7c9001fbe0 0x7f7c9003a3c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d7a00144a0 msgr2=0x55d7a0016940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d7a00144a0 0x55d7a0016940 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b70034750 msgr2=0x7f7b70036c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b70034750 0x7f7b70036c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000ffd0 tx=0x7f7c90010000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 msgr2=0x55d7a00001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d7a00001b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00d63f0 tx=0x7f7ca00abdb0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.422+0000 7f7ca6c66640 1 -- 172.21.15.72:0/2939690563 reap_dead start 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 shutdown_connections 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/2939690563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fff8f40 0x55d7a00001b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 >> 172.21.15.72:0/2939690563 conn(0x55d79fff5280 msgr2=0x55d79fff28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 shutdown_connections 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/2939690563 wait complete. 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b80034650 msgr2=0x7f7b80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b80034650 0x7f7b80036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55d79ffd57c0 tx=0x7f7c9000f000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79ffec0e0 msgr2=0x55d79ffec500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79ffec0e0 0x55d79ffec500 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b3900 tx=0x7f7ca00c6820 comp rx=0 tx=0).stop 2024-04-26T12:51:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 shutdown_connections 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b80034650 0x7f7b80036b10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/1380032348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79ffec0e0 0x55d79ffec500 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 >> 172.21.15.72:0/1380032348 conn(0x55d79ffe0ef0 msgr2=0x55d79ffe1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 shutdown_connections 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/1380032348 wait complete. 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d79ffd7620 msgr2=0x55d79ffd9a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d79ffd7620 0x55d79ffd9a10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d79fedbbf0 msgr2=0x55d79ffd4c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d79fedbbf0 0x55d79ffd4c30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d79ffdb560 msgr2=0x55d79ffdd950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d79ffdb560 0x55d79ffdd950 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b8c034650 msgr2=0x7f7b8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7b8c034650 0x7f7b8c036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000f70 tx=0x7f7c90001380 comp rx=0 tx=0).stop 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 msgr2=0x55d79ffcdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 --2- 172.21.15.72:0/3386576065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d79fedb2d0 0x55d79ffcdce0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0017ca0 tx=0x7f7ca0017e30 comp rx=0 tx=0).stop 2024-04-26T12:51:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca6c66640 1 -- 172.21.15.72:0/3386576065 reap_dead start 2024-04-26T12:51:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 shutdown_connections 2024-04-26T12:51:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 >> 172.21.15.72:0/3386576065 conn(0x55d79fed6ba0 msgr2=0x55d79ffc1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 shutdown_connections 2024-04-26T12:51:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.426+0000 7f7ca894a980 1 -- 172.21.15.72:0/3386576065 wait complete. 2024-04-26T12:51:16.437 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-04-26T12:51:16.437 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-04-26T12:51:16.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-26T12:51:16.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-26T12:51:16.437 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-26T12:51:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fd8ad5980 1 Processor -- start 2024-04-26T12:51:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fd8ad5980 1 -- start start 2024-04-26T12:51:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fd8ad5980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea4ffde7e0 0x55ea4ffe0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fd8ad5980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea4fe87510 con 0x55ea4ffda2d0 2024-04-26T12:51:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fd8ad5980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55ea4fe8e430 con 0x55ea4ffde7e0 2024-04-26T12:51:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fcddef640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea4ffde7e0 0x55ea4ffe0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fcddef640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55ea4ffde7e0 0x55ea4ffe0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42206/0 (socket says 172.21.15.72:42206) 2024-04-26T12:51:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fcddef640 1 -- 172.21.15.72:0/2457502914 learned_addr learned my addr 172.21.15.72:0/2457502914 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fcddef640 1 -- 172.21.15.72:0/2457502914 >> v1:172.21.15.29:6789/0 conn(0x55ea4ffda2d0 legacy=0x55ea4ffda6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.506+0000 7f3fcddef640 1 -- 172.21.15.72:0/2457502914 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4fe63ae0 con 0x55ea4ffde7e0 2024-04-26T12:51:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fcddef640 1 --2- 172.21.15.72:0/2457502914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffde7e0 0x55ea4ffe0bd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000a5c0 tx=0x7f3fc001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97afef1ee03a6319 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd5def640 1 -- 172.21.15.72:0/2457502914 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc00a6070 con 0x55ea4ffde7e0 2024-04-26T12:51:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd5def640 1 -- 172.21.15.72:0/2457502914 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc00af070 con 0x55ea4ffde7e0 2024-04-26T12:51:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd5def640 1 -- 172.21.15.72:0/2457502914 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc00aa5c0 con 0x55ea4ffde7e0 2024-04-26T12:51:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2457502914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffde7e0 msgr2=0x55ea4ffe0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/2457502914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffde7e0 0x55ea4ffe0bd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000a5c0 tx=0x7f3fc001b340 comp rx=0 tx=0).stop 2024-04-26T12:51:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2457502914 shutdown_connections 2024-04-26T12:51:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/2457502914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffde7e0 0x55ea4ffe0bd0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2457502914 >> 172.21.15.72:0/2457502914 conn(0x55ea4ffd5ba0 msgr2=0x55ea4ffd7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2457502914 shutdown_connections 2024-04-26T12:51:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.510+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2457502914 wait complete. 2024-04-26T12:51:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd8ad5980 1 Processor -- start 2024-04-26T12:51:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd8ad5980 1 -- start start 2024-04-26T12:51:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd8ad5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd8ad5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fedda70 con 0x55ea4ffda2d0 2024-04-26T12:51:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42220/0 (socket says 172.21.15.72:42220) 2024-04-26T12:51:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd65f0640 1 -- 172.21.15.72:0/1210528097 learned_addr learned my addr 172.21.15.72:0/1210528097 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd65f0640 1 -- 172.21.15.72:0/1210528097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea500c5a90 con 0x55ea4ffda2d0 2024-04-26T12:51:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.522+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/1210528097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500c54c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001ea0 tx=0x7f3fc800b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76d69c262c2d93f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3ec4608640 1 -- 172.21.15.72:0/1210528097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc800a040 con 0x55ea4ffda2d0 2024-04-26T12:51:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3ec4608640 1 -- 172.21.15.72:0/1210528097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc800f620 con 0x55ea4ffda2d0 2024-04-26T12:51:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3ec4608640 1 -- 172.21.15.72:0/1210528097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc800f890 con 0x55ea4ffda2d0 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/1210528097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 msgr2=0x55ea500c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/1210528097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500c54c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001ea0 tx=0x7f3fc800b680 comp rx=0 tx=0).stop 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/1210528097 shutdown_connections 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/1210528097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500c54c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/1210528097 >> 172.21.15.72:0/1210528097 conn(0x55ea4ffd5ba0 msgr2=0x55ea500c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/1210528097 shutdown_connections 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/1210528097 wait complete. 2024-04-26T12:51:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 Processor -- start 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- start start 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea4ffe3c00 con 0x55ea4ffda2d0 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42222/0 (socket says 172.21.15.72:42222) 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3109914724 learned_addr learned my addr 172.21.15.72:0/3109914724 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea500cccf0 con 0x55ea4ffda2d0 2024-04-26T12:51:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500cc7b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001fd0 tx=0x7f3fc8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3ec2e05640 1 -- 172.21.15.72:0/3109914724 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8001520 con 0x55ea4ffda2d0 2024-04-26T12:51:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea500ccf80 con 0x55ea4ffda2d0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3ec2e05640 1 -- 172.21.15.72:0/3109914724 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc801ca10 con 0x55ea4ffda2d0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3ec2e05640 1 -- 172.21.15.72:0/3109914724 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc801cd50 con 0x55ea4ffda2d0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.526+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea500cfbc0 con 0x55ea4ffda2d0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3ec2e05640 1 -- 172.21.15.72:0/3109914724 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3fc8017050 con 0x55ea4ffda2d0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3ec2e05640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ebc034650 0x7f3ebc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3ec2e05640 1 -- 172.21.15.72:0/3109914724 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f3fc8015020 con 0x55ea4ffda2d0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ebc034650 0x7f3ebc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea4ffde7e0 0x55ea500d3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea500d3d50 con 0x55ea4ffde7e0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd6df1640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea4ffde7e0 0x55ea500d3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ebc034650 0x7f3ebc036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00ae000 tx=0x7f3fc00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd6df1640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea4ffde7e0 0x55ea500d3810 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3109914724 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea4ffde7e0 2024-04-26T12:51:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea500d0de0 con 0x55ea4ffde7e0 2024-04-26T12:51:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3109914724 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea4ffde7e0 2024-04-26T12:51:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea500d6080 0x55ea500d8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea500d8b60 con 0x55ea500d6080 2024-04-26T12:51:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea500d6080 0x55ea500d8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea500d6080 0x55ea500d8470 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3109914724 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3fc802e070 con 0x55ea500d6080 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea500d4f20 con 0x55ea4ffde7e0 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3109914724 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea4ffde7e0 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea500d9fc0 0x55ea500dc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.530+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea500dcaf0 con 0x55ea500d9fc0 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea500d9fc0 0x55ea500dc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea500d9fc0 0x55ea500dc3b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fcddef640 1 -- 172.21.15.72:0/3109914724 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea500d9fc0 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd8ad5980 1 Processor -- start 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd8ad5980 1 -- start start 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd8ad5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500eab80 0x55ea500eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd8ad5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fee1ab0 con 0x55ea500eab80 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500eab80 0x55ea500eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500eab80 0x55ea500eafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42228/0 (socket says 172.21.15.72:42228) 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3732027186 learned_addr learned my addr 172.21.15.72:0/3732027186 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3732027186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea500eb4e0 con 0x55ea500eab80 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500eab80 0x55ea500eafa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3fc801dfd0 tx=0x7f3fc8018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3ebbfff640 1 -- 172.21.15.72:0/3732027186 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8013130 con 0x55ea500eab80 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea500ebf80 con 0x55ea500eab80 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea500ec450 con 0x55ea500eab80 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3ebbfff640 1 -- 172.21.15.72:0/3732027186 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc80132d0 con 0x55ea500eab80 2024-04-26T12:51:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3ebbfff640 1 -- 172.21.15.72:0/3732027186 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc80135b0 con 0x55ea500eab80 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.534+0000 7f3ebbfff640 1 -- 172.21.15.72:0/3732027186 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3fc8041bd0 con 0x55ea500eab80 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3ebbfff640 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3eb0034650 0x7f3eb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3ebbfff640 1 -- 172.21.15.72:0/3732027186 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f3fc8033d50 con 0x55ea500eab80 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3eb0034650 0x7f3eb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 Processor -- start 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- start start 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3eb0034650 0x7f3eb0036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55ea500d4200 tx=0x7f3fc0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea500c5de0 con 0x55ea500f7bb0 2024-04-26T12:51:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500f7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42238/0 (socket says 172.21.15.72:42238) 2024-04-26T12:51:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 -- 172.21.15.72:0/2113281474 learned_addr learned my addr 172.21.15.72:0/2113281474 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 -- 172.21.15.72:0/2113281474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea500f85a0 con 0x55ea500f7bb0 2024-04-26T12:51:16.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/2113281474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500f7fd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3fc801ffd0 tx=0x7f3fc8027910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d09d02aca6a972 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3eb9ffb640 1 -- 172.21.15.72:0/2113281474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8013dd0 con 0x55ea500f7bb0 2024-04-26T12:51:16.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3eb9ffb640 1 -- 172.21.15.72:0/2113281474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc8049d80 con 0x55ea500f7bb0 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3eb9ffb640 1 -- 172.21.15.72:0/2113281474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc80139e0 con 0x55ea500f7bb0 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2113281474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 msgr2=0x55ea500f7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/2113281474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500f7fd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3fc801ffd0 tx=0x7f3fc8027910 comp rx=0 tx=0).stop 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2113281474 shutdown_connections 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/2113281474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500f7fd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2113281474 >> 172.21.15.72:0/2113281474 conn(0x55ea500f3f40 msgr2=0x55ea500f1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2113281474 shutdown_connections 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/2113281474 wait complete. 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 Processor -- start 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- start start 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd8ad5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55ea500f85a0 con 0x55ea500f7bb0 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42246/0 (socket says 172.21.15.72:42246) 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.538+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 learned_addr learned my addr 172.21.15.72:0/3686123270 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea500ff250 con 0x55ea500f7bb0 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500fed10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3fc802fa30 tx=0x7f3fc801e1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3ea7fff640 1 -- 172.21.15.72:0/3686123270 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc80454f0 con 0x55ea500f7bb0 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea500ff250 con 0x55ea500f7bb0 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3ea7fff640 1 -- 172.21.15.72:0/3686123270 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc806a030 con 0x55ea500f7bb0 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3ea7fff640 1 -- 172.21.15.72:0/3686123270 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc803fcd0 con 0x55ea500f7bb0 2024-04-26T12:51:16.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea500ff6c0 con 0x55ea500f7bb0 2024-04-26T12:51:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3ea7fff640 1 -- 172.21.15.72:0/3686123270 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3fc8048b60 con 0x55ea500f7bb0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3ea7fff640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ea0034650 0x7f3ea0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3ea7fff640 1 -- 172.21.15.72:0/3686123270 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f3fc8070d10 con 0x55ea500f7bb0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ea0034650 0x7f3ea0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea50109cc0 0x55ea5010c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010c8b0 con 0x55ea50109cc0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd6df1640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea50109cc0 0x55ea5010c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ea0034650 0x7f3ea0036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0000c10 tx=0x7f3fc00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd6df1640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea50109cc0 0x55ea5010c160 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 realm 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010cd10 con 0x55ea50109cc0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d5b0 con 0x55ea50109cc0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea5010e6b0 0x55ea50110aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.542+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50111020 con 0x55ea5010e6b0 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea5010e6b0 0x55ea50110aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd65f0640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea5010e6b0 0x55ea50110aa0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd8ad5980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd8ad5980 20 searching for the correct realm 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea50112f90 0x55ea50115450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea50115b20 con 0x55ea50112f90 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea50112f90 0x55ea50115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea50112f90 0x55ea50115450 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fcddef640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3fc00e0040 0x7f3fc00e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea50115b20 con 0x7f3fc00e0040 2024-04-26T12:51:16.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd6df1640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3fc00e0040 0x7f3fc00e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd6df1640 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3fc00e0040 0x7f3fc00e0930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd000a4d0 con 0x7f3fc00e0040 2024-04-26T12:51:16.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.546+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x7f3fc00e0040 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd000a4d0 con 0x7f3fc00e0040 2024-04-26T12:51:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x7f3fc00e0040 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd000a4d0 con 0x7f3fc00e0040 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd000a4d0 con 0x55ea50109cc0 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x7f3fc00e0040 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3fd0032040 con 0x7f3fc00e0040 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.550+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0032040 con 0x55ea50109cc0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3fd0032040 con 0x55ea50109cc0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x7f3fc00e0040 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0032040 con 0x7f3fc00e0040 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0032040 con 0x55ea50109cc0 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.554+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x7f3fc00e0040 2024-04-26T12:51:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0032040 con 0x7f3fc00e0040 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50112f90 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea5010e6b0 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x55ea50109cc0 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3fd0032040 con 0x55ea50109cc0 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ea5010d950 con 0x7f3fc00e0040 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fd0032040 con 0x7f3fc00e0040 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50111870 con 0x55ea50109cc0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fd0032040 con 0x55ea50109cc0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50111870 con 0x55ea50109cc0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fd0032040 con 0x55ea50109cc0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50111870 con 0x55ea50112f90 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 zone default found 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 4 Realm: () 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 zonegroup default 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.558+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50112110 con 0x55ea5010e6b0 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50117980 con 0x55ea50112f90 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50117d20 con 0x55ea50112f90 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 20 started sync module instance, tier type = 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50116e20 con 0x7f3fc00e0040 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0032040 con 0x7f3fc00e0040 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94464854029088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50116e20 con 0x7f3fc00e0040 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea501186e0 con 0x55ea50109cc0 2024-04-26T12:51:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94464854029088] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x7f3fc00e0040 2024-04-26T12:51:16.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94464854033216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50116e20 con 0x55ea50109cc0 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.562+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea501190f0 con 0x55ea50112f90 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.566+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94464854033216] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.566+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.566+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94464854026608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50116d90 con 0x55ea50112f90 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.566+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50119df0 con 0x7f3fc00e0040 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.566+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x7f3fc00e0040 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.566+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94464854039152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011a690 con 0x7f3fc00e0040 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.566+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011b050 con 0x55ea50109cc0 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94464854026608] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94464854039152] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x7f3fc00e0040 2024-04-26T12:51:16.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94464854043552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011a600 con 0x55ea50109cc0 2024-04-26T12:51:16.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011afc0 con 0x55ea5010e6b0 2024-04-26T12:51:16.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94464854043552] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94464854041216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011b8f0 con 0x55ea5010e6b0 2024-04-26T12:51:16.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.570+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011c140 con 0x55ea5010e6b0 2024-04-26T12:51:16.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.574+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94464854041216] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.574+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.574+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94464854045760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011c990 con 0x55ea5010e6b0 2024-04-26T12:51:16.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.574+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d350 con 0x55ea5010e6b0 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94464854052512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d770 con 0x55ea5010e6b0 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=0 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=1 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=2 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=3 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=4 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=5 2024-04-26T12:51:16.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94464854045760] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=6 2024-04-26T12:51:16.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94464854052512] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 add_watcher() i=7 2024-04-26T12:51:16.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:16.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d770 con 0x55ea50109cc0 2024-04-26T12:51:16.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94464854053568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d6e0 con 0x55ea50109cc0 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94464854053568] v35'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3e8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 5 note: GC not initialized 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3e077fe640 20 reqs_thread_entry: start 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.578+0000 7f3fd8ad5980 20 Filter name: none 2024-04-26T12:51:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3e057fa640 20 reqs_thread_entry: start 2024-04-26T12:51:16.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd8ad5980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea50143b50 con 0x55ea50109cc0 2024-04-26T12:51:16.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd8ad5980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:51:16.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ea501450a0 con 0x55ea5010e6b0 2024-04-26T12:51:16.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3e8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94464854053568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50122ef0 con 0x55ea50109cc0 2024-04-26T12:51:16.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94464854053568] v35'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.582+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94464854029088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d2c0 con 0x7f3fc00e0040 2024-04-26T12:51:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.586+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94464854029088] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x7f3fc00e0040 2024-04-26T12:51:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.586+0000 7f3fd8ad5980 20 remove_watcher() i=0 2024-04-26T12:51:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.586+0000 7f3fd8ad5980 2 removed watcher, disabling cache 2024-04-26T12:51:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.586+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94464854033216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d2c0 con 0x55ea50109cc0 2024-04-26T12:51:16.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.586+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94464854033216] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.586+0000 7f3fd8ad5980 20 remove_watcher() i=1 2024-04-26T12:51:16.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.586+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94464854026608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d2c0 con 0x55ea50112f90 2024-04-26T12:51:16.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fcddef640 1 -- 172.21.15.72:0/3686123270 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94464854026608] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc00aaa60 con 0x55ea50112f90 2024-04-26T12:51:16.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd8ad5980 20 remove_watcher() i=2 2024-04-26T12:51:16.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94464854039152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50116970 con 0x7f3fc00e0040 2024-04-26T12:51:16.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94464854039152] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x7f3fc00e0040 2024-04-26T12:51:16.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd8ad5980 20 remove_watcher() i=3 2024-04-26T12:51:16.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94464854043552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea5011d2c0 con 0x55ea50109cc0 2024-04-26T12:51:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94464854043552] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fd0040040 con 0x55ea50109cc0 2024-04-26T12:51:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd8ad5980 20 remove_watcher() i=4 2024-04-26T12:51:16.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.590+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94464854041216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50119a70 con 0x55ea5010e6b0 2024-04-26T12:51:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.594+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94464854041216] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.594+0000 7f3fd8ad5980 20 remove_watcher() i=5 2024-04-26T12:51:16.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.594+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94464854045760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50116970 con 0x55ea5010e6b0 2024-04-26T12:51:16.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.594+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94464854045760] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.594+0000 7f3fd8ad5980 20 remove_watcher() i=6 2024-04-26T12:51:16.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.594+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94464854052512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ea50116970 con 0x55ea5010e6b0 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd65f0640 1 -- 172.21.15.72:0/3686123270 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94464854052512] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8076070 con 0x55ea5010e6b0 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 20 remove_watcher() i=7 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea5010e6b0 msgr2=0x55ea50110aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea5010e6b0 0x55ea50110aa0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea50109cc0 msgr2=0x55ea5010c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea50109cc0 0x55ea5010c160 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3fc00e0040 msgr2=0x7f3fc00e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f3fc00e0040 0x7f3fc00e0930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea50112f90 msgr2=0x55ea50115450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea50112f90 0x55ea50115450 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ea0034650 msgr2=0x7f3ea0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ea0034650 0x7f3ea0036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0000c10 tx=0x7f3fc00c1040 comp rx=0 tx=0).stop 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 msgr2=0x55ea500fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3686123270 reap_dead start 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500fed10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3fc802fa30 tx=0x7f3fc801e1e0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 shutdown_connections 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3686123270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500f7bb0 0x55ea500fed10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 >> 172.21.15.72:0/3686123270 conn(0x55ea500f3f40 msgr2=0x55ea500f15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 shutdown_connections 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3686123270 wait complete. 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3eb0034650 msgr2=0x7f3eb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3eb0034650 0x7f3eb0036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55ea500d4200 tx=0x7f3fc0005ad0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500eab80 msgr2=0x55ea500eafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500eab80 0x55ea500eafa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3fc801dfd0 tx=0x7f3fc8018d50 comp rx=0 tx=0).stop 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 shutdown_connections 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3eb0034650 0x7f3eb0036b10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3732027186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea500eab80 0x55ea500eafa0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 >> 172.21.15.72:0/3732027186 conn(0x55ea500df990 msgr2=0x55ea500e04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 shutdown_connections 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3732027186 wait complete. 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea500d6080 msgr2=0x55ea500d8470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55ea500d6080 0x55ea500d8470 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea4ffde7e0 msgr2=0x55ea500d3810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55ea4ffde7e0 0x55ea500d3810 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea500d9fc0 msgr2=0x55ea500dc3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55ea500d9fc0 0x55ea500dc3b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ebc034650 msgr2=0x7f3ebc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3ebc034650 0x7f3ebc036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00ae000 tx=0x7f3fc00a6000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 msgr2=0x55ea500cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 --2- 172.21.15.72:0/3109914724 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ea4ffda2d0 0x55ea500cc7b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001fd0 tx=0x7f3fc8000bd0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd6df1640 1 -- 172.21.15.72:0/3109914724 reap_dead start 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 shutdown_connections 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 >> 172.21.15.72:0/3109914724 conn(0x55ea4ffd5ba0 msgr2=0x55ea500bfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 shutdown_connections 2024-04-26T12:51:16.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.598+0000 7f3fd8ad5980 1 -- 172.21.15.72:0/3109914724 wait complete. 2024-04-26T12:51:16.610 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-04-26T12:51:16.610 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-04-26T12:51:16.610 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-26T12:51:16.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-26T12:51:16.611 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-26T12:51:16.684 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:16.684 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8aff16a980 1 Processor -- start 2024-04-26T12:51:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8aff16a980 1 -- start start 2024-04-26T12:51:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8aff16a980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a214cdd000 0x55a214d6e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8aff16a980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a214c16510 con 0x55a214d6e8e0 2024-04-26T12:51:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8aff16a980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55a214c1d430 con 0x55a214cdd000 2024-04-26T12:51:16.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8afcc85640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a214cdd000 0x55a214d6e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8af7fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55a214d6e8e0 0x55a214d70cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:49978/0 (socket says 172.21.15.72:49978) 2024-04-26T12:51:16.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8af7fff640 1 -- 172.21.15.72:0/2392110246 learned_addr learned my addr 172.21.15.72:0/2392110246 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:16.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8afcc85640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55a214cdd000 0x55a214d6e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42258/0 (socket says 172.21.15.72:42258) 2024-04-26T12:51:16.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8afcc85640 1 -- 172.21.15.72:0/2392110246 >> v1:172.21.15.29:6789/0 conn(0x55a214d6e8e0 legacy=0x55a214d70cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.682+0000 7f8afcc85640 1 -- 172.21.15.72:0/2392110246 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a214bf2ae0 con 0x55a214cdd000 2024-04-26T12:51:16.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8afcc85640 1 --2- 172.21.15.72:0/2392110246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214d6e3a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8af000a480 tx=0x7f8af001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9943c0bdfcd9eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8af77fe640 1 -- 172.21.15.72:0/2392110246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00b0070 con 0x55a214cdd000 2024-04-26T12:51:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8af77fe640 1 -- 172.21.15.72:0/2392110246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af00ab540 con 0x55a214cdd000 2024-04-26T12:51:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8af77fe640 1 -- 172.21.15.72:0/2392110246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00ab840 con 0x55a214cdd000 2024-04-26T12:51:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392110246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 msgr2=0x55a214d6e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8aff16a980 1 --2- 172.21.15.72:0/2392110246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214d6e3a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8af000a480 tx=0x7f8af001b280 comp rx=0 tx=0).stop 2024-04-26T12:51:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392110246 shutdown_connections 2024-04-26T12:51:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.686+0000 7f8aff16a980 1 --2- 172.21.15.72:0/2392110246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214d6e3a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.690+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392110246 >> 172.21.15.72:0/2392110246 conn(0x55a214d63a80 msgr2=0x55a214d65ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.690+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392110246 shutdown_connections 2024-04-26T12:51:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.690+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392110246 wait complete. 2024-04-26T12:51:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 Processor -- start 2024-04-26T12:51:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- start start 2024-04-26T12:51:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a214c6ca70 con 0x55a214cdd000 2024-04-26T12:51:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42268/0 (socket says 172.21.15.72:42268) 2024-04-26T12:51:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 -- 172.21.15.72:0/1382248357 learned_addr learned my addr 172.21.15.72:0/1382248357 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 -- 172.21.15.72:0/1382248357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a214e56ca0 con 0x55a214cdd000 2024-04-26T12:51:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 --2- 172.21.15.72:0/1382248357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e566d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8af00ae040 tx=0x7f8af0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54793d2275577c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f89eae05640 1 -- 172.21.15.72:0/1382248357 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00b0040 con 0x55a214cdd000 2024-04-26T12:51:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f89eae05640 1 -- 172.21.15.72:0/1382248357 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af00ab9d0 con 0x55a214cdd000 2024-04-26T12:51:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f89eae05640 1 -- 172.21.15.72:0/1382248357 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00abcf0 con 0x55a214cdd000 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- 172.21.15.72:0/1382248357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 msgr2=0x55a214e566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 --2- 172.21.15.72:0/1382248357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e566d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8af00ae040 tx=0x7f8af0003030 comp rx=0 tx=0).stop 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- 172.21.15.72:0/1382248357 shutdown_connections 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 --2- 172.21.15.72:0/1382248357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e566d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- 172.21.15.72:0/1382248357 >> 172.21.15.72:0/1382248357 conn(0x55a214d63a80 msgr2=0x55a214e52260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- 172.21.15.72:0/1382248357 shutdown_connections 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- 172.21.15.72:0/1382248357 wait complete. 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 Processor -- start 2024-04-26T12:51:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- start start 2024-04-26T12:51:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e5d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8aff16a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a214d74e50 con 0x55a214cdd000 2024-04-26T12:51:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e5d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e5d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42274/0 (socket says 172.21.15.72:42274) 2024-04-26T12:51:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.702+0000 7f8afcc85640 1 -- 172.21.15.72:0/3507548762 learned_addr learned my addr 172.21.15.72:0/3507548762 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8afcc85640 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a214e5dd50 con 0x55a214cdd000 2024-04-26T12:51:16.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8afcc85640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e5d810 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8af0018eb0 tx=0x7f8af0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f89e9602640 1 -- 172.21.15.72:0/3507548762 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00b0070 con 0x55a214cdd000 2024-04-26T12:51:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a214e5dfe0 con 0x55a214cdd000 2024-04-26T12:51:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f89e9602640 1 -- 172.21.15.72:0/3507548762 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af00b68f0 con 0x55a214cdd000 2024-04-26T12:51:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a214e60bd0 con 0x55a214cdd000 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f89e9602640 1 -- 172.21.15.72:0/3507548762 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00b6bd0 con 0x55a214cdd000 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f89e9602640 1 -- 172.21.15.72:0/3507548762 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8af00b7420 con 0x55a214cdd000 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f89e9602640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89e4034650 0x7f89e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f89e9602640 1 -- 172.21.15.72:0/3507548762 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f8af00bc070 con 0x55a214cdd000 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8af7fff640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89e4034650 0x7f89e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214d6e8e0 0x55a214e646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e64d60 con 0x55a214d6e8e0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8afd486640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214d6e8e0 0x55a214e646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8af7fff640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89e4034650 0x7f89e4036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8000f70 tx=0x7f8ae80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8afd486640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214d6e8e0 0x55a214e646f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8afd486640 1 -- 172.21.15.72:0/3507548762 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214d6e8e0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e61df0 con 0x55a214d6e8e0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8afd486640 1 -- 172.21.15.72:0/3507548762 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214d6e8e0 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e67100 0x55a214e694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.706+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e69bc0 con 0x55a214e67100 2024-04-26T12:51:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8afcc85640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e67100 0x55a214e694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8afcc85640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e67100 0x55a214e694f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8afcc85640 1 -- 172.21.15.72:0/3507548762 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e67100 2024-04-26T12:51:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e65fa0 con 0x55a214d6e8e0 2024-04-26T12:51:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8afd486640 1 -- 172.21.15.72:0/3507548762 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214d6e8e0 2024-04-26T12:51:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214e6b000 0x55a214e6d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e6db80 con 0x55a214e6b000 2024-04-26T12:51:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8af7fff640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214e6b000 0x55a214e6d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8af7fff640 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214e6b000 0x55a214e6d3f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8af7fff640 1 -- 172.21.15.72:0/3507548762 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214e6b000 2024-04-26T12:51:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8aff16a980 1 Processor -- start 2024-04-26T12:51:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8aff16a980 1 -- start start 2024-04-26T12:51:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8aff16a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e7bbd0 0x55a214e7bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8aff16a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a214c70ab0 con 0x55a214e7bbd0 2024-04-26T12:51:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e7bbd0 0x55a214e7bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e7bbd0 0x55a214e7bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42288/0 (socket says 172.21.15.72:42288) 2024-04-26T12:51:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.710+0000 7f8afcc85640 1 -- 172.21.15.72:0/2392600385 learned_addr learned my addr 172.21.15.72:0/2392600385 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8afcc85640 1 -- 172.21.15.72:0/2392600385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a214e7c530 con 0x55a214e7bbd0 2024-04-26T12:51:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8afcc85640 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e7bbd0 0x55a214e7bff0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8af00e2f60 tx=0x7f8af00c6f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f89e27fc640 1 -- 172.21.15.72:0/2392600385 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00d20b0 con 0x55a214e7bbd0 2024-04-26T12:51:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a214e7cfd0 con 0x55a214e7bbd0 2024-04-26T12:51:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a214e7cfd0 con 0x55a214e7bbd0 2024-04-26T12:51:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f89e27fc640 1 -- 172.21.15.72:0/2392600385 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af00d2250 con 0x55a214e7bbd0 2024-04-26T12:51:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f89e27fc640 1 -- 172.21.15.72:0/2392600385 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00e4bf0 con 0x55a214e7bbd0 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f89e27fc640 1 -- 172.21.15.72:0/2392600385 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8af00c6730 con 0x55a214e7bbd0 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f89e27fc640 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89d40346a0 0x7f89d4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f89e27fc640 1 -- 172.21.15.72:0/2392600385 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f8af00d8050 con 0x55a214e7bbd0 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8af7fff640 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89d40346a0 0x7f89d4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8aff16a980 1 Processor -- start 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8aff16a980 1 -- start start 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8af7fff640 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89d40346a0 0x7f89d4036b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800bf60 tx=0x7f8ae800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8aff16a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e88de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8aff16a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a214e56f30 con 0x55a214e889c0 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e88de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e88de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42298/0 (socket says 172.21.15.72:42298) 2024-04-26T12:51:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8afcc85640 1 -- 172.21.15.72:0/1609411809 learned_addr learned my addr 172.21.15.72:0/1609411809 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.714+0000 7f8afcc85640 1 -- 172.21.15.72:0/1609411809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a214e893b0 con 0x55a214e889c0 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8afcc85640 1 --2- 172.21.15.72:0/1609411809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e88de0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8af00d2fd0 tx=0x7f8af00c9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba24d696a87aa95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f89d3fff640 1 -- 172.21.15.72:0/1609411809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00e16e0 con 0x55a214e889c0 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f89d3fff640 1 -- 172.21.15.72:0/1609411809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af00c6a20 con 0x55a214e889c0 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f89d3fff640 1 -- 172.21.15.72:0/1609411809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00dca30 con 0x55a214e889c0 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- 172.21.15.72:0/1609411809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 msgr2=0x55a214e88de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 --2- 172.21.15.72:0/1609411809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e88de0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8af00d2fd0 tx=0x7f8af00c9f70 comp rx=0 tx=0).stop 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- 172.21.15.72:0/1609411809 shutdown_connections 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 --2- 172.21.15.72:0/1609411809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e88de0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- 172.21.15.72:0/1609411809 >> 172.21.15.72:0/1609411809 conn(0x55a214e84d50 msgr2=0x55a214e82db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- 172.21.15.72:0/1609411809 shutdown_connections 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- 172.21.15.72:0/1609411809 wait complete. 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 Processor -- start 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- start start 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e8fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a214e893b0 con 0x55a214e889c0 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e8fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8afcc85640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e8fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42310/0 (socket says 172.21.15.72:42310) 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 learned_addr learned my addr 172.21.15.72:0/4091947990 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a214e90060 con 0x55a214e889c0 2024-04-26T12:51:16.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8afcc85640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e8fb20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8af00d2fd0 tx=0x7f8af00e61c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f89d27fc640 1 -- 172.21.15.72:0/4091947990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00e45a0 con 0x55a214e889c0 2024-04-26T12:51:16.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f89d27fc640 1 -- 172.21.15.72:0/4091947990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af00dca30 con 0x55a214e889c0 2024-04-26T12:51:16.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a214e90060 con 0x55a214e889c0 2024-04-26T12:51:16.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f89d27fc640 1 -- 172.21.15.72:0/4091947990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af00e4740 con 0x55a214e889c0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.718+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a214e90060 con 0x55a214e889c0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f89d27fc640 1 -- 172.21.15.72:0/4091947990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8af00ff040 con 0x55a214e889c0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f89d27fc640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89c8034650 0x7f89c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f89d27fc640 1 -- 172.21.15.72:0/4091947990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f8af00fd020 con 0x55a214e889c0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8af7fff640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89c8034650 0x7f89c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214e9aad0 0x55a214e9cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9d6c0 con 0x55a214e9aad0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afd486640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214e9aad0 0x55a214e9cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8af7fff640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89c8034650 0x7f89c8036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a214e6df80 tx=0x7f8ae8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afd486640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214e9aad0 0x55a214e9cf70 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 realm 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9db20 con 0x55a214e9aad0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e3c0 con 0x55a214e9aad0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e9f4c0 0x55a214ea18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea1e30 con 0x55a214e9f4c0 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afcc85640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e9f4c0 0x55a214ea18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afcc85640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e9f4c0 0x55a214ea18b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 20 searching for the correct realm 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214ea3d60 0x55a214ea6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.722+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea68f0 con 0x55a214ea3d60 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8af7fff640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214ea3d60 0x55a214ea6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8af7fff640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214ea3d60 0x55a214ea6220 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8af7fff640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8ae8037040 0x7f8ae8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea68f0 con 0x7f8ae8037040 2024-04-26T12:51:16.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8ae8037040 0x7f8ae8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8ae8037040 0x7f8ae8036410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af800a4d0 con 0x7f8ae8037040 2024-04-26T12:51:16.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.726+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x7f8ae8037040 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af800a4d0 con 0x7f8ae8037040 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x7f8ae8037040 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af800a4d0 con 0x7f8ae8037040 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af800a4d0 con 0x55a214e9aad0 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x7f8ae8037040 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8af8032040 con 0x7f8ae8037040 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af8032040 con 0x55a214e9aad0 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8af8032040 con 0x55a214e9aad0 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.730+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x7f8ae8037040 2024-04-26T12:51:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af8032040 con 0x7f8ae8037040 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af8032040 con 0x55a214e9aad0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x7f8ae8037040 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af8032040 con 0x7f8ae8037040 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214ea3d60 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9f4c0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.734+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x55a214e9aad0 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8af8032040 con 0x55a214e9aad0 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a214e9e760 con 0x7f8ae8037040 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af8032040 con 0x7f8ae8037040 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea2680 con 0x55a214e9aad0 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8af8032040 con 0x55a214e9aad0 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea2680 con 0x55a214e9aad0 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8af8032040 con 0x55a214e9aad0 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea2680 con 0x55a214ea3d60 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 zone default found 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 4 Realm: () 2024-04-26T12:51:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 zonegroup default 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea2f20 con 0x55a214e9f4c0 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea8750 con 0x55a214ea3d60 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea8af0 con 0x55a214ea3d60 2024-04-26T12:51:16.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 started sync module instance, tier type = 2024-04-26T12:51:16.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:16.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea7bf0 con 0x7f8ae8037040 2024-04-26T12:51:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8032040 con 0x7f8ae8037040 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94154623975744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea7bf0 con 0x7f8ae8037040 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.738+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea9530 con 0x55a214e9aad0 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.742+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94154623975744] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x7f8ae8037040 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.742+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.742+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94154623979520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea7bf0 con 0x55a214e9aad0 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.742+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea9f40 con 0x55a214ea3d60 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.742+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94154623979520] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94154623973184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea7b60 con 0x55a214ea3d60 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eaacb0 con 0x7f8ae8037040 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x7f8ae8037040 2024-04-26T12:51:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94154623985632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eab550 con 0x7f8ae8037040 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eabf10 con 0x55a214e9aad0 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94154623973184] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94154623985632] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x7f8ae8037040 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94154623990368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eabe80 con 0x55a214e9aad0 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.746+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eab4b0 con 0x55a214e9f4c0 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94154623990368] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94154623987712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eac7b0 con 0x55a214e9f4c0 2024-04-26T12:51:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ead000 con 0x55a214e9f4c0 2024-04-26T12:51:16.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94154623996832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eadc70 con 0x55a214e9f4c0 2024-04-26T12:51:16.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eae630 con 0x55a214e9f4c0 2024-04-26T12:51:16.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.750+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94154623987712] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94154623992576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eae630 con 0x55a214e9f4c0 2024-04-26T12:51:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=0 2024-04-26T12:51:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=1 2024-04-26T12:51:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=2 2024-04-26T12:51:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=3 2024-04-26T12:51:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=4 2024-04-26T12:51:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=5 2024-04-26T12:51:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94154623996832] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=6 2024-04-26T12:51:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94154623992576] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 20 add_watcher() i=7 2024-04-26T12:51:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ead7c0 con 0x55a214e9aad0 2024-04-26T12:51:16.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.754+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94154623997888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eaeb00 con 0x55a214e9aad0 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94154623997888] v35'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f89b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 5 note: GC not initialized 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f89b1fe3640 20 reqs_thread_entry: start 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 20 Filter name: none 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f89237fe640 20 reqs_thread_entry: start 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ed4890 con 0x55a214e9aad0 2024-04-26T12:51:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:51:16.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a214ed5de0 con 0x55a214e9f4c0 2024-04-26T12:51:16.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f89b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.758+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94154623997888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eb3ad0 con 0x55a214e9aad0 2024-04-26T12:51:16.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94154623997888] v35'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94154623975744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ead7c0 con 0x7f8ae8037040 2024-04-26T12:51:16.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94154623975744] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x7f8ae8037040 2024-04-26T12:51:16.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8aff16a980 20 remove_watcher() i=0 2024-04-26T12:51:16.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8aff16a980 2 removed watcher, disabling cache 2024-04-26T12:51:16.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94154623979520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea8140 con 0x55a214e9aad0 2024-04-26T12:51:16.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94154623979520] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8aff16a980 20 remove_watcher() i=1 2024-04-26T12:51:16.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.762+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94154623973184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea8140 con 0x55a214ea3d60 2024-04-26T12:51:16.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.766+0000 7f8af7fff640 1 -- 172.21.15.72:0/4091947990 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94154623973184] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae800e620 con 0x55a214ea3d60 2024-04-26T12:51:16.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.766+0000 7f8aff16a980 20 remove_watcher() i=2 2024-04-26T12:51:16.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.766+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94154623985632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea8140 con 0x7f8ae8037040 2024-04-26T12:51:16.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.766+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94154623985632] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x7f8ae8037040 2024-04-26T12:51:16.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.766+0000 7f8aff16a980 20 remove_watcher() i=3 2024-04-26T12:51:16.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.766+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94154623990368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eaa7e0 con 0x55a214e9aad0 2024-04-26T12:51:16.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.770+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94154623990368] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af8040040 con 0x55a214e9aad0 2024-04-26T12:51:16.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.770+0000 7f8aff16a980 20 remove_watcher() i=4 2024-04-26T12:51:16.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.770+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94154623987712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ea8140 con 0x55a214e9f4c0 2024-04-26T12:51:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.770+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94154623987712] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.770+0000 7f8aff16a980 20 remove_watcher() i=5 2024-04-26T12:51:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.770+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94154623996832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214eaba60 con 0x55a214e9f4c0 2024-04-26T12:51:16.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94154623996832] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 20 remove_watcher() i=6 2024-04-26T12:51:16.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94154623992576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a214ead850 con 0x55a214e9f4c0 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8afcc85640 1 -- 172.21.15.72:0/4091947990 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94154623992576] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af00b3040 con 0x55a214e9f4c0 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 20 remove_watcher() i=7 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e9f4c0 msgr2=0x55a214ea18b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e9f4c0 0x55a214ea18b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214e9aad0 msgr2=0x55a214e9cf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214e9aad0 0x55a214e9cf70 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8ae8037040 msgr2=0x7f8ae8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f8ae8037040 0x7f8ae8036410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214ea3d60 msgr2=0x55a214ea6220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214ea3d60 0x55a214ea6220 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89c8034650 msgr2=0x7f89c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89c8034650 0x7f89c8036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a214e6df80 tx=0x7f8ae8010000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 msgr2=0x55a214e8fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8afd486640 1 -- 172.21.15.72:0/4091947990 reap_dead start 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e8fb20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8af00d2fd0 tx=0x7f8af00e61c0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 shutdown_connections 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/4091947990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e889c0 0x55a214e8fb20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 >> 172.21.15.72:0/4091947990 conn(0x55a214e84d50 msgr2=0x55a214e823b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 shutdown_connections 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/4091947990 wait complete. 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89d40346a0 msgr2=0x7f89d4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89d40346a0 0x7f89d4036b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800bf60 tx=0x7f8ae800f000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e7bbd0 msgr2=0x55a214e7bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e7bbd0 0x55a214e7bff0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8af00e2f60 tx=0x7f8af00c6f40 comp rx=0 tx=0).stop 2024-04-26T12:51:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 shutdown_connections 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89d40346a0 0x7f89d4036b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/2392600385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214e7bbd0 0x55a214e7bff0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 >> 172.21.15.72:0/2392600385 conn(0x55a214e709e0 msgr2=0x55a214e714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 shutdown_connections 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/2392600385 wait complete. 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e67100 msgr2=0x55a214e694f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55a214e67100 0x55a214e694f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214d6e8e0 msgr2=0x55a214e646f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.774+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55a214d6e8e0 0x55a214e646f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214e6b000 msgr2=0x55a214e6d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55a214e6b000 0x55a214e6d3f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89e4034650 msgr2=0x7f89e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f89e4034650 0x7f89e4036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8000f70 tx=0x7f8ae80012c0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 msgr2=0x55a214e5d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 --2- 172.21.15.72:0/3507548762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a214cdd000 0x55a214e5d810 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8af0018eb0 tx=0x7f8af0018020 comp rx=0 tx=0).stop 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8afd486640 1 -- 172.21.15.72:0/3507548762 reap_dead start 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 shutdown_connections 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 >> 172.21.15.72:0/3507548762 conn(0x55a214d63a80 msgr2=0x55a214e50d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 shutdown_connections 2024-04-26T12:51:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.778+0000 7f8aff16a980 1 -- 172.21.15.72:0/3507548762 wait complete. 2024-04-26T12:51:16.788 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-26T12:51:16.788 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-26T12:51:16.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-26T12:51:16.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-26T12:51:16.788 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-26T12:51:16.866 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:16.867 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:16.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3749ada980 1 Processor -- start 2024-04-26T12:51:16.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3749ada980 1 -- start start 2024-04-26T12:51:16.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3749ada980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56129288b7d0 0x56129288dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3749ada980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561292734510 con 0x561292887310 2024-04-26T12:51:16.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3749ada980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56129273b430 con 0x56129288b7d0 2024-04-26T12:51:16.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3746df4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56129288b7d0 0x56129288dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f37475f5640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x561292887310 0x5612928876f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:49986/0 (socket says 172.21.15.72:49986) 2024-04-26T12:51:16.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f37475f5640 1 -- 172.21.15.72:0/1088319052 learned_addr learned my addr 172.21.15.72:0/1088319052 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:16.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3746df4640 1 -- 172.21.15.72:0/1088319052 >> v1:172.21.15.29:6789/0 conn(0x561292887310 legacy=0x5612928876f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.866+0000 7f3746df4640 1 -- 172.21.15.72:0/1088319052 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561292710ae0 con 0x56129288b7d0 2024-04-26T12:51:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3746df4640 1 --2- 172.21.15.72:0/1088319052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56129288b7d0 0x56129288dbc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f373c00a480 tx=0x7f373c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4705165221e5b926 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f37465f3640 1 -- 172.21.15.72:0/1088319052 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f373c0b0070 con 0x56129288b7d0 2024-04-26T12:51:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f37465f3640 1 -- 172.21.15.72:0/1088319052 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373c0ab540 con 0x56129288b7d0 2024-04-26T12:51:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f37465f3640 1 -- 172.21.15.72:0/1088319052 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f373c0ab840 con 0x56129288b7d0 2024-04-26T12:51:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3749ada980 1 -- 172.21.15.72:0/1088319052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56129288b7d0 msgr2=0x56129288dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3749ada980 1 --2- 172.21.15.72:0/1088319052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56129288b7d0 0x56129288dbc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f373c00a480 tx=0x7f373c01b280 comp rx=0 tx=0).stop 2024-04-26T12:51:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3749ada980 1 -- 172.21.15.72:0/1088319052 shutdown_connections 2024-04-26T12:51:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3749ada980 1 --2- 172.21.15.72:0/1088319052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56129288b7d0 0x56129288dbc0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3749ada980 1 -- 172.21.15.72:0/1088319052 >> 172.21.15.72:0/1088319052 conn(0x561292882be0 msgr2=0x561292885000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3749ada980 1 -- 172.21.15.72:0/1088319052 shutdown_connections 2024-04-26T12:51:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.870+0000 7f3749ada980 1 -- 172.21.15.72:0/1088319052 wait complete. 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.882+0000 7f3749ada980 1 Processor -- start 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.882+0000 7f3749ada980 1 -- start start 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.882+0000 7f3749ada980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292972450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.882+0000 7f3749ada980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56129278aa70 con 0x561292887310 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.882+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292972450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.882+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292972450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42332/0 (socket says 172.21.15.72:42332) 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.882+0000 7f37475f5640 1 -- 172.21.15.72:0/915348763 learned_addr learned my addr 172.21.15.72:0/915348763 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f37475f5640 1 -- 172.21.15.72:0/915348763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561292972a20 con 0x561292887310 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f37475f5640 1 --2- 172.21.15.72:0/915348763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292972450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f37380015f0 tx=0x7f3738001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d852dfaf706ee59d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f363560a640 1 -- 172.21.15.72:0/915348763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738004530 con 0x561292887310 2024-04-26T12:51:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f363560a640 1 -- 172.21.15.72:0/915348763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37380046f0 con 0x561292887310 2024-04-26T12:51:16.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f363560a640 1 -- 172.21.15.72:0/915348763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738004a90 con 0x561292887310 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- 172.21.15.72:0/915348763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 msgr2=0x561292972450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 --2- 172.21.15.72:0/915348763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292972450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f37380015f0 tx=0x7f3738001ab0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- 172.21.15.72:0/915348763 shutdown_connections 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 --2- 172.21.15.72:0/915348763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292972450 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- 172.21.15.72:0/915348763 >> 172.21.15.72:0/915348763 conn(0x561292882be0 msgr2=0x56129296dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- 172.21.15.72:0/915348763 shutdown_connections 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- 172.21.15.72:0/915348763 wait complete. 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 Processor -- start 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- start start 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292979720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561292890bf0 con 0x561292887310 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292979720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292979720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42344/0 (socket says 172.21.15.72:42344) 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f37475f5640 1 -- 172.21.15.72:0/3550564172 learned_addr learned my addr 172.21.15.72:0/3550564172 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f37475f5640 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561292979c60 con 0x561292887310 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f37475f5640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292979720 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5612929732e0 tx=0x7f3738000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3633e07640 1 -- 172.21.15.72:0/3550564172 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738013760 con 0x561292887310 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561292979ef0 con 0x561292887310 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3633e07640 1 -- 172.21.15.72:0/3550564172 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3738013900 con 0x561292887310 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3633e07640 1 -- 172.21.15.72:0/3550564172 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738013be0 con 0x561292887310 2024-04-26T12:51:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.886+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129297cb30 con 0x561292887310 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3633e07640 1 -- 172.21.15.72:0/3550564172 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3738010070 con 0x561292887310 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3633e07640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3633e07640 1 -- 172.21.15.72:0/3550564172 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f3738018070 con 0x561292887310 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3746df4640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56129288b7d0 0x561292980650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561292980cc0 con 0x56129288b7d0 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3747df6640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56129288b7d0 0x561292980650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3746df4640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ad000 tx=0x7f373c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3747df6640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56129288b7d0 0x561292980650 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3747df6640 1 -- 172.21.15.72:0/3550564172 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37400083f0 con 0x56129288b7d0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56129297dd50 con 0x56129288b7d0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3747df6640 1 -- 172.21.15.72:0/3550564172 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37400083f0 con 0x56129288b7d0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561292983010 0x561292985400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561292985ad0 con 0x561292983010 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f37475f5640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561292983010 0x561292985400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.890+0000 7f37475f5640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561292983010 0x561292985400 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f37475f5640 1 -- 172.21.15.72:0/3550564172 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f373801b030 con 0x561292983010 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561292981eb0 con 0x56129288b7d0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3747df6640 1 -- 172.21.15.72:0/3550564172 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37400083f0 con 0x56129288b7d0 2024-04-26T12:51:16.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561292986f10 0x561292989300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561292989a90 con 0x561292986f10 2024-04-26T12:51:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3746df4640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561292986f10 0x561292989300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3746df4640 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561292986f10 0x561292989300 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3746df4640 1 -- 172.21.15.72:0/3550564172 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f373c0b3040 con 0x561292986f10 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 Processor -- start 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 -- start start 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292997aa0 0x561292997ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56129278eab0 con 0x561292997aa0 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292997aa0 0x561292997ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292997aa0 0x561292997ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42354/0 (socket says 172.21.15.72:42354) 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f37475f5640 1 -- 172.21.15.72:0/2294621110 learned_addr learned my addr 172.21.15.72:0/2294621110 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f37475f5640 1 -- 172.21.15.72:0/2294621110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561292998400 con 0x561292997aa0 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f37475f5640 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292997aa0 0x561292997ec0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f37380483b0 tx=0x7f3738012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3631602640 1 -- 172.21.15.72:0/2294621110 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738039030 con 0x561292997aa0 2024-04-26T12:51:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561292998ea0 con 0x561292997aa0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561292999370 con 0x561292997aa0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3631602640 1 -- 172.21.15.72:0/2294621110 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37380413d0 con 0x561292997aa0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.894+0000 7f3631602640 1 -- 172.21.15.72:0/2294621110 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738043040 con 0x561292997aa0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3631602640 1 -- 172.21.15.72:0/2294621110 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f37380416b0 con 0x561292997aa0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3631602640 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36200346a0 0x7f3620036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3631602640 1 -- 172.21.15.72:0/2294621110 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f373803d070 con 0x561292997aa0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3746df4640 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36200346a0 0x7f3620036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 Processor -- start 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- start start 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3746df4640 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36200346a0 0x7f3620036b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ab510 tx=0x7f373c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612927fd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561292972d70 con 0x5612927fccd0 2024-04-26T12:51:16.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612927fd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612927fd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42366/0 (socket says 172.21.15.72:42366) 2024-04-26T12:51:16.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 -- 172.21.15.72:0/3443367307 learned_addr learned my addr 172.21.15.72:0/3443367307 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 -- 172.21.15.72:0/3443367307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612927fb500 con 0x5612927fccd0 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 --2- 172.21.15.72:0/3443367307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612927fd0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3738047160 tx=0x7f37380335b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5829775c34123745 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f362affd640 1 -- 172.21.15.72:0/3443367307 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738051e10 con 0x5612927fccd0 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f362affd640 1 -- 172.21.15.72:0/3443367307 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3738034890 con 0x5612927fccd0 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f362affd640 1 -- 172.21.15.72:0/3443367307 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738035450 con 0x5612927fccd0 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- 172.21.15.72:0/3443367307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 msgr2=0x5612927fd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 --2- 172.21.15.72:0/3443367307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612927fd0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3738047160 tx=0x7f37380335b0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- 172.21.15.72:0/3443367307 shutdown_connections 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 --2- 172.21.15.72:0/3443367307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612927fd0f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- 172.21.15.72:0/3443367307 >> 172.21.15.72:0/3443367307 conn(0x5612929a0e00 msgr2=0x56129299ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- 172.21.15.72:0/3443367307 shutdown_connections 2024-04-26T12:51:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- 172.21.15.72:0/3443367307 wait complete. 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 Processor -- start 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- start start 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612929adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f3749ada980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5612927fb910 con 0x5612927fccd0 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612929adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612929adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42376/0 (socket says 172.21.15.72:42376) 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.898+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 learned_addr learned my addr 172.21.15.72:0/4000986203 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612929ae4c0 con 0x5612927fccd0 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f37475f5640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612929adf80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3738046010 tx=0x7f373802cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f36297fa640 1 -- 172.21.15.72:0/4000986203 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3738075070 con 0x5612927fccd0 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612929ae4c0 con 0x5612927fccd0 2024-04-26T12:51:16.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f36297fa640 1 -- 172.21.15.72:0/4000986203 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373803b130 con 0x5612927fccd0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f36297fa640 1 -- 172.21.15.72:0/4000986203 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f373803b320 con 0x5612927fccd0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612929ae4c0 con 0x5612927fccd0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f36297fa640 1 -- 172.21.15.72:0/4000986203 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3738078070 con 0x5612927fccd0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f36297fa640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3610034650 0x7f3610036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f36297fa640 1 -- 172.21.15.72:0/4000986203 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f373807bd30 con 0x5612927fccd0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3746df4640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3610034650 0x7f3610036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5612929b9020 0x5612929bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929bbc10 con 0x5612929b9020 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3747df6640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5612929b9020 0x5612929bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3746df4640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3610034650 0x7f3610036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f373c0b6fd0 tx=0x7f373c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3747df6640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5612929b9020 0x5612929bb4c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37400083f0 con 0x5612929b9020 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 realm 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929bc020 con 0x5612929b9020 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37400083f0 con 0x5612929b9020 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929bc8c0 con 0x5612929b9020 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37400083f0 con 0x5612929b9020 2024-04-26T12:51:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929b9020 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.902+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37400083f0 con 0x5612929b9020 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5612929bd9c0 0x5612929bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929c0330 con 0x5612929bd9c0 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f37475f5640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5612929bd9c0 0x5612929bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f37475f5640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5612929bd9c0 0x5612929bfdb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 20 searching for the correct realm 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5612929c22a0 0x5612929c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929c4e30 con 0x5612929c22a0 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3746df4640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5612929c22a0 0x5612929c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3746df4640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5612929c22a0 0x5612929c4760 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3746df4640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f373c0ab030 0x7f373c0b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929c4e30 con 0x7f373c0ab030 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3747df6640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f373c0ab030 0x7f373c0b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3747df6640 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f373c0ab030 0x7f373c0b7400 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37400083f0 con 0x7f373c0ab030 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929bd9c0 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.906+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929b9020 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37400083f0 con 0x5612929b9020 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929b9020 2024-04-26T12:51:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929bd9c0 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929bd9c0 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x7f373c0ab030 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929c22a0 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929b9020 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x7f373c0ab030 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929b9020 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x7f373c0ab030 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929c22a0 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929c22a0 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.910+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929bd9c0 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929c22a0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929c22a0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929b9020 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929b9020 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929bd9c0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929c22a0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x7f373c0ab030 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929b9020 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929bd9c0 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929c22a0 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.914+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929bd9c0 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x7f373c0ab030 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929c22a0 2024-04-26T12:51:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929bd9c0 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x5612929b9020 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f374002b040 con 0x7f373c0ab030 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929b9020 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929b9020 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929bcc60 con 0x5612929c22a0 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 zone default found 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 4 Realm: () 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 zonegroup default 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.918+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929c0e50 con 0x5612929bd9c0 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929c1740 con 0x5612929c22a0 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929c6c90 con 0x5612929c22a0 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 20 started sync module instance, tier type = 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c6130 con 0x7f373c0ab030 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94637769121168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c6790 con 0x7f373c0ab030 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c7650 con 0x5612929b9020 2024-04-26T12:51:16.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.922+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94637769121168] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94637769122704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c7650 con 0x5612929b9020 2024-04-26T12:51:16.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c8010 con 0x5612929c22a0 2024-04-26T12:51:16.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94637769128800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c88b0 con 0x5612929c22a0 2024-04-26T12:51:16.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c92f0 con 0x7f373c0ab030 2024-04-26T12:51:16.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94637769122704] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94637769133504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c96e0 con 0x7f373c0ab030 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.926+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca0a0 con 0x5612929b9020 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94637769128800] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94637769133504] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94637769126304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c9bf0 con 0x5612929b9020 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca440 con 0x5612929bd9c0 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94637769126304] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94637769137136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca010 con 0x5612929bd9c0 2024-04-26T12:51:16.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.930+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929cb140 con 0x5612929bd9c0 2024-04-26T12:51:16.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.934+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.934+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94637769141872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929cb900 con 0x5612929bd9c0 2024-04-26T12:51:16.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.934+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929cc420 con 0x5612929bd9c0 2024-04-26T12:51:16.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.934+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94637769137136] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94637769141872] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94637769146096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929cb350 con 0x5612929bd9c0 2024-04-26T12:51:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=0 2024-04-26T12:51:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=1 2024-04-26T12:51:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=2 2024-04-26T12:51:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=3 2024-04-26T12:51:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=4 2024-04-26T12:51:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=5 2024-04-26T12:51:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=6 2024-04-26T12:51:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94637769146096] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 add_watcher() i=7 2024-04-26T12:51:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929cf410 con 0x5612929b9020 2024-04-26T12:51:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94637769140192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929cc8c0 con 0x5612929b9020 2024-04-26T12:51:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94637769140192] v35'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f35fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.938+0000 7f3749ada980 5 note: GC not initialized 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f35fcfe1640 20 reqs_thread_entry: start 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 20 Filter name: none 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f35767fc640 20 reqs_thread_entry: start 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 20 rados->read ofs=0 len=0 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929f2730 con 0x5612929b9020 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:51:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612929f3c80 con 0x5612929bd9c0 2024-04-26T12:51:16.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f35fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:16.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94637769140192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929f0d30 con 0x5612929b9020 2024-04-26T12:51:16.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94637769140192] v35'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.942+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94637769121168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca7e0 con 0x7f373c0ab030 2024-04-26T12:51:16.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.946+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94637769121168] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.946+0000 7f3749ada980 20 remove_watcher() i=0 2024-04-26T12:51:16.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.946+0000 7f3749ada980 2 removed watcher, disabling cache 2024-04-26T12:51:16.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.946+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94637769122704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca7e0 con 0x5612929b9020 2024-04-26T12:51:16.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.946+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94637769122704] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.946+0000 7f3749ada980 20 remove_watcher() i=1 2024-04-26T12:51:16.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.946+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94637769128800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca7e0 con 0x5612929c22a0 2024-04-26T12:51:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3746df4640 1 -- 172.21.15.72:0/4000986203 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94637769128800] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f373c0b3040 con 0x5612929c22a0 2024-04-26T12:51:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3749ada980 20 remove_watcher() i=2 2024-04-26T12:51:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94637769133504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca7e0 con 0x7f373c0ab030 2024-04-26T12:51:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94637769133504] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x7f373c0ab030 2024-04-26T12:51:16.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3749ada980 20 remove_watcher() i=3 2024-04-26T12:51:16.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94637769126304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c8dc0 con 0x5612929b9020 2024-04-26T12:51:16.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94637769126304] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3740026040 con 0x5612929b9020 2024-04-26T12:51:16.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3749ada980 20 remove_watcher() i=4 2024-04-26T12:51:16.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.950+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94637769137136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929ca7e0 con 0x5612929bd9c0 2024-04-26T12:51:16.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.954+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94637769137136] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.954+0000 7f3749ada980 20 remove_watcher() i=5 2024-04-26T12:51:16.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.954+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94637769141872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c71a0 con 0x5612929bd9c0 2024-04-26T12:51:16.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94637769141872] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 20 remove_watcher() i=6 2024-04-26T12:51:16.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94637769146096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612929c71a0 con 0x5612929bd9c0 2024-04-26T12:51:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f37475f5640 1 -- 172.21.15.72:0/4000986203 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94637769146096] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3738077030 con 0x5612929bd9c0 2024-04-26T12:51:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 20 remove_watcher() i=7 2024-04-26T12:51:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5612929bd9c0 msgr2=0x5612929bfdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5612929bd9c0 0x5612929bfdb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5612929b9020 msgr2=0x5612929bb4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5612929b9020 0x5612929bb4c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f373c0ab030 msgr2=0x7f373c0b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f373c0ab030 0x7f373c0b7400 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5612929c22a0 msgr2=0x5612929c4760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5612929c22a0 0x5612929c4760 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3610034650 msgr2=0x7f3610036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3610034650 0x7f3610036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f373c0b6fd0 tx=0x7f373c0a6000 comp rx=0 tx=0).stop 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 msgr2=0x5612929adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3747df6640 1 -- 172.21.15.72:0/4000986203 reap_dead start 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612929adf80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3738046010 tx=0x7f373802cf20 comp rx=0 tx=0).stop 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 shutdown_connections 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/4000986203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5612927fccd0 0x5612929adf80 secure :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3738046010 tx=0x7f373802cf20 comp rx=0 tx=0).stop 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 >> 172.21.15.72:0/4000986203 conn(0x5612929a0e00 msgr2=0x56129299e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 shutdown_connections 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/4000986203 wait complete. 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36200346a0 msgr2=0x7f3620036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36200346a0 0x7f3620036b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ab510 tx=0x7f373c005a10 comp rx=0 tx=0).stop 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292997aa0 msgr2=0x561292997ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292997aa0 0x561292997ec0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f37380483b0 tx=0x7f3738012ef0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 shutdown_connections 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36200346a0 0x7f3620036b60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/2294621110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292997aa0 0x561292997ec0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 >> 172.21.15.72:0/2294621110 conn(0x56129298c8b0 msgr2=0x56129298d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 shutdown_connections 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/2294621110 wait complete. 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561292983010 msgr2=0x561292985400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x561292983010 0x561292985400 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56129288b7d0 msgr2=0x561292980650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56129288b7d0 0x561292980650 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561292986f10 msgr2=0x561292989300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x561292986f10 0x561292989300 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 msgr2=0x7f362c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ad000 tx=0x7f373c0a5040 comp rx=0 tx=0).stop 2024-04-26T12:51:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 msgr2=0x561292979720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 --2- 172.21.15.72:0/3550564172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561292887310 0x561292979720 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5612929732e0 tx=0x7f3738000f50 comp rx=0 tx=0).stop 2024-04-26T12:51:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3747df6640 1 -- 172.21.15.72:0/3550564172 reap_dead start 2024-04-26T12:51:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 shutdown_connections 2024-04-26T12:51:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 >> 172.21.15.72:0/3550564172 conn(0x561292882be0 msgr2=0x56129296caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 shutdown_connections 2024-04-26T12:51:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:16.958+0000 7f3749ada980 1 -- 172.21.15.72:0/3550564172 wait complete. 2024-04-26T12:51:16.971 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-04-26T12:51:16.972 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-04-26T12:51:16.972 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-26T12:51:16.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-26T12:51:16.972 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-26T12:51:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:17.055 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ef840980 1 Processor -- start 2024-04-26T12:51:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ef840980 1 -- start start 2024-04-26T12:51:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ef840980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b74e528810 0x55b74e52ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ef840980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b74e3d1510 con 0x55b74e524300 2024-04-26T12:51:17.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ef840980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b74e3d8430 con 0x55b74e528810 2024-04-26T12:51:17.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ed35b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55b74e524300 0x55b74e5246e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:49994/0 (socket says 172.21.15.72:49994) 2024-04-26T12:51:17.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ed35b640 1 -- 172.21.15.72:0/2068504657 learned_addr learned my addr 172.21.15.72:0/2068504657 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:17.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/2068504657 >> v2:172.21.15.29:3300/0 conn(0x55b74e528810 0x55b74e52ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3dffff640 1 -- 172.21.15.72:0/2068504657 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1878114537 0 0) 0x55b74e3d1510 con 0x55b74e524300 2024-04-26T12:51:17.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3dffff640 1 -- 172.21.15.72:0/2068504657 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3d8001e20 con 0x55b74e524300 2024-04-26T12:51:17.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/2068504657 >> v1:172.21.15.29:6789/0 conn(0x55b74e524300 legacy=0x55b74e5246e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.054+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/2068504657 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e3adae0 con 0x55b74e528810 2024-04-26T12:51:17.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/2068504657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e528810 0x55b74e52ac00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400a480 tx=0x7ff3e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f972bc46518651e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3dffff640 1 -- 172.21.15.72:0/2068504657 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e40b0070 con 0x55b74e528810 2024-04-26T12:51:17.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3dffff640 1 -- 172.21.15.72:0/2068504657 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e40ab540 con 0x55b74e528810 2024-04-26T12:51:17.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3dffff640 1 -- 172.21.15.72:0/2068504657 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e40ab820 con 0x55b74e528810 2024-04-26T12:51:17.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ef840980 1 -- 172.21.15.72:0/2068504657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e528810 msgr2=0x55b74e52ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ef840980 1 --2- 172.21.15.72:0/2068504657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e528810 0x55b74e52ac00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400a480 tx=0x7ff3e401b280 comp rx=0 tx=0).stop 2024-04-26T12:51:17.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ef840980 1 -- 172.21.15.72:0/2068504657 shutdown_connections 2024-04-26T12:51:17.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ef840980 1 --2- 172.21.15.72:0/2068504657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e528810 0x55b74e52ac00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ef840980 1 -- 172.21.15.72:0/2068504657 >> 172.21.15.72:0/2068504657 conn(0x55b74e51fbd0 msgr2=0x55b74e521ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ef840980 1 -- 172.21.15.72:0/2068504657 shutdown_connections 2024-04-26T12:51:17.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.058+0000 7ff3ef840980 1 -- 172.21.15.72:0/2068504657 wait complete. 2024-04-26T12:51:17.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ef840980 1 Processor -- start 2024-04-26T12:51:17.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ef840980 1 -- start start 2024-04-26T12:51:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ef840980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e60f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ef840980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b74e427a70 con 0x55b74e524300 2024-04-26T12:51:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e60f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e60f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42398/0 (socket says 172.21.15.72:42398) 2024-04-26T12:51:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ed35b640 1 -- 172.21.15.72:0/448719901 learned_addr learned my addr 172.21.15.72:0/448719901 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ed35b640 1 -- 172.21.15.72:0/448719901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e60f8c0 con 0x55b74e524300 2024-04-26T12:51:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.070+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/448719901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e60f2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8006fc0 tx=0x7ff3e8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dd82e1c20286eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff2db606640 1 -- 172.21.15.72:0/448719901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8004530 con 0x55b74e524300 2024-04-26T12:51:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff2db606640 1 -- 172.21.15.72:0/448719901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e80046d0 con 0x55b74e524300 2024-04-26T12:51:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff2db606640 1 -- 172.21.15.72:0/448719901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8004a70 con 0x55b74e524300 2024-04-26T12:51:17.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- 172.21.15.72:0/448719901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 msgr2=0x55b74e60f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 --2- 172.21.15.72:0/448719901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e60f2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8006fc0 tx=0x7ff3e8001af0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- 172.21.15.72:0/448719901 shutdown_connections 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 --2- 172.21.15.72:0/448719901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e60f2f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- 172.21.15.72:0/448719901 >> 172.21.15.72:0/448719901 conn(0x55b74e51fbd0 msgr2=0x55b74e60ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- 172.21.15.72:0/448719901 shutdown_connections 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- 172.21.15.72:0/448719901 wait complete. 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 Processor -- start 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- start start 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e6165e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b74e52dc30 con 0x55b74e524300 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e6165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e6165e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42402/0 (socket says 172.21.15.72:42402) 2024-04-26T12:51:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ed35b640 1 -- 172.21.15.72:0/3932104074 learned_addr learned my addr 172.21.15.72:0/3932104074 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ed35b640 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e616b20 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e6165e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8002260 tx=0x7ff3e8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff2d9e03640 1 -- 172.21.15.72:0/3932104074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8013760 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b74e616db0 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff2d9e03640 1 -- 172.21.15.72:0/3932104074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8013900 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff2d9e03640 1 -- 172.21.15.72:0/3932104074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8013c00 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.074+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b74e6199f0 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff2d9e03640 1 -- 172.21.15.72:0/3932104074 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3e8010070 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff2d9e03640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2d4034650 0x7ff2d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff2d9e03640 1 -- 172.21.15.72:0/3932104074 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ff3e8018070 con 0x55b74e524300 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2d4034650 0x7ff2d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e528810 0x55b74e61d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e61db40 con 0x55b74e528810 2024-04-26T12:51:17.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3edb5c640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e528810 0x55b74e61d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2d4034650 0x7ff2d4036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40ad000 tx=0x7ff3e40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3edb5c640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e528810 0x55b74e61d4d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3edb5c640 1 -- 172.21.15.72:0/3932104074 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e528810 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e61ac10 con 0x55b74e528810 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3edb5c640 1 -- 172.21.15.72:0/3932104074 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e528810 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e61fe70 0x55b74e622260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e622930 con 0x55b74e61fe70 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e61fe70 0x55b74e622260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e61fe70 0x55b74e622260 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ed35b640 1 -- 172.21.15.72:0/3932104074 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff3e801b030 con 0x55b74e61fe70 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e61ed10 con 0x55b74e528810 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3edb5c640 1 -- 172.21.15.72:0/3932104074 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e528810 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e623d70 0x55b74e626160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6268f0 con 0x55b74e623d70 2024-04-26T12:51:17.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.078+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e623d70 0x55b74e626160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e623d70 0x55b74e626160 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/3932104074 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff3e40b3040 con 0x55b74e623d70 2024-04-26T12:51:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ef840980 1 Processor -- start 2024-04-26T12:51:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ef840980 1 -- start start 2024-04-26T12:51:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ef840980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e634940 0x55b74e634d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ef840980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b74e42bab0 con 0x55b74e634940 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e634940 0x55b74e634d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e634940 0x55b74e634d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42418/0 (socket says 172.21.15.72:42418) 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ed35b640 1 -- 172.21.15.72:0/3161862175 learned_addr learned my addr 172.21.15.72:0/3161862175 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ed35b640 1 -- 172.21.15.72:0/3161862175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e6352a0 con 0x55b74e634940 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e634940 0x55b74e634d60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80484a0 tx=0x7ff3e8048720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff2d2ffd640 1 -- 172.21.15.72:0/3161862175 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8029680 con 0x55b74e634940 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b74e635d40 con 0x55b74e634940 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b74e636210 con 0x55b74e634940 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff2d2ffd640 1 -- 172.21.15.72:0/3161862175 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8029820 con 0x55b74e634940 2024-04-26T12:51:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff2d2ffd640 1 -- 172.21.15.72:0/3161862175 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8041ad0 con 0x55b74e634940 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.082+0000 7ff2d2ffd640 1 -- 172.21.15.72:0/3161862175 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3e804b030 con 0x55b74e634940 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff2d2ffd640 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2c4034650 0x7ff2c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff2d2ffd640 1 -- 172.21.15.72:0/3161862175 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ff3e803b070 con 0x55b74e634940 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2c4034650 0x7ff2c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 Processor -- start 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- start start 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2c4034650 0x7ff2c4036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4017e90 tx=0x7ff3e4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e49a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b74e60fc10 con 0x55b74e49a570 2024-04-26T12:51:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e49a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e49a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42434/0 (socket says 172.21.15.72:42434) 2024-04-26T12:51:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 -- 172.21.15.72:0/1838631100 learned_addr learned my addr 172.21.15.72:0/1838631100 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 -- 172.21.15.72:0/1838631100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e498dc0 con 0x55b74e49a570 2024-04-26T12:51:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/1838631100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e49a950 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff3e802cfd0 tx=0x7ff3e8048980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7930d61005a9d52e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff2d0ff9640 1 -- 172.21.15.72:0/1838631100 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8034430 con 0x55b74e49a570 2024-04-26T12:51:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff2d0ff9640 1 -- 172.21.15.72:0/1838631100 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8020e10 con 0x55b74e49a570 2024-04-26T12:51:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff2d0ff9640 1 -- 172.21.15.72:0/1838631100 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e80325d0 con 0x55b74e49a570 2024-04-26T12:51:17.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- 172.21.15.72:0/1838631100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 msgr2=0x55b74e49a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 --2- 172.21.15.72:0/1838631100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e49a950 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff3e802cfd0 tx=0x7ff3e8048980 comp rx=0 tx=0).stop 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- 172.21.15.72:0/1838631100 shutdown_connections 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 --2- 172.21.15.72:0/1838631100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e49a950 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- 172.21.15.72:0/1838631100 >> 172.21.15.72:0/1838631100 conn(0x55b74e63dcc0 msgr2=0x55b74e63bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- 172.21.15.72:0/1838631100 shutdown_connections 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- 172.21.15.72:0/1838631100 wait complete. 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 Processor -- start 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- start start 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e64adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ef840980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b74e4991d0 con 0x55b74e49a570 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e64adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e64adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42442/0 (socket says 172.21.15.72:42442) 2024-04-26T12:51:17.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 learned_addr learned my addr 172.21.15.72:0/662190594 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.086+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74e64b330 con 0x55b74e49a570 2024-04-26T12:51:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e64adf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8033ef0 tx=0x7ff3e8033e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff2c2ffd640 1 -- 172.21.15.72:0/662190594 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8048850 con 0x55b74e49a570 2024-04-26T12:51:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b74e64b330 con 0x55b74e49a570 2024-04-26T12:51:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff2c2ffd640 1 -- 172.21.15.72:0/662190594 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8011e10 con 0x55b74e49a570 2024-04-26T12:51:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff2c2ffd640 1 -- 172.21.15.72:0/662190594 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3e8041e50 con 0x55b74e49a570 2024-04-26T12:51:17.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b74e64b330 con 0x55b74e49a570 2024-04-26T12:51:17.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff2c2ffd640 1 -- 172.21.15.72:0/662190594 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3e806e070 con 0x55b74e49a570 2024-04-26T12:51:17.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff2c2ffd640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2b8034650 0x7ff2b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff2c2ffd640 1 -- 172.21.15.72:0/662190594 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ff3e8072d10 con 0x55b74e49a570 2024-04-26T12:51:17.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2b8034650 0x7ff2b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e655f20 0x55b74e6583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e658b30 con 0x55b74e655f20 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3edb5c640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e655f20 0x55b74e6583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2b8034650 0x7ff2b8036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40acfd0 tx=0x7ff3e40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3edb5c640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e655f20 0x55b74e6583e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e655f20 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 realm 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e658f40 con 0x55b74e655f20 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e655f20 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659810 con 0x55b74e655f20 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e655f20 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e655f20 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e655f20 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e65a910 0x55b74e65cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e65d310 con 0x55b74e65a910 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.090+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e65a910 0x55b74e65cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ed35b640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e65a910 0x55b74e65cd00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ef840980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ef840980 20 searching for the correct realm 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e65f260 0x55b74e661670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e661d40 con 0x55b74e65f260 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e65f260 0x55b74e661670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e65f260 0x55b74e661670 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ecb5a640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff3e40dd040 0x7ff3e40cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e661d40 con 0x7ff3e40dd040 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff3e40dd040 0x7ff3e40cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff3e40dd040 0x7ff3e40cf430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e00083f0 con 0x7ff3e40dd040 2024-04-26T12:51:17.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e65a910 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e655f20 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e00083f0 con 0x55b74e655f20 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e655f20 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.094+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e65a910 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e65a910 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x7ff3e40dd040 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e65f260 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e655f20 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x7ff3e40dd040 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e655f20 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x7ff3e40dd040 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65f260 2024-04-26T12:51:17.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65f260 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65a910 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.098+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65f260 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65f260 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e655f20 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e655f20 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65a910 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65f260 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x7ff3e40dd040 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e655f20 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65a910 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65f260 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.102+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65a910 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x7ff3e40dd040 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65f260 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e65a910 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x55b74e655f20 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff3e002b040 con 0x7ff3e40dd040 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e655f20 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e655f20 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e659bb0 con 0x55b74e65f260 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 zone default found 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 4 Realm: () 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:17.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 zonegroup default 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e65e190 con 0x55b74e65a910 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e663ba0 con 0x55b74e65f260 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.106+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e663f40 con 0x55b74e65f260 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 20 started sync module instance, tier type = 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e663040 con 0x7ff3e40dd040 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94245782697008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e663040 con 0x7ff3e40dd040 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e664900 con 0x55b74e655f20 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94245782697008] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94245782695072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e664900 con 0x55b74e655f20 2024-04-26T12:51:17.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.110+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6652c0 con 0x55b74e65f260 2024-04-26T12:51:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94245782703632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e665b10 con 0x55b74e65f260 2024-04-26T12:51:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6664d0 con 0x7ff3e40dd040 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94245782695072] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94245782703632] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94245782708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e666440 con 0x7ff3e40dd040 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.114+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e665660 con 0x55b74e655f20 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94245782708256] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94245782710384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e665660 con 0x55b74e655f20 2024-04-26T12:51:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6675f0 con 0x55b74e65a910 2024-04-26T12:51:17.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94245782710384] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94245782711440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6679e0 con 0x55b74e65a910 2024-04-26T12:51:17.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.118+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6682d0 con 0x55b74e65a910 2024-04-26T12:51:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94245782711440] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94245782712496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6684b0 con 0x55b74e65a910 2024-04-26T12:51:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e668d00 con 0x55b74e65a910 2024-04-26T12:51:17.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94245782718128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e669140 con 0x55b74e65a910 2024-04-26T12:51:17.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 20 add_watcher() i=0 2024-04-26T12:51:17.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 20 add_watcher() i=1 2024-04-26T12:51:17.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 20 add_watcher() i=2 2024-04-26T12:51:17.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 20 add_watcher() i=3 2024-04-26T12:51:17.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 20 add_watcher() i=4 2024-04-26T12:51:17.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.122+0000 7ff3ef840980 20 add_watcher() i=5 2024-04-26T12:51:17.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94245782712496] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 20 add_watcher() i=6 2024-04-26T12:51:17.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94245782718128] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 20 add_watcher() i=7 2024-04-26T12:51:17.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:17.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6679e0 con 0x55b74e655f20 2024-04-26T12:51:17.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94245782719440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6679e0 con 0x55b74e655f20 2024-04-26T12:51:17.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94245782719440] v35'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff2a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 5 note: GC not initialized 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff2a27e4640 20 reqs_thread_entry: start 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 20 Filter name: none 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff213fff640 20 reqs_thread_entry: start 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.126+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68fa10 con 0x55b74e65a910 2024-04-26T12:51:17.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68e050 con 0x55b74e655f20 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-26T12:51:17.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68e920 con 0x55b74e65a910 2024-04-26T12:51:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v35'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94245782873200 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e693000 con 0x55b74e65a910 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== watch-notify(notify (1) cookie 94245782718128 notify 150323855389 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55b74e68f460 con 0x55b74e65a910 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff2d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855389 cookie 94245782718128 notifier 4734 bl.length()=556 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff2d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff2d0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff2d0ff9640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff2b0003eb0 con 0x55b74e65a910 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.130+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(65 notify.7 [notify cookie 94245782873200 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== watch-notify(notify_complete (2) cookie 94245782873200 notify 150323855389 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b74e6352a0 con 0x55b74e65a910 2024-04-26T12:51:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68e920 con 0x55b74e655f20 2024-04-26T12:51:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ef840980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:51:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ef840980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:51:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ef840980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T12:51:17.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94245782873200 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b74e6930e0 con 0x55b74e65a910 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== watch-notify(notify (1) cookie 94245782711440 notify 150323855390 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b74e6352a0 con 0x55b74e65a910 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(68 notify.5 [notify cookie 94245782873200 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff2c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855390 cookie 94245782711440 notifier 4734 bl.length()=177 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff2c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff2c3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff2c3fff640 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff220003410 con 0x55b74e65a910 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.134+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== watch-notify(notify_complete (2) cookie 94245782873200 notify 150323855390 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b74e6199f0 con 0x55b74e65a910 2024-04-26T12:51:17.139 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-26T12:51:17.134222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:51:17.134214Z","tags":[],"group_ids":[]} 2024-04-26T12:51:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff2a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:17.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94245782719440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x55b74e655f20 2024-04-26T12:51:17.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94245782719440] v35'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94245782697008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x7ff3e40dd040 2024-04-26T12:51:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94245782697008] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff3ef840980 20 remove_watcher() i=0 2024-04-26T12:51:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff3ef840980 2 removed watcher, disabling cache 2024-04-26T12:51:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.138+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94245782695072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x55b74e655f20 2024-04-26T12:51:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94245782695072] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3ef840980 20 remove_watcher() i=1 2024-04-26T12:51:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94245782703632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x55b74e65f260 2024-04-26T12:51:17.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3ecb5a640 1 -- 172.21.15.72:0/662190594 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94245782703632] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e40ca030 con 0x55b74e65f260 2024-04-26T12:51:17.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3ef840980 20 remove_watcher() i=2 2024-04-26T12:51:17.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94245782708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x7ff3e40dd040 2024-04-26T12:51:17.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94245782708256] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x7ff3e40dd040 2024-04-26T12:51:17.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3ef840980 20 remove_watcher() i=3 2024-04-26T12:51:17.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.142+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94245782710384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x55b74e655f20 2024-04-26T12:51:17.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.146+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94245782710384] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e0026040 con 0x55b74e655f20 2024-04-26T12:51:17.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.146+0000 7ff3ef840980 20 remove_watcher() i=4 2024-04-26T12:51:17.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.146+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94245782711440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x55b74e65a910 2024-04-26T12:51:17.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.146+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94245782711440] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.146+0000 7ff3ef840980 20 remove_watcher() i=5 2024-04-26T12:51:17.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.146+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94245782712496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x55b74e65a910 2024-04-26T12:51:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94245782712496] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 20 remove_watcher() i=6 2024-04-26T12:51:17.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94245782718128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b74e68d6b0 con 0x55b74e65a910 2024-04-26T12:51:17.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ed35b640 1 -- 172.21.15.72:0/662190594 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94245782718128] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3e8077020 con 0x55b74e65a910 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 20 remove_watcher() i=7 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e65a910 msgr2=0x55b74e65cd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e65a910 0x55b74e65cd00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e655f20 msgr2=0x55b74e6583e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e655f20 0x55b74e6583e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff3e40dd040 msgr2=0x7ff3e40cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff3e40dd040 0x7ff3e40cf430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e65f260 msgr2=0x55b74e661670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.150+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e65f260 0x55b74e661670 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2b8034650 msgr2=0x7ff2b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2b8034650 0x7ff2b8036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40acfd0 tx=0x7ff3e40a6000 comp rx=0 tx=0).stop 2024-04-26T12:51:17.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 msgr2=0x55b74e64adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3edb5c640 1 -- 172.21.15.72:0/662190594 reap_dead start 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e64adf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8033ef0 tx=0x7ff3e8033e80 comp rx=0 tx=0).stop 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 shutdown_connections 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/662190594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e49a570 0x55b74e64adf0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 >> 172.21.15.72:0/662190594 conn(0x55b74e63dcc0 msgr2=0x55b74e63b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 shutdown_connections 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/662190594 wait complete. 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2c4034650 msgr2=0x7ff2c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2c4034650 0x7ff2c4036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4017e90 tx=0x7ff3e4005a10 comp rx=0 tx=0).stop 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e634940 msgr2=0x55b74e634d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e634940 0x55b74e634d60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80484a0 tx=0x7ff3e8048720 comp rx=0 tx=0).stop 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 shutdown_connections 2024-04-26T12:51:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2c4034650 0x7ff2c4036b10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3161862175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e634940 0x55b74e634d60 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 >> 172.21.15.72:0/3161862175 conn(0x55b74e629750 msgr2=0x55b74e62a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 shutdown_connections 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3161862175 wait complete. 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e61fe70 msgr2=0x55b74e622260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b74e61fe70 0x55b74e622260 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e528810 msgr2=0x55b74e61d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b74e528810 0x55b74e61d4d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e623d70 msgr2=0x55b74e626160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b74e623d70 0x55b74e626160 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2d4034650 msgr2=0x7ff2d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff2d4034650 0x7ff2d4036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40ad000 tx=0x7ff3e40a5040 comp rx=0 tx=0).stop 2024-04-26T12:51:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 msgr2=0x55b74e6165e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 --2- 172.21.15.72:0/3932104074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b74e524300 0x55b74e6165e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8002260 tx=0x7ff3e8000f50 comp rx=0 tx=0).stop 2024-04-26T12:51:17.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3edb5c640 1 -- 172.21.15.72:0/3932104074 reap_dead start 2024-04-26T12:51:17.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 shutdown_connections 2024-04-26T12:51:17.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 >> 172.21.15.72:0/3932104074 conn(0x55b74e51fbd0 msgr2=0x55b74e609990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 shutdown_connections 2024-04-26T12:51:17.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.154+0000 7ff3ef840980 1 -- 172.21.15.72:0/3932104074 wait complete. 2024-04-26T12:51:17.165 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-26T12:51:17.134222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:51:17.134214Z', 'tags': [], 'group_ids': []} 2024-04-26T12:51:17.180 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:51:17.184 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-26T12:51:17.184 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-26T12:51:17.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-26T12:51:17.184 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-26T12:51:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c5196980 1 Processor -- start 2024-04-26T12:51:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c5196980 1 -- start start 2024-04-26T12:51:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c5196980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f92bc22880 0x55f92bc24c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c5196980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f92bacb510 con 0x55f92bc1c770 2024-04-26T12:51:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c5196980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f92bad2430 con 0x55f92bc22880 2024-04-26T12:51:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c24b0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f92bc22880 0x55f92bc24c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c2cb1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f92bc1c770 0x55f92bc1cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:50002/0 (socket says 172.21.15.72:50002) 2024-04-26T12:51:17.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c24b0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f92bc22880 0x55f92bc24c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42454/0 (socket says 172.21.15.72:42454) 2024-04-26T12:51:17.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/127599373 learned_addr learned my addr 172.21.15.72:0/127599373 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:17.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c24b0640 1 -- 172.21.15.72:0/127599373 >> v1:172.21.15.29:6789/0 conn(0x55f92bc1c770 legacy=0x55f92bc1cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.234+0000 7fd2c24b0640 1 -- 172.21.15.72:0/127599373 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92baa7ae0 con 0x55f92bc22880 2024-04-26T12:51:17.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/127599373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc22880 0x55f92bc24c70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800a480 tx=0x7fd2b801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24f1dacc7118339 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c1caf640 1 -- 172.21.15.72:0/127599373 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b80b0070 con 0x55f92bc22880 2024-04-26T12:51:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c1caf640 1 -- 172.21.15.72:0/127599373 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b80ab540 con 0x55f92bc22880 2024-04-26T12:51:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c1caf640 1 -- 172.21.15.72:0/127599373 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b80ab840 con 0x55f92bc22880 2024-04-26T12:51:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c5196980 1 -- 172.21.15.72:0/127599373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc22880 msgr2=0x55f92bc24c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c5196980 1 --2- 172.21.15.72:0/127599373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc22880 0x55f92bc24c70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800a480 tx=0x7fd2b801b280 comp rx=0 tx=0).stop 2024-04-26T12:51:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c5196980 1 -- 172.21.15.72:0/127599373 shutdown_connections 2024-04-26T12:51:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c5196980 1 --2- 172.21.15.72:0/127599373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc22880 0x55f92bc24c70 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c5196980 1 -- 172.21.15.72:0/127599373 >> 172.21.15.72:0/127599373 conn(0x55f92bc18200 msgr2=0x55f92bc1a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c5196980 1 -- 172.21.15.72:0/127599373 shutdown_connections 2024-04-26T12:51:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.238+0000 7fd2c5196980 1 -- 172.21.15.72:0/127599373 wait complete. 2024-04-26T12:51:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.250+0000 7fd2c5196980 1 Processor -- start 2024-04-26T12:51:17.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.250+0000 7fd2c5196980 1 -- start start 2024-04-26T12:51:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.250+0000 7fd2c5196980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.250+0000 7fd2c5196980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f92bb21a70 con 0x55f92bc1c770 2024-04-26T12:51:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42464/0 (socket says 172.21.15.72:42464) 2024-04-26T12:51:17.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/3799059027 learned_addr learned my addr 172.21.15.72:0/3799059027 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/3799059027 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92bd09ac0 con 0x55f92bc1c770 2024-04-26T12:51:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/3799059027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd094f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4001e20 tx=0x7fd2b400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e13f776a973ba9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd1b0e09640 1 -- 172.21.15.72:0/3799059027 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b4012020 con 0x55f92bc1c770 2024-04-26T12:51:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd1b0e09640 1 -- 172.21.15.72:0/3799059027 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b400e7c0 con 0x55f92bc1c770 2024-04-26T12:51:17.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd1b0e09640 1 -- 172.21.15.72:0/3799059027 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b400eb00 con 0x55f92bc1c770 2024-04-26T12:51:17.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- 172.21.15.72:0/3799059027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 msgr2=0x55f92bd094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3799059027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd094f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4001e20 tx=0x7fd2b400b790 comp rx=0 tx=0).stop 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- 172.21.15.72:0/3799059027 shutdown_connections 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3799059027 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd094f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- 172.21.15.72:0/3799059027 >> 172.21.15.72:0/3799059027 conn(0x55f92bc18200 msgr2=0x55f92bd05080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- 172.21.15.72:0/3799059027 shutdown_connections 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- 172.21.15.72:0/3799059027 wait complete. 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 Processor -- start 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- start start 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd10780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f92bc27c70 con 0x55f92bc1c770 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd10780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd10780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42480/0 (socket says 172.21.15.72:42480) 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/3914059313 learned_addr learned my addr 172.21.15.72:0/3914059313 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92bd10cc0 con 0x55f92bc1c770 2024-04-26T12:51:17.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd10780 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4001e20 tx=0x7fd2b4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd1af606640 1 -- 172.21.15.72:0/3914059313 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b4012030 con 0x55f92bc1c770 2024-04-26T12:51:17.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f92bd10f50 con 0x55f92bc1c770 2024-04-26T12:51:17.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd1af606640 1 -- 172.21.15.72:0/3914059313 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b4001480 con 0x55f92bc1c770 2024-04-26T12:51:17.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd1af606640 1 -- 172.21.15.72:0/3914059313 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b401a920 con 0x55f92bc1c770 2024-04-26T12:51:17.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.254+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92bd13b40 con 0x55f92bc1c770 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd1af606640 1 -- 172.21.15.72:0/3914059313 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd2b4015020 con 0x55f92bc1c770 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd1af606640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1a8034650 0x7fd1a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd1af606640 1 -- 172.21.15.72:0/3914059313 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fd2b4020030 con 0x55f92bc1c770 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1a8034650 0x7fd1a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bc22880 0x55f92bd17620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd17c40 con 0x55f92bc22880 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c34b2640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bc22880 0x55f92bd17620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1a8034650 0x7fd1a8036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80ad000 tx=0x7fd2b80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c34b2640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bc22880 0x55f92bd17620 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c34b2640 1 -- 172.21.15.72:0/3914059313 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bc22880 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd14d60 con 0x55f92bc22880 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c34b2640 1 -- 172.21.15.72:0/3914059313 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bc22880 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd19f90 0x55f92bd1c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd1ca70 con 0x55f92bd19f90 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd19f90 0x55f92bd1c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.258+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd19f90 0x55f92bd1c380 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/3914059313 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd19f90 2024-04-26T12:51:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd18e30 con 0x55f92bc22880 2024-04-26T12:51:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c34b2640 1 -- 172.21.15.72:0/3914059313 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bc22880 2024-04-26T12:51:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd1ded0 0x55f92bd202c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd20a00 con 0x55f92bd1ded0 2024-04-26T12:51:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd1ded0 0x55f92bd202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd1ded0 0x55f92bd202c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c24b0640 1 -- 172.21.15.72:0/3914059313 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2b80b3040 con 0x55f92bd1ded0 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 Processor -- start 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 -- start start 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1f390 0x55f92bc1d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f92bb25ab0 con 0x55f92bc1f390 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1f390 0x55f92bc1d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1f390 0x55f92bc1d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42484/0 (socket says 172.21.15.72:42484) 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/4199953113 learned_addr learned my addr 172.21.15.72:0/4199953113 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/4199953113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92bc1dd70 con 0x55f92bc1f390 2024-04-26T12:51:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1f390 0x55f92bc1d830 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400e790 tx=0x7fd2b4017f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd1ace01640 1 -- 172.21.15.72:0/4199953113 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b4003a20 con 0x55f92bc1f390 2024-04-26T12:51:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f92bc1e000 con 0x55f92bc1f390 2024-04-26T12:51:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92bc1e000 con 0x55f92bc1f390 2024-04-26T12:51:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd1ace01640 1 -- 172.21.15.72:0/4199953113 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b4003bc0 con 0x55f92bc1f390 2024-04-26T12:51:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.262+0000 7fd1ace01640 1 -- 172.21.15.72:0/4199953113 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b4041bb0 con 0x55f92bc1f390 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd1ace01640 1 -- 172.21.15.72:0/4199953113 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd2b4009070 con 0x55f92bc1f390 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd1ace01640 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd19c0346a0 0x7fd19c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd1ace01640 1 -- 172.21.15.72:0/4199953113 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fd2b4005050 con 0x55f92bc1f390 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd19c0346a0 0x7fd19c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 Processor -- start 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- start start 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd19c0346a0 0x7fd19c036b60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55f92bd18110 tx=0x7fd2b8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd3dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f92bd09e10 con 0x55f92bd3daa0 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd3dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd3dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42498/0 (socket says 172.21.15.72:42498) 2024-04-26T12:51:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/279122437 learned_addr learned my addr 172.21.15.72:0/279122437 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/279122437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92bd3e490 con 0x55f92bd3daa0 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/279122437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd3dec0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd2b403aa00 tx=0x7fd2b403a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50eb2487b7ae94c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd1a67fc640 1 -- 172.21.15.72:0/279122437 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b40418c0 con 0x55f92bd3daa0 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd1a67fc640 1 -- 172.21.15.72:0/279122437 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b40413a0 con 0x55f92bd3daa0 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd1a67fc640 1 -- 172.21.15.72:0/279122437 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b4048660 con 0x55f92bd3daa0 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- 172.21.15.72:0/279122437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 msgr2=0x55f92bd3dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 --2- 172.21.15.72:0/279122437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd3dec0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd2b403aa00 tx=0x7fd2b403a430 comp rx=0 tx=0).stop 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- 172.21.15.72:0/279122437 shutdown_connections 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 --2- 172.21.15.72:0/279122437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd3dec0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- 172.21.15.72:0/279122437 >> 172.21.15.72:0/279122437 conn(0x55f92bd39e30 msgr2=0x55f92bd37e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- 172.21.15.72:0/279122437 shutdown_connections 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- 172.21.15.72:0/279122437 wait complete. 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 Processor -- start 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- start start 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd44da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.266+0000 7fd2c5196980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f92bd3ea00 con 0x55f92bd3daa0 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd44da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c2cb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd44da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:42510/0 (socket says 172.21.15.72:42510) 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 learned_addr learned my addr 172.21.15.72:0/779049844 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92bd452e0 con 0x55f92bd3daa0 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd44da0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55f92bd39300 tx=0x7fd2b4012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd1a4ff9640 1 -- 172.21.15.72:0/779049844 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b406d020 con 0x55f92bd3daa0 2024-04-26T12:51:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd1a4ff9640 1 -- 172.21.15.72:0/779049844 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b402d520 con 0x55f92bd3daa0 2024-04-26T12:51:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f92bd452e0 con 0x55f92bd3daa0 2024-04-26T12:51:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd1a4ff9640 1 -- 172.21.15.72:0/779049844 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b4048b10 con 0x55f92bd3daa0 2024-04-26T12:51:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92bd452e0 con 0x55f92bd3daa0 2024-04-26T12:51:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd1a4ff9640 1 -- 172.21.15.72:0/779049844 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd2b4070020 con 0x55f92bd3daa0 2024-04-26T12:51:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd1a4ff9640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd18c034650 0x7fd18c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd1a4ff9640 1 -- 172.21.15.72:0/779049844 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fd2b4064070 con 0x55f92bd3daa0 2024-04-26T12:51:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd18c034650 0x7fd18c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bd4fee0 0x55f92bd523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd52af0 con 0x55f92bd4fee0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c34b2640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bd4fee0 0x55f92bd523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd18c034650 0x7fd18c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c10 tx=0x7fd2b80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c34b2640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bd4fee0 0x55f92bd523a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 realm 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd52f00 con 0x55f92bd4fee0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd537d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.270+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd548d0 0x55f92bd56cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd572d0 con 0x55f92bd548d0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd548d0 0x55f92bd56cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c2cb1640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd548d0 0x55f92bd56cc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 20 searching for the correct realm 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd59220 0x55f92bd5b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5bce0 con 0x55f92bd59220 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd59220 0x55f92bd5b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd59220 0x55f92bd5b610 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c24b0640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd2b80ab030 0x7fd2b80d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5bce0 con 0x7fd2b80ab030 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c34b2640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd2b80ab030 0x7fd2b80d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c34b2640 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd2b80ab030 0x7fd2b80d1400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x7fd2b80ab030 2024-04-26T12:51:17.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.274+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x7fd2b80ab030 2024-04-26T12:51:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x7fd2b80ab030 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x7fd2b80ab030 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x7fd2b80ab030 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc00a4d0 con 0x55f92bd4fee0 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x7fd2b80ab030 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd2bc032040 con 0x7fd2b80ab030 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.278+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc032040 con 0x55f92bd4fee0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2bc032040 con 0x55f92bd4fee0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x7fd2b80ab030 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc032040 con 0x7fd2b80ab030 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc032040 con 0x55f92bd4fee0 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.282+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x7fd2b80ab030 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc032040 con 0x7fd2b80ab030 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd59220 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd548d0 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x55f92bd4fee0 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2bc032040 con 0x55f92bd4fee0 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd53b70 con 0x7fd2b80ab030 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc032040 con 0x7fd2b80ab030 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:17.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd57b90 con 0x55f92bd4fee0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2bc032040 con 0x55f92bd4fee0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd57b90 con 0x55f92bd4fee0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2bc032040 con 0x55f92bd4fee0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd57b90 con 0x55f92bd59220 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 zone default found 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 4 Realm: () 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 zonegroup default 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd58580 con 0x55f92bd548d0 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.286+0000 7fd2c5196980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd58150 con 0x55f92bd59220 2024-04-26T12:51:17.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5e100 con 0x55f92bd59220 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 20 started sync module instance, tier type = 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5d480 con 0x7fd2b80ab030 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc032040 con 0x7fd2b80ab030 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94528670652800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5d480 con 0x7fd2b80ab030 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5eb80 con 0x55f92bd4fee0 2024-04-26T12:51:17.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94528670652800] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94528670656480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5d480 con 0x55f92bd4fee0 2024-04-26T12:51:17.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.290+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5f590 con 0x55f92bd59220 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.294+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94528670656480] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.294+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.294+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94528670650320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd5d3f0 con 0x55f92bd59220 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.294+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd602f0 con 0x7fd2b80ab030 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.294+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.294+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94528670662112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd60b90 con 0x7fd2b80ab030 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.294+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd61550 con 0x55f92bd4fee0 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.298+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94528670662112] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.298+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94528670650320] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.298+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.298+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94528670666912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd60af0 con 0x55f92bd4fee0 2024-04-26T12:51:17.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.298+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd614c0 con 0x55f92bd548d0 2024-04-26T12:51:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.298+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94528670666912] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.302+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.302+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94528670664528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd61e20 con 0x55f92bd548d0 2024-04-26T12:51:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.302+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd62670 con 0x55f92bd548d0 2024-04-26T12:51:17.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.302+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94528670664528] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.302+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.302+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94528670669168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd62ec0 con 0x55f92bd548d0 2024-04-26T12:51:17.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.302+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd63880 con 0x55f92bd548d0 2024-04-26T12:51:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94528670669168] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94528670673696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd63880 con 0x55f92bd548d0 2024-04-26T12:51:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=0 2024-04-26T12:51:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=1 2024-04-26T12:51:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=2 2024-04-26T12:51:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=3 2024-04-26T12:51:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=4 2024-04-26T12:51:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=5 2024-04-26T12:51:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=6 2024-04-26T12:51:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94528670673696] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 20 add_watcher() i=7 2024-04-26T12:51:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd66bb0 con 0x55f92bd4fee0 2024-04-26T12:51:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.306+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94528670688736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd639f0 con 0x55f92bd4fee0 2024-04-26T12:51:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94528670688736] v35'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 5 note: GC not initialized 2024-04-26T12:51:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd0f3fff640 20 reqs_thread_entry: start 2024-04-26T12:51:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 20 Filter name: none 2024-04-26T12:51:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd0f1ffb640 20 reqs_thread_entry: start 2024-04-26T12:51:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T12:51:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8a470 con 0x55f92bd548d0 2024-04-26T12:51:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:51:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-26T12:51:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:51:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:51:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8e7c0 con 0x7fd2b80ab030 2024-04-26T12:51:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v35'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:51:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:51:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T12:51:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.310+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94528670847344 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8f430 con 0x55f92bd548d0 2024-04-26T12:51:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== watch-notify(notify (1) cookie 94528670664528 notify 150323855391 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55f92bc1dd70 con 0x55f92bd548d0 2024-04-26T12:51:17.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(64 notify.5 [notify cookie 94528670847344 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855391 cookie 94528670664528 notifier 4741 bl.length()=382 2024-04-26T12:51:17.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:51:17.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:51:17.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd188003eb0 con 0x55f92bd548d0 2024-04-26T12:51:17.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== watch-notify(notify_complete (2) cookie 94528670847344 notify 150323855391 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd2b4033040 con 0x55f92bd548d0 2024-04-26T12:51:17.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8f330 con 0x55f92bd4fee0 2024-04-26T12:51:17.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 : miss 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 20 rados->read ofs=0 len=0 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 8.1c 8:389832b4:root::.bucket.meta.myfoo6%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8c8d0 con 0x55f92bd59220 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 info.flags=0x17 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 to cache LRU end 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 2024-04-26T12:51:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 8.1c 8:389832b4:root::.bucket.meta.myfoo6%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd965a0 con 0x55f92bd59220 2024-04-26T12:51:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v35'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 info.flags=0x17 2024-04-26T12:51:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 to cache LRU end 2024-04-26T12:51:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:51:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9, ofs0, ns] 2024-04-26T12:51:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94528670846752 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd952b0 con 0x7fd2b80ab030 2024-04-26T12:51:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== watch-notify(notify (1) cookie 94528670652800 notify 150323855382 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fd2bc018960 con 0x7fd2b80ab030 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855382 cookie 94528670652800 notifier 4741 bl.length()=748 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 info.flags=0x17 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 to cache LRU end 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(69 notify.0 [notify cookie 94528670846752 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.314+0000 7fd1a67fc640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd188003eb0 con 0x7fd2b80ab030 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== watch-notify(notify_complete (2) cookie 94528670846752 notify 150323855382 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd2bc018c00 con 0x7fd2b80ab030 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): orig_sources= new_sources= 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): potential sources added=[] removed=[] 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): orig_dests= new_dests= 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): potential dests added=[] removed=[] 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd94e00 con 0x55f92bd4fee0 2024-04-26T12:51:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(71 bud.buckets [call] v35'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd94e00 con 0x55f92bd4fee0 2024-04-26T12:51:17.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(72 bud.buckets [call] v35'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95e10 con 0x55f92bd4fee0 2024-04-26T12:51:17.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v35'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94528670846752 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8faa0 con 0x7fd2b80ab030 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== watch-notify(notify (1) cookie 94528670662112 notify 150323855383 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55f92bd938a0 con 0x7fd2b80ab030 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd1a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855383 cookie 94528670662112 notifier 4741 bl.length()=316 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd1a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd1a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(74 notify.3 [notify cookie 94528670846752 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.318+0000 7fd1a5ffb640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd0f8003410 con 0x7fd2b80ab030 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== watch-notify(notify_complete (2) cookie 94528670846752 notify 150323855383 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd2bc018c00 con 0x7fd2b80ab030 2024-04-26T12:51:17.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 : hit (requested=0x17, cached=0x17) 2024-04-26T12:51:17.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 2024-04-26T12:51:17.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:76 8.1c 8:389832b4:root::.bucket.meta.myfoo6%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd93010 con 0x55f92bd59220 2024-04-26T12:51:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(76 .bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v35'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 info.flags=0x17 2024-04-26T12:51:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 to cache LRU end 2024-04-26T12:51:17.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9, ofs0, ns] 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94528670879232 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8ff90 con 0x7fd2b80ab030 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== watch-notify(notify (1) cookie 94528670652800 notify 150323855384 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fd2bc018c00 con 0x7fd2b80ab030 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd1a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855384 cookie 94528670652800 notifier 4741 bl.length()=748 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd1a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 info.flags=0x17 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd1a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 to cache LRU end 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd1a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(77 notify.0 [notify cookie 94528670879232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd1a5ffb640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd0f80034e0 con 0x7fd2b80ab030 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== watch-notify(notify_complete (2) cookie 94528670879232 notify 150323855384 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd2bc043870 con 0x7fd2b80ab030 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): orig_sources= new_sources= 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): potential sources added=[] removed=[] 2024-04-26T12:51:17.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): orig_dests= new_dests= 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 20 handle_bi_update(): bucket=:myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]): potential dests added=[] removed=[] 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 4.15 4:a89b2d7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95370 con 0x55f92bd59220 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(79 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:80 4.1b 4:db91d4ad:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95370 con 0x7fd2b80ab030 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(80 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:81 4.25 4:a7f36742:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95370 con 0x55f92bd59220 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(81 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 4.30 4:0ce9357b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95370 con 0x55f92bd59220 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:83 4.12 4:4b795005:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95300 con 0x55f92bd4fee0 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(83 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.322+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:84 4.36 4:6dde4018:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95300 con 0x55f92bd4fee0 2024-04-26T12:51:17.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(84 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 4.1d 4:bb84b32f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95300 con 0x55f92bd59220 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(85 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:86 4.38 4:1c32b28e:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd952b0 con 0x55f92bd4fee0 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(86 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:87 4.18 4:1816693c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd952b0 con 0x7fd2b80ab030 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(87 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:88 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd952b0 con 0x7fd2b80ab030 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(88 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [call out=377b] v0'0 uv8 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 10 cls_bucket_list_unordered: got thirteen 2024-04-26T12:51:17.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:89 4.17 4:ea544dea:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd952b0 con 0x55f92bd548d0 2024-04-26T12:51:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(89 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 get_obj_state: octx=0x7fd2bc00aae0 obj=myfoo6:thirteen state=0x55f92bd93c58 s->prefetch_data=0 2024-04-26T12:51:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:90 3.9s0 3:93d44bee:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95310 con 0x55f92bd59220 2024-04-26T12:51:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(90 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 10 manifest: total_size = 8 2024-04-26T12:51:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9505091087076306955 2024-04-26T12:51:17.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.acl 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.etag 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 get_obj_state: octx=0x7fd2bc00aae0 obj=myfoo6:thirteen state=0x55f92bd93c58 s->prefetch_data=0 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 : hit (requested=0x17, cached=0x17) 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.326+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:91 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd95e50 con 0x7fd2b80ab030 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(91 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [stat,call,call] v35'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:92 3.9s0 3:93d44bee:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd97c70 con 0x55f92bd59220 2024-04-26T12:51:17.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(92 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v35'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd97c70 con 0x7fd2b80ab030 2024-04-26T12:51:17.335 INFO:teuthology.orchestra.run.smithi072.stderr:1 objects processed in :myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9]). Next marker thirteen 2024-04-26T12:51:17.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd998f0 con 0x7fd2b80ab030 2024-04-26T12:51:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(93 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [stat,call,call] v35'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd1a5ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-04-26T12:51:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v35'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:51:17.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c5196980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c5196980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.330+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94528670898416 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd97c70 con 0x55f92bd548d0 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== watch-notify(notify (1) cookie 94528670664528 notify 150323855392 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7fd2b4033040 con 0x55f92bd548d0 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855392 cookie 94528670664528 notifier 4741 bl.length()=556 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(95 notify.5 [notify cookie 94528670898416 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a67fc640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd188003eb0 con 0x55f92bd548d0 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== watch-notify(notify_complete (2) cookie 94528670898416 notify 150323855392 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f92bd13b40 con 0x55f92bd548d0 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd4fee0 2024-04-26T12:51:17.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c5196980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c5196980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c5196980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94528670879232 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd548d0 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== watch-notify(notify (1) cookie 94528670664528 notify 150323855393 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f92bd13b40 con 0x55f92bd548d0 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855393 cookie 94528670664528 notifier 4741 bl.length()=177 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(98 notify.5 [notify cookie 94528670879232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.334+0000 7fd1a5ffb640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd0f80034e0 con 0x55f92bd548d0 2024-04-26T12:51:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== watch-notify(notify_complete (2) cookie 94528670879232 notify 150323855393 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f92bd10f50 con 0x55f92bd548d0 2024-04-26T12:51:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c5196980 10 removing user index: bar 2024-04-26T12:51:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd97c70 con 0x55f92bd548d0 2024-04-26T12:51:17.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(100 bar [delete] v35'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c5196980 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-26T12:51:17.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c5196980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-26T12:51:17.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94528670879232 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd548d0 2024-04-26T12:51:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== watch-notify(notify (1) cookie 94528670673696 notify 150323855394 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55f92bd10f50 con 0x55f92bd548d0 2024-04-26T12:51:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855394 cookie 94528670673696 notifier 4741 bl.length()=152 2024-04-26T12:51:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd1a67fc640 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd188003eb0 con 0x55f92bd548d0 2024-04-26T12:51:17.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(101 notify.7 [notify cookie 94528670879232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.338+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== watch-notify(notify_complete (2) cookie 94528670879232 notify 150323855394 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f92bd10cc0 con 0x55f92bd548d0 2024-04-26T12:51:17.346 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-26T12:51:17.134222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:51:17.134214Z","tags":[],"group_ids":[]} 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94528670688736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd4fee0 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94528670688736] v35'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94528670652800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x7fd2b80ab030 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94528670652800] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c5196980 20 remove_watcher() i=0 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c5196980 2 removed watcher, disabling cache 2024-04-26T12:51:17.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.342+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94528670656480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd4fee0 2024-04-26T12:51:17.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.346+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94528670656480] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.346+0000 7fd2c5196980 20 remove_watcher() i=1 2024-04-26T12:51:17.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.346+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94528670650320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd59220 2024-04-26T12:51:17.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.346+0000 7fd2c24b0640 1 -- 172.21.15.72:0/779049844 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94528670650320] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b80d8040 con 0x55f92bd59220 2024-04-26T12:51:17.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.346+0000 7fd2c5196980 20 remove_watcher() i=2 2024-04-26T12:51:17.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.346+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94528670662112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x7fd2b80ab030 2024-04-26T12:51:17.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.350+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94528670662112] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x7fd2b80ab030 2024-04-26T12:51:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.350+0000 7fd2c5196980 20 remove_watcher() i=3 2024-04-26T12:51:17.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.350+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94528670666912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd4fee0 2024-04-26T12:51:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.350+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94528670666912] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc040040 con 0x55f92bd4fee0 2024-04-26T12:51:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.350+0000 7fd2c5196980 20 remove_watcher() i=4 2024-04-26T12:51:17.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.350+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94528670664528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd548d0 2024-04-26T12:51:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.354+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94528670664528] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.354+0000 7fd2c5196980 20 remove_watcher() i=5 2024-04-26T12:51:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.354+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94528670669168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd548d0 2024-04-26T12:51:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.354+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94528670669168] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.354+0000 7fd2c5196980 20 remove_watcher() i=6 2024-04-26T12:51:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.354+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94528670673696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f92bd8efd0 con 0x55f92bd548d0 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c2cb1640 1 -- 172.21.15.72:0/779049844 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94528670673696] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2b4008030 con 0x55f92bd548d0 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 20 remove_watcher() i=7 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd548d0 msgr2=0x55f92bd56cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd548d0 0x55f92bd56cc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bd4fee0 msgr2=0x55f92bd523a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bd4fee0 0x55f92bd523a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd2b80ab030 msgr2=0x7fd2b80d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fd2b80ab030 0x7fd2b80d1400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd59220 msgr2=0x55f92bd5b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd59220 0x55f92bd5b610 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd18c034650 msgr2=0x7fd18c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd18c034650 0x7fd18c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c10 tx=0x7fd2b80a6000 comp rx=0 tx=0).stop 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 msgr2=0x55f92bd44da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c34b2640 1 -- 172.21.15.72:0/779049844 reap_dead start 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd44da0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55f92bd39300 tx=0x7fd2b4012d50 comp rx=0 tx=0).stop 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 shutdown_connections 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/779049844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bd3daa0 0x55f92bd44da0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 >> 172.21.15.72:0/779049844 conn(0x55f92bd39e30 msgr2=0x55f92bd37490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 shutdown_connections 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/779049844 wait complete. 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd19c0346a0 msgr2=0x7fd19c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd19c0346a0 0x7fd19c036b60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55f92bd18110 tx=0x7fd2b8005a10 comp rx=0 tx=0).stop 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1f390 msgr2=0x55f92bc1d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1f390 0x55f92bc1d830 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400e790 tx=0x7fd2b4017f20 comp rx=0 tx=0).stop 2024-04-26T12:51:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 shutdown_connections 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd19c0346a0 0x7fd19c036b60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/4199953113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1f390 0x55f92bc1d830 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 >> 172.21.15.72:0/4199953113 conn(0x55f92bd238a0 msgr2=0x55f92bd243b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 shutdown_connections 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/4199953113 wait complete. 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd19f90 msgr2=0x55f92bd1c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f92bd19f90 0x55f92bd1c380 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bc22880 msgr2=0x55f92bd17620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f92bc22880 0x55f92bd17620 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd1ded0 msgr2=0x55f92bd202c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f92bd1ded0 0x55f92bd202c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1a8034650 msgr2=0x7fd1a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd1a8034650 0x7fd1a8036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80ad000 tx=0x7fd2b80a5040 comp rx=0 tx=0).stop 2024-04-26T12:51:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 msgr2=0x55f92bd10780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 --2- 172.21.15.72:0/3914059313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f92bc1c770 0x55f92bd10780 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4001e20 tx=0x7fd2b4000ee0 comp rx=0 tx=0).stop 2024-04-26T12:51:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c34b2640 1 -- 172.21.15.72:0/3914059313 reap_dead start 2024-04-26T12:51:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 shutdown_connections 2024-04-26T12:51:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 >> 172.21.15.72:0/3914059313 conn(0x55f92bc18200 msgr2=0x55f92bd03b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 shutdown_connections 2024-04-26T12:51:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:17.358+0000 7fd2c5196980 1 -- 172.21.15.72:0/3914059313 wait complete. 2024-04-26T12:51:17.370 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-26T12:51:17.134222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:51:17.134214Z', 'tags': [], 'group_ids': []} 2024-04-26T12:51:22.383 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:51:22.383 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-26T12:51:22.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-26T12:51:22.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-26T12:51:22.384 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-26T12:51:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7db70e980 1 Processor -- start 2024-04-26T12:51:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7db70e980 1 -- start start 2024-04-26T12:51:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7db70e980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56482554d520 0x56482554d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7db70e980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5648253f8510 con 0x56482554de40 2024-04-26T12:51:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7db70e980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5648253ff430 con 0x56482554d520 2024-04-26T12:51:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7d9229640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56482554d520 0x56482554d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7d8a28640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56482554de40 0x56482554e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:47808/0 (socket says 172.21.15.72:47808) 2024-04-26T12:51:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7d8a28640 1 -- 172.21.15.72:0/1714985831 learned_addr learned my addr 172.21.15.72:0/1714985831 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7d9229640 1 -- 172.21.15.72:0/1714985831 >> v1:172.21.15.29:6789/0 conn(0x56482554de40 legacy=0x56482554e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.430+0000 7fe7d9229640 1 -- 172.21.15.72:0/1714985831 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648253d4ae0 con 0x56482554d520 2024-04-26T12:51:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7d9229640 1 --2- 172.21.15.72:0/1714985831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x56482554d900 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00a480 tx=0x7fe7cc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38305a727c437988 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7d3fff640 1 -- 172.21.15.72:0/1714985831 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0b0070 con 0x56482554d520 2024-04-26T12:51:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7d3fff640 1 -- 172.21.15.72:0/1714985831 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0ab540 con 0x56482554d520 2024-04-26T12:51:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7d3fff640 1 -- 172.21.15.72:0/1714985831 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0ab840 con 0x56482554d520 2024-04-26T12:51:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7db70e980 1 -- 172.21.15.72:0/1714985831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 msgr2=0x56482554d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7db70e980 1 --2- 172.21.15.72:0/1714985831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x56482554d900 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00a480 tx=0x7fe7cc01b280 comp rx=0 tx=0).stop 2024-04-26T12:51:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7db70e980 1 -- 172.21.15.72:0/1714985831 shutdown_connections 2024-04-26T12:51:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7db70e980 1 --2- 172.21.15.72:0/1714985831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x56482554d900 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7db70e980 1 -- 172.21.15.72:0/1714985831 >> 172.21.15.72:0/1714985831 conn(0x5648254c0c00 msgr2=0x5648254c1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7db70e980 1 -- 172.21.15.72:0/1714985831 shutdown_connections 2024-04-26T12:51:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.434+0000 7fe7db70e980 1 -- 172.21.15.72:0/1714985831 wait complete. 2024-04-26T12:51:22.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7db70e980 1 Processor -- start 2024-04-26T12:51:22.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7db70e980 1 -- start start 2024-04-26T12:51:22.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7db70e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x564825638ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7db70e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56482544ea70 con 0x56482554d520 2024-04-26T12:51:22.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x564825638ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x564825638ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48422/0 (socket says 172.21.15.72:48422) 2024-04-26T12:51:22.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7d9229640 1 -- 172.21.15.72:0/2417757013 learned_addr learned my addr 172.21.15.72:0/2417757013 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7d9229640 1 -- 172.21.15.72:0/2417757013 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564825639470 con 0x56482554d520 2024-04-26T12:51:22.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.450+0000 7fe7d9229640 1 --2- 172.21.15.72:0/2417757013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x564825638ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0ae040 tx=0x7fe7cc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef7f6a696e7925a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe6c7606640 1 -- 172.21.15.72:0/2417757013 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0b0040 con 0x56482554d520 2024-04-26T12:51:22.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe6c7606640 1 -- 172.21.15.72:0/2417757013 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0ab9d0 con 0x56482554d520 2024-04-26T12:51:22.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe6c7606640 1 -- 172.21.15.72:0/2417757013 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0abcf0 con 0x56482554d520 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- 172.21.15.72:0/2417757013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 msgr2=0x564825638ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2417757013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x564825638ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0ae040 tx=0x7fe7cc003030 comp rx=0 tx=0).stop 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- 172.21.15.72:0/2417757013 shutdown_connections 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2417757013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x564825638ea0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- 172.21.15.72:0/2417757013 >> 172.21.15.72:0/2417757013 conn(0x5648254c0c00 msgr2=0x564825634a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- 172.21.15.72:0/2417757013 shutdown_connections 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- 172.21.15.72:0/2417757013 wait complete. 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 Processor -- start 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- start start 2024-04-26T12:51:22.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x5648256400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564825557570 con 0x56482554d520 2024-04-26T12:51:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x5648256400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x5648256400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48436/0 (socket says 172.21.15.72:48436) 2024-04-26T12:51:22.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7d9229640 1 -- 172.21.15.72:0/3141953928 learned_addr learned my addr 172.21.15.72:0/3141953928 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7d9229640 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648256405e0 con 0x56482554d520 2024-04-26T12:51:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7d9229640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x5648256400a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc01b2c0 tx=0x7fe7cc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe6c5e03640 1 -- 172.21.15.72:0/3141953928 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0b0050 con 0x56482554d520 2024-04-26T12:51:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe6c5e03640 1 -- 172.21.15.72:0/3141953928 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0b6870 con 0x56482554d520 2024-04-26T12:51:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564825640870 con 0x56482554d520 2024-04-26T12:51:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe6c5e03640 1 -- 172.21.15.72:0/3141953928 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0b6b50 con 0x56482554d520 2024-04-26T12:51:22.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.454+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648256434b0 con 0x56482554d520 2024-04-26T12:51:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe6c5e03640 1 -- 172.21.15.72:0/3141953928 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe7cc0b7420 con 0x56482554d520 2024-04-26T12:51:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe6c5e03640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6c0034650 0x7fe6c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe6c5e03640 1 -- 172.21.15.72:0/3141953928 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fe7cc0bc070 con 0x56482554d520 2024-04-26T12:51:22.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6c0034650 0x7fe6c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482554de40 0x564825646f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825647600 con 0x56482554de40 2024-04-26T12:51:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d9a2a640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482554de40 0x564825646f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6c0034650 0x7fe6c0036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40012f0 tx=0x7fe7c4006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d9a2a640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482554de40 0x564825646f90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/3141953928 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482554de40 2024-04-26T12:51:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5648256446b0 con 0x56482554de40 2024-04-26T12:51:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/3141953928 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482554de40 2024-04-26T12:51:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825649980 0x56482564bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56482564c440 con 0x564825649980 2024-04-26T12:51:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d9229640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825649980 0x56482564bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.458+0000 7fe7d9229640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825649980 0x56482564bd70 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d9229640 1 -- 172.21.15.72:0/3141953928 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe7cc0e4040 con 0x564825649980 2024-04-26T12:51:22.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825648820 con 0x56482554de40 2024-04-26T12:51:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/3141953928 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482554de40 2024-04-26T12:51:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56482564d8a0 0x56482564fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825650380 con 0x56482564d8a0 2024-04-26T12:51:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56482564d8a0 0x56482564fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56482564d8a0 0x56482564fc90 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d8a28640 1 -- 172.21.15.72:0/3141953928 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe7c400f070 con 0x56482564d8a0 2024-04-26T12:51:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7db70e980 1 Processor -- start 2024-04-26T12:51:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7db70e980 1 -- start start 2024-04-26T12:51:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7db70e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482565e410 0x56482565e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7db70e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564825452ab0 con 0x56482565e410 2024-04-26T12:51:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482565e410 0x56482565e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482565e410 0x56482565e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48444/0 (socket says 172.21.15.72:48444) 2024-04-26T12:51:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d9229640 1 -- 172.21.15.72:0/45368527 learned_addr learned my addr 172.21.15.72:0/45368527 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.462+0000 7fe7d9229640 1 -- 172.21.15.72:0/45368527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482565ed70 con 0x56482565e410 2024-04-26T12:51:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7d9229640 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482565e410 0x56482565e830 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0e2f10 tx=0x7fe7cc0c9670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe6beffd640 1 -- 172.21.15.72:0/45368527 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0e9070 con 0x56482565e410 2024-04-26T12:51:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe6beffd640 1 -- 172.21.15.72:0/45368527 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0c9c70 con 0x56482565e410 2024-04-26T12:51:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe6beffd640 1 -- 172.21.15.72:0/45368527 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0b4b90 con 0x56482565e410 2024-04-26T12:51:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56482565f810 con 0x56482565e410 2024-04-26T12:51:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56482565f810 con 0x56482565e410 2024-04-26T12:51:22.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe6beffd640 1 -- 172.21.15.72:0/45368527 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe7cc0ec070 con 0x56482565e410 2024-04-26T12:51:22.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe6beffd640 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6b0034650 0x7fe6b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe6beffd640 1 -- 172.21.15.72:0/45368527 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fe7cc0df030 con 0x56482565e410 2024-04-26T12:51:22.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6b0034650 0x7fe6b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7db70e980 1 Processor -- start 2024-04-26T12:51:22.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7db70e980 1 -- start start 2024-04-26T12:51:22.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6b0034650 0x7fe6b0036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x564825647f30 tx=0x7fe7c400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7db70e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x56482566b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7db70e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564825639700 con 0x56482566b230 2024-04-26T12:51:22.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x56482566b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x56482566b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48454/0 (socket says 172.21.15.72:48454) 2024-04-26T12:51:22.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.466+0000 7fe7d9229640 1 -- 172.21.15.72:0/3433066121 learned_addr learned my addr 172.21.15.72:0/3433066121 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7d9229640 1 -- 172.21.15.72:0/3433066121 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482566bc00 con 0x56482566b230 2024-04-26T12:51:22.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7d9229640 1 --2- 172.21.15.72:0/3433066121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x56482566b630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0aaa00 tx=0x7fe7cc0d03c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2a302e66db7e7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe6bcff9640 1 -- 172.21.15.72:0/3433066121 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0aaa70 con 0x56482566b230 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe6bcff9640 1 -- 172.21.15.72:0/3433066121 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc100070 con 0x56482566b230 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe6bcff9640 1 -- 172.21.15.72:0/3433066121 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0c9730 con 0x56482566b230 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 -- 172.21.15.72:0/3433066121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 msgr2=0x56482566b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3433066121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x56482566b630 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0aaa00 tx=0x7fe7cc0d03c0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 -- 172.21.15.72:0/3433066121 shutdown_connections 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3433066121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x56482566b630 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 -- 172.21.15.72:0/3433066121 >> 172.21.15.72:0/3433066121 conn(0x564825667570 msgr2=0x5648256655d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 -- 172.21.15.72:0/3433066121 shutdown_connections 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 -- 172.21.15.72:0/3433066121 wait complete. 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 Processor -- start 2024-04-26T12:51:22.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 -- start start 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x564825672350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7db70e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56482566c160 con 0x56482566b230 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x564825672350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7d9229640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x564825672350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48466/0 (socket says 172.21.15.72:48466) 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 learned_addr learned my addr 172.21.15.72:0/2498381164 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564825672890 con 0x56482566b230 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe7d9229640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x564825672350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0c9c00 tx=0x7fe7cc0cdf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe6aeffd640 1 -- 172.21.15.72:0/2498381164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0e1260 con 0x56482566b230 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe6aeffd640 1 -- 172.21.15.72:0/2498381164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0e1400 con 0x56482566b230 2024-04-26T12:51:22.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.470+0000 7fe6aeffd640 1 -- 172.21.15.72:0/2498381164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7cc0e15f0 con 0x56482566b230 2024-04-26T12:51:22.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564825672890 con 0x56482566b230 2024-04-26T12:51:22.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564825672890 con 0x56482566b230 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe6aeffd640 1 -- 172.21.15.72:0/2498381164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe7cc0fa070 con 0x56482566b230 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe6aeffd640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6a40346a0 0x7fe6a4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe6aeffd640 1 -- 172.21.15.72:0/2498381164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fe7cc0a8070 con 0x56482566b230 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6a40346a0 0x7fe6a4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482567d2e0 0x56482567f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56482567fef0 con 0x56482567d2e0 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d9a2a640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482567d2e0 0x56482567f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6a40346a0 0x7fe6a4036b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40062e0 tx=0x7fe7c4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d9a2a640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482567d2e0 0x56482567f7a0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482567d2e0 2024-04-26T12:51:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 realm 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825680300 con 0x56482567d2e0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482567d2e0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825680bd0 con 0x56482567d2e0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482567d2e0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x56482567d2e0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482567d2e0 2024-04-26T12:51:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:22.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825681cd0 0x5648256840c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.474+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5648256846d0 con 0x564825681cd0 2024-04-26T12:51:22.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9229640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825681cd0 0x5648256840c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9229640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825681cd0 0x5648256840c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7db70e980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7db70e980 20 searching for the correct realm 2024-04-26T12:51:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5648256865b0 0x5648256889e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825689060 con 0x5648256865b0 2024-04-26T12:51:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5648256865b0 0x5648256889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5648256865b0 0x5648256889e0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c400f070 con 0x5648256865b0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d8a28640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe7c4024070 0x7fe7c4031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825689060 con 0x7fe7c4024070 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9a2a640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe7c4024070 0x7fe7c4031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9a2a640 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe7c4024070 0x7fe7c4031460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d40083f0 con 0x7fe7c4024070 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x564825681cd0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.478+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x56482567d2e0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d40083f0 con 0x56482567d2e0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x56482567d2e0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x564825681cd0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x564825681cd0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x7fe7c4024070 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x5648256865b0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c400f070 con 0x5648256865b0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x56482567d2e0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x7fe7c4024070 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x56482567d2e0 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x7fe7c4024070 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.482+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x5648256865b0 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x5648256865b0 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x564825681cd0 2024-04-26T12:51:22.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x5648256865b0 2024-04-26T12:51:22.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x5648256865b0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x56482567d2e0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x56482567d2e0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x564825681cd0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x5648256865b0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x7fe7c4024070 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x56482567d2e0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.486+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x564825681cd0 2024-04-26T12:51:22.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x5648256865b0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x564825681cd0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x7fe7c4024070 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x5648256865b0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x564825681cd0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x56482567d2e0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe7d402b040 con 0x7fe7c4024070 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x56482567d2e0 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.490+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x56482567d2e0 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825680f70 con 0x5648256865b0 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 zone default found 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 4 Realm: () 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 zonegroup default 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825685510 con 0x564825681cd0 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56482568aec0 con 0x5648256865b0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56482568b260 con 0x5648256865b0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 started sync module instance, tier type = 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568a360 con 0x7fe7c4024070 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867865249920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568a360 con 0x7fe7c4024070 2024-04-26T12:51:22.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.494+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568baf0 con 0x56482567d2e0 2024-04-26T12:51:22.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.498+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94867865249920] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.498+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.498+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867865253376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568a360 con 0x56482567d2e0 2024-04-26T12:51:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.498+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568c500 con 0x5648256865b0 2024-04-26T12:51:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94867865253376] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867865247408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568a2d0 con 0x5648256865b0 2024-04-26T12:51:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568d240 con 0x7fe7c4024070 2024-04-26T12:51:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867865259344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568db10 con 0x7fe7c4024070 2024-04-26T12:51:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568e4d0 con 0x56482567d2e0 2024-04-26T12:51:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94867865247408] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94867865259344] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867865264160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568da60 con 0x56482567d2e0 2024-04-26T12:51:22.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.502+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568e440 con 0x564825681cd0 2024-04-26T12:51:22.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.506+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94867865264160] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.506+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.506+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867865261760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568eda0 con 0x564825681cd0 2024-04-26T12:51:22.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.506+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568f5f0 con 0x564825681cd0 2024-04-26T12:51:22.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.506+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94867865261760] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867865266416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56482568fe40 con 0x564825681cd0 2024-04-26T12:51:22.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564825690800 con 0x564825681cd0 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94867865266416] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867865270944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564825690800 con 0x564825681cd0 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 20 add_watcher() i=0 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 20 add_watcher() i=1 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 20 add_watcher() i=2 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 20 add_watcher() i=3 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 20 add_watcher() i=4 2024-04-26T12:51:22.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 20 add_watcher() i=5 2024-04-26T12:51:22.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.510+0000 7fe7db70e980 20 add_watcher() i=6 2024-04-26T12:51:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94867865270944] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 add_watcher() i=7 2024-04-26T12:51:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564825693b30 con 0x56482567d2e0 2024-04-26T12:51:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867865285984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564825690970 con 0x56482567d2e0 2024-04-26T12:51:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94867865285984] v35'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe68f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 5 note: GC not initialized 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe68e7e4640 20 reqs_thread_entry: start 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 Filter name: none 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe5fffff640 20 reqs_thread_entry: start 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5648256b7490 con 0x564825681cd0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.514+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5ad0 con 0x564825681cd0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:51:22.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:51:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:51:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:51:22.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b63a0 con 0x564825681cd0 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v35'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94867865427696 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5648256baa80 con 0x564825681cd0 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== watch-notify(notify (1) cookie 94867865261760 notify 150323855395 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5648256b6ee0 con 0x564825681cd0 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe6bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855395 cookie 94867865261760 notifier 4748 bl.length()=556 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe6bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe6bcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:51:22.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(65 notify.5 [notify cookie 94867865427696 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe6bcff9640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fe69c003eb0 con 0x564825681cd0 2024-04-26T12:51:22.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== watch-notify(notify_complete (2) cookie 94867865427696 notify 150323855395 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5648256434b0 con 0x564825681cd0 2024-04-26T12:51:22.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.518+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b6350 con 0x564825681cd0 2024-04-26T12:51:22.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7db70e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:51:22.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7db70e980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:51:22.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7db70e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:51:22.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94867865427616 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5648256b6320 con 0x5648256865b0 2024-04-26T12:51:22.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== watch-notify(notify (1) cookie 94867865247408 notify 150323855366 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fe7c401b030 con 0x5648256865b0 2024-04-26T12:51:22.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe6bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 94867865247408 notifier 4748 bl.length()=177 2024-04-26T12:51:22.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 notify.2 [notify cookie 94867865427616 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe6bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:51:22.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe6bcff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:51:22.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe6bcff9640 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fe69c003eb0 con 0x5648256865b0 2024-04-26T12:51:22.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== watch-notify(notify_complete (2) cookie 94867865427616 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5648253f8510 con 0x5648256865b0 2024-04-26T12:51:22.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.522+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.527 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:51:22.521644Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:51:22.521630Z","tags":[],"group_ids":[]} 2024-04-26T12:51:22.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe68f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:22.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867865285984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x56482567d2e0 2024-04-26T12:51:22.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94867865285984] v35'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867865249920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x7fe7c4024070 2024-04-26T12:51:22.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94867865249920] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe7db70e980 20 remove_watcher() i=0 2024-04-26T12:51:22.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe7db70e980 2 removed watcher, disabling cache 2024-04-26T12:51:22.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.526+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867865253376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x56482567d2e0 2024-04-26T12:51:22.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.530+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94867865253376] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.530+0000 7fe7db70e980 20 remove_watcher() i=1 2024-04-26T12:51:22.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.530+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867865247408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x5648256865b0 2024-04-26T12:51:22.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.530+0000 7fe7d8a28640 1 -- 172.21.15.72:0/2498381164 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94867865247408] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7c4040040 con 0x5648256865b0 2024-04-26T12:51:22.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.530+0000 7fe7db70e980 20 remove_watcher() i=2 2024-04-26T12:51:22.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.530+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867865259344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x7fe7c4024070 2024-04-26T12:51:22.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.534+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94867865259344] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x7fe7c4024070 2024-04-26T12:51:22.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.534+0000 7fe7db70e980 20 remove_watcher() i=3 2024-04-26T12:51:22.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.534+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867865264160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x56482567d2e0 2024-04-26T12:51:22.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.534+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94867865264160] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7d4026040 con 0x56482567d2e0 2024-04-26T12:51:22.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.534+0000 7fe7db70e980 20 remove_watcher() i=4 2024-04-26T12:51:22.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.534+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867865261760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x564825681cd0 2024-04-26T12:51:22.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.538+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94867865261760] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.538+0000 7fe7db70e980 20 remove_watcher() i=5 2024-04-26T12:51:22.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.538+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867865266416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x564825681cd0 2024-04-26T12:51:22.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.538+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94867865266416] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.538+0000 7fe7db70e980 20 remove_watcher() i=6 2024-04-26T12:51:22.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.538+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867865270944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5648256b5130 con 0x564825681cd0 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7d9229640 1 -- 172.21.15.72:0/2498381164 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94867865270944] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7cc0f9030 con 0x564825681cd0 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 20 remove_watcher() i=7 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825681cd0 msgr2=0x5648256840c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825681cd0 0x5648256840c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482567d2e0 msgr2=0x56482567f7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482567d2e0 0x56482567f7a0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe7c4024070 msgr2=0x7fe7c4031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fe7c4024070 0x7fe7c4031460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5648256865b0 msgr2=0x5648256889e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5648256865b0 0x5648256889e0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6a40346a0 msgr2=0x7fe6a4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6a40346a0 0x7fe6a4036b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40062e0 tx=0x7fe7c4010000 comp rx=0 tx=0).stop 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 msgr2=0x564825672350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/2498381164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482566b230 0x564825672350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0c9c00 tx=0x7fe7cc0cdf10 comp rx=0 tx=0).stop 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 reap_dead start 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/2498381164 reap_dead start 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 shutdown_connections 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 >> 172.21.15.72:0/2498381164 conn(0x564825667570 msgr2=0x5648256655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 shutdown_connections 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/2498381164 wait complete. 2024-04-26T12:51:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6b0034650 msgr2=0x7fe6b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6b0034650 0x7fe6b0036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x564825647f30 tx=0x7fe7c400f000 comp rx=0 tx=0).stop 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482565e410 msgr2=0x56482565e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482565e410 0x56482565e830 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0e2f10 tx=0x7fe7cc0c9670 comp rx=0 tx=0).stop 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 shutdown_connections 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6b0034650 0x7fe6b0036b10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/45368527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482565e410 0x56482565e830 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 >> 172.21.15.72:0/45368527 conn(0x564825653220 msgr2=0x564825653d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 shutdown_connections 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/45368527 wait complete. 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825649980 msgr2=0x56482564bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x564825649980 0x56482564bd70 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482554de40 msgr2=0x564825646f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56482554de40 0x564825646f90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56482564d8a0 msgr2=0x56482564fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56482564d8a0 0x56482564fc90 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6c0034650 msgr2=0x7fe6c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fe6c0034650 0x7fe6c0036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40012f0 tx=0x7fe7c4006700 comp rx=0 tx=0).stop 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 msgr2=0x5648256400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 --2- 172.21.15.72:0/3141953928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56482554d520 0x5648256400a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc01b2c0 tx=0x7fe7cc018020 comp rx=0 tx=0).stop 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7d9a2a640 1 -- 172.21.15.72:0/3141953928 reap_dead start 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 shutdown_connections 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 >> 172.21.15.72:0/3141953928 conn(0x5648254c0c00 msgr2=0x564825633540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 shutdown_connections 2024-04-26T12:51:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.542+0000 7fe7db70e980 1 -- 172.21.15.72:0/3141953928 wait complete. 2024-04-26T12:51:22.557 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:51:22.521644Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:51:22.521630Z', 'tags': [], 'group_ids': []} 2024-04-26T12:51:22.578 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:51:22.585 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-26T12:51:22.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-26T12:51:22.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-26T12:51:22.586 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-26T12:51:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e6105980 1 Processor -- start 2024-04-26T12:51:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e6105980 1 -- start start 2024-04-26T12:51:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e6105980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562f24508a00 0x562f2450adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e6105980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f243af510 con 0x562f245044f0 2024-04-26T12:51:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e6105980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x562f243b6430 con 0x562f24508a00 2024-04-26T12:51:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e341f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562f24508a00 0x562f2450adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e3c20640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x562f245044f0 0x562f245048d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:47824/0 (socket says 172.21.15.72:47824) 2024-04-26T12:51:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e3c20640 1 -- 172.21.15.72:0/1948996910 learned_addr learned my addr 172.21.15.72:0/1948996910 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e341f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x562f24508a00 0x562f2450adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48480/0 (socket says 172.21.15.72:48480) 2024-04-26T12:51:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e341f640 1 -- 172.21.15.72:0/1948996910 >> v1:172.21.15.29:6789/0 conn(0x562f245044f0 legacy=0x562f245048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.618+0000 7f65e341f640 1 -- 172.21.15.72:0/1948996910 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f2438bae0 con 0x562f24508a00 2024-04-26T12:51:22.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e341f640 1 --2- 172.21.15.72:0/1948996910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24508a00 0x562f2450adf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f65d800a480 tx=0x7f65d801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afa8ab28166d304 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e2c1e640 1 -- 172.21.15.72:0/1948996910 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d80b0070 con 0x562f24508a00 2024-04-26T12:51:22.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e2c1e640 1 -- 172.21.15.72:0/1948996910 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d80ab540 con 0x562f24508a00 2024-04-26T12:51:22.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e2c1e640 1 -- 172.21.15.72:0/1948996910 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d80ab840 con 0x562f24508a00 2024-04-26T12:51:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e6105980 1 -- 172.21.15.72:0/1948996910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24508a00 msgr2=0x562f2450adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e6105980 1 --2- 172.21.15.72:0/1948996910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24508a00 0x562f2450adf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f65d800a480 tx=0x7f65d801b280 comp rx=0 tx=0).stop 2024-04-26T12:51:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e6105980 1 -- 172.21.15.72:0/1948996910 shutdown_connections 2024-04-26T12:51:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e6105980 1 --2- 172.21.15.72:0/1948996910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24508a00 0x562f2450adf0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e6105980 1 -- 172.21.15.72:0/1948996910 >> 172.21.15.72:0/1948996910 conn(0x562f24477bd0 msgr2=0x562f24477fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e6105980 1 -- 172.21.15.72:0/1948996910 shutdown_connections 2024-04-26T12:51:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.622+0000 7f65e6105980 1 -- 172.21.15.72:0/1948996910 wait complete. 2024-04-26T12:51:22.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 Processor -- start 2024-04-26T12:51:22.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 -- start start 2024-04-26T12:51:22.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245ef610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562f24405a70 con 0x562f245044f0 2024-04-26T12:51:22.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48490/0 (socket says 172.21.15.72:48490) 2024-04-26T12:51:22.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e3c20640 1 -- 172.21.15.72:0/1200872140 learned_addr learned my addr 172.21.15.72:0/1200872140 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e3c20640 1 -- 172.21.15.72:0/1200872140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f245efbe0 con 0x562f245044f0 2024-04-26T12:51:22.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e3c20640 1 --2- 172.21.15.72:0/1200872140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245ef610 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f65d4001d90 tx=0x7f65d4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54baba320b42c5f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f64d1e0b640 1 -- 172.21.15.72:0/1200872140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4013030 con 0x562f245044f0 2024-04-26T12:51:22.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f64d1e0b640 1 -- 172.21.15.72:0/1200872140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d400e690 con 0x562f245044f0 2024-04-26T12:51:22.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f64d1e0b640 1 -- 172.21.15.72:0/1200872140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d400ea10 con 0x562f245044f0 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 -- 172.21.15.72:0/1200872140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 msgr2=0x562f245ef610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 --2- 172.21.15.72:0/1200872140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245ef610 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f65d4001d90 tx=0x7f65d4001e80 comp rx=0 tx=0).stop 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 -- 172.21.15.72:0/1200872140 shutdown_connections 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 --2- 172.21.15.72:0/1200872140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245ef610 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 -- 172.21.15.72:0/1200872140 >> 172.21.15.72:0/1200872140 conn(0x562f24477bd0 msgr2=0x562f245eb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.638+0000 7f65e6105980 1 -- 172.21.15.72:0/1200872140 shutdown_connections 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 -- 172.21.15.72:0/1200872140 wait complete. 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 Processor -- start 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 -- start start 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562f2450de20 con 0x562f245044f0 2024-04-26T12:51:22.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48496/0 (socket says 172.21.15.72:48496) 2024-04-26T12:51:22.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e3c20640 1 -- 172.21.15.72:0/1082618936 learned_addr learned my addr 172.21.15.72:0/1082618936 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e3c20640 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f245f6de0 con 0x562f245044f0 2024-04-26T12:51:22.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e3c20640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245f68a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x562f245f04a0 tx=0x7f65d4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f64cbfff640 1 -- 172.21.15.72:0/1082618936 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4027070 con 0x562f245044f0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f245f7070 con 0x562f245044f0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f64cbfff640 1 -- 172.21.15.72:0/1082618936 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4019900 con 0x562f245044f0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f64cbfff640 1 -- 172.21.15.72:0/1082618936 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4019c20 con 0x562f245044f0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f245f9cb0 con 0x562f245044f0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f64cbfff640 1 -- 172.21.15.72:0/1082618936 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f65d402a070 con 0x562f245044f0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f64cbfff640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64cc034650 0x7f64cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f64cbfff640 1 -- 172.21.15.72:0/1082618936 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f65d401f070 con 0x562f245044f0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e341f640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64cc034650 0x7f64cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24508a00 0x562f245fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f245fde20 con 0x562f24508a00 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.642+0000 7f65e4421640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24508a00 0x562f245fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e341f640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64cc034650 0x7f64cc036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f65d80ad000 tx=0x7f65d80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e4421640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24508a00 0x562f245fd7d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e4421640 1 -- 172.21.15.72:0/1082618936 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24508a00 2024-04-26T12:51:22.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f245faed0 con 0x562f24508a00 2024-04-26T12:51:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e4421640 1 -- 172.21.15.72:0/1082618936 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24508a00 2024-04-26T12:51:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f24600170 0x562f24602560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f24602c30 con 0x562f24600170 2024-04-26T12:51:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e3c20640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f24600170 0x562f24602560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e3c20640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f24600170 0x562f24602560 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e3c20640 1 -- 172.21.15.72:0/1082618936 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65d4029030 con 0x562f24600170 2024-04-26T12:51:22.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f245ff010 con 0x562f24508a00 2024-04-26T12:51:22.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e4421640 1 -- 172.21.15.72:0/1082618936 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24508a00 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f24604090 0x562f24606480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f24606b70 con 0x562f24604090 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.646+0000 7f65e341f640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f24604090 0x562f24606480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e341f640 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f24604090 0x562f24606480 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e341f640 1 -- 172.21.15.72:0/1082618936 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65d80b3040 con 0x562f24604090 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e6105980 1 Processor -- start 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e6105980 1 -- start start 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e6105980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24614bc0 0x562f24614fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e6105980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562f24409ab0 con 0x562f24614bc0 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24614bc0 0x562f24614fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24614bc0 0x562f24614fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48504/0 (socket says 172.21.15.72:48504) 2024-04-26T12:51:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e3c20640 1 -- 172.21.15.72:0/943847875 learned_addr learned my addr 172.21.15.72:0/943847875 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e3c20640 1 -- 172.21.15.72:0/943847875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f24615520 con 0x562f24614bc0 2024-04-26T12:51:22.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e3c20640 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24614bc0 0x562f24614fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f65d400bc00 tx=0x7f65d4048630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f64c97fa640 1 -- 172.21.15.72:0/943847875 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4048c10 con 0x562f24614bc0 2024-04-26T12:51:22.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f24615fc0 con 0x562f24614bc0 2024-04-26T12:51:22.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f64c97fa640 1 -- 172.21.15.72:0/943847875 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4048db0 con 0x562f24614bc0 2024-04-26T12:51:22.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f64c97fa640 1 -- 172.21.15.72:0/943847875 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d402a6b0 con 0x562f24614bc0 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.650+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f24616490 con 0x562f24614bc0 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f64c97fa640 1 -- 172.21.15.72:0/943847875 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f65d4036040 con 0x562f24614bc0 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f64c97fa640 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64bc034650 0x7f64bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f64c97fa640 1 -- 172.21.15.72:0/943847875 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f65d4014070 con 0x562f24614bc0 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e341f640 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64bc034650 0x7f64bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 Processor -- start 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- start start 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24622000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e341f640 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64bc034650 0x7f64bc036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x562f245fefe0 tx=0x7f65d8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562f245eff30 con 0x562f24621be0 2024-04-26T12:51:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24622000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24622000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48514/0 (socket says 172.21.15.72:48514) 2024-04-26T12:51:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e3c20640 1 -- 172.21.15.72:0/1915608139 learned_addr learned my addr 172.21.15.72:0/1915608139 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e3c20640 1 -- 172.21.15.72:0/1915608139 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f246225d0 con 0x562f24621be0 2024-04-26T12:51:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e3c20640 1 --2- 172.21.15.72:0/1915608139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24622000 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f65d402a9c0 tx=0x7f65d402c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad6881a29a954c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f64c2ffd640 1 -- 172.21.15.72:0/1915608139 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4058040 con 0x562f24621be0 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f64c2ffd640 1 -- 172.21.15.72:0/1915608139 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4021530 con 0x562f24621be0 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f64c2ffd640 1 -- 172.21.15.72:0/1915608139 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4022d00 con 0x562f24621be0 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- 172.21.15.72:0/1915608139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 msgr2=0x562f24622000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 --2- 172.21.15.72:0/1915608139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24622000 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f65d402a9c0 tx=0x7f65d402c910 comp rx=0 tx=0).stop 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- 172.21.15.72:0/1915608139 shutdown_connections 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 --2- 172.21.15.72:0/1915608139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24622000 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- 172.21.15.72:0/1915608139 >> 172.21.15.72:0/1915608139 conn(0x562f2461df20 msgr2=0x562f2461bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- 172.21.15.72:0/1915608139 shutdown_connections 2024-04-26T12:51:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- 172.21.15.72:0/1915608139 wait complete. 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 Processor -- start 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- start start 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24628f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.654+0000 7f65e6105980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x562f24622c90 con 0x562f24621be0 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24628f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e3c20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24628f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48524/0 (socket says 172.21.15.72:48524) 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 learned_addr learned my addr 172.21.15.72:0/3772837690 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f24629450 con 0x562f24621be0 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e3c20640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24628f10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f65d4047280 tx=0x7f65d4042140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f64c17fa640 1 -- 172.21.15.72:0/3772837690 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d406a070 con 0x562f24621be0 2024-04-26T12:51:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f24629450 con 0x562f24621be0 2024-04-26T12:51:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f64c17fa640 1 -- 172.21.15.72:0/3772837690 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4058040 con 0x562f24621be0 2024-04-26T12:51:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f246298c0 con 0x562f24621be0 2024-04-26T12:51:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f64c17fa640 1 -- 172.21.15.72:0/3772837690 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4057070 con 0x562f24621be0 2024-04-26T12:51:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f64c17fa640 1 -- 172.21.15.72:0/3772837690 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f65d406d070 con 0x562f24621be0 2024-04-26T12:51:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f64c17fa640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64ac0346a0 0x7f64ac036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f64c17fa640 1 -- 172.21.15.72:0/3772837690 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f65d4005050 con 0x562f24621be0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e341f640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64ac0346a0 0x7f64ac036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24633fc0 0x562f24636480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f24636bd0 con 0x562f24633fc0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e4421640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24633fc0 0x562f24636480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e341f640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64ac0346a0 0x7f64ac036b60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f65d80b6fd0 tx=0x7f65d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.658+0000 7f65e4421640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24633fc0 0x562f24636480 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 realm 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f24636fe0 con 0x562f24633fc0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f246378b0 con 0x562f24633fc0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f246389b0 0x562f2463ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f2463b3b0 con 0x562f246389b0 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e3c20640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f246389b0 0x562f2463ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e3c20640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f246389b0 0x562f2463ada0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 20 searching for the correct realm 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f2463d290 0x562f2463f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f2463fd40 con 0x562f2463d290 2024-04-26T12:51:22.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e341f640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f2463d290 0x562f2463f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e341f640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f2463d290 0x562f2463f6c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e341f640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f65d80ab030 0x7f65d80b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f2463fd40 con 0x7f65d80ab030 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.662+0000 7f65e4421640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f65d80ab030 0x7f65d80b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f65d80ab030 0x7f65d80b7400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc00a4d0 con 0x7f65d80ab030 2024-04-26T12:51:22.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x7f65d80ab030 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc00a4d0 con 0x7f65d80ab030 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.666+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x7f65d80ab030 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc00a4d0 con 0x7f65d80ab030 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc00a4d0 con 0x562f24633fc0 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x7f65d80ab030 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65dc032040 con 0x7f65d80ab030 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc032040 con 0x562f24633fc0 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65dc032040 con 0x562f24633fc0 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.670+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x7f65d80ab030 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc032040 con 0x7f65d80ab030 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc032040 con 0x562f24633fc0 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x7f65d80ab030 2024-04-26T12:51:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc032040 con 0x7f65d80ab030 2024-04-26T12:51:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f2463d290 2024-04-26T12:51:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f246389b0 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.674+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x562f24633fc0 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65dc032040 con 0x562f24633fc0 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562f24637c50 con 0x7f65d80ab030 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc032040 con 0x7f65d80ab030 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f2463bc00 con 0x562f24633fc0 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65dc032040 con 0x562f24633fc0 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f2463bc00 con 0x562f24633fc0 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65dc032040 con 0x562f24633fc0 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f2463bc00 con 0x562f2463d290 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 zone default found 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 4 Realm: () 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 zonegroup default 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f2463c610 con 0x562f246389b0 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f24642050 con 0x562f2463d290 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f246423f0 con 0x562f2463d290 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 started sync module instance, tier type = 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.678+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24641490 con 0x7f65d80ab030 2024-04-26T12:51:22.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.682+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc032040 con 0x7f65d80ab030 2024-04-26T12:51:22.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.682+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94760473991344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24641490 con 0x7f65d80ab030 2024-04-26T12:51:22.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.682+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24642c40 con 0x562f24633fc0 2024-04-26T12:51:22.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.682+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94760473991344] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x7f65d80ab030 2024-04-26T12:51:22.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.682+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.682+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94760473995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24641490 con 0x562f24633fc0 2024-04-26T12:51:22.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.682+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24643650 con 0x562f2463d290 2024-04-26T12:51:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94760473997728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24643ea0 con 0x562f2463d290 2024-04-26T12:51:22.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24644860 con 0x7f65d80ab030 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94760473995424] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x7f65d80ab030 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94760474002352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f246447d0 con 0x7f65d80ab030 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f246455b0 con 0x562f24633fc0 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94760473997728] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.686+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94760474002352] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x7f65d80ab030 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.690+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.690+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94760473999856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24645070 con 0x562f24633fc0 2024-04-26T12:51:22.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.690+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f246458c0 con 0x562f246389b0 2024-04-26T12:51:22.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.690+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94760473999856] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.690+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.690+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94760474004688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24645cb0 con 0x562f246389b0 2024-04-26T12:51:22.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.690+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24646670 con 0x562f246389b0 2024-04-26T12:51:22.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94760474004688] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94760474005808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24646670 con 0x562f246389b0 2024-04-26T12:51:22.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24647030 con 0x562f246389b0 2024-04-26T12:51:22.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94760474005808] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94760474010560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24647030 con 0x562f246389b0 2024-04-26T12:51:22.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 20 add_watcher() i=0 2024-04-26T12:51:22.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 20 add_watcher() i=1 2024-04-26T12:51:22.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 20 add_watcher() i=2 2024-04-26T12:51:22.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 20 add_watcher() i=3 2024-04-26T12:51:22.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 20 add_watcher() i=4 2024-04-26T12:51:22.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 20 add_watcher() i=5 2024-04-26T12:51:22.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.694+0000 7f65e6105980 20 add_watcher() i=6 2024-04-26T12:51:22.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94760474010560] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e6105980 20 add_watcher() i=7 2024-04-26T12:51:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e6105980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f2464a430 con 0x562f24633fc0 2024-04-26T12:51:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94760474013008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24647920 con 0x562f24633fc0 2024-04-26T12:51:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94760474013008] v35'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f6499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e6105980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.698+0000 7f65e6105980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 5 note: GC not initialized 2024-04-26T12:51:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f6498fe1640 20 reqs_thread_entry: start 2024-04-26T12:51:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 20 Filter name: none 2024-04-26T12:51:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f64127fc640 20 reqs_thread_entry: start 2024-04-26T12:51:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T12:51:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562f2466dc60 con 0x7f65d80ab030 2024-04-26T12:51:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f65dc040040 con 0x7f65d80ab030 2024-04-26T12:51:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:51:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-26T12:51:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:51:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:51:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.702+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f24672010 con 0x562f246389b0 2024-04-26T12:51:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.706+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v35'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-26T12:51:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.706+0000 7f6499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.706+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94760474013008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x562f24633fc0 2024-04-26T12:51:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.706+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94760474013008] v35'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.706+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94760473991344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x7f65d80ab030 2024-04-26T12:51:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.710+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94760473991344] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x7f65d80ab030 2024-04-26T12:51:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.710+0000 7f65e6105980 20 remove_watcher() i=0 2024-04-26T12:51:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.710+0000 7f65e6105980 2 removed watcher, disabling cache 2024-04-26T12:51:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.710+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94760473995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x562f24633fc0 2024-04-26T12:51:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.710+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94760473995424] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.710+0000 7f65e6105980 20 remove_watcher() i=1 2024-04-26T12:51:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.710+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94760473997728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x562f2463d290 2024-04-26T12:51:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e341f640 1 -- 172.21.15.72:0/3772837690 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94760473997728] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80b3040 con 0x562f2463d290 2024-04-26T12:51:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e6105980 20 remove_watcher() i=2 2024-04-26T12:51:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94760474002352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x7f65d80ab030 2024-04-26T12:51:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94760474002352] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x7f65d80ab030 2024-04-26T12:51:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e6105980 20 remove_watcher() i=3 2024-04-26T12:51:22.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94760473999856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x562f24633fc0 2024-04-26T12:51:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94760473999856] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc040040 con 0x562f24633fc0 2024-04-26T12:51:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e6105980 20 remove_watcher() i=4 2024-04-26T12:51:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.714+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94760474004688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x562f246389b0 2024-04-26T12:51:22.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.718+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94760474004688] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.718+0000 7f65e6105980 20 remove_watcher() i=5 2024-04-26T12:51:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.718+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94760474005808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x562f246389b0 2024-04-26T12:51:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94760474005808] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 20 remove_watcher() i=6 2024-04-26T12:51:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94760474010560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562f2466b990 con 0x562f246389b0 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e3c20640 1 -- 172.21.15.72:0/3772837690 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94760474010560] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d406c030 con 0x562f246389b0 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 20 remove_watcher() i=7 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f246389b0 msgr2=0x562f2463ada0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f246389b0 0x562f2463ada0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24633fc0 msgr2=0x562f24636480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24633fc0 0x562f24636480 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f65d80ab030 msgr2=0x7f65d80b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f65d80ab030 0x7f65d80b7400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f2463d290 msgr2=0x562f2463f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f2463d290 0x562f2463f6c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64ac0346a0 msgr2=0x7f64ac036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64ac0346a0 0x7f64ac036b60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f65d80b6fd0 tx=0x7f65d80a6000 comp rx=0 tx=0).stop 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 msgr2=0x562f24628f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e4421640 1 -- 172.21.15.72:0/3772837690 reap_dead start 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24628f10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f65d4047280 tx=0x7f65d4042140 comp rx=0 tx=0).stop 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 shutdown_connections 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/3772837690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24621be0 0x562f24628f10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 >> 172.21.15.72:0/3772837690 conn(0x562f2461df20 msgr2=0x562f2461b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 shutdown_connections 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/3772837690 wait complete. 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64bc034650 msgr2=0x7f64bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64bc034650 0x7f64bc036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x562f245fefe0 tx=0x7f65d8005a10 comp rx=0 tx=0).stop 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24614bc0 msgr2=0x562f24614fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24614bc0 0x562f24614fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f65d400bc00 tx=0x7f65d4048630 comp rx=0 tx=0).stop 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 shutdown_connections 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64bc034650 0x7f64bc036b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/943847875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f24614bc0 0x562f24614fe0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 >> 172.21.15.72:0/943847875 conn(0x562f246099d0 msgr2=0x562f2460a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 shutdown_connections 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/943847875 wait complete. 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f24600170 msgr2=0x562f24602560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x562f24600170 0x562f24602560 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24508a00 msgr2=0x562f245fd7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x562f24508a00 0x562f245fd7d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f24604090 msgr2=0x562f24606480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x562f24604090 0x562f24606480 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64cc034650 msgr2=0x7f64cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64cc034650 0x7f64cc036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f65d80ad000 tx=0x7f65d80a5040 comp rx=0 tx=0).stop 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 msgr2=0x562f245f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.722+0000 7f65e6105980 1 --2- 172.21.15.72:0/1082618936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x562f245044f0 0x562f245f68a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x562f245f04a0 tx=0x7f65d4000bd0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.726+0000 7f65e4421640 1 -- 172.21.15.72:0/1082618936 reap_dead start 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.726+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 shutdown_connections 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.726+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 >> 172.21.15.72:0/1082618936 conn(0x562f24477bd0 msgr2=0x562f245e9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.726+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 shutdown_connections 2024-04-26T12:51:22.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.726+0000 7f65e6105980 1 -- 172.21.15.72:0/1082618936 wait complete. 2024-04-26T12:51:22.737 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:51:22.790 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:51:22.791 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-26T12:51:22.798 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:51:22.798 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-26T12:51:22.798 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-26T12:51:22.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-26T12:51:22.799 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-26T12:51:22.837 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:22.837 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.834+0000 7f655197b980 1 Processor -- start 2024-04-26T12:51:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.834+0000 7f655197b980 1 -- start start 2024-04-26T12:51:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.834+0000 7f655197b980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556ab9548a50 0x556ab9548e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.834+0000 7f655197b980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ab93f4510 con 0x556ab9549370 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.834+0000 7f655197b980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556ab93fb430 con 0x556ab9548a50 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.834+0000 7f654f496640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556ab9548a50 0x556ab9548e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.838+0000 7f654ec95640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556ab9549370 0x556ab95454c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:47834/0 (socket says 172.21.15.72:47834) 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.838+0000 7f654f496640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556ab9548a50 0x556ab9548e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48534/0 (socket says 172.21.15.72:48534) 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.838+0000 7f654ec95640 1 -- 172.21.15.72:0/2327870532 learned_addr learned my addr 172.21.15.72:0/2327870532 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.838+0000 7f654f496640 1 -- 172.21.15.72:0/2327870532 >> v1:172.21.15.29:6789/0 conn(0x556ab9549370 legacy=0x556ab95454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.838+0000 7f654f496640 1 -- 172.21.15.72:0/2327870532 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab93d0ae0 con 0x556ab9548a50 2024-04-26T12:51:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.838+0000 7f654f496640 1 --2- 172.21.15.72:0/2327870532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9548a50 0x556ab9548e30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f654000a480 tx=0x7f654001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e527f68fb0bf01b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.838+0000 7f654e494640 1 -- 172.21.15.72:0/2327870532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400af070 con 0x556ab9548a50 2024-04-26T12:51:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f654e494640 1 -- 172.21.15.72:0/2327870532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400aa530 con 0x556ab9548a50 2024-04-26T12:51:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f654e494640 1 -- 172.21.15.72:0/2327870532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400aa830 con 0x556ab9548a50 2024-04-26T12:51:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f655197b980 1 -- 172.21.15.72:0/2327870532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9548a50 msgr2=0x556ab9548e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f655197b980 1 --2- 172.21.15.72:0/2327870532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9548a50 0x556ab9548e30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f654000a480 tx=0x7f654001b280 comp rx=0 tx=0).stop 2024-04-26T12:51:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f655197b980 1 -- 172.21.15.72:0/2327870532 shutdown_connections 2024-04-26T12:51:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f655197b980 1 --2- 172.21.15.72:0/2327870532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9548a50 0x556ab9548e30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f655197b980 1 -- 172.21.15.72:0/2327870532 >> 172.21.15.72:0/2327870532 conn(0x556ab9541200 msgr2=0x556ab9543620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f655197b980 1 -- 172.21.15.72:0/2327870532 shutdown_connections 2024-04-26T12:51:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.842+0000 7f655197b980 1 -- 172.21.15.72:0/2327870532 wait complete. 2024-04-26T12:51:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 Processor -- start 2024-04-26T12:51:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- start start 2024-04-26T12:51:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9632eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ab944aa70 con 0x556ab9549370 2024-04-26T12:51:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9632eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9632eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48548/0 (socket says 172.21.15.72:48548) 2024-04-26T12:51:22.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f654f496640 1 -- 172.21.15.72:0/56057010 learned_addr learned my addr 172.21.15.72:0/56057010 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f654f496640 1 -- 172.21.15.72:0/56057010 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab9633480 con 0x556ab9549370 2024-04-26T12:51:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f654f496640 1 --2- 172.21.15.72:0/56057010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9632eb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f65400ad040 tx=0x7f6540003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e100cf92749362d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f643d60a640 1 -- 172.21.15.72:0/56057010 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400af040 con 0x556ab9549370 2024-04-26T12:51:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f643d60a640 1 -- 172.21.15.72:0/56057010 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400aaa20 con 0x556ab9549370 2024-04-26T12:51:22.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f643d60a640 1 -- 172.21.15.72:0/56057010 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400aad40 con 0x556ab9549370 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- 172.21.15.72:0/56057010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 msgr2=0x556ab9632eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 --2- 172.21.15.72:0/56057010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9632eb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f65400ad040 tx=0x7f6540003030 comp rx=0 tx=0).stop 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- 172.21.15.72:0/56057010 shutdown_connections 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 --2- 172.21.15.72:0/56057010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9632eb0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- 172.21.15.72:0/56057010 >> 172.21.15.72:0/56057010 conn(0x556ab9541200 msgr2=0x556ab962e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- 172.21.15.72:0/56057010 shutdown_connections 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- 172.21.15.72:0/56057010 wait complete. 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 Processor -- start 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- start start 2024-04-26T12:51:22.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9639ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.858+0000 7f655197b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ab9551550 con 0x556ab9549370 2024-04-26T12:51:22.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9639ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9639ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48564/0 (socket says 172.21.15.72:48564) 2024-04-26T12:51:22.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654f496640 1 -- 172.21.15.72:0/2747643084 learned_addr learned my addr 172.21.15.72:0/2747643084 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654f496640 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab963a530 con 0x556ab9549370 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654f496640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9639ff0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f654001b2c0 tx=0x7f6540018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f643be07640 1 -- 172.21.15.72:0/2747643084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400c2020 con 0x556ab9549370 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f643be07640 1 -- 172.21.15.72:0/2747643084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6540000e50 con 0x556ab9549370 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ab963a7c0 con 0x556ab9549370 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f643be07640 1 -- 172.21.15.72:0/2747643084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400af050 con 0x556ab9549370 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab963d450 con 0x556ab9549370 2024-04-26T12:51:22.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f643be07640 1 -- 172.21.15.72:0/2747643084 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f65400c5020 con 0x556ab9549370 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f643be07640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6434034650 0x7f6434036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f643be07640 1 -- 172.21.15.72:0/2747643084 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f65400ba070 con 0x556ab9549370 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654ec95640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6434034650 0x7f6434036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab963f090 0x556ab9641480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96419c0 con 0x556ab963f090 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654fc97640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab963f090 0x556ab9641480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654ec95640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6434034650 0x7f6434036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6538000f70 tx=0x7f65380012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654fc97640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab963f090 0x556ab9641480 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.862+0000 7f654fc97640 1 -- 172.21.15.72:0/2747643084 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab963f090 2024-04-26T12:51:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab963e650 con 0x556ab963f090 2024-04-26T12:51:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654fc97640 1 -- 172.21.15.72:0/2747643084 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab963f090 2024-04-26T12:51:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab9643ce0 0x556ab96460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96467c0 con 0x556ab9643ce0 2024-04-26T12:51:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654f496640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab9643ce0 0x556ab96460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654f496640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab9643ce0 0x556ab96460d0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654f496640 1 -- 172.21.15.72:0/2747643084 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65400b2040 con 0x556ab9643ce0 2024-04-26T12:51:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9642b80 con 0x556ab963f090 2024-04-26T12:51:22.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654fc97640 1 -- 172.21.15.72:0/2747643084 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab963f090 2024-04-26T12:51:22.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9647c20 0x556ab964a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab964a750 con 0x556ab9647c20 2024-04-26T12:51:22.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654ec95640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9647c20 0x556ab964a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654ec95640 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9647c20 0x556ab964a010 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f654ec95640 1 -- 172.21.15.72:0/2747643084 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f653800e620 con 0x556ab9647c20 2024-04-26T12:51:22.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.866+0000 7f655197b980 1 Processor -- start 2024-04-26T12:51:22.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f655197b980 1 -- start start 2024-04-26T12:51:22.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f655197b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab96587e0 0x556ab9658c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f655197b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ab944eab0 con 0x556ab96587e0 2024-04-26T12:51:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab96587e0 0x556ab9658c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab96587e0 0x556ab9658c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48566/0 (socket says 172.21.15.72:48566) 2024-04-26T12:51:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f654f496640 1 -- 172.21.15.72:0/3116248329 learned_addr learned my addr 172.21.15.72:0/3116248329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f654f496640 1 -- 172.21.15.72:0/3116248329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab9659140 con 0x556ab96587e0 2024-04-26T12:51:22.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f654f496640 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab96587e0 0x556ab9658c00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f65400e2c80 tx=0x7f6540006400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f6439602640 1 -- 172.21.15.72:0/3116248329 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400b4de0 con 0x556ab96587e0 2024-04-26T12:51:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f6439602640 1 -- 172.21.15.72:0/3116248329 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400e4aa0 con 0x556ab96587e0 2024-04-26T12:51:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ab9659be0 con 0x556ab96587e0 2024-04-26T12:51:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f6439602640 1 -- 172.21.15.72:0/3116248329 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400e4d80 con 0x556ab96587e0 2024-04-26T12:51:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab965a0b0 con 0x556ab96587e0 2024-04-26T12:51:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f6439602640 1 -- 172.21.15.72:0/3116248329 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f65400dc070 con 0x556ab96587e0 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f6439602640 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64280346a0 0x7f6428036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f6439602640 1 -- 172.21.15.72:0/3116248329 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f65400c8030 con 0x556ab96587e0 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f654ec95640 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64280346a0 0x7f6428036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.870+0000 7f655197b980 1 Processor -- start 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- start start 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654ec95640 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64280346a0 0x7f6428036b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x556ab9646b90 tx=0x7f653800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab9665c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ab9633770 con 0x556ab9665810 2024-04-26T12:51:22.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab9665c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab9665c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48574/0 (socket says 172.21.15.72:48574) 2024-04-26T12:51:22.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 -- 172.21.15.72:0/1254331789 learned_addr learned my addr 172.21.15.72:0/1254331789 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 -- 172.21.15.72:0/1254331789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab9666200 con 0x556ab9665810 2024-04-26T12:51:22.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 --2- 172.21.15.72:0/1254331789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab9665c30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f65400b5d50 tx=0x7f65400dd880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d040d5bf6045d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f6432ffd640 1 -- 172.21.15.72:0/1254331789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400d3430 con 0x556ab9665810 2024-04-26T12:51:22.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f6432ffd640 1 -- 172.21.15.72:0/1254331789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400f2070 con 0x556ab9665810 2024-04-26T12:51:22.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f6432ffd640 1 -- 172.21.15.72:0/1254331789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400bfdd0 con 0x556ab9665810 2024-04-26T12:51:22.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- 172.21.15.72:0/1254331789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 msgr2=0x556ab9665c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:22.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 --2- 172.21.15.72:0/1254331789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab9665c30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f65400b5d50 tx=0x7f65400dd880 comp rx=0 tx=0).stop 2024-04-26T12:51:22.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- 172.21.15.72:0/1254331789 shutdown_connections 2024-04-26T12:51:22.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 --2- 172.21.15.72:0/1254331789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab9665c30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- 172.21.15.72:0/1254331789 >> 172.21.15.72:0/1254331789 conn(0x556ab9661ba0 msgr2=0x556ab965fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- 172.21.15.72:0/1254331789 shutdown_connections 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- 172.21.15.72:0/1254331789 wait complete. 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 Processor -- start 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- start start 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab966caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f655197b980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556ab9666910 con 0x556ab9665810 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab966caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab966caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48584/0 (socket says 172.21.15.72:48584) 2024-04-26T12:51:22.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.874+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 learned_addr learned my addr 172.21.15.72:0/2170599625 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:22.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab966d030 con 0x556ab9665810 2024-04-26T12:51:22.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f654f496640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab966caf0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f65400dd980 tx=0x7f65400d3f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f64317fa640 1 -- 172.21.15.72:0/2170599625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400bfdd0 con 0x556ab9665810 2024-04-26T12:51:22.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ab966d030 con 0x556ab9665810 2024-04-26T12:51:22.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f64317fa640 1 -- 172.21.15.72:0/2170599625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400c6550 con 0x556ab9665810 2024-04-26T12:51:22.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f64317fa640 1 -- 172.21.15.72:0/2170599625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65400d3430 con 0x556ab9665810 2024-04-26T12:51:22.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab966d4a0 con 0x556ab9665810 2024-04-26T12:51:22.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f64317fa640 1 -- 172.21.15.72:0/2170599625 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f654010f020 con 0x556ab9665810 2024-04-26T12:51:22.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f64317fa640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6418034650 0x7f6418036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f64317fa640 1 -- 172.21.15.72:0/2170599625 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f654010d020 con 0x556ab9665810 2024-04-26T12:51:22.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f654ec95640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6418034650 0x7f6418036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab9677c90 0x556ab967a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967a8a0 con 0x556ab9677c90 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f654fc97640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab9677c90 0x556ab967a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f654ec95640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6418034650 0x7f6418036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f653800bf60 tx=0x7f6538010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f654fc97640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab9677c90 0x556ab967a150 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 20 realm 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.878+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967acb0 con 0x556ab9677c90 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b550 con 0x556ab9677c90 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab967c650 0x556ab967ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967f090 con 0x556ab967c650 2024-04-26T12:51:22.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654f496640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab967c650 0x556ab967ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654f496640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab967c650 0x556ab967ea40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 20 searching for the correct realm 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9680f70 0x556ab9683380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab9683a00 con 0x556ab9680f70 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654ec95640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9680f70 0x556ab9683380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654ec95640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9680f70 0x556ab9683380 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654ec95640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6538037040 0x7f6538036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab9683a00 con 0x7f6538037040 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.882+0000 7f654fc97640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6538037040 0x7f6538036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6538037040 0x7f6538036410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654800a4d0 con 0x7f6538037040 2024-04-26T12:51:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x7f6538037040 2024-04-26T12:51:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654800a4d0 con 0x7f6538037040 2024-04-26T12:51:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.886+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x7f6538037040 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654800a4d0 con 0x7f6538037040 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f654800a4d0 con 0x556ab9677c90 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x7f6538037040 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6548032040 con 0x7f6538037040 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6548032040 con 0x556ab9677c90 2024-04-26T12:51:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6548032040 con 0x556ab9677c90 2024-04-26T12:51:22.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.890+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x7f6538037040 2024-04-26T12:51:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6548032040 con 0x7f6538037040 2024-04-26T12:51:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6548032040 con 0x556ab9677c90 2024-04-26T12:51:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x7f6538037040 2024-04-26T12:51:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6548032040 con 0x7f6538037040 2024-04-26T12:51:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9680f70 2024-04-26T12:51:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.894+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab967c650 2024-04-26T12:51:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x556ab9677c90 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6548032040 con 0x556ab9677c90 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ab967b8f0 con 0x7f6538037040 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6548032040 con 0x7f6538037040 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967f8e0 con 0x556ab9677c90 2024-04-26T12:51:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6548032040 con 0x556ab9677c90 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967f8e0 con 0x556ab9677c90 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6548032040 con 0x556ab9677c90 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967f8e0 con 0x556ab9680f70 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 zone default found 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 4 Realm: () 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 zonegroup default 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96802e0 con 0x556ab967c650 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab967fe70 con 0x556ab9680f70 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.898+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9685de0 con 0x556ab9680f70 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 20 started sync module instance, tier type = 2024-04-26T12:51:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96851a0 con 0x7f6538037040 2024-04-26T12:51:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548032040 con 0x7f6538037040 2024-04-26T12:51:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93916865517248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96851a0 con 0x7f6538037040 2024-04-26T12:51:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96868e0 con 0x556ab9677c90 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93916865517248] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93916865520624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96851a0 con 0x556ab9677c90 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.902+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9687320 con 0x556ab9680f70 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.906+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93916865520624] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.906+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.906+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93916865514736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9685110 con 0x556ab9680f70 2024-04-26T12:51:22.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.906+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9688070 con 0x7f6538037040 2024-04-26T12:51:22.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.906+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.906+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93916865527056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9688910 con 0x7f6538037040 2024-04-26T12:51:22.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.906+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9689310 con 0x556ab9677c90 2024-04-26T12:51:22.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.910+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93916865514736] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.910+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93916865527056] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.910+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.910+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93916865525520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9688410 con 0x556ab9677c90 2024-04-26T12:51:22.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.910+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9689bb0 con 0x556ab967c650 2024-04-26T12:51:22.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.910+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93916865525520] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.914+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.914+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93916865533696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9688410 con 0x556ab967c650 2024-04-26T12:51:22.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.914+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab968a400 con 0x556ab967c650 2024-04-26T12:51:22.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.914+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93916865533696] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.914+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.914+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93916865531424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab968a400 con 0x556ab967c650 2024-04-26T12:51:22.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.914+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab968ae00 con 0x556ab967c650 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93916865531424] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93916865538320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab968ad70 con 0x556ab967c650 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=0 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=1 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=2 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=3 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=4 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=5 2024-04-26T12:51:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=6 2024-04-26T12:51:22.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93916865538320] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 20 add_watcher() i=7 2024-04-26T12:51:22.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:22.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab968a040 con 0x556ab9677c90 2024-04-26T12:51:22.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.918+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93916865540592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab968bbd0 con 0x556ab9677c90 2024-04-26T12:51:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.922+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93916865540592] v35'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.922+0000 7f64067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.922+0000 7f655197b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.922+0000 7f655197b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.922+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9696da0 con 0x556ab9677c90 2024-04-26T12:51:22.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.922+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.922+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9697470 con 0x556ab967c650 2024-04-26T12:51:22.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.926+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.926+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9697470 con 0x556ab9680f70 2024-04-26T12:51:22.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.926+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.926+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9697a80 con 0x556ab9677c90 2024-04-26T12:51:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.930+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'219 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.930+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9697f30 con 0x7f6538037040 2024-04-26T12:51:22.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.930+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'70 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.930+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9692a50 con 0x556ab9680f70 2024-04-26T12:51:22.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.930+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.930+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9692a50 con 0x556ab9677c90 2024-04-26T12:51:22.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.934+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.934+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9698a90 con 0x556ab967c650 2024-04-26T12:51:22.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.934+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.934+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9698a90 con 0x7f6538037040 2024-04-26T12:51:22.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.938+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.938+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9698a90 con 0x556ab9680f70 2024-04-26T12:51:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.938+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.938+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96927c0 con 0x7f6538037040 2024-04-26T12:51:22.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.942+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'71 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.942+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96927c0 con 0x556ab967c650 2024-04-26T12:51:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.942+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.942+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96927c0 con 0x7f6538037040 2024-04-26T12:51:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.942+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.942+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96927c0 con 0x556ab967c650 2024-04-26T12:51:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.946+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.946+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96927c0 con 0x556ab9677c90 2024-04-26T12:51:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.946+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'220 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.946+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96927c0 con 0x556ab9680f70 2024-04-26T12:51:22.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.950+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'63 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.950+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x7f6538037040 2024-04-26T12:51:22.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.950+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.950+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.954+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.954+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9677c90 2024-04-26T12:51:22.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.954+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.954+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9677c90 2024-04-26T12:51:22.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.958+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'221 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.958+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.958+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'64 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.958+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x7f6538037040 2024-04-26T12:51:22.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.958+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.958+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.962+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.962+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.962+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.962+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.962+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.962+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.966+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.966+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab967c650 2024-04-26T12:51:22.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.966+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.966+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.970+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.970+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab967c650 2024-04-26T12:51:22.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.970+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.970+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab9680f70 2024-04-26T12:51:22.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.974+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'65 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.974+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x556ab967c650 2024-04-26T12:51:22.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.974+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.974+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9699390 con 0x7f6538037040 2024-04-26T12:51:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f64057e2640 20 reqs_thread_entry: start 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 20 Filter name: none 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f63fe7fc640 20 reqs_thread_entry: start 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96950f0 con 0x7f6538037040 2024-04-26T12:51:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96b6fc0 con 0x556ab9677c90 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 : miss 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.978+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:96 8.1c 8:389832b4:root::.bucket.meta.myfoo6%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96b6e40 con 0x556ab9680f70 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(96 .bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 info.flags=0x17 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 to cache LRU end 2024-04-26T12:51:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:51:22.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:51:22.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 2024-04-26T12:51:22.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 4.15 4:a89b2d7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734320 con 0x556ab9680f70 2024-04-26T12:51:22.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(97 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 4.1b 4:db91d4ad:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734360 con 0x7f6538037040 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(98 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:99 4.25 4:a7f36742:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734360 con 0x556ab9680f70 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(99 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:100 4.30 4:0ce9357b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734360 con 0x556ab9680f70 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(100 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f653800e620 con 0x556ab9680f70 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:101 4.12 4:4b795005:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734360 con 0x556ab9677c90 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(101 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:102 4.36 4:6dde4018:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734360 con 0x556ab9677c90 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(102 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.982+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:103 4.1d 4:bb84b32f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734360 con 0x556ab9680f70 2024-04-26T12:51:22.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(103 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:22.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:104 4.38 4:1c32b28e:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734320 con 0x556ab9677c90 2024-04-26T12:51:22.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(104 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:105 4.18 4:1816693c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734320 con 0x7f6538037040 2024-04-26T12:51:22.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(105 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:106 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734320 con 0x7f6538037040 2024-04-26T12:51:22.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(106 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [call out=289b] v0'0 uv10 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 10 cls_bucket_list_unordered: got thirteen 2024-04-26T12:51:22.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:107 4.17 4:ea544dea:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab9734320 con 0x556ab967c650 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(107 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 20 get_obj_state: octx=0x7f654800ab20 obj=myfoo6:thirteen state=0x556ab97323a8 s->prefetch_data=0 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:108 3.9s0 3:93d44bee:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab97331d0 con 0x556ab9680f70 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(108 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 10 manifest: total_size = 8 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 20 get_obj_state: setting s->obj_tag to _VwPfBfnwINHeHLSCvxURAkvW8zJmTvK 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 20 get_obj_state: octx=0x7f654800ab20 obj=myfoo6:thirteen state=0x556ab97323a8 s->prefetch_data=0 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 20 prepare_atomic_modification: state is not atomic. state=0x556ab97323a8 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 2024-04-26T12:51:22.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.986+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:109 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9733a60 con 0x7f6538037040 2024-04-26T12:51:22.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(109 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [stat,call,call] v35'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:110 3.9s0 3:93d44bee:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab9733a60 con 0x556ab9680f70 2024-04-26T12:51:22.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(110 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9_thirteen [call] v35'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:22.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:111 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bb9f0 con 0x7f6538037040 2024-04-26T12:51:22.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 20 list_objects_ordered: starting attempt 1 2024-04-26T12:51:22.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:51:22.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:112 4.15 4:a89b2d7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bb9f0 con 0x556ab9680f70 2024-04-26T12:51:22.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:113 4.1b 4:db91d4ad:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bb9f0 con 0x7f6538037040 2024-04-26T12:51:22.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:114 4.25 4:a7f36742:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96c3160 con 0x556ab9680f70 2024-04-26T12:51:22.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:115 4.30 4:0ce9357b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bb9f0 con 0x556ab9680f70 2024-04-26T12:51:22.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:116 4.12 4:4b795005:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96c80e0 con 0x556ab9677c90 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:117 4.36 4:6dde4018:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96ca9d0 con 0x556ab9677c90 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:118 4.1d 4:bb84b32f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd7d0 con 0x556ab9680f70 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:119 4.38 4:1c32b28e:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d0600 con 0x556ab9677c90 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:120 4.18 4:1816693c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d3450 con 0x7f6538037040 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:121 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d5e20 con 0x7f6538037040 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:122 4.17 4:ea544dea:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d8ca0 con 0x556ab967c650 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.990+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(113 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(120 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(119 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(116 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(122 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:22.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(117 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548040040 con 0x556ab9677c90 2024-04-26T12:51:22.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(115 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:22.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(112 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(114 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(118 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(111 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [stat,call,call] v35'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f6432ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(121 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6548040040 con 0x7f6538037040 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9])"; uploads.size()=0; is_truncated=0 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:123 4.15 4:a89b2d7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d5e20 con 0x556ab9680f70 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:124 4.1b 4:db91d4ad:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d8ca0 con 0x7f6538037040 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:125 4.25 4:a7f36742:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d0600 con 0x556ab9680f70 2024-04-26T12:51:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:126 4.30 4:0ce9357b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d5e20 con 0x556ab9680f70 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:127 4.12 4:4b795005:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d8ca0 con 0x556ab9677c90 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:128 4.36 4:6dde4018:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:129 4.1d 4:bb84b32f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d5e20 con 0x556ab9680f70 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:130 4.38 4:1c32b28e:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d59a0 con 0x556ab9677c90 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:131 4.18 4:1816693c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d8ca0 con 0x7f6538037040 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:132 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:133 4.17 4:ea544dea:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96c5b00 con 0x556ab967c650 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(124 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(126 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(131 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(128 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(132 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== osd_op_reply(125 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 40 ==== osd_op_reply(129 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(133 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(130 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.994+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(127 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 41 ==== osd_op_reply(123 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(134 bud.buckets [call] v35'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 20 rados_obj.operate() r=0 bl.length=166 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(136 myfoo6 [call,call,delete] v35'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93916866231312 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== watch-notify(notify (1) cookie 93916865527056 notify 150323855386 ret 0) ==== 192+0+0 (crc 0 0 0) 0x556ab96925a0 con 0x7f6538037040 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:22.998+0000 7f64327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855386 cookie 93916865527056 notifier 4762 bl.length()=150 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f64327fc640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6378003390 con 0x7f6538037040 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== osd_op_reply(137 notify.3 [notify cookie 93916866231312 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== watch-notify(notify_complete (2) cookie 93916866231312 notify 150323855386 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ab9696910 con 0x7f6538037040 2024-04-26T12:51:23.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:139 8.1c 8:389832b4:root::.bucket.meta.myfoo6%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9680f70 2024-04-26T12:51:23.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 42 ==== osd_op_reply(139 .bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 from cache 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9, ofs0, ns] 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93916865719728 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== watch-notify(notify (1) cookie 93916865517248 notify 150323855387 ret 0) ==== 249+0+0 (crc 0 0 0) 0x556ab9696910 con 0x7f6538037040 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f6432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855387 cookie 93916865517248 notifier 4762 bl.length()=207 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== osd_op_reply(140 notify.0 [notify cookie 93916865719728 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f6432ffd640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6414003d70 con 0x7f6538037040 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== watch-notify(notify_complete (2) cookie 93916865719728 notify 150323855387 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ab9696740 con 0x7f6538037040 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:142 4.15 4:a89b2d7f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9680f70 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:143 4.1b 4:db91d4ad:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d8ca0 con 0x7f6538037040 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:144 4.25 4:a7f36742:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bbd10 con 0x556ab9680f70 2024-04-26T12:51:23.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:145 4.30 4:0ce9357b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9680f70 2024-04-26T12:51:23.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:146 4.12 4:4b795005:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bbd10 con 0x556ab9677c90 2024-04-26T12:51:23.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:147 4.36 4:6dde4018:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d8ca0 con 0x556ab9677c90 2024-04-26T12:51:23.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:148 4.1d 4:bb84b32f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9680f70 2024-04-26T12:51:23.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:149 4.38 4:1c32b28e:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bbd10 con 0x556ab9677c90 2024-04-26T12:51:23.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:150 4.18 4:1816693c:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96d8ca0 con 0x7f6538037040 2024-04-26T12:51:23.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:151 4.3f 4:fc60b81d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.002+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:152 4.17 4:ea544dea:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96bbd10 con 0x556ab967c650 2024-04-26T12:51:23.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 40 ==== osd_op_reply(149 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.7 [delete] v35'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 41 ==== osd_op_reply(147 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.5 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 42 ==== osd_op_reply(146 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.4 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(143 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.1 [delete] v35'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 43 ==== osd_op_reply(148 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.6 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 44 ==== osd_op_reply(142 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.0 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 45 ==== osd_op_reply(144 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.2 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 46 ==== osd_op_reply(145 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.3 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(151 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.9 [delete] v35'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(152 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.10 [delete] v35'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 41 ==== osd_op_reply(150 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9.8 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f655197b980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 : miss 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.006+0000 7f655197b980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:153 6.3 6:c78e9f1a:::pubsub..bucket.myfoo6%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 42 ==== osd_op_reply(153 pubsub..bucket.myfoo6/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 info.flags=0x0 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 10 adding default.rgw.log++pubsub..bucket.myfoo6/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 to cache LRU end 2024-04-26T12:51:23.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:154 6.3 6:c78e9f1a:::pubsub..bucket.myfoo6%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 43 ==== osd_op_reply(154 pubsub..bucket.myfoo6/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.9 [delete] v35'73 uv57 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 43 ==== osd_op_reply(155 bud.buckets [call] v35'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-26T12:51:23.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.010+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 44 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v35'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f655197b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T12:51:23.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93916865834224 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab967c650 2024-04-26T12:51:23.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== watch-notify(notify (1) cookie 93916865533696 notify 150323855396 ret 0) ==== 212+0+0 (crc 0 0 0) 0x556ab9698a90 con 0x556ab967c650 2024-04-26T12:51:23.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f64327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855396 cookie 93916865533696 notifier 4762 bl.length()=170 2024-04-26T12:51:23.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f64327fc640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6378003390 con 0x556ab967c650 2024-04-26T12:51:23.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(157 notify.5 [notify cookie 93916865834224 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== watch-notify(notify_complete (2) cookie 93916865834224 notify 150323855396 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ab9659140 con 0x556ab967c650 2024-04-26T12:51:23.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f655197b980 10 removing email index: 2024-04-26T12:51:23.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f655197b980 10 removing user buckets index 2024-04-26T12:51:23.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 45 ==== osd_op_reply(159 bud.buckets [delete] v35'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f655197b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-26T12:51:23.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.014+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93916865834224 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab967c650 2024-04-26T12:51:23.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== watch-notify(notify (1) cookie 93916865531424 notify 150323855397 ret 0) ==== 202+0+0 (crc 0 0 0) 0x556ab9659140 con 0x556ab967c650 2024-04-26T12:51:23.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(160 notify.6 [notify cookie 93916865834224 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f6432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855397 cookie 93916865531424 notifier 4762 bl.length()=160 2024-04-26T12:51:23.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f6432ffd640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6414003d70 con 0x556ab967c650 2024-04-26T12:51:23.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== watch-notify(notify_complete (2) cookie 93916865834224 notify 150323855397 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ab963d450 con 0x556ab967c650 2024-04-26T12:51:23.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f655197b980 10 removing user index: bud 2024-04-26T12:51:23.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 44 ==== osd_op_reply(162 bud [call,call,delete] v35'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f655197b980 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-26T12:51:23.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f655197b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T12:51:23.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93916865834224 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab967c650 2024-04-26T12:51:23.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== watch-notify(notify (1) cookie 93916865533696 notify 150323855398 ret 0) ==== 194+0+0 (crc 0 0 0) 0x556ab963d450 con 0x556ab967c650 2024-04-26T12:51:23.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f6432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855398 cookie 93916865533696 notifier 4762 bl.length()=152 2024-04-26T12:51:23.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f6432ffd640 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6414003d70 con 0x556ab967c650 2024-04-26T12:51:23.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.018+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(163 notify.5 [notify cookie 93916865834224 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.022+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.022+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== watch-notify(notify_complete (2) cookie 93916865834224 notify 150323855398 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ab963a7c0 con 0x556ab967c650 2024-04-26T12:51:23.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.022+0000 7f64067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:23.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.022+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93916865540592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.022+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 46 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93916865540592] v35'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.022+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93916865517248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.026+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 45 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93916865517248] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.026+0000 7f655197b980 20 remove_watcher() i=0 2024-04-26T12:51:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.026+0000 7f655197b980 2 removed watcher, disabling cache 2024-04-26T12:51:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.026+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93916865520624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.026+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 47 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93916865520624] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.026+0000 7f655197b980 20 remove_watcher() i=1 2024-04-26T12:51:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.026+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93916865514736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9680f70 2024-04-26T12:51:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.030+0000 7f654ec95640 1 -- 172.21.15.72:0/2170599625 <== osd.3 v2:172.21.15.72:6808/671626845 47 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93916865514736] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6538053060 con 0x556ab9680f70 2024-04-26T12:51:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.030+0000 7f655197b980 20 remove_watcher() i=2 2024-04-26T12:51:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.030+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93916865527056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x7f6538037040 2024-04-26T12:51:23.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.030+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.2 v2:172.21.15.72:6800/1931234624 46 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93916865527056] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548058040 con 0x7f6538037040 2024-04-26T12:51:23.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.030+0000 7f655197b980 20 remove_watcher() i=3 2024-04-26T12:51:23.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.030+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93916865525520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab9677c90 2024-04-26T12:51:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.034+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 <== osd.1 v2:172.21.15.72:6816/1811201389 48 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93916865525520] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6548058040 con 0x556ab9677c90 2024-04-26T12:51:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.034+0000 7f655197b980 20 remove_watcher() i=4 2024-04-26T12:51:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.034+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93916865533696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab967c650 2024-04-26T12:51:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.034+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93916865533696] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.034+0000 7f655197b980 20 remove_watcher() i=5 2024-04-26T12:51:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.034+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93916865531424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab967c650 2024-04-26T12:51:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93916865531424] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 20 remove_watcher() i=6 2024-04-26T12:51:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93916865538320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ab96cd880 con 0x556ab967c650 2024-04-26T12:51:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f654f496640 1 -- 172.21.15.72:0/2170599625 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93916865538320] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65400b2040 con 0x556ab967c650 2024-04-26T12:51:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 20 remove_watcher() i=7 2024-04-26T12:51:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab967c650 msgr2=0x556ab967ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab967c650 0x556ab967ea40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab9677c90 msgr2=0x556ab967a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab9677c90 0x556ab967a150 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6538037040 msgr2=0x7f6538036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6538037040 0x7f6538036410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9680f70 msgr2=0x556ab9683380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9680f70 0x556ab9683380 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6418034650 msgr2=0x7f6418036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6418034650 0x7f6418036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f653800bf60 tx=0x7f6538010000 comp rx=0 tx=0).stop 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 msgr2=0x556ab966caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab966caf0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f65400dd980 tx=0x7f65400d3f10 comp rx=0 tx=0).stop 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f654fc97640 1 -- 172.21.15.72:0/2170599625 reap_dead start 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 shutdown_connections 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 --2- 172.21.15.72:0/2170599625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9665810 0x556ab966caf0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 >> 172.21.15.72:0/2170599625 conn(0x556ab9661ba0 msgr2=0x556ab965fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 shutdown_connections 2024-04-26T12:51:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.038+0000 7f655197b980 1 -- 172.21.15.72:0/2170599625 wait complete. 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64280346a0 msgr2=0x7f6428036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64280346a0 0x7f6428036b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x556ab9646b90 tx=0x7f653800f000 comp rx=0 tx=0).stop 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab96587e0 msgr2=0x556ab9658c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab96587e0 0x556ab9658c00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f65400e2c80 tx=0x7f6540006400 comp rx=0 tx=0).stop 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 shutdown_connections 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f64280346a0 0x7f6428036b60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/3116248329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab96587e0 0x556ab9658c00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 >> 172.21.15.72:0/3116248329 conn(0x556ab964d5f0 msgr2=0x556ab964e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 shutdown_connections 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/3116248329 wait complete. 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab9643ce0 msgr2=0x556ab96460d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556ab9643ce0 0x556ab96460d0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab963f090 msgr2=0x556ab9641480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556ab963f090 0x556ab9641480 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9647c20 msgr2=0x556ab964a010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556ab9647c20 0x556ab964a010 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6434034650 msgr2=0x7f6434036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6434034650 0x7f6434036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6538000f70 tx=0x7f65380012c0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 msgr2=0x556ab9639ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 --2- 172.21.15.72:0/2747643084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556ab9549370 0x556ab9639ff0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f654001b2c0 tx=0x7f6540018020 comp rx=0 tx=0).stop 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f654fc97640 1 -- 172.21.15.72:0/2747643084 reap_dead start 2024-04-26T12:51:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 shutdown_connections 2024-04-26T12:51:23.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 >> 172.21.15.72:0/2747643084 conn(0x556ab9541200 msgr2=0x556ab962d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 shutdown_connections 2024-04-26T12:51:23.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.042+0000 7f655197b980 1 -- 172.21.15.72:0/2747643084 wait complete. 2024-04-26T12:51:23.057 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-26T12:51:23.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-26T12:51:23.057 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-26T12:51:23.133 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:51:23.134 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:51:23.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.130+0000 7ff9c9937980 1 Processor -- start 2024-04-26T12:51:23.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.130+0000 7ff9c9937980 1 -- start start 2024-04-26T12:51:23.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c9937980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56134e246b20 0x56134e246f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c9937980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56134e17d510 con 0x56134e247440 2024-04-26T12:51:23.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c9937980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56134e184430 con 0x56134e246b20 2024-04-26T12:51:23.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c7452640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56134e246b20 0x56134e246f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c7452640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56134e246b20 0x56134e246f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48596/0 (socket says 172.21.15.72:48596) 2024-04-26T12:51:23.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c6c51640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56134e247440 0x56134e247e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:47844/0 (socket says 172.21.15.72:47844) 2024-04-26T12:51:23.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c7452640 1 -- 172.21.15.72:0/3513725878 learned_addr learned my addr 172.21.15.72:0/3513725878 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:23.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c7452640 1 -- 172.21.15.72:0/3513725878 >> v1:172.21.15.29:6789/0 conn(0x56134e247440 legacy=0x56134e247e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c7452640 1 -- 172.21.15.72:0/3513725878 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134e159ae0 con 0x56134e246b20 2024-04-26T12:51:23.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c7452640 1 --2- 172.21.15.72:0/3513725878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e246f00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000a5c0 tx=0x7ff9b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e257ac204a774b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c6450640 1 -- 172.21.15.72:0/3513725878 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00a6070 con 0x56134e246b20 2024-04-26T12:51:23.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c6450640 1 -- 172.21.15.72:0/3513725878 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00af070 con 0x56134e246b20 2024-04-26T12:51:23.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.134+0000 7ff9c6450640 1 -- 172.21.15.72:0/3513725878 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00aa5c0 con 0x56134e246b20 2024-04-26T12:51:23.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.138+0000 7ff9c9937980 1 -- 172.21.15.72:0/3513725878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 msgr2=0x56134e246f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.138+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3513725878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e246f00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000a5c0 tx=0x7ff9b001b340 comp rx=0 tx=0).stop 2024-04-26T12:51:23.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.138+0000 7ff9c9937980 1 -- 172.21.15.72:0/3513725878 shutdown_connections 2024-04-26T12:51:23.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.138+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3513725878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e246f00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.138+0000 7ff9c9937980 1 -- 172.21.15.72:0/3513725878 >> 172.21.15.72:0/3513725878 conn(0x56134e245bd0 msgr2=0x56134e245fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.138+0000 7ff9c9937980 1 -- 172.21.15.72:0/3513725878 shutdown_connections 2024-04-26T12:51:23.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.138+0000 7ff9c9937980 1 -- 172.21.15.72:0/3513725878 wait complete. 2024-04-26T12:51:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.150+0000 7ff9c9937980 1 Processor -- start 2024-04-26T12:51:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.150+0000 7ff9c9937980 1 -- start start 2024-04-26T12:51:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.150+0000 7ff9c9937980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.150+0000 7ff9c9937980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56134e1d3a70 con 0x56134e246b20 2024-04-26T12:51:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.150+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.150+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48610/0 (socket says 172.21.15.72:48610) 2024-04-26T12:51:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.150+0000 7ff9c7452640 1 -- 172.21.15.72:0/3998568942 learned_addr learned my addr 172.21.15.72:0/3998568942 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c7452640 1 -- 172.21.15.72:0/3998568942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134e3c2a80 con 0x56134e246b20 2024-04-26T12:51:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c7452640 1 --2- 172.21.15.72:0/3998568942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c24b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000a5c0 tx=0x7ff9b0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67ea1cf0d6a7b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff8b560a640 1 -- 172.21.15.72:0/3998568942 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00aa9f0 con 0x56134e246b20 2024-04-26T12:51:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff8b560a640 1 -- 172.21.15.72:0/3998568942 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00aab90 con 0x56134e246b20 2024-04-26T12:51:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff8b560a640 1 -- 172.21.15.72:0/3998568942 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00bd3f0 con 0x56134e246b20 2024-04-26T12:51:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- 172.21.15.72:0/3998568942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 msgr2=0x56134e3c24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3998568942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c24b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000a5c0 tx=0x7ff9b0003030 comp rx=0 tx=0).stop 2024-04-26T12:51:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- 172.21.15.72:0/3998568942 shutdown_connections 2024-04-26T12:51:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3998568942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c24b0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- 172.21.15.72:0/3998568942 >> 172.21.15.72:0/3998568942 conn(0x56134e245bd0 msgr2=0x56134e3be040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- 172.21.15.72:0/3998568942 shutdown_connections 2024-04-26T12:51:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- 172.21.15.72:0/3998568942 wait complete. 2024-04-26T12:51:23.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 Processor -- start 2024-04-26T12:51:23.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- start start 2024-04-26T12:51:23.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56134e2e0c00 con 0x56134e246b20 2024-04-26T12:51:23.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48618/0 (socket says 172.21.15.72:48618) 2024-04-26T12:51:23.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c7452640 1 -- 172.21.15.72:0/3370051242 learned_addr learned my addr 172.21.15.72:0/3370051242 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c7452640 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134e3c9af0 con 0x56134e246b20 2024-04-26T12:51:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c7452640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c95b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0000c10 tx=0x7ff9b00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff8b3e07640 1 -- 172.21.15.72:0/3370051242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00cb020 con 0x56134e246b20 2024-04-26T12:51:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56134e3c9d80 con 0x56134e246b20 2024-04-26T12:51:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff8b3e07640 1 -- 172.21.15.72:0/3370051242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00c6710 con 0x56134e246b20 2024-04-26T12:51:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.154+0000 7ff8b3e07640 1 -- 172.21.15.72:0/3370051242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00c69f0 con 0x56134e246b20 2024-04-26T12:51:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134e3cc9b0 con 0x56134e246b20 2024-04-26T12:51:23.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff8b3e07640 1 -- 172.21.15.72:0/3370051242 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9b00ce020 con 0x56134e246b20 2024-04-26T12:51:23.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff8b3e07640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8ac034650 0x7ff8ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff8b3e07640 1 -- 172.21.15.72:0/3370051242 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ff9b00e55f0 con 0x56134e246b20 2024-04-26T12:51:23.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8ac034650 0x7ff8ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e247440 0x56134e3d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e3d0b20 con 0x56134e247440 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c7c53640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e247440 0x56134e3d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8ac034650 0x7ff8ac036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8000f70 tx=0x7ff9b8001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c7c53640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e247440 0x56134e3d04d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c7c53640 1 -- 172.21.15.72:0/3370051242 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e247440 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e3cdbd0 con 0x56134e247440 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c7c53640 1 -- 172.21.15.72:0/3370051242 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e247440 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e3d2ec0 0x56134e3d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e3d59a0 con 0x56134e3d2ec0 2024-04-26T12:51:23.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c7452640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e3d2ec0 0x56134e3d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.158+0000 7ff9c7452640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e3d2ec0 0x56134e3d52b0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c7452640 1 -- 172.21.15.72:0/3370051242 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff9b00bd3f0 con 0x56134e3d2ec0 2024-04-26T12:51:23.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e3d1d60 con 0x56134e247440 2024-04-26T12:51:23.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c7c53640 1 -- 172.21.15.72:0/3370051242 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e247440 2024-04-26T12:51:23.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e3d6e00 0x56134e3d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e3d9930 con 0x56134e3d6e00 2024-04-26T12:51:23.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e3d6e00 0x56134e3d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e3d6e00 0x56134e3d91f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c6c51640 1 -- 172.21.15.72:0/3370051242 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff9b800f6a0 con 0x56134e3d6e00 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 Processor -- start 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 -- start start 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3e79c0 0x56134e3e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56134e1d7ab0 con 0x56134e3e79c0 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3e79c0 0x56134e3e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3e79c0 0x56134e3e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48634/0 (socket says 172.21.15.72:48634) 2024-04-26T12:51:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c7452640 1 -- 172.21.15.72:0/2702320257 learned_addr learned my addr 172.21.15.72:0/2702320257 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c7452640 1 -- 172.21.15.72:0/2702320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134e3e8320 con 0x56134e3e79c0 2024-04-26T12:51:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c7452640 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3e79c0 0x56134e3e7de0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00c5f00 tx=0x7ff9b00b3c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff8b1602640 1 -- 172.21.15.72:0/2702320257 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00cf730 con 0x56134e3e79c0 2024-04-26T12:51:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56134e3e8dc0 con 0x56134e3e79c0 2024-04-26T12:51:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff8b1602640 1 -- 172.21.15.72:0/2702320257 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00cf8d0 con 0x56134e3e79c0 2024-04-26T12:51:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134e3e9290 con 0x56134e3e79c0 2024-04-26T12:51:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.162+0000 7ff8b1602640 1 -- 172.21.15.72:0/2702320257 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00e3ac0 con 0x56134e3e79c0 2024-04-26T12:51:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff8b1602640 1 -- 172.21.15.72:0/2702320257 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9b00e3c60 con 0x56134e3e79c0 2024-04-26T12:51:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff8b1602640 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8a0034650 0x7ff8a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff8b1602640 1 -- 172.21.15.72:0/2702320257 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ff9b00f1ce0 con 0x56134e3e79c0 2024-04-26T12:51:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8a0034650 0x7ff8a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c9937980 1 Processor -- start 2024-04-26T12:51:23.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c9937980 1 -- start start 2024-04-26T12:51:23.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8a0034650 0x7ff8a0036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56134e3d1040 tx=0x7ff9b800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c9937980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c9937980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56134e3c2d10 con 0x56134e3f4800 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3f4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48648/0 (socket says 172.21.15.72:48648) 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c7452640 1 -- 172.21.15.72:0/525049613 learned_addr learned my addr 172.21.15.72:0/525049613 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c7452640 1 -- 172.21.15.72:0/525049613 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134e3f51d0 con 0x56134e3f4800 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff9c7452640 1 --2- 172.21.15.72:0/525049613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3f4c00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00bb3b0 tx=0x7ff9b00c6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf79b2cb3fd5ef9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff8aaffd640 1 -- 172.21.15.72:0/525049613 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00fe030 con 0x56134e3f4800 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff8aaffd640 1 -- 172.21.15.72:0/525049613 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00c9e20 con 0x56134e3f4800 2024-04-26T12:51:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.166+0000 7ff8aaffd640 1 -- 172.21.15.72:0/525049613 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00e5a60 con 0x56134e3f4800 2024-04-26T12:51:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- 172.21.15.72:0/525049613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 msgr2=0x56134e3f4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 --2- 172.21.15.72:0/525049613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3f4c00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00bb3b0 tx=0x7ff9b00c6f90 comp rx=0 tx=0).stop 2024-04-26T12:51:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- 172.21.15.72:0/525049613 shutdown_connections 2024-04-26T12:51:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 --2- 172.21.15.72:0/525049613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3f4c00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- 172.21.15.72:0/525049613 >> 172.21.15.72:0/525049613 conn(0x56134e3f0b40 msgr2=0x56134e3eeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- 172.21.15.72:0/525049613 shutdown_connections 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- 172.21.15.72:0/525049613 wait complete. 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 Processor -- start 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- start start 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3fba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56134e3f5890 con 0x56134e3f4800 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c7452640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3fba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:48662/0 (socket says 172.21.15.72:48662) 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 learned_addr learned my addr 172.21.15.72:0/903592396 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:51:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134e3fbfd0 con 0x56134e3f4800 2024-04-26T12:51:23.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c7452640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3fba90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00bb3b0 tx=0x7ff9b00e1fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff8a97fa640 1 -- 172.21.15.72:0/903592396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b0006840 con 0x56134e3f4800 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56134e3fbfd0 con 0x56134e3f4800 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff8a97fa640 1 -- 172.21.15.72:0/903592396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00069e0 con 0x56134e3f4800 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff8a97fa640 1 -- 172.21.15.72:0/903592396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b00e51e0 con 0x56134e3f4800 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134e3fc440 con 0x56134e3f4800 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff8a97fa640 1 -- 172.21.15.72:0/903592396 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9b00c0640 con 0x56134e3f4800 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.170+0000 7ff8a97fa640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff890034650 0x7ff890036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff8a97fa640 1 -- 172.21.15.72:0/903592396 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ff9b0102070 con 0x56134e3f4800 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff890034650 0x7ff890036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e406a30 0x56134e408ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e409620 con 0x56134e406a30 2024-04-26T12:51:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7c53640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e406a30 0x56134e408ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff890034650 0x7ff890036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800ffd0 tx=0x7ff9b8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7c53640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e406a30 0x56134e408ed0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 realm 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e409a30 con 0x56134e406a30 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a2d0 con 0x56134e406a30 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e40b3d0 0x56134e40d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40de60 con 0x56134e40b3d0 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7452640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e40b3d0 0x56134e40d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7452640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e40b3d0 0x56134e40d7c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 20 searching for the correct realm 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e40fd40 0x56134e4121b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e412830 con 0x56134e40fd40 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.174+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e40fd40 0x56134e4121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e40fd40 0x56134e4121b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c6c51640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff9b801fbe0 0x7ff9b803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:51:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e412830 con 0x7ff9b801fbe0 2024-04-26T12:51:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff9b801fbe0 0x7ff9b803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:51:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff9b801fbe0 0x7ff9b803a3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:51:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c000a4d0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x7ff9b801fbe0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c000a4d0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.178+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x7ff9b801fbe0 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c000a4d0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c000a4d0 con 0x56134e406a30 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x7ff9b801fbe0 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff9c0032040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c0032040 con 0x56134e406a30 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff9c0032040 con 0x56134e406a30 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.182+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x7ff9b801fbe0 2024-04-26T12:51:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c0032040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c0032040 con 0x56134e406a30 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x7ff9b801fbe0 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c0032040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40fd40 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e40b3d0 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.186+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x56134e406a30 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9c0032040 con 0x56134e406a30 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56134e40a670 con 0x7ff9b801fbe0 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c0032040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:51:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40e6b0 con 0x56134e406a30 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9c0032040 con 0x56134e406a30 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40e6b0 con 0x56134e406a30 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9c0032040 con 0x56134e406a30 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40e6b0 con 0x56134e40fd40 2024-04-26T12:51:23.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 zone default found 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 4 Realm: () 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 zonegroup default 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40f070 con 0x56134e40b3d0 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e40ebf0 con 0x56134e40fd40 2024-04-26T12:51:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e414be0 con 0x56134e40fd40 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 started sync module instance, tier type = 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e413fd0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0032040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94640917267696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e413fd0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.190+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e415660 con 0x56134e406a30 2024-04-26T12:51:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.194+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94640917267696] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.194+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.194+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94640917271232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e413fd0 con 0x56134e406a30 2024-04-26T12:51:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.194+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4160a0 con 0x56134e40fd40 2024-04-26T12:51:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94640917271232] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94640917265184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e413f40 con 0x56134e40fd40 2024-04-26T12:51:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e416de0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94640917276912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4176b0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e418070 con 0x56134e406a30 2024-04-26T12:51:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94640917265184] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94640917276912] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94640917281728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e417fe0 con 0x56134e406a30 2024-04-26T12:51:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.198+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e417600 con 0x56134e40b3d0 2024-04-26T12:51:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.202+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94640917281728] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.202+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.202+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94640917279056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e418910 con 0x56134e40b3d0 2024-04-26T12:51:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.202+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e419160 con 0x56134e40b3d0 2024-04-26T12:51:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94640917279056] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94640917283936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4199b0 con 0x56134e40b3d0 2024-04-26T12:51:23.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e41a370 con 0x56134e40b3d0 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94640917290960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e41aaa0 con 0x56134e40b3d0 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 20 add_watcher() i=0 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 20 add_watcher() i=1 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 20 add_watcher() i=2 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 20 add_watcher() i=3 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 20 add_watcher() i=4 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 20 add_watcher() i=5 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94640917283936] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.206+0000 7ff9c9937980 20 add_watcher() i=6 2024-04-26T12:51:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94640917290960] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c9937980 20 add_watcher() i=7 2024-04-26T12:51:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c9937980 2 all 8 watchers are set, enabling cache 2024-04-26T12:51:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e419500 con 0x56134e406a30 2024-04-26T12:51:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94640917288192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e41b050 con 0x56134e406a30 2024-04-26T12:51:23.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94640917288192] v35'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff87dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:23.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c9937980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:51:23.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c9937980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:51:23.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e426580 con 0x56134e406a30 2024-04-26T12:51:23.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.210+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.214+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e426bd0 con 0x56134e40b3d0 2024-04-26T12:51:23.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.214+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.214+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e426bd0 con 0x56134e40fd40 2024-04-26T12:51:23.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.214+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.214+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4276b0 con 0x56134e406a30 2024-04-26T12:51:23.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.218+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'224 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.218+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x7ff9b801fbe0 2024-04-26T12:51:23.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.218+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'74 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.218+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422260 con 0x56134e40fd40 2024-04-26T12:51:23.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.218+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.218+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4283e0 con 0x56134e406a30 2024-04-26T12:51:23.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.222+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.222+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4221e0 con 0x56134e40b3d0 2024-04-26T12:51:23.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.222+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.222+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x7ff9b801fbe0 2024-04-26T12:51:23.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.226+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.226+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.226+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.226+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e428ae0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.226+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'75 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.226+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e428ae0 con 0x56134e40b3d0 2024-04-26T12:51:23.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.230+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.230+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e428ec0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.230+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.230+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e428ec0 con 0x56134e40b3d0 2024-04-26T12:51:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.230+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.234+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e406a30 2024-04-26T12:51:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.234+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'225 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.234+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.234+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'66 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.234+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x7ff9b801fbe0 2024-04-26T12:51:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.238+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'76 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.238+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.238+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.238+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e406a30 2024-04-26T12:51:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.238+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.238+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e406a30 2024-04-26T12:51:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.242+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'226 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.242+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.242+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'67 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.242+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x7ff9b801fbe0 2024-04-26T12:51:23.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.246+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.250+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.250+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40b3d0 2024-04-26T12:51:23.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.254+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.254+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.254+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.254+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40b3d0 2024-04-26T12:51:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.258+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.258+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40fd40 2024-04-26T12:51:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.262+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'68 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.262+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x56134e40b3d0 2024-04-26T12:51:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.262+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.262+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e422290 con 0x7ff9b801fbe0 2024-04-26T12:51:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff87cfe1640 20 reqs_thread_entry: start 2024-04-26T12:51:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 20 init_complete bucket index max shards: 11 2024-04-26T12:51:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 20 Filter name: none 2024-04-26T12:51:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff7f67fc640 20 reqs_thread_entry: start 2024-04-26T12:51:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:51:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e421800 con 0x56134e40b3d0 2024-04-26T12:51:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:51:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:51:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:51:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:51:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.266+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e446a80 con 0x56134e40b3d0 2024-04-26T12:51:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 : miss 2024-04-26T12:51:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:96 8.1d 8:ba7e2375:root::.bucket.meta.myfoo7%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e446930 con 0x56134e40b3d0 2024-04-26T12:51:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 20 rados_obj.operate() r=0 bl.length=382 2024-04-26T12:51:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 info.flags=0x17 2024-04-26T12:51:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 to cache LRU end 2024-04-26T12:51:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:51:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:51:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 2024-04-26T12:51:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 4.19 4:9af80fc2:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3e40 con 0x56134e40fd40 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(97 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 4.b 4:d24b1bcb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3e80 con 0x7ff9b801fbe0 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(98 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:99 4.c 4:310f7393:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3e80 con 0x56134e406a30 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(99 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.270+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:100 4.b 4:d1d02344:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3e80 con 0x7ff9b801fbe0 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(100 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 4.4 4:239e8ea1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3e80 con 0x56134e40b3d0 2024-04-26T12:51:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(101 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:102 4.c 4:3064a92a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3e80 con 0x56134e406a30 2024-04-26T12:51:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(102 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5 [call out=378b] v0'0 uv13 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 10 cls_bucket_list_unordered: got fourteen 2024-04-26T12:51:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 4.c 4:302bdd6d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3e40 con 0x56134e406a30 2024-04-26T12:51:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(103 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c0040040 con 0x56134e406a30 2024-04-26T12:51:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:104 4.1 4:800de300:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3ea0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(104 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c0040040 con 0x7ff9b801fbe0 2024-04-26T12:51:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:105 4.16 4:693bfe8f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3ea0 con 0x56134e40fd40 2024-04-26T12:51:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(105 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:106 4.9 4:9221faeb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3ea0 con 0x56134e406a30 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(106 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:107 4.0 4:023a97e3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3ea0 con 0x56134e40fd40 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(107 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 20 get_obj_state: octx=0x7ff9c000aae0 obj=myfoo7:fourteen state=0x56134e4c1ee8 s->prefetch_data=0 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.274+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:108 3.5s0 3:a29d6746:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c2d10 con 0x7ff9b801fbe0 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(108 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c9937980 10 manifest: total_size = 8 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c9937980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.17987525813095349938 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c9937980 20 get_obj_state: octx=0x7ff9c000aae0 obj=myfoo7:fourteen state=0x56134e4c1ee8 s->prefetch_data=0 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c9937980 20 prepare_atomic_modification: state is not atomic. state=0x56134e4c1ee8 2024-04-26T12:51:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c9937980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5 2024-04-26T12:51:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:109 4.c 4:3064a92a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3680 con 0x56134e406a30 2024-04-26T12:51:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(109 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5 [stat,call,call] v35'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.278+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:110 3.5s0 3:a29d6746:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4c3680 con 0x7ff9b801fbe0 2024-04-26T12:51:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(110 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10_fourteen [call] v35'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:111 4.c 4:3064a92a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e44b4e0 con 0x56134e406a30 2024-04-26T12:51:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 20 list_objects_ordered: starting attempt 1 2024-04-26T12:51:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:51:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:112 4.19 4:9af80fc2:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e44b4e0 con 0x56134e40fd40 2024-04-26T12:51:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:113 4.b 4:d24b1bcb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e44f720 con 0x7ff9b801fbe0 2024-04-26T12:51:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:114 4.c 4:310f7393:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e44b4e0 con 0x56134e406a30 2024-04-26T12:51:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:115 4.b 4:d1d02344:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e454500 con 0x7ff9b801fbe0 2024-04-26T12:51:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:116 4.4 4:239e8ea1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e456e10 con 0x56134e40b3d0 2024-04-26T12:51:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:117 4.c 4:3064a92a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e459680 con 0x56134e406a30 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:118 4.c 4:302bdd6d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e456e10 con 0x56134e406a30 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:119 4.1 4:800de300:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e45e8b0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:120 4.16 4:693bfe8f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e461260 con 0x56134e40fd40 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:121 4.9 4:9221faeb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e463c70 con 0x56134e406a30 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:122 4.0 4:023a97e3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e40fd40 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(113 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(112 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(119 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(115 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(116 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(114 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(121 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(120 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(122 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(118 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(111 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5 [stat,call,call] v35'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff8aa7fc640 20 handle_completion(): completion ok for obj=fourteen 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(117 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10])"; uploads.size()=0; is_truncated=0 2024-04-26T12:51:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:123 4.19 4:9af80fc2:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e40fd40 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:124 4.b 4:d24b1bcb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e456ea0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:125 4.c 4:310f7393:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4592a0 con 0x56134e406a30 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:126 4.b 4:d1d02344:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e44e710 con 0x7ff9b801fbe0 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:127 4.4 4:239e8ea1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e40b3d0 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:128 4.c 4:3064a92a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e456ea0 con 0x56134e406a30 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:129 4.c 4:302bdd6d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e44f450 con 0x56134e406a30 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:130 4.1 4:800de300:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:131 4.16 4:693bfe8f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4592a0 con 0x56134e40fd40 2024-04-26T12:51:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:132 4.9 4:9221faeb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e44f450 con 0x56134e406a30 2024-04-26T12:51:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:133 4.0 4:023a97e3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4592a0 con 0x56134e40fd40 2024-04-26T12:51:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(127 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(123 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(131 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(133 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(124 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(130 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(126 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(132 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(125 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(128 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 40 ==== osd_op_reply(129 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.282+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e40b3d0 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(134 fud.buckets [call] v35'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff9b011e070 con 0x56134e40b3d0 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c9937980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-26T12:51:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv56 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c9937980 20 rados_obj.operate() r=0 bl.length=168 2024-04-26T12:51:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c9937980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-04-26T12:51:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c9937980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-26T12:51:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.286+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(136 myfoo7 [call,call,delete] v35'57 uv57 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c9937980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c9937980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94640917603136 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== watch-notify(notify (1) cookie 94640917276912 notify 150323855388 ret 0) ==== 192+0+0 (crc 0 0 0) 0x56134e422010 con 0x7ff9b801fbe0 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff8aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855388 cookie 94640917276912 notifier 4769 bl.length()=150 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(137 notify.3 [notify cookie 94640917603136 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff8aa7fc640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff7fc0032d0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== watch-notify(notify_complete (2) cookie 94640917603136 notify 150323855388 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56134e422630 con 0x7ff9b801fbe0 2024-04-26T12:51:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:139 8.1d 8:ba7e2375:root::.bucket.meta.myfoo7%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e40b3d0 2024-04-26T12:51:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(139 .bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c9937980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 from cache 2024-04-26T12:51:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c9937980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10, ofs0, ns] 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.290+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94640917473440 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e406a30 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 41 ==== watch-notify(notify (1) cookie 94640917271232 notify 150323855381 ret 0) ==== 250+0+0 (crc 0 0 0) 0x56134e422630 con 0x56134e406a30 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff8aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855381 cookie 94640917271232 notifier 4769 bl.length()=208 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 42 ==== osd_op_reply(140 notify.1 [notify cookie 94640917473440 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff8aa7fc640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff7fc0032d0 con 0x56134e406a30 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 43 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 44 ==== watch-notify(notify_complete (2) cookie 94640917473440 notify 150323855381 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56134e421be0 con 0x56134e406a30 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:142 4.19 4:9af80fc2:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e40fd40 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:143 4.b 4:d24b1bcb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466320 con 0x7ff9b801fbe0 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:144 4.c 4:310f7393:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e406a30 2024-04-26T12:51:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:145 4.b 4:d1d02344:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e464af0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:146 4.4 4:239e8ea1:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4652b0 con 0x56134e40b3d0 2024-04-26T12:51:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:147 4.c 4:3064a92a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e464af0 con 0x56134e406a30 2024-04-26T12:51:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:148 4.c 4:302bdd6d:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4652b0 con 0x56134e406a30 2024-04-26T12:51:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:149 4.1 4:800de300:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x7ff9b801fbe0 2024-04-26T12:51:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:150 4.16 4:693bfe8f:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e464af0 con 0x56134e40fd40 2024-04-26T12:51:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:151 4.9 4:9221faeb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4652b0 con 0x56134e406a30 2024-04-26T12:51:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:152 4.0 4:023a97e3:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e466af0 con 0x56134e40fd40 2024-04-26T12:51:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(142 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.0 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== osd_op_reply(149 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.7 [delete] v35'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(150 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.8 [delete] v35'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.294+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(143 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.1 [delete] v35'11 uv11 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 45 ==== osd_op_reply(151 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.9 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== osd_op_reply(145 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.3 [delete] v35'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 46 ==== osd_op_reply(144 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.2 [delete] v35'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(152 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.10 [delete] v35'4 uv4 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 47 ==== osd_op_reply(147 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.5 [delete] v35'17 uv17 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== osd_op_reply(146 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.4 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 48 ==== osd_op_reply(148 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10.6 [delete] v35'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 : miss 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 20 rados->read ofs=0 len=0 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:153 6.1 6:81b90004:::pubsub..bucket.myfoo7%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4652b0 con 0x56134e406a30 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 49 ==== osd_op_reply(153 pubsub..bucket.myfoo7/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 info.flags=0x0 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 10 adding default.rgw.log++pubsub..bucket.myfoo7/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 to cache LRU end 2024-04-26T12:51:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:154 6.1 6:81b90004:::pubsub..bucket.myfoo7%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e464af0 con 0x56134e406a30 2024-04-26T12:51:23.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 50 ==== osd_op_reply(154 pubsub..bucket.myfoo7/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.10 [delete] v35'15 uv14 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.298+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4662c0 con 0x56134e40b3d0 2024-04-26T12:51:23.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(155 fud.buckets [call] v35'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c9937980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T12:51:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e464190 con 0x56134e40b3d0 2024-04-26T12:51:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v35'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c9937980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:51:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94640917473440 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4652b0 con 0x56134e40fd40 2024-04-26T12:51:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== watch-notify(notify (1) cookie 94640917265184 notify 150323855367 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56134e426540 con 0x56134e40fd40 2024-04-26T12:51:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 40 ==== osd_op_reply(157 notify.2 [notify cookie 94640917473440 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff8aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94640917265184 notifier 4769 bl.length()=170 2024-04-26T12:51:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff8aaffd640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff88c003d70 con 0x56134e40fd40 2024-04-26T12:51:23.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 41 ==== watch-notify(notify_complete (2) cookie 94640917473440 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56134e428210 con 0x56134e40fd40 2024-04-26T12:51:23.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c9937980 10 removing email index: 2024-04-26T12:51:23.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c9937980 10 removing user buckets index 2024-04-26T12:51:23.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 42 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.302+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e464190 con 0x56134e40b3d0 2024-04-26T12:51:23.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(159 fud.buckets [delete] v35'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c9937980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-26T12:51:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94640917473440 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e4445b0 con 0x56134e40b3d0 2024-04-26T12:51:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== watch-notify(notify (1) cookie 94640917283936 notify 150323855399 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56134e445e80 con 0x56134e40b3d0 2024-04-26T12:51:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(160 notify.6 [notify cookie 94640917473440 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff8aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855399 cookie 94640917283936 notifier 4769 bl.length()=160 2024-04-26T12:51:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff8aaffd640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff88c003d70 con 0x56134e40b3d0 2024-04-26T12:51:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== watch-notify(notify_complete (2) cookie 94640917473440 notify 150323855399 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff9b00e1070 con 0x56134e40b3d0 2024-04-26T12:51:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c9937980 10 removing user index: fud 2024-04-26T12:51:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.306+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e4468a0 con 0x56134e40b3d0 2024-04-26T12:51:23.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(162 fud [call,call,delete] v35'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c9937980 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-26T12:51:23.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c9937980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:51:23.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94640917473440 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56134e465760 con 0x56134e40b3d0 2024-04-26T12:51:23.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== watch-notify(notify (1) cookie 94640917279056 notify 150323855400 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7ff9b00e1070 con 0x56134e40b3d0 2024-04-26T12:51:23.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff8aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855400 cookie 94640917279056 notifier 4769 bl.length()=152 2024-04-26T12:51:23.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(163 notify.5 [notify cookie 94640917473440 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff8aaffd640 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff88c003d70 con 0x56134e40b3d0 2024-04-26T12:51:23.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 43 ==== watch-notify(notify_complete (2) cookie 94640917473440 notify 150323855400 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56134e3cc9b0 con 0x56134e40b3d0 2024-04-26T12:51:23.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.310+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff87dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:51:23.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94640917288192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e424900 con 0x56134e406a30 2024-04-26T12:51:23.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 51 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94640917288192] v35'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94640917267696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e424900 con 0x7ff9b801fbe0 2024-04-26T12:51:23.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94640917267696] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff9c9937980 20 remove_watcher() i=0 2024-04-26T12:51:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff9c9937980 2 removed watcher, disabling cache 2024-04-26T12:51:23.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.314+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94640917271232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e424900 con 0x56134e406a30 2024-04-26T12:51:23.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.318+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 52 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94640917271232] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.318+0000 7ff9c9937980 20 remove_watcher() i=1 2024-04-26T12:51:23.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.318+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94640917265184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e424900 con 0x56134e40fd40 2024-04-26T12:51:23.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.318+0000 7ff9c6c51640 1 -- 172.21.15.72:0/903592396 <== osd.3 v2:172.21.15.72:6808/671626845 43 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94640917265184] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8037040 con 0x56134e40fd40 2024-04-26T12:51:23.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.318+0000 7ff9c9937980 20 remove_watcher() i=2 2024-04-26T12:51:23.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.318+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94640917276912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e424900 con 0x7ff9b801fbe0 2024-04-26T12:51:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.322+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94640917276912] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x7ff9b801fbe0 2024-04-26T12:51:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.322+0000 7ff9c9937980 20 remove_watcher() i=3 2024-04-26T12:51:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.322+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94640917281728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e424900 con 0x56134e406a30 2024-04-26T12:51:23.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.322+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 <== osd.1 v2:172.21.15.72:6816/1811201389 53 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94640917281728] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c004d060 con 0x56134e406a30 2024-04-26T12:51:23.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.322+0000 7ff9c9937980 20 remove_watcher() i=4 2024-04-26T12:51:23.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.322+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94640917279056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e417bc0 con 0x56134e40b3d0 2024-04-26T12:51:23.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.326+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 45 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94640917279056] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.326+0000 7ff9c9937980 20 remove_watcher() i=5 2024-04-26T12:51:23.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.326+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94640917283936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e424900 con 0x56134e40b3d0 2024-04-26T12:51:23.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.326+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 46 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94640917283936] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.326+0000 7ff9c9937980 20 remove_watcher() i=6 2024-04-26T12:51:23.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.326+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94640917290960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56134e417bc0 con 0x56134e40b3d0 2024-04-26T12:51:23.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c7452640 1 -- 172.21.15.72:0/903592396 <== osd.0 v2:172.21.15.29:6800/1895601642 47 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94640917290960] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b013d040 con 0x56134e40b3d0 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 20 remove_watcher() i=7 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e40b3d0 msgr2=0x56134e40d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e40b3d0 0x56134e40d7c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e406a30 msgr2=0x56134e408ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e406a30 0x56134e408ed0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff9b801fbe0 msgr2=0x7ff9b803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ff9b801fbe0 0x7ff9b803a3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e40fd40 msgr2=0x56134e4121b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e40fd40 0x56134e4121b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff890034650 msgr2=0x7ff890036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff890034650 0x7ff890036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800ffd0 tx=0x7ff9b8010000 comp rx=0 tx=0).stop 2024-04-26T12:51:23.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 msgr2=0x56134e3fba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c7c53640 1 -- 172.21.15.72:0/903592396 reap_dead start 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3fba90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00bb3b0 tx=0x7ff9b00e1fb0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 shutdown_connections 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/903592396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3f4800 0x56134e3fba90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 >> 172.21.15.72:0/903592396 conn(0x56134e3f0b40 msgr2=0x56134e3ee1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 shutdown_connections 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/903592396 wait complete. 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8a0034650 msgr2=0x7ff8a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8a0034650 0x7ff8a0036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56134e3d1040 tx=0x7ff9b800f000 comp rx=0 tx=0).stop 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3e79c0 msgr2=0x56134e3e7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3e79c0 0x56134e3e7de0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00c5f00 tx=0x7ff9b00b3c70 comp rx=0 tx=0).stop 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 shutdown_connections 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8a0034650 0x7ff8a0036b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/2702320257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e3e79c0 0x56134e3e7de0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 >> 172.21.15.72:0/2702320257 conn(0x56134e3dc7d0 msgr2=0x56134e3dd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 shutdown_connections 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/2702320257 wait complete. 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e3d2ec0 msgr2=0x56134e3d52b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56134e3d2ec0 0x56134e3d52b0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e247440 msgr2=0x56134e3d04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56134e247440 0x56134e3d04d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e3d6e00 msgr2=0x56134e3d91f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56134e3d6e00 0x56134e3d91f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8ac034650 msgr2=0x7ff8ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff8ac034650 0x7ff8ac036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8000f70 tx=0x7ff9b8001380 comp rx=0 tx=0).stop 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 msgr2=0x56134e3c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 --2- 172.21.15.72:0/3370051242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56134e246b20 0x56134e3c95b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0000c10 tx=0x7ff9b00180e0 comp rx=0 tx=0).stop 2024-04-26T12:51:23.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c7c53640 1 -- 172.21.15.72:0/3370051242 reap_dead start 2024-04-26T12:51:23.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 shutdown_connections 2024-04-26T12:51:23.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 >> 172.21.15.72:0/3370051242 conn(0x56134e245bd0 msgr2=0x56134e3bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:51:23.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 shutdown_connections 2024-04-26T12:51:23.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:51:23.330+0000 7ff9c9937980 1 -- 172.21.15.72:0/3370051242 wait complete. 2024-04-26T12:52:03.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-26T12:52:03.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-26T12:52:03.345 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-26T12:52:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2d478980 1 Processor -- start 2024-04-26T12:52:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2d478980 1 -- start start 2024-04-26T12:52:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2d478980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55cd1f2da9f0 0x55cd1f2dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2d478980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd1f181510 con 0x55cd1f2d64e0 2024-04-26T12:52:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2d478980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55cd1f188430 con 0x55cd1f2da9f0 2024-04-26T12:52:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2af93640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55cd1f2d64e0 0x55cd1f2d68c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48668/0 (socket says 172.21.15.72:48668) 2024-04-26T12:52:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2a792640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55cd1f2da9f0 0x55cd1f2dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2af93640 1 -- 172.21.15.72:0/1576184774 learned_addr learned my addr 172.21.15.72:0/1576184774 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda29f91640 1 -- 172.21.15.72:0/1576184774 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224457738 0 0) 0x55cd1f181510 con 0x55cd1f2d64e0 2024-04-26T12:52:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda29f91640 1 -- 172.21.15.72:0/1576184774 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda14001e20 con 0x55cd1f2d64e0 2024-04-26T12:52:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2a792640 1 -- 172.21.15.72:0/1576184774 >> v1:172.21.15.29:6789/0 conn(0x55cd1f2d64e0 legacy=0x55cd1f2d68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.384+0000 7fda2a792640 1 -- 172.21.15.72:0/1576184774 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1f15dae0 con 0x55cd1f2da9f0 2024-04-26T12:52:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2a792640 1 --2- 172.21.15.72:0/1576184774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2da9f0 0x55cd1f2dcde0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fda2000a480 tx=0x7fda2001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730aeb25d77e293c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda29f91640 1 -- 172.21.15.72:0/1576184774 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda200b0070 con 0x55cd1f2da9f0 2024-04-26T12:52:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda29f91640 1 -- 172.21.15.72:0/1576184774 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda200ab540 con 0x55cd1f2da9f0 2024-04-26T12:52:03.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda29f91640 1 -- 172.21.15.72:0/1576184774 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda200ab840 con 0x55cd1f2da9f0 2024-04-26T12:52:03.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2d478980 1 -- 172.21.15.72:0/1576184774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2da9f0 msgr2=0x55cd1f2dcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2d478980 1 --2- 172.21.15.72:0/1576184774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2da9f0 0x55cd1f2dcde0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fda2000a480 tx=0x7fda2001b280 comp rx=0 tx=0).stop 2024-04-26T12:52:03.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2d478980 1 -- 172.21.15.72:0/1576184774 shutdown_connections 2024-04-26T12:52:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2d478980 1 --2- 172.21.15.72:0/1576184774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2da9f0 0x55cd1f2dcde0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2d478980 1 -- 172.21.15.72:0/1576184774 >> 172.21.15.72:0/1576184774 conn(0x55cd1f249bc0 msgr2=0x55cd1f249fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2d478980 1 -- 172.21.15.72:0/1576184774 shutdown_connections 2024-04-26T12:52:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.388+0000 7fda2d478980 1 -- 172.21.15.72:0/1576184774 wait complete. 2024-04-26T12:52:03.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.404+0000 7fda2d478980 1 Processor -- start 2024-04-26T12:52:03.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.404+0000 7fda2d478980 1 -- start start 2024-04-26T12:52:03.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.404+0000 7fda2d478980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.404+0000 7fda2d478980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f1d7a70 con 0x55cd1f2d64e0 2024-04-26T12:52:03.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:37984/0 (socket says 172.21.15.72:37984) 2024-04-26T12:52:03.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 -- 172.21.15.72:0/3191085520 learned_addr learned my addr 172.21.15.72:0/3191085520 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 -- 172.21.15.72:0/3191085520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1f3c1b60 con 0x55cd1f2d64e0 2024-04-26T12:52:03.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 --2- 172.21.15.72:0/3191085520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c1590 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001740 tx=0x7fda1c001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df661f0ed56d1cfa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fd918e09640 1 -- 172.21.15.72:0/3191085520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c016070 con 0x55cd1f2d64e0 2024-04-26T12:52:03.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fd918e09640 1 -- 172.21.15.72:0/3191085520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1c004530 con 0x55cd1f2d64e0 2024-04-26T12:52:03.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fd918e09640 1 -- 172.21.15.72:0/3191085520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c004850 con 0x55cd1f2d64e0 2024-04-26T12:52:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 -- 172.21.15.72:0/3191085520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 msgr2=0x55cd1f3c1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 --2- 172.21.15.72:0/3191085520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c1590 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001740 tx=0x7fda1c001c00 comp rx=0 tx=0).stop 2024-04-26T12:52:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 -- 172.21.15.72:0/3191085520 shutdown_connections 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 --2- 172.21.15.72:0/3191085520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c1590 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 -- 172.21.15.72:0/3191085520 >> 172.21.15.72:0/3191085520 conn(0x55cd1f249bc0 msgr2=0x55cd1f3bd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 -- 172.21.15.72:0/3191085520 shutdown_connections 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 -- 172.21.15.72:0/3191085520 wait complete. 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 Processor -- start 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 -- start start 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2d478980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f2dfe10 con 0x55cd1f2d64e0 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:37998/0 (socket says 172.21.15.72:37998) 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 -- 172.21.15.72:0/386217644 learned_addr learned my addr 172.21.15.72:0/386217644 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.408+0000 7fda2af93640 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1f3c8dc0 con 0x55cd1f2d64e0 2024-04-26T12:52:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2af93640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c8880 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fda1c014040 tx=0x7fda1c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fd917606640 1 -- 172.21.15.72:0/386217644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c016040 con 0x55cd1f2d64e0 2024-04-26T12:52:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd1f3c9050 con 0x55cd1f2d64e0 2024-04-26T12:52:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fd917606640 1 -- 172.21.15.72:0/386217644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1c011400 con 0x55cd1f2d64e0 2024-04-26T12:52:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fd917606640 1 -- 172.21.15.72:0/386217644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c011720 con 0x55cd1f2d64e0 2024-04-26T12:52:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1f3cbc90 con 0x55cd1f2d64e0 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fd917606640 1 -- 172.21.15.72:0/386217644 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fda1c0119d0 con 0x55cd1f2d64e0 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fd917606640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd910034650 0x7fd910036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fd917606640 1 -- 172.21.15.72:0/386217644 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fda1c0497a0 con 0x55cd1f2d64e0 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2a792640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd910034650 0x7fd910036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f3cd8d0 0x55cd1f3cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f3d0200 con 0x55cd1f3cd8d0 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2b794640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f3cd8d0 0x55cd1f3cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2a792640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd910034650 0x7fd910036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fda200ad000 tx=0x7fda200a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2b794640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f3cd8d0 0x55cd1f3cfcc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2b794640 1 -- 172.21.15.72:0/386217644 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f3cd8d0 2024-04-26T12:52:03.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.412+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f3cce90 con 0x55cd1f3cd8d0 2024-04-26T12:52:03.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2b794640 1 -- 172.21.15.72:0/386217644 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f3cd8d0 2024-04-26T12:52:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f3d24d0 0x55cd1f3d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f3d4fb0 con 0x55cd1f3d24d0 2024-04-26T12:52:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2af93640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f3d24d0 0x55cd1f3d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2af93640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f3d24d0 0x55cd1f3d48c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2af93640 1 -- 172.21.15.72:0/386217644 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda1c02c070 con 0x55cd1f3d24d0 2024-04-26T12:52:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f3d1370 con 0x55cd1f3cd8d0 2024-04-26T12:52:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2b794640 1 -- 172.21.15.72:0/386217644 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f3cd8d0 2024-04-26T12:52:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f3d6410 0x55cd1f3d8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f3d8f40 con 0x55cd1f3d6410 2024-04-26T12:52:03.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2a792640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f3d6410 0x55cd1f3d8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2a792640 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f3d6410 0x55cd1f3d8800 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.416+0000 7fda2a792640 1 -- 172.21.15.72:0/386217644 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f3d6410 2024-04-26T12:52:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2d478980 1 Processor -- start 2024-04-26T12:52:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2d478980 1 -- start start 2024-04-26T12:52:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2d478980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3e6fd0 0x55cd1f3e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2d478980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f1dbab0 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3e6fd0 0x55cd1f3e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3e6fd0 0x55cd1f3e73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38004/0 (socket says 172.21.15.72:38004) 2024-04-26T12:52:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2af93640 1 -- 172.21.15.72:0/1189706020 learned_addr learned my addr 172.21.15.72:0/1189706020 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2af93640 1 -- 172.21.15.72:0/1189706020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1f3e7930 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2af93640 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3e6fd0 0x55cd1f3e73f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fda1c047aa0 tx=0x7fda1c00f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fd914e01640 1 -- 172.21.15.72:0/1189706020 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c02a040 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fd914e01640 1 -- 172.21.15.72:0/1189706020 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1c047e50 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd1f3e83d0 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fd914e01640 1 -- 172.21.15.72:0/1189706020 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c0461b0 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1f3e88a0 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fd914e01640 1 -- 172.21.15.72:0/1189706020 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fda1c046350 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fd914e01640 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd904034650 0x7fd904036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fd914e01640 1 -- 172.21.15.72:0/1189706020 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fda1c03ad20 con 0x55cd1f3e6fd0 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.420+0000 7fda2a792640 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd904034650 0x7fd904036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 Processor -- start 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- start start 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f3c1eb0 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2a792640 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd904034650 0x7fd904036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55cd1f3d0670 tx=0x7fda20005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38016/0 (socket says 172.21.15.72:38016) 2024-04-26T12:52:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 -- 172.21.15.72:0/4254156809 learned_addr learned my addr 172.21.15.72:0/4254156809 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 -- 172.21.15.72:0/4254156809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1f3f49c0 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 --2- 172.21.15.72:0/4254156809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3f43f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01dc30 tx=0x7fda1c038a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ea7de13434daf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fd90e7fc640 1 -- 172.21.15.72:0/4254156809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c059070 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fd90e7fc640 1 -- 172.21.15.72:0/4254156809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1c00a2f0 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fd90e7fc640 1 -- 172.21.15.72:0/4254156809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c03e070 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- 172.21.15.72:0/4254156809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 msgr2=0x55cd1f3f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 --2- 172.21.15.72:0/4254156809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3f43f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01dc30 tx=0x7fda1c038a50 comp rx=0 tx=0).stop 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- 172.21.15.72:0/4254156809 shutdown_connections 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 --2- 172.21.15.72:0/4254156809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3f43f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- 172.21.15.72:0/4254156809 >> 172.21.15.72:0/4254156809 conn(0x55cd1f3f0330 msgr2=0x55cd1f3ee390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- 172.21.15.72:0/4254156809 shutdown_connections 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- 172.21.15.72:0/4254156809 wait complete. 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 Processor -- start 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- start start 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3fb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2d478980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f3f50a0 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3fb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3fb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38028/0 (socket says 172.21.15.72:38028) 2024-04-26T12:52:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.424+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 learned_addr learned my addr 172.21.15.72:0/2240689118 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1f3fb870 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2af93640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3fb330 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fda1c046870 tx=0x7fda1c00a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fd90cff9640 1 -- 172.21.15.72:0/2240689118 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c063070 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd1f3fb870 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fd90cff9640 1 -- 172.21.15.72:0/2240689118 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1c049050 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fd90cff9640 1 -- 172.21.15.72:0/2240689118 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1c059040 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1f3fb870 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fd90cff9640 1 -- 172.21.15.72:0/2240689118 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fda1c066070 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fd90cff9640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8f40345b0 0x7fd8f4036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fd90cff9640 1 -- 172.21.15.72:0/2240689118 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fda1c04f030 con 0x55cd1f3f3ff0 2024-04-26T12:52:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2a792640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8f40345b0 0x7fd8f4036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f4062a0 0x55cd1f408760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f408eb0 con 0x55cd1f4062a0 2024-04-26T12:52:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2b794640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f4062a0 0x55cd1f408760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2a792640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8f40345b0 0x7fd8f4036a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55cd1f3d9340 tx=0x7fda200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.428+0000 7fda2b794640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f4062a0 0x55cd1f408760 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f4062a0 2024-04-26T12:52:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 realm 2024-04-26T12:52:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4092c0 con 0x55cd1f4062a0 2024-04-26T12:52:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f4062a0 2024-04-26T12:52:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409b90 con 0x55cd1f4062a0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f4062a0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f4062a0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f4062a0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f40ac90 0x55cd1f40d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f40d650 con 0x55cd1f40ac90 2024-04-26T12:52:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2af93640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f40ac90 0x55cd1f40d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2af93640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f40ac90 0x55cd1f40d080 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:03.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 20 searching for the correct realm 2024-04-26T12:52:03.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f40f5a0 0x55cd1f4119d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4120a0 con 0x55cd1f40f5a0 2024-04-26T12:52:03.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2a792640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f40f5a0 0x55cd1f4119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2a792640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f40f5a0 0x55cd1f4119d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2a792640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fda200dc040 0x7fda200dc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4120a0 con 0x7fda200dc040 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.432+0000 7fda2b794640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fda200dc040 0x7fda200dc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fda200dc040 0x7fda200dc420 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda240083f0 con 0x7fda200dc040 2024-04-26T12:52:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f40ac90 2024-04-26T12:52:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f4062a0 2024-04-26T12:52:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda240083f0 con 0x55cd1f4062a0 2024-04-26T12:52:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f4062a0 2024-04-26T12:52:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f40ac90 2024-04-26T12:52:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f40ac90 2024-04-26T12:52:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x7fda200dc040 2024-04-26T12:52:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.436+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f40f5a0 2024-04-26T12:52:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f4062a0 2024-04-26T12:52:03.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x7fda200dc040 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f4062a0 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x7fda200dc040 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40ac90 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f4062a0 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f4062a0 2024-04-26T12:52:03.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.440+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40ac90 2024-04-26T12:52:03.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x7fda200dc040 2024-04-26T12:52:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f4062a0 2024-04-26T12:52:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40ac90 2024-04-26T12:52:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40ac90 2024-04-26T12:52:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x7fda200dc040 2024-04-26T12:52:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.444+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f40ac90 2024-04-26T12:52:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x55cd1f4062a0 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fda2402b040 con 0x7fda200dc040 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f4062a0 2024-04-26T12:52:03.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f4062a0 2024-04-26T12:52:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f409f30 con 0x55cd1f40f5a0 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 zone default found 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 4 Realm: () 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 zonegroup default 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f40e580 con 0x55cd1f40ac90 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f413f00 con 0x55cd1f40f5a0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4142a0 con 0x55cd1f40f5a0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 started sync module instance, tier type = 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.448+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4133a0 con 0x7fda200dc040 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.452+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.452+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94339481024672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4133a0 con 0x7fda200dc040 2024-04-26T12:52:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.452+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f414c60 con 0x55cd1f4062a0 2024-04-26T12:52:03.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.452+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94339481024672] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.452+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.452+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94339481028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4133a0 con 0x55cd1f4062a0 2024-04-26T12:52:03.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.452+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f415670 con 0x55cd1f40f5a0 2024-04-26T12:52:03.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94339481028800] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94339481022192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f413310 con 0x55cd1f40f5a0 2024-04-26T12:52:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f416440 con 0x7fda200dc040 2024-04-26T12:52:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94339481034512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f416ce0 con 0x7fda200dc040 2024-04-26T12:52:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4176e0 con 0x55cd1f4062a0 2024-04-26T12:52:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.456+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94339481022192] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94339481034512] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94339481033312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4167b0 con 0x55cd1f4062a0 2024-04-26T12:52:03.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f417f80 con 0x55cd1f40ac90 2024-04-26T12:52:03.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94339481033312] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94339481041616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4167b0 con 0x55cd1f40ac90 2024-04-26T12:52:03.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.460+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f4187d0 con 0x55cd1f40ac90 2024-04-26T12:52:03.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.464+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.464+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94339481045872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f419440 con 0x55cd1f40ac90 2024-04-26T12:52:03.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.464+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f419e00 con 0x55cd1f40ac90 2024-04-26T12:52:03.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.464+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94339481041616] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94339481045872] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94339481039344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f419e00 con 0x55cd1f40ac90 2024-04-26T12:52:03.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=0 2024-04-26T12:52:03.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=1 2024-04-26T12:52:03.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=2 2024-04-26T12:52:03.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=3 2024-04-26T12:52:03.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=4 2024-04-26T12:52:03.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=5 2024-04-26T12:52:03.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=6 2024-04-26T12:52:03.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94339481039344] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 20 add_watcher() i=7 2024-04-26T12:52:03.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:03.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f41cfd0 con 0x55cd1f4062a0 2024-04-26T12:52:03.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.468+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94339481049424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f41a220 con 0x55cd1f4062a0 2024-04-26T12:52:03.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94339481049424] v35'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fd8e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:03.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:03.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:03.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 5 note: GC not initialized 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fd85bfff640 20 reqs_thread_entry: start 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 20 Filter name: none 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fd859ffb640 20 reqs_thread_entry: start 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440880 con 0x55cd1f4062a0 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:52:03.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:03.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.472+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f443310 con 0x55cd1f40ac90 2024-04-26T12:52:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.476+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 usage.10 [call] v35'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.476+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f443310 con 0x55cd1f40ac90 2024-04-26T12:52:03.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.476+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(64 usage.10 [call] v35'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fd8e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:03.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94339481049424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f400940 con 0x55cd1f4062a0 2024-04-26T12:52:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94339481049424] v35'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94339481024672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f419950 con 0x7fda200dc040 2024-04-26T12:52:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94339481024672] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fda2d478980 20 remove_watcher() i=0 2024-04-26T12:52:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fda2d478980 2 removed watcher, disabling cache 2024-04-26T12:52:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.480+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94339481028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440420 con 0x55cd1f4062a0 2024-04-26T12:52:03.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.484+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94339481028800] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.484+0000 7fda2d478980 20 remove_watcher() i=1 2024-04-26T12:52:03.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.484+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94339481022192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440420 con 0x55cd1f40f5a0 2024-04-26T12:52:03.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.484+0000 7fda2a792640 1 -- 172.21.15.72:0/2240689118 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94339481022192] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda200b3040 con 0x55cd1f40f5a0 2024-04-26T12:52:03.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.484+0000 7fda2d478980 20 remove_watcher() i=2 2024-04-26T12:52:03.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.484+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94339481034512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440420 con 0x7fda200dc040 2024-04-26T12:52:03.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.488+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94339481034512] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x7fda200dc040 2024-04-26T12:52:03.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.488+0000 7fda2d478980 20 remove_watcher() i=3 2024-04-26T12:52:03.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.488+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94339481033312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440420 con 0x55cd1f4062a0 2024-04-26T12:52:03.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.488+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94339481033312] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda24026040 con 0x55cd1f4062a0 2024-04-26T12:52:03.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.488+0000 7fda2d478980 20 remove_watcher() i=4 2024-04-26T12:52:03.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.488+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94339481041616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440420 con 0x55cd1f40ac90 2024-04-26T12:52:03.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.492+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94339481041616] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.492+0000 7fda2d478980 20 remove_watcher() i=5 2024-04-26T12:52:03.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.492+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94339481045872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440420 con 0x55cd1f40ac90 2024-04-26T12:52:03.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.492+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94339481045872] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.492+0000 7fda2d478980 20 remove_watcher() i=6 2024-04-26T12:52:03.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.492+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94339481039344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cd1f440420 con 0x55cd1f40ac90 2024-04-26T12:52:03.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2af93640 1 -- 172.21.15.72:0/2240689118 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94339481039344] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda1c065030 con 0x55cd1f40ac90 2024-04-26T12:52:03.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 20 remove_watcher() i=7 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f40ac90 msgr2=0x55cd1f40d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f40ac90 0x55cd1f40d080 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f4062a0 msgr2=0x55cd1f408760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f4062a0 0x55cd1f408760 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fda200dc040 msgr2=0x7fda200dc420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fda200dc040 0x7fda200dc420 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f40f5a0 msgr2=0x55cd1f4119d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f40f5a0 0x55cd1f4119d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8f40345b0 msgr2=0x7fd8f4036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd8f40345b0 0x7fd8f4036a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55cd1f3d9340 tx=0x7fda200a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2b794640 1 -- 172.21.15.72:0/2240689118 reap_dead start 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 msgr2=0x55cd1f3fb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3fb330 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fda1c046870 tx=0x7fda1c00a1d0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 shutdown_connections 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/2240689118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3f3ff0 0x55cd1f3fb330 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 >> 172.21.15.72:0/2240689118 conn(0x55cd1f3f0330 msgr2=0x55cd1f3ee360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 shutdown_connections 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/2240689118 wait complete. 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd904034650 msgr2=0x7fd904036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd904034650 0x7fd904036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55cd1f3d0670 tx=0x7fda20005a10 comp rx=0 tx=0).stop 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3e6fd0 msgr2=0x55cd1f3e73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3e6fd0 0x55cd1f3e73f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fda1c047aa0 tx=0x7fda1c00f8b0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 shutdown_connections 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd904034650 0x7fd904036b10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/1189706020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f3e6fd0 0x55cd1f3e73f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 >> 172.21.15.72:0/1189706020 conn(0x55cd1f3dbde0 msgr2=0x55cd1f3dc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 shutdown_connections 2024-04-26T12:52:03.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/1189706020 wait complete. 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f3d24d0 msgr2=0x55cd1f3d48c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55cd1f3d24d0 0x55cd1f3d48c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f3cd8d0 msgr2=0x55cd1f3cfcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55cd1f3cd8d0 0x55cd1f3cfcc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f3d6410 msgr2=0x55cd1f3d8800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55cd1f3d6410 0x55cd1f3d8800 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd910034650 msgr2=0x7fd910036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fd910034650 0x7fd910036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fda200ad000 tx=0x7fda200a5040 comp rx=0 tx=0).stop 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 msgr2=0x55cd1f3c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 --2- 172.21.15.72:0/386217644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cd1f2d64e0 0x55cd1f3c8880 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fda1c014040 tx=0x7fda1c001260 comp rx=0 tx=0).stop 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2b794640 1 -- 172.21.15.72:0/386217644 reap_dead start 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 shutdown_connections 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 >> 172.21.15.72:0/386217644 conn(0x55cd1f249bc0 msgr2=0x55cd1f3bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 shutdown_connections 2024-04-26T12:52:03.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.496+0000 7fda2d478980 1 -- 172.21.15.72:0/386217644 wait complete. 2024-04-26T12:52:03.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-26T12:52:03.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-26T12:52:03.511 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-26T12:52:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f5966b8a980 1 Processor -- start 2024-04-26T12:52:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f5966b8a980 1 -- start start 2024-04-26T12:52:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f5966b8a980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55600c3e2950 0x55600c3e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f5966b8a980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55600c319510 con 0x55600c3e1440 2024-04-26T12:52:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f5966b8a980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55600c320430 con 0x55600c3e2950 2024-04-26T12:52:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f59646a5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55600c3e2950 0x55600c3e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f59646a5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55600c3e2950 0x55600c3e0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38030/0 (socket says 172.21.15.72:38030) 2024-04-26T12:52:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f59646a5640 1 -- 172.21.15.72:0/4206154620 learned_addr learned my addr 172.21.15.72:0/4206154620 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f59646a5640 1 -- 172.21.15.72:0/4206154620 >> v1:172.21.15.29:6789/0 conn(0x55600c3e1440 legacy=0x55600c4742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f59646a5640 1 -- 172.21.15.72:0/4206154620 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600c2f5ae0 con 0x55600c3e2950 2024-04-26T12:52:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.584+0000 7f59636a3640 1 -- 172.21.15.72:0/4206154620 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239557798 0 0) 0x55600c319510 con 0x55600c3e1440 2024-04-26T12:52:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f59646a5640 1 --2- 172.21.15.72:0/4206154620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e2950 0x55600c3e0f00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f595c00a5c0 tx=0x7f595c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dd5e5467433759 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f59636a3640 1 -- 172.21.15.72:0/4206154620 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0a6070 con 0x55600c3e2950 2024-04-26T12:52:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f59636a3640 1 -- 172.21.15.72:0/4206154620 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0af070 con 0x55600c3e2950 2024-04-26T12:52:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f59636a3640 1 -- 172.21.15.72:0/4206154620 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0aa5c0 con 0x55600c3e2950 2024-04-26T12:52:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f5966b8a980 1 -- 172.21.15.72:0/4206154620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e2950 msgr2=0x55600c3e0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f5966b8a980 1 --2- 172.21.15.72:0/4206154620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e2950 0x55600c3e0f00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f595c00a5c0 tx=0x7f595c01b340 comp rx=0 tx=0).stop 2024-04-26T12:52:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f5966b8a980 1 -- 172.21.15.72:0/4206154620 shutdown_connections 2024-04-26T12:52:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f5966b8a980 1 --2- 172.21.15.72:0/4206154620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e2950 0x55600c3e0f00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f5966b8a980 1 -- 172.21.15.72:0/4206154620 >> 172.21.15.72:0/4206154620 conn(0x55600c467b90 msgr2=0x55600c469fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f5966b8a980 1 -- 172.21.15.72:0/4206154620 shutdown_connections 2024-04-26T12:52:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.588+0000 7f5966b8a980 1 -- 172.21.15.72:0/4206154620 wait complete. 2024-04-26T12:52:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f5966b8a980 1 Processor -- start 2024-04-26T12:52:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f5966b8a980 1 -- start start 2024-04-26T12:52:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f5966b8a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c559ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f5966b8a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55600c36fa70 con 0x55600c3e1440 2024-04-26T12:52:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c559ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c559ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38032/0 (socket says 172.21.15.72:38032) 2024-04-26T12:52:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f59646a5640 1 -- 172.21.15.72:0/3136036518 learned_addr learned my addr 172.21.15.72:0/3136036518 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f59646a5640 1 -- 172.21.15.72:0/3136036518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600c55a0a0 con 0x55600c3e1440 2024-04-26T12:52:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f59646a5640 1 --2- 172.21.15.72:0/3136036518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c559ad0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f595c017f50 tx=0x7f595c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fa8c4e183bd837 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f585260c640 1 -- 172.21.15.72:0/3136036518 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0aa9c0 con 0x55600c3e1440 2024-04-26T12:52:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f585260c640 1 -- 172.21.15.72:0/3136036518 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0aab60 con 0x55600c3e1440 2024-04-26T12:52:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.604+0000 7f585260c640 1 -- 172.21.15.72:0/3136036518 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0aae40 con 0x55600c3e1440 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- 172.21.15.72:0/3136036518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 msgr2=0x55600c559ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 --2- 172.21.15.72:0/3136036518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c559ad0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f595c017f50 tx=0x7f595c003030 comp rx=0 tx=0).stop 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- 172.21.15.72:0/3136036518 shutdown_connections 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 --2- 172.21.15.72:0/3136036518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c559ad0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- 172.21.15.72:0/3136036518 >> 172.21.15.72:0/3136036518 conn(0x55600c467b90 msgr2=0x55600c555660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- 172.21.15.72:0/3136036518 shutdown_connections 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- 172.21.15.72:0/3136036518 wait complete. 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 Processor -- start 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- start start 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c560bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55600c4784d0 con 0x55600c3e1440 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c560bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c560bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38042/0 (socket says 172.21.15.72:38042) 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f59646a5640 1 -- 172.21.15.72:0/139904672 learned_addr learned my addr 172.21.15.72:0/139904672 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f59646a5640 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600c561130 con 0x55600c3e1440 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f59646a5640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c560bf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f595c005940 tx=0x7f595c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5850e09640 1 -- 172.21.15.72:0/139904672 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0ca020 con 0x55600c3e1440 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55600c5613c0 con 0x55600c3e1440 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5850e09640 1 -- 172.21.15.72:0/139904672 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0bd6a0 con 0x55600c3e1440 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5850e09640 1 -- 172.21.15.72:0/139904672 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0bd980 con 0x55600c3e1440 2024-04-26T12:52:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.608+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600c563fd0 con 0x55600c3e1440 2024-04-26T12:52:03.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5850e09640 1 -- 172.21.15.72:0/139904672 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f595c0cd020 con 0x55600c3e1440 2024-04-26T12:52:03.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5850e09640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f584c0346a0 0x7f584c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5850e09640 1 -- 172.21.15.72:0/139904672 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f595c0e5200 con 0x55600c3e1440 2024-04-26T12:52:03.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5963ea4640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f584c0346a0 0x7f584c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c3e2950 0x55600c567b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5681a0 con 0x55600c3e2950 2024-04-26T12:52:03.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5964ea6640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c3e2950 0x55600c567b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5963ea4640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f584c0346a0 0x7f584c036b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5958000f70 tx=0x7f5958001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5964ea6640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c3e2950 0x55600c567b30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5964ea6640 1 -- 172.21.15.72:0/139904672 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c3e2950 2024-04-26T12:52:03.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5651b0 con 0x55600c3e2950 2024-04-26T12:52:03.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5964ea6640 1 -- 172.21.15.72:0/139904672 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c3e2950 2024-04-26T12:52:03.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c56a4d0 0x55600c56c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c56cf90 con 0x55600c56a4d0 2024-04-26T12:52:03.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f59646a5640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c56a4d0 0x55600c56c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f59646a5640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c56a4d0 0x55600c56c8c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.612+0000 7f59646a5640 1 -- 172.21.15.72:0/139904672 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f595c0c6960 con 0x55600c56a4d0 2024-04-26T12:52:03.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c569370 con 0x55600c3e2950 2024-04-26T12:52:03.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5964ea6640 1 -- 172.21.15.72:0/139904672 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c3e2950 2024-04-26T12:52:03.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c56e3f0 0x55600c5707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c570f20 con 0x55600c56e3f0 2024-04-26T12:52:03.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5963ea4640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c56e3f0 0x55600c5707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5963ea4640 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c56e3f0 0x55600c5707e0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5963ea4640 1 -- 172.21.15.72:0/139904672 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5958010690 con 0x55600c56e3f0 2024-04-26T12:52:03.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 Processor -- start 2024-04-26T12:52:03.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 -- start start 2024-04-26T12:52:03.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c57efb0 0x55600c57f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55600c373ab0 con 0x55600c57efb0 2024-04-26T12:52:03.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c57efb0 0x55600c57f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c57efb0 0x55600c57f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38050/0 (socket says 172.21.15.72:38050) 2024-04-26T12:52:03.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f59646a5640 1 -- 172.21.15.72:0/1734287459 learned_addr learned my addr 172.21.15.72:0/1734287459 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f59646a5640 1 -- 172.21.15.72:0/1734287459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600c57f910 con 0x55600c57efb0 2024-04-26T12:52:03.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f59646a5640 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c57efb0 0x55600c57f3d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f595c0abff0 tx=0x7f595c0b3e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5849ffb640 1 -- 172.21.15.72:0/1734287459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0ce940 con 0x55600c57efb0 2024-04-26T12:52:03.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5849ffb640 1 -- 172.21.15.72:0/1734287459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0ad9e0 con 0x55600c57efb0 2024-04-26T12:52:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55600c5803b0 con 0x55600c57efb0 2024-04-26T12:52:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5849ffb640 1 -- 172.21.15.72:0/1734287459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0adcc0 con 0x55600c57efb0 2024-04-26T12:52:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.616+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600c580880 con 0x55600c57efb0 2024-04-26T12:52:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5849ffb640 1 -- 172.21.15.72:0/1734287459 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f595c006570 con 0x55600c57efb0 2024-04-26T12:52:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5849ffb640 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f583c0346a0 0x7f583c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5849ffb640 1 -- 172.21.15.72:0/1734287459 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f595c0f3a90 con 0x55600c57efb0 2024-04-26T12:52:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5963ea4640 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f583c0346a0 0x7f583c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 Processor -- start 2024-04-26T12:52:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 -- start start 2024-04-26T12:52:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c58c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5963ea4640 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f583c0346a0 0x7f583c036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f595800c010 tx=0x7f5958006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55600c55a330 con 0x55600c58bf90 2024-04-26T12:52:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c58c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c58c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38066/0 (socket says 172.21.15.72:38066) 2024-04-26T12:52:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f59646a5640 1 -- 172.21.15.72:0/3468391308 learned_addr learned my addr 172.21.15.72:0/3468391308 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f59646a5640 1 -- 172.21.15.72:0/3468391308 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600c58c940 con 0x55600c58bf90 2024-04-26T12:52:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f59646a5640 1 --2- 172.21.15.72:0/3468391308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c58c370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f595c006fc0 tx=0x7f595c0de200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3a7d02ece2621a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f58437fe640 1 -- 172.21.15.72:0/3468391308 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c101030 con 0x55600c58bf90 2024-04-26T12:52:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f58437fe640 1 -- 172.21.15.72:0/3468391308 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0ad770 con 0x55600c58bf90 2024-04-26T12:52:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f58437fe640 1 -- 172.21.15.72:0/3468391308 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c0ad250 con 0x55600c58bf90 2024-04-26T12:52:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 -- 172.21.15.72:0/3468391308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 msgr2=0x55600c58c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 --2- 172.21.15.72:0/3468391308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c58c370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f595c006fc0 tx=0x7f595c0de200 comp rx=0 tx=0).stop 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 -- 172.21.15.72:0/3468391308 shutdown_connections 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 --2- 172.21.15.72:0/3468391308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c58c370 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 -- 172.21.15.72:0/3468391308 >> 172.21.15.72:0/3468391308 conn(0x55600c588320 msgr2=0x55600c586380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 -- 172.21.15.72:0/3468391308 shutdown_connections 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.620+0000 7f5966b8a980 1 -- 172.21.15.72:0/3468391308 wait complete. 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 Processor -- start 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 -- start start 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c593090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55600c58c940 con 0x55600c58bf90 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c593090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f59646a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c593090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38070/0 (socket says 172.21.15.72:38070) 2024-04-26T12:52:03.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 learned_addr learned my addr 172.21.15.72:0/1530144084 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600c5935d0 con 0x55600c58bf90 2024-04-26T12:52:03.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f59646a5640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c593090 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f595c0adee0 tx=0x7f595c0e7f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5841ffb640 1 -- 172.21.15.72:0/1530144084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c112070 con 0x55600c58bf90 2024-04-26T12:52:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55600c5935d0 con 0x55600c58bf90 2024-04-26T12:52:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5841ffb640 1 -- 172.21.15.72:0/1530144084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0dbb00 con 0x55600c58bf90 2024-04-26T12:52:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600c593a40 con 0x55600c58bf90 2024-04-26T12:52:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5841ffb640 1 -- 172.21.15.72:0/1530144084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f595c101040 con 0x55600c58bf90 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5841ffb640 1 -- 172.21.15.72:0/1530144084 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f595c104070 con 0x55600c58bf90 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5841ffb640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5834034650 0x7f5834036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5841ffb640 1 -- 172.21.15.72:0/1530144084 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f595c102070 con 0x55600c58bf90 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5963ea4640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5834034650 0x7f5834036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c59e040 0x55600c5a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.624+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a0c50 con 0x55600c59e040 2024-04-26T12:52:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5964ea6640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c59e040 0x55600c5a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5963ea4640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5834034650 0x7f5834036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5958010fd0 tx=0x7f5958022040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5964ea6640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c59e040 0x55600c5a0500 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 realm 2024-04-26T12:52:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a1060 con 0x55600c59e040 2024-04-26T12:52:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a1900 con 0x55600c59e040 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a1ca0 con 0x55600c59e040 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c5a2a00 0x55600c5a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a5370 con 0x55600c5a2a00 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f59646a5640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c5a2a00 0x55600c5a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f59646a5640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c5a2a00 0x55600c5a4df0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 20 searching for the correct realm 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c5a72e0 0x55600c5a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a9e70 con 0x55600c5a72e0 2024-04-26T12:52:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5963ea4640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c5a72e0 0x55600c5a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.628+0000 7f5963ea4640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c5a72e0 0x55600c5a97a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5963ea4640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5958010070 0x7f59580393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a9e70 con 0x7f5958010070 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5958010070 0x7f59580393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5958010070 0x7f59580393c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595400a4d0 con 0x7f5958010070 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a1ca0 con 0x55600c5a2a00 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a1ca0 con 0x55600c59e040 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a1ca0 con 0x55600c59e040 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a1ca0 con 0x55600c5a2a00 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a2a00 2024-04-26T12:52:03.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.632+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x7f5958010070 2024-04-26T12:52:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595400a4d0 con 0x7f5958010070 2024-04-26T12:52:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c59e040 2024-04-26T12:52:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x7f5958010070 2024-04-26T12:52:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595400a4d0 con 0x7f5958010070 2024-04-26T12:52:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c59e040 2024-04-26T12:52:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595400a4d0 con 0x55600c59e040 2024-04-26T12:52:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x7f5958010070 2024-04-26T12:52:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5954032040 con 0x7f5958010070 2024-04-26T12:52:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a2a00 2024-04-26T12:52:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c59e040 2024-04-26T12:52:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5954032040 con 0x55600c59e040 2024-04-26T12:52:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.636+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c59e040 2024-04-26T12:52:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5954032040 con 0x55600c59e040 2024-04-26T12:52:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a2a00 2024-04-26T12:52:03.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x7f5958010070 2024-04-26T12:52:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5954032040 con 0x7f5958010070 2024-04-26T12:52:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c59e040 2024-04-26T12:52:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5954032040 con 0x55600c59e040 2024-04-26T12:52:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a2a00 2024-04-26T12:52:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a2a00 2024-04-26T12:52:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x7f5958010070 2024-04-26T12:52:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5954032040 con 0x7f5958010070 2024-04-26T12:52:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.640+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a72e0 2024-04-26T12:52:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c5a2a00 2024-04-26T12:52:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x55600c59e040 2024-04-26T12:52:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5954032040 con 0x55600c59e040 2024-04-26T12:52:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f595c124040 con 0x7f5958010070 2024-04-26T12:52:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5954032040 con 0x7f5958010070 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a5bc0 con 0x55600c59e040 2024-04-26T12:52:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5954032040 con 0x55600c59e040 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a5bc0 con 0x55600c59e040 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5954032040 con 0x55600c59e040 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a5bc0 con 0x55600c5a72e0 2024-04-26T12:52:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 zone default found 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 4 Realm: () 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 zonegroup default 2024-04-26T12:52:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5a6460 con 0x55600c5a2a00 2024-04-26T12:52:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5abcd0 con 0x55600c5a72e0 2024-04-26T12:52:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.644+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ac070 con 0x55600c5a72e0 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 20 started sync module instance, tier type = 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ab170 con 0x7f5958010070 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954032040 con 0x7f5958010070 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93871012492960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ab170 con 0x7f5958010070 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5acb50 con 0x55600c59e040 2024-04-26T12:52:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93871012492960] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x7f5958010070 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93871012496928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ab170 con 0x55600c59e040 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.648+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ad560 con 0x55600c5a72e0 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.652+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93871012496928] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.652+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.652+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93871012490432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ab0e0 con 0x55600c5a72e0 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.652+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ae2b0 con 0x7f5958010070 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.652+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x7f5958010070 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.652+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93871012503312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ae9a0 con 0x7f5958010070 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.652+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5af490 con 0x55600c59e040 2024-04-26T12:52:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.656+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93871012490432] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.656+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93871012503312] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x7f5958010070 2024-04-26T12:52:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.656+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.656+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93871012507488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5af450 con 0x55600c59e040 2024-04-26T12:52:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.656+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5afd30 con 0x55600c5a2a00 2024-04-26T12:52:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93871012507488] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93871012509824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5af450 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5b05a0 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93871012509824] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93871012501840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5b0df0 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.660+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5b17b0 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93871012501840] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93871012514384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5b17b0 con 0x55600c5a2a00 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=0 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=1 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=2 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=3 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=4 2024-04-26T12:52:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=5 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=6 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93871012514384] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 20 add_watcher() i=7 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5b4b00 con 0x55600c59e040 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.664+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93871012529424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5b1920 con 0x55600c59e040 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93871012529424] v35'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f581a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 5 note: GC not initialized 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f58197e2640 20 reqs_thread_entry: start 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 20 Filter name: none 2024-04-26T12:52:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f578affd640 20 reqs_thread_entry: start 2024-04-26T12:52:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5d7f40 con 0x55600c59e040 2024-04-26T12:52:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:52:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55600c5d9490 con 0x55600c5a2a00 2024-04-26T12:52:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.668+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f581a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93871012529424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5981a0 con 0x55600c59e040 2024-04-26T12:52:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93871012529424] v35'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93871012492960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5b4510 con 0x7f5958010070 2024-04-26T12:52:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93871012492960] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x7f5958010070 2024-04-26T12:52:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f5966b8a980 20 remove_watcher() i=0 2024-04-26T12:52:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f5966b8a980 2 removed watcher, disabling cache 2024-04-26T12:52:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.672+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93871012496928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ab6a0 con 0x55600c59e040 2024-04-26T12:52:03.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.676+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93871012496928] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.676+0000 7f5966b8a980 20 remove_watcher() i=1 2024-04-26T12:52:03.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.676+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93871012490432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ab6a0 con 0x55600c5a72e0 2024-04-26T12:52:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.676+0000 7f5963ea4640 1 -- 172.21.15.72:0/1530144084 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93871012490432] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5958036040 con 0x55600c5a72e0 2024-04-26T12:52:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.676+0000 7f5966b8a980 20 remove_watcher() i=2 2024-04-26T12:52:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.676+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93871012503312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5aacc0 con 0x7f5958010070 2024-04-26T12:52:03.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.680+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93871012503312] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x7f5958010070 2024-04-26T12:52:03.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.680+0000 7f5966b8a980 20 remove_watcher() i=3 2024-04-26T12:52:03.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.680+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93871012507488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5ab6a0 con 0x55600c59e040 2024-04-26T12:52:03.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.680+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93871012507488] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5954040040 con 0x55600c59e040 2024-04-26T12:52:03.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.680+0000 7f5966b8a980 20 remove_watcher() i=4 2024-04-26T12:52:03.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.680+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93871012509824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5adf10 con 0x55600c5a2a00 2024-04-26T12:52:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.684+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93871012509824] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.684+0000 7f5966b8a980 20 remove_watcher() i=5 2024-04-26T12:52:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.684+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93871012501840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5aacc0 con 0x55600c5a2a00 2024-04-26T12:52:03.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.684+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93871012501840] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.684+0000 7f5966b8a980 20 remove_watcher() i=6 2024-04-26T12:52:03.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.684+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93871012514384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55600c5aef60 con 0x55600c5a2a00 2024-04-26T12:52:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f59646a5640 1 -- 172.21.15.72:0/1530144084 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93871012514384] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f595c0eb020 con 0x55600c5a2a00 2024-04-26T12:52:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 20 remove_watcher() i=7 2024-04-26T12:52:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c5a2a00 msgr2=0x55600c5a4df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c5a2a00 0x55600c5a4df0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c59e040 msgr2=0x55600c5a0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c59e040 0x55600c5a0500 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5958010070 msgr2=0x7f59580393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f5958010070 0x7f59580393c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c5a72e0 msgr2=0x55600c5a97a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c5a72e0 0x55600c5a97a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5834034650 msgr2=0x7f5834036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5834034650 0x7f5834036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5958010fd0 tx=0x7f5958022040 comp rx=0 tx=0).stop 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 msgr2=0x55600c593090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1530144084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c58bf90 0x55600c593090 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f595c0adee0 tx=0x7f595c0e7f70 comp rx=0 tx=0).stop 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5964ea6640 1 -- 172.21.15.72:0/1530144084 reap_dead start 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 shutdown_connections 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 >> 172.21.15.72:0/1530144084 conn(0x55600c588320 msgr2=0x55600c585980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 shutdown_connections 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1530144084 wait complete. 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f583c0346a0 msgr2=0x7f583c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f583c0346a0 0x7f583c036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f595800c010 tx=0x7f5958006000 comp rx=0 tx=0).stop 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c57efb0 msgr2=0x55600c57f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c57efb0 0x55600c57f3d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f595c0abff0 tx=0x7f595c0b3e40 comp rx=0 tx=0).stop 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 shutdown_connections 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f583c0346a0 0x7f583c036b60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/1734287459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c57efb0 0x55600c57f3d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 >> 172.21.15.72:0/1734287459 conn(0x55600c573dc0 msgr2=0x55600c5748d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 shutdown_connections 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/1734287459 wait complete. 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c56a4d0 msgr2=0x55600c56c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55600c56a4d0 0x55600c56c8c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c3e2950 msgr2=0x55600c567b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55600c3e2950 0x55600c567b30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c56e3f0 msgr2=0x55600c5707e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55600c56e3f0 0x55600c5707e0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f584c0346a0 msgr2=0x7f584c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f584c0346a0 0x7f584c036b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5958000f70 tx=0x7f5958001400 comp rx=0 tx=0).stop 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 msgr2=0x55600c560bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 --2- 172.21.15.72:0/139904672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55600c3e1440 0x55600c560bf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f595c005940 tx=0x7f595c0180e0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5964ea6640 1 -- 172.21.15.72:0/139904672 reap_dead start 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 shutdown_connections 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 >> 172.21.15.72:0/139904672 conn(0x55600c467b90 msgr2=0x55600c554170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 shutdown_connections 2024-04-26T12:52:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.688+0000 7f5966b8a980 1 -- 172.21.15.72:0/139904672 wait complete. 2024-04-26T12:52:03.700 INFO:teuthology.orchestra.run.smithi072.stdout:{"entries":[],"summary":[]} 2024-04-26T12:52:03.701 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-26T12:52:03.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-26T12:52:03.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-26T12:52:03.701 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-26T12:52:03.777 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:03.777 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:03.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa10851c980 1 Processor -- start 2024-04-26T12:52:03.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa10851c980 1 -- start start 2024-04-26T12:52:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa10851c980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56346aec1a00 0x56346aec3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa10851c980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56346ad68510 con 0x56346aebd4f0 2024-04-26T12:52:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa10851c980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56346ad6f430 con 0x56346aec1a00 2024-04-26T12:52:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa105836640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56346aec1a00 0x56346aec3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa105836640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56346aec1a00 0x56346aec3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38074/0 (socket says 172.21.15.72:38074) 2024-04-26T12:52:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa105836640 1 -- 172.21.15.72:0/1581580793 learned_addr learned my addr 172.21.15.72:0/1581580793 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa105836640 1 -- 172.21.15.72:0/1581580793 >> v1:172.21.15.29:6789/0 conn(0x56346aebd4f0 legacy=0x56346aebd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.776+0000 7fa105836640 1 -- 172.21.15.72:0/1581580793 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56346ad44ae0 con 0x56346aec1a00 2024-04-26T12:52:03.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa105836640 1 --2- 172.21.15.72:0/1581580793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aec1a00 0x56346aec3df0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00a4e0 tx=0x7fa0fc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c57fd65b831615 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa105035640 1 -- 172.21.15.72:0/1581580793 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc0aa540 con 0x56346aec1a00 2024-04-26T12:52:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa105035640 1 -- 172.21.15.72:0/1581580793 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0aa6e0 con 0x56346aec1a00 2024-04-26T12:52:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa105035640 1 -- 172.21.15.72:0/1581580793 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc0aaa40 con 0x56346aec1a00 2024-04-26T12:52:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa10851c980 1 -- 172.21.15.72:0/1581580793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aec1a00 msgr2=0x56346aec3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa10851c980 1 --2- 172.21.15.72:0/1581580793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aec1a00 0x56346aec3df0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00a4e0 tx=0x7fa0fc01b090 comp rx=0 tx=0).stop 2024-04-26T12:52:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa10851c980 1 -- 172.21.15.72:0/1581580793 shutdown_connections 2024-04-26T12:52:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa10851c980 1 --2- 172.21.15.72:0/1581580793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aec1a00 0x56346aec3df0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa10851c980 1 -- 172.21.15.72:0/1581580793 >> 172.21.15.72:0/1581580793 conn(0x56346ae30bd0 msgr2=0x56346ae30fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa10851c980 1 -- 172.21.15.72:0/1581580793 shutdown_connections 2024-04-26T12:52:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.780+0000 7fa10851c980 1 -- 172.21.15.72:0/1581580793 wait complete. 2024-04-26T12:52:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa10851c980 1 Processor -- start 2024-04-26T12:52:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa10851c980 1 -- start start 2024-04-26T12:52:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa10851c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afa8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa10851c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56346adbea70 con 0x56346aebd4f0 2024-04-26T12:52:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afa8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afa8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38088/0 (socket says 172.21.15.72:38088) 2024-04-26T12:52:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa106037640 1 -- 172.21.15.72:0/201362338 learned_addr learned my addr 172.21.15.72:0/201362338 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa106037640 1 -- 172.21.15.72:0/201362338 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56346afa8be0 con 0x56346aebd4f0 2024-04-26T12:52:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7fa106037640 1 --2- 172.21.15.72:0/201362338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afa8610 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800b1f0 tx=0x7fa0f800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f203d560eb501b6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.796+0000 7f9ff4608640 1 -- 172.21.15.72:0/201362338 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f800a040 con 0x56346aebd4f0 2024-04-26T12:52:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7f9ff4608640 1 -- 172.21.15.72:0/201362338 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f800f750 con 0x56346aebd4f0 2024-04-26T12:52:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7f9ff4608640 1 -- 172.21.15.72:0/201362338 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f800fa70 con 0x56346aebd4f0 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- 172.21.15.72:0/201362338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 msgr2=0x56346afa8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 --2- 172.21.15.72:0/201362338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afa8610 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800b1f0 tx=0x7fa0f800b6b0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- 172.21.15.72:0/201362338 shutdown_connections 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 --2- 172.21.15.72:0/201362338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afa8610 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- 172.21.15.72:0/201362338 >> 172.21.15.72:0/201362338 conn(0x56346ae30bd0 msgr2=0x56346afa41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- 172.21.15.72:0/201362338 shutdown_connections 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- 172.21.15.72:0/201362338 wait complete. 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 Processor -- start 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- start start 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afaf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56346aec6e20 con 0x56346aebd4f0 2024-04-26T12:52:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afaf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afaf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38104/0 (socket says 172.21.15.72:38104) 2024-04-26T12:52:03.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa106037640 1 -- 172.21.15.72:0/3182543463 learned_addr learned my addr 172.21.15.72:0/3182543463 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa106037640 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56346afafe00 con 0x56346aebd4f0 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa106037640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afaf8c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800f720 tx=0x7fa0f8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7f9ff2e05640 1 -- 172.21.15.72:0/3182543463 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f8001300 con 0x56346aebd4f0 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56346afb0090 con 0x56346aebd4f0 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7f9ff2e05640 1 -- 172.21.15.72:0/3182543463 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f801c9c0 con 0x56346aebd4f0 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7f9ff2e05640 1 -- 172.21.15.72:0/3182543463 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f801cd20 con 0x56346aebd4f0 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.800+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56346afb2cd0 con 0x56346aebd4f0 2024-04-26T12:52:03.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7f9ff2e05640 1 -- 172.21.15.72:0/3182543463 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0f8017050 con 0x56346aebd4f0 2024-04-26T12:52:03.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7f9ff2e05640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fec0346a0 0x7f9fec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7f9ff2e05640 1 -- 172.21.15.72:0/3182543463 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa0f8015020 con 0x56346aebd4f0 2024-04-26T12:52:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa105836640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fec0346a0 0x7f9fec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346aec1a00 0x56346afb6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afb6e60 con 0x56346aec1a00 2024-04-26T12:52:03.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa106838640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346aec1a00 0x56346afb6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa105836640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fec0346a0 0x7f9fec036b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0ab000 tx=0x7fa0fc0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa106838640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346aec1a00 0x56346afb6920 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa106838640 1 -- 172.21.15.72:0/3182543463 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1000083f0 con 0x56346aec1a00 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afb3ef0 con 0x56346aec1a00 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa106838640 1 -- 172.21.15.72:0/3182543463 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1000083f0 con 0x56346aec1a00 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346afb9200 0x56346afbb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afbbcc0 con 0x56346afb9200 2024-04-26T12:52:03.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa106037640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346afb9200 0x56346afbb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa106037640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346afb9200 0x56346afbb5f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa106037640 1 -- 172.21.15.72:0/3182543463 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa0f802e070 con 0x56346afb9200 2024-04-26T12:52:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.804+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afb80a0 con 0x56346aec1a00 2024-04-26T12:52:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa106838640 1 -- 172.21.15.72:0/3182543463 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1000083f0 con 0x56346aec1a00 2024-04-26T12:52:03.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346afbd120 0x56346afbf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afbfc10 con 0x56346afbd120 2024-04-26T12:52:03.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa105836640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346afbd120 0x56346afbf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa105836640 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346afbd120 0x56346afbf510 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa105836640 1 -- 172.21.15.72:0/3182543463 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa0fc0aac70 con 0x56346afbd120 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 Processor -- start 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 -- start start 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afcdc20 0x56346afce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56346adc2ab0 con 0x56346afcdc20 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afcdc20 0x56346afce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afcdc20 0x56346afce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38116/0 (socket says 172.21.15.72:38116) 2024-04-26T12:52:03.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa106037640 1 -- 172.21.15.72:0/1535384737 learned_addr learned my addr 172.21.15.72:0/1535384737 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa106037640 1 -- 172.21.15.72:0/1535384737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56346afce580 con 0x56346afcdc20 2024-04-26T12:52:03.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa106037640 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afcdc20 0x56346afce040 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80188c0 tx=0x7fa0f8018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7f9febfff640 1 -- 172.21.15.72:0/1535384737 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f80110d0 con 0x56346afcdc20 2024-04-26T12:52:03.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7f9febfff640 1 -- 172.21.15.72:0/1535384737 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f8011270 con 0x56346afcdc20 2024-04-26T12:52:03.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56346afcf020 con 0x56346afcdc20 2024-04-26T12:52:03.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7f9febfff640 1 -- 172.21.15.72:0/1535384737 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f8011570 con 0x56346afcdc20 2024-04-26T12:52:03.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.808+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56346afcf4f0 con 0x56346afcdc20 2024-04-26T12:52:03.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7f9febfff640 1 -- 172.21.15.72:0/1535384737 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0f803b030 con 0x56346afcdc20 2024-04-26T12:52:03.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7f9febfff640 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fe0034650 0x7f9fe0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7f9febfff640 1 -- 172.21.15.72:0/1535384737 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa0f803ed00 con 0x56346afcdc20 2024-04-26T12:52:03.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa105836640 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fe0034650 0x7f9fe0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 Processor -- start 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 -- start start 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa105836640 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fe0034650 0x7f9fe0036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01b0d0 tx=0x7fa0fc005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afdaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56346afa8f30 con 0x56346afdab70 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afdaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afdaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38126/0 (socket says 172.21.15.72:38126) 2024-04-26T12:52:03.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa106037640 1 -- 172.21.15.72:0/2921843543 learned_addr learned my addr 172.21.15.72:0/2921843543 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa106037640 1 -- 172.21.15.72:0/2921843543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56346afdb560 con 0x56346afdab70 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa106037640 1 --2- 172.21.15.72:0/2921843543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afdaf90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800e710 tx=0x7fa0f801e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988d059d42a5a00d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7f9fe9ffb640 1 -- 172.21.15.72:0/2921843543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f8049e40 con 0x56346afdab70 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7f9fe9ffb640 1 -- 172.21.15.72:0/2921843543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f805b020 con 0x56346afdab70 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7f9fe9ffb640 1 -- 172.21.15.72:0/2921843543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f8019c60 con 0x56346afdab70 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 -- 172.21.15.72:0/2921843543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 msgr2=0x56346afdaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 --2- 172.21.15.72:0/2921843543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afdaf90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800e710 tx=0x7fa0f801e410 comp rx=0 tx=0).stop 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 -- 172.21.15.72:0/2921843543 shutdown_connections 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 --2- 172.21.15.72:0/2921843543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afdaf90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 -- 172.21.15.72:0/2921843543 >> 172.21.15.72:0/2921843543 conn(0x56346afd6f00 msgr2=0x56346afd4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 -- 172.21.15.72:0/2921843543 shutdown_connections 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.812+0000 7fa10851c980 1 -- 172.21.15.72:0/2921843543 wait complete. 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 Processor -- start 2024-04-26T12:52:03.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 -- start start 2024-04-26T12:52:03.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afe1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56346afdbc50 con 0x56346afdab70 2024-04-26T12:52:03.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afe1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa106037640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afe1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38142/0 (socket says 172.21.15.72:38142) 2024-04-26T12:52:03.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 learned_addr learned my addr 172.21.15.72:0/859710465 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:03.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56346afe23d0 con 0x56346afdab70 2024-04-26T12:52:03.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa106037640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afe1e90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800efd0 tx=0x7fa0f801e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7f9fd7fff640 1 -- 172.21.15.72:0/859710465 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f805a070 con 0x56346afdab70 2024-04-26T12:52:03.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7f9fd7fff640 1 -- 172.21.15.72:0/859710465 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f8049e40 con 0x56346afdab70 2024-04-26T12:52:03.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56346afe23d0 con 0x56346afdab70 2024-04-26T12:52:03.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7f9fd7fff640 1 -- 172.21.15.72:0/859710465 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0f8042080 con 0x56346afdab70 2024-04-26T12:52:03.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56346afe23d0 con 0x56346afdab70 2024-04-26T12:52:03.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7f9fd7fff640 1 -- 172.21.15.72:0/859710465 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0f80470c0 con 0x56346afdab70 2024-04-26T12:52:03.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7f9fd7fff640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd0034650 0x7f9fd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7f9fd7fff640 1 -- 172.21.15.72:0/859710465 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa0f8069030 con 0x56346afdab70 2024-04-26T12:52:03.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa105836640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd0034650 0x7f9fd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346afecf60 0x56346afef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afefb70 con 0x56346afecf60 2024-04-26T12:52:03.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.816+0000 7fa106838640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346afecf60 0x56346afef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa105836640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd0034650 0x7f9fd0036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00a4e0 tx=0x7fa0fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106838640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346afecf60 0x56346afef420 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1000083f0 con 0x56346afecf60 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 realm 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afeff80 con 0x56346afecf60 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1000083f0 con 0x56346afecf60 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0850 con 0x56346afecf60 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1000083f0 con 0x56346afecf60 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346afecf60 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1000083f0 con 0x56346afecf60 2024-04-26T12:52:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:03.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346aff1950 0x56346aff3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346aff4300 con 0x56346aff1950 2024-04-26T12:52:03.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106037640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346aff1950 0x56346aff3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106037640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346aff1950 0x56346aff3d40 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 20 searching for the correct realm 2024-04-26T12:52:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346aff6250 0x56346aff8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff8d30 con 0x56346aff6250 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.820+0000 7fa105836640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346aff6250 0x56346aff8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa105836640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346aff6250 0x56346aff8660 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa105836640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0fc0dd040 0x7fa0fc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff8d30 con 0x7fa0fc0dd040 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0fc0dd040 0x7fa0fc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0fc0dd040 0x7fa0fc0ce940 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1000083f0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346aff1950 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346afecf60 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1000083f0 con 0x56346afecf60 2024-04-26T12:52:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346afecf60 2024-04-26T12:52:03.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346aff1950 2024-04-26T12:52:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346aff1950 2024-04-26T12:52:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.824+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346aff6250 2024-04-26T12:52:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346afecf60 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346afecf60 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff6250 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff6250 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff1950 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff6250 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff6250 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.828+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346afecf60 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346afecf60 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff1950 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff6250 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346afecf60 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff1950 2024-04-26T12:52:03.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff6250 2024-04-26T12:52:03.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.832+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff1950 2024-04-26T12:52:03.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff6250 2024-04-26T12:52:03.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346aff1950 2024-04-26T12:52:03.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x56346afecf60 2024-04-26T12:52:03.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa10002b040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346afecf60 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346afecf60 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346aff0bf0 con 0x56346aff6250 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 zone default found 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 4 Realm: () 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 zonegroup default 2024-04-26T12:52:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346aff5180 con 0x56346aff1950 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.836+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346affab90 con 0x56346aff6250 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346affaf30 con 0x56346aff6250 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 20 started sync module instance, tier type = 2024-04-26T12:52:03.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:03.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affa030 con 0x7fa0fc0dd040 2024-04-26T12:52:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94783133426992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affa030 con 0x7fa0fc0dd040 2024-04-26T12:52:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affb8f0 con 0x56346afecf60 2024-04-26T12:52:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94783133426992] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.840+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94783133424816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affb8f0 con 0x56346afecf60 2024-04-26T12:52:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affc2b0 con 0x56346aff6250 2024-04-26T12:52:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94783133424816] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94783133430848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affb860 con 0x56346aff6250 2024-04-26T12:52:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affcfb0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94783133436944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affd850 con 0x7fa0fc0dd040 2024-04-26T12:52:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.844+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affe210 con 0x56346afecf60 2024-04-26T12:52:03.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.848+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94783133430848] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.848+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94783133436944] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.848+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.848+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94783133441376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affd7a0 con 0x56346afecf60 2024-04-26T12:52:03.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.848+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affe180 con 0x56346aff1950 2024-04-26T12:52:03.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.848+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94783133441376] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.852+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.852+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94783133438704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affeae0 con 0x56346aff1950 2024-04-26T12:52:03.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.852+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346afff330 con 0x56346aff1950 2024-04-26T12:52:03.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.852+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94783133438704] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.852+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.852+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94783133443632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346afffb80 con 0x56346aff1950 2024-04-26T12:52:03.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.852+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b000410 con 0x56346aff1950 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94783133449088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affffe0 con 0x56346aff1950 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=0 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=1 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=2 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=3 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=4 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=5 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94783133443632] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=6 2024-04-26T12:52:03.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94783133449088] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 20 add_watcher() i=7 2024-04-26T12:52:03.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:03.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346afff6d0 con 0x56346afecf60 2024-04-26T12:52:03.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.856+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94783133447888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b000e20 con 0x56346afecf60 2024-04-26T12:52:03.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.860+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94783133447888] v35'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.860+0000 7f9fbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:03.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.860+0000 7fa10851c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:03.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.860+0000 7fa10851c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:03.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.860+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00c3a0 con 0x56346afecf60 2024-04-26T12:52:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.860+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.860+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00ca70 con 0x56346aff1950 2024-04-26T12:52:03.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.864+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.864+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00ca70 con 0x56346aff6250 2024-04-26T12:52:03.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.864+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.864+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00d530 con 0x56346afecf60 2024-04-26T12:52:03.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.864+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'233 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.864+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b008010 con 0x7fa0fc0dd040 2024-04-26T12:52:03.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.868+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'77 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.868+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b008010 con 0x56346aff6250 2024-04-26T12:52:03.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.868+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.868+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e260 con 0x56346afecf60 2024-04-26T12:52:03.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.872+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.872+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e260 con 0x56346aff1950 2024-04-26T12:52:03.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.872+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.872+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e260 con 0x7fa0fc0dd040 2024-04-26T12:52:03.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.876+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.876+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e260 con 0x56346aff6250 2024-04-26T12:52:03.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.876+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.876+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e710 con 0x7fa0fc0dd040 2024-04-26T12:52:03.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.876+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'78 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.876+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e710 con 0x56346aff1950 2024-04-26T12:52:03.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.880+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.880+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.880+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.880+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff1950 2024-04-26T12:52:03.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.884+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.884+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346afecf60 2024-04-26T12:52:03.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.884+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'234 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.884+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.888+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'69 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.888+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.888+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'79 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.888+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.892+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.892+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346afecf60 2024-04-26T12:52:03.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.892+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.892+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346afecf60 2024-04-26T12:52:03.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.896+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'235 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.896+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.896+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'70 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.896+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.896+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.900+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.900+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.900+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.900+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.900+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.904+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.904+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.904+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.904+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff1950 2024-04-26T12:52:03.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.908+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.908+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.908+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.908+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff1950 2024-04-26T12:52:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.908+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.908+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff6250 2024-04-26T12:52:03.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.912+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'71 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.912+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x56346aff1950 2024-04-26T12:52:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00e7a0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7f9f377fe640 20 reqs_thread_entry: start 2024-04-26T12:52:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 20 Filter name: none 2024-04-26T12:52:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:52:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7f9f357fa640 20 reqs_thread_entry: start 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b007520 con 0x56346afecf60 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.916+0000 7fa10851c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0074e0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv55 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 : miss 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:96 8.15 8:adf1ff52:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b02c370 con 0x56346aff6250 2024-04-26T12:52:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(96 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 info.flags=0x17 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 to cache LRU end 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:97 4.29 4:94bb04eb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a10 con 0x56346aff6250 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(97 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:98 4.2f 4:f4738c93:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a10 con 0x56346afecf60 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(98 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:99 4.17 4:eae362f9:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a10 con 0x56346aff1950 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(99 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:100 4.3 4:c2c00eba:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a10 con 0x56346afecf60 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(100 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.920+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:101 4.3f 4:ffa80e0b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a50 con 0x7fa0fc0dd040 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(101 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:102 4.f 4:f381f605:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a50 con 0x56346afecf60 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(102 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 4.28 4:155b0ccc:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a50 con 0x56346afecf60 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(103 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:104 4.3a 4:5da6f0b5:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a50 con 0x56346aff6250 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(104 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 4.38 4:1ea8a16a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a50 con 0x56346afecf60 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(105 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:106 4.5 4:a08935e4:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a10 con 0x56346aff6250 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(106 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:107 4.6 4:625fec56:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a9a10 con 0x56346aff6250 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(107 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 20 get_obj_state: octx=0x7fa100008c90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x56346b0a7ab8 s->prefetch_data=0 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:108 3.39s0 3:9e8386e8:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a88e0 con 0x56346aff6250 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(108 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 10 manifest: total_size = 6 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 20 get_obj_state: setting s->obj_tag to fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7217473608189485034 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 20 get_obj_state: octx=0x7fa100008c90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x56346b0a7ab8 s->prefetch_data=0 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 20 prepare_atomic_modification: state is not atomic. state=0x56346b0a7ab8 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 20 bucket index object: :.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4 2024-04-26T12:52:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.924+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:109 4.3f 4:ffa80e0b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a93f0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(109 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4 [stat,call,call] v35'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:110 3.39s0 3:9e8386e8:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b0a93f0 con 0x56346aff6250 2024-04-26T12:52:03.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(110 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7_15f6f8dc036519d7fe15b39338f6e5db [call] v35'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:111 4.3f 4:ffa80e0b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b031100 con 0x7fa0fc0dd040 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 20 list_objects_ordered: starting attempt 1 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:112 4.29 4:94bb04eb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b032a80 con 0x56346aff6250 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:113 4.2f 4:f4738c93:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b035380 con 0x56346afecf60 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:114 4.17 4:eae362f9:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b032a80 con 0x56346aff1950 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:115 4.3 4:c2c00eba:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b035380 con 0x56346afecf60 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:116 4.3f 4:ffa80e0b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b03c680 con 0x7fa0fc0dd040 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:117 4.f 4:f381f605:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b03f190 con 0x56346afecf60 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:118 4.28 4:155b0ccc:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041ff0 con 0x56346afecf60 2024-04-26T12:52:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.928+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:119 4.3a 4:5da6f0b5:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b044e70 con 0x56346aff6250 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(113 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(114 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(115 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:120 4.38 4:1ea8a16a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b044e70 con 0x56346afecf60 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(112 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(118 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(117 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:121 4.5 4:a08935e4:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b044e70 con 0x56346aff6250 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:122 4.6 4:625fec56:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041ff0 con 0x56346aff6250 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(119 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(120 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(121 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(122 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(111 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4 [stat,call,call] v35'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7f9fe9ffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(116 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4 [call out=124b] v0'0 uv15 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7])"; uploads.size()=0; is_truncated=0 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:123 4.29 4:94bb04eb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041ff0 con 0x56346aff6250 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:124 4.2f 4:f4738c93:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b03f190 con 0x56346afecf60 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:125 4.17 4:eae362f9:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b044820 con 0x56346aff1950 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:126 4.3 4:c2c00eba:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041ff0 con 0x56346afecf60 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:127 4.3f 4:ffa80e0b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b044c90 con 0x7fa0fc0dd040 2024-04-26T12:52:03.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:128 4.f 4:f381f605:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b03f190 con 0x56346afecf60 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:129 4.28 4:155b0ccc:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b044820 con 0x56346afecf60 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:130 4.3a 4:5da6f0b5:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b044c90 con 0x56346aff6250 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:131 4.38 4:1ea8a16a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041ff0 con 0x56346afecf60 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:132 4.5 4:a08935e4:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b03c4d0 con 0x56346aff6250 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:133 4.6 4:625fec56:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b049af0 con 0x56346aff6250 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(123 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(124 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(126 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(127 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4 [call out=124b] v0'0 uv15 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 40 ==== osd_op_reply(128 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== osd_op_reply(132 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(125 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 40 ==== osd_op_reply(130 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 41 ==== osd_op_reply(133 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 41 ==== osd_op_reply(129 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 42 ==== osd_op_reply(131 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.932+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(134 foo.buckets [call] v35'58 uv58 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv52 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:52:03.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(136 myfoo [call,call,delete] v35'59 uv59 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.936+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94783133708624 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x56346aff1950 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== watch-notify(notify (1) cookie 94783133443632 notify 150323855401 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56346b007d30 con 0x56346aff1950 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(137 notify.6 [notify cookie 94783133708624 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7f9fe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855401 cookie 94783133443632 notifier 4790 bl.length()=149 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7f9fe97fa640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9f3c003330 con 0x56346aff1950 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== watch-notify(notify_complete (2) cookie 94783133708624 notify 150323855401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56346afce580 con 0x56346aff1950 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:139 8.15 8:adf1ff52:root::.bucket.meta.myfoo%3afe657080-460c-4bb9-93cf-69170ee92cfa.4237.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x56346aff6250 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 42 ==== osd_op_reply(139 .bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa10851c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 from cache 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa10851c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7, ofs0, ns] 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94783133708624 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x56346aff1950 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== watch-notify(notify (1) cookie 94783133438704 notify 150323855402 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56346afce580 con 0x56346aff1950 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7f9fe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855402 cookie 94783133438704 notifier 4790 bl.length()=206 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== osd_op_reply(140 notify.5 [notify cookie 94783133708624 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.940+0000 7f9fe97fa640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9f3c003330 con 0x56346aff1950 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== watch-notify(notify_complete (2) cookie 94783133708624 notify 150323855402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56346afb2cd0 con 0x56346aff1950 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:142 4.29 4:94bb04eb:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x56346aff6250 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:143 4.2f 4:f4738c93:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b044640 con 0x56346afecf60 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:144 4.17 4:eae362f9:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b031050 con 0x56346aff1950 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:145 4.3 4:c2c00eba:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b03c330 con 0x56346afecf60 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:146 4.3f 4:ffa80e0b:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041fb0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:147 4.f 4:f381f605:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b03fff0 con 0x56346afecf60 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:148 4.28 4:155b0ccc:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b031050 con 0x56346afecf60 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:149 4.3a 4:5da6f0b5:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b03c330 con 0x56346aff6250 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:150 4.38 4:1ea8a16a:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b03fff0 con 0x56346afecf60 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:151 4.5 4:a08935e4:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b031a70 con 0x56346aff6250 2024-04-26T12:52:03.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:152 4.6 4:625fec56:::.dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b031050 con 0x56346aff6250 2024-04-26T12:52:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 43 ==== osd_op_reply(142 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.0 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.944+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 43 ==== osd_op_reply(143 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.1 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 44 ==== osd_op_reply(145 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.3 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(144 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.2 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0f802e070 con 0x56346aff1950 2024-04-26T12:52:03.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 44 ==== osd_op_reply(152 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.10 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 45 ==== osd_op_reply(150 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.8 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 46 ==== osd_op_reply(147 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.5 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 47 ==== osd_op_reply(148 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.6 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 45 ==== osd_op_reply(151 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.9 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 46 ==== osd_op_reply(149 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.7 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(146 .dir.fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7.4 [delete] v35'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa10851c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 : miss 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa10851c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:153 6.16 6:6c586f0c:::pubsub..bucket.myfoo%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b03c330 con 0x56346aff6250 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa10851c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa10851c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 info.flags=0x0 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa10851c980 10 adding default.rgw.log++pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 to cache LRU end 2024-04-26T12:52:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.948+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:154 6.16 6:6c586f0c:::pubsub..bucket.myfoo%2ffe657080-460c-4bb9-93cf-69170ee92cfa.4237.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041f60 con 0x56346aff6250 2024-04-26T12:52:03.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.952+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 48 ==== osd_op_reply(154 pubsub..bucket.myfoo/fe657080-460c-4bb9-93cf-69170ee92cfa.4237.7 [delete] v35'29 uv21 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.952+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041f60 con 0x7fa0fc0dd040 2024-04-26T12:52:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.952+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(155 foo.buckets [call] v35'60 uv60 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.952+0000 7fa10851c980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-26T12:52:03.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.952+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041f60 con 0x56346aff1950 2024-04-26T12:52:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v35'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa0f809f040 con 0x56346aff1950 2024-04-26T12:52:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa10851c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-26T12:52:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94783133720416 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b040160 con 0x7fa0fc0dd040 2024-04-26T12:52:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== watch-notify(notify (1) cookie 94783133436944 notify 150323855389 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56346b00c360 con 0x7fa0fc0dd040 2024-04-26T12:52:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7f9fe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855389 cookie 94783133436944 notifier 4790 bl.length()=170 2024-04-26T12:52:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(157 notify.3 [notify cookie 94783133720416 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7f9fe97fa640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9f3c003330 con 0x7fa0fc0dd040 2024-04-26T12:52:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== watch-notify(notify_complete (2) cookie 94783133720416 notify 150323855389 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56346b007990 con 0x7fa0fc0dd040 2024-04-26T12:52:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa10851c980 10 removing email index: foo@foo.com 2024-04-26T12:52:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.956+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041f60 con 0x56346afecf60 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 48 ==== osd_op_reply(159 foo@foo.com [delete] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa10851c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94783133720416 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b040160 con 0x7fa0fc0dd040 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== watch-notify(notify (1) cookie 94783133436944 notify 150323855390 ret 0) ==== 204+0+0 (crc 0 0 0) 0x56346b007990 con 0x7fa0fc0dd040 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7f9fe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855390 cookie 94783133436944 notifier 4790 bl.length()=162 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== osd_op_reply(160 notify.3 [notify cookie 94783133720416 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7f9fe97fa640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9f3c0032d0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== watch-notify(notify_complete (2) cookie 94783133720416 notify 150323855390 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56346b00bed0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa10851c980 10 removing user buckets index 2024-04-26T12:52:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041f60 con 0x7fa0fc0dd040 2024-04-26T12:52:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== osd_op_reply(162 foo.buckets [delete] v35'61 uv61 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa100026040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa10851c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-26T12:52:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.960+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94783133720416 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b040160 con 0x56346aff1950 2024-04-26T12:52:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== watch-notify(notify (1) cookie 94783133438704 notify 150323855403 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56346afb2cd0 con 0x56346aff1950 2024-04-26T12:52:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7f9fe9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855403 cookie 94783133438704 notifier 4790 bl.length()=160 2024-04-26T12:52:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(163 notify.5 [notify cookie 94783133720416 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0f809f040 con 0x56346aff1950 2024-04-26T12:52:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7f9fe9ffb640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9fcc003d70 con 0x56346aff1950 2024-04-26T12:52:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== watch-notify(notify_complete (2) cookie 94783133720416 notify 150323855403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56346afb0090 con 0x56346aff1950 2024-04-26T12:52:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f809f040 con 0x56346aff1950 2024-04-26T12:52:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa10851c980 10 removing user index: foo 2024-04-26T12:52:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b041f60 con 0x56346afecf60 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 49 ==== osd_op_reply(165 foo [call,call,delete] v35'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa10851c980 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa10851c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94783133720416 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56346b030ba0 con 0x56346afecf60 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 50 ==== watch-notify(notify (1) cookie 94783133441376 notify 150323855382 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56346b00bed0 con 0x56346afecf60 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7f9fe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855382 cookie 94783133441376 notifier 4790 bl.length()=152 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7f9fe97fa640 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9f3c0032d0 con 0x56346afecf60 2024-04-26T12:52:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 51 ==== osd_op_reply(166 notify.4 [notify cookie 94783133720416 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 52 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100026040 con 0x56346afecf60 2024-04-26T12:52:03.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.964+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 53 ==== watch-notify(notify_complete (2) cookie 94783133720416 notify 150323855382 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56346b00bd00 con 0x56346afecf60 2024-04-26T12:52:03.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.968+0000 7f9fbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:03.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.968+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94783133447888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00a6b0 con 0x56346afecf60 2024-04-26T12:52:03.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.968+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 54 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94783133447888] v35'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa100064040 con 0x56346afecf60 2024-04-26T12:52:03.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.968+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94783133426992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00a6b0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.972+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94783133426992] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100064040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.972+0000 7fa10851c980 20 remove_watcher() i=0 2024-04-26T12:52:03.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.972+0000 7fa10851c980 2 removed watcher, disabling cache 2024-04-26T12:52:03.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.972+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94783133424816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00a6b0 con 0x56346afecf60 2024-04-26T12:52:03.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.972+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 55 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94783133424816] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100064040 con 0x56346afecf60 2024-04-26T12:52:03.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.972+0000 7fa10851c980 20 remove_watcher() i=1 2024-04-26T12:52:03.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.972+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94783133430848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00a6b0 con 0x56346aff6250 2024-04-26T12:52:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.976+0000 7fa105836640 1 -- 172.21.15.72:0/859710465 <== osd.3 v2:172.21.15.72:6808/671626845 49 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94783133430848] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0fc0cb070 con 0x56346aff6250 2024-04-26T12:52:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.976+0000 7fa10851c980 20 remove_watcher() i=2 2024-04-26T12:52:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.976+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94783133436944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00a6b0 con 0x7fa0fc0dd040 2024-04-26T12:52:03.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.976+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94783133436944] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100064040 con 0x7fa0fc0dd040 2024-04-26T12:52:03.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.976+0000 7fa10851c980 20 remove_watcher() i=3 2024-04-26T12:52:03.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.976+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94783133441376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00a6b0 con 0x56346afecf60 2024-04-26T12:52:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.980+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 <== osd.1 v2:172.21.15.72:6816/1811201389 56 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94783133441376] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa100064040 con 0x56346afecf60 2024-04-26T12:52:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.980+0000 7fa10851c980 20 remove_watcher() i=4 2024-04-26T12:52:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.980+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94783133438704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affdd60 con 0x56346aff1950 2024-04-26T12:52:03.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.980+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94783133438704] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f809f040 con 0x56346aff1950 2024-04-26T12:52:03.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.980+0000 7fa10851c980 20 remove_watcher() i=5 2024-04-26T12:52:03.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.980+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94783133443632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346b00a6b0 con 0x56346aff1950 2024-04-26T12:52:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94783133443632] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f809f040 con 0x56346aff1950 2024-04-26T12:52:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 20 remove_watcher() i=6 2024-04-26T12:52:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94783133449088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56346affdd60 con 0x56346aff1950 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa106037640 1 -- 172.21.15.72:0/859710465 <== osd.0 v2:172.21.15.29:6800/1895601642 43 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94783133449088] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0f809f040 con 0x56346aff1950 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 20 remove_watcher() i=7 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346aff1950 msgr2=0x56346aff3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346aff1950 0x56346aff3d40 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346afecf60 msgr2=0x56346afef420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346afecf60 0x56346afef420 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0fc0dd040 msgr2=0x7fa0fc0ce940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0fc0dd040 0x7fa0fc0ce940 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346aff6250 msgr2=0x56346aff8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346aff6250 0x56346aff8660 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd0034650 msgr2=0x7f9fd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd0034650 0x7f9fd0036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00a4e0 tx=0x7fa0fc0a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 msgr2=0x56346afe1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/859710465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afdab70 0x56346afe1e90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800efd0 tx=0x7fa0f801e4c0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa106838640 1 -- 172.21.15.72:0/859710465 reap_dead start 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 shutdown_connections 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 >> 172.21.15.72:0/859710465 conn(0x56346afd6f00 msgr2=0x56346afd4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 shutdown_connections 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/859710465 wait complete. 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fe0034650 msgr2=0x7f9fe0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fe0034650 0x7f9fe0036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01b0d0 tx=0x7fa0fc005e50 comp rx=0 tx=0).stop 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afcdc20 msgr2=0x56346afce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.984+0000 7fa10851c980 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afcdc20 0x56346afce040 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80188c0 tx=0x7fa0f8018d50 comp rx=0 tx=0).stop 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 shutdown_connections 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fe0034650 0x7f9fe0036b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 --2- 172.21.15.72:0/1535384737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346afcdc20 0x56346afce040 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 >> 172.21.15.72:0/1535384737 conn(0x56346afc2a30 msgr2=0x56346afc3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 shutdown_connections 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/1535384737 wait complete. 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346afb9200 msgr2=0x56346afbb5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56346afb9200 0x56346afbb5f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346aec1a00 msgr2=0x56346afb6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56346aec1a00 0x56346afb6920 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346afbd120 msgr2=0x56346afbf510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56346afbd120 0x56346afbf510 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fec0346a0 msgr2=0x7f9fec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fec0346a0 0x7f9fec036b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0ab000 tx=0x7fa0fc0a5000 comp rx=0 tx=0).stop 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 msgr2=0x56346afaf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 --2- 172.21.15.72:0/3182543463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56346aebd4f0 0x56346afaf8c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800f720 tx=0x7fa0f8000ee0 comp rx=0 tx=0).stop 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa106838640 1 -- 172.21.15.72:0/3182543463 reap_dead start 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 shutdown_connections 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 >> 172.21.15.72:0/3182543463 conn(0x56346ae30bd0 msgr2=0x56346afa2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 shutdown_connections 2024-04-26T12:52:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:03.988+0000 7fa10851c980 1 -- 172.21.15.72:0/3182543463 wait complete. 2024-04-26T12:52:04.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:52:04.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:52:04.001 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:52:04.076 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:04.076 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:04.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8047d38980 1 Processor -- start 2024-04-26T12:52:04.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8047d38980 1 -- start start 2024-04-26T12:52:04.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8047d38980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d43558f4e0 0x55d43558f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8047d38980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d43543a510 con 0x55d43558fe00 2024-04-26T12:52:04.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8047d38980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55d435441430 con 0x55d43558f4e0 2024-04-26T12:52:04.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8045853640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d43558f4e0 0x55d43558f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8045853640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d43558f4e0 0x55d43558f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38152/0 (socket says 172.21.15.72:38152) 2024-04-26T12:52:04.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8045853640 1 -- 172.21.15.72:0/3112644121 learned_addr learned my addr 172.21.15.72:0/3112644121 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8045052640 1 --1- 172.21.15.72:0/3112644121 >> v1:172.21.15.29:6789/0 conn(0x55d43558fe00 0x55d4355907c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48694/0 (socket says 172.21.15.72:48694) 2024-04-26T12:52:04.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8045853640 1 -- 172.21.15.72:0/3112644121 >> v1:172.21.15.29:6789/0 conn(0x55d43558fe00 legacy=0x55d4355907c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.076+0000 7f8045853640 1 -- 172.21.15.72:0/3112644121 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d435416ae0 con 0x55d43558f4e0 2024-04-26T12:52:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8045853640 1 --2- 172.21.15.72:0/3112644121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43558f8c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f803800a4e0 tx=0x7f803801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7c5cdd5d7af1b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8044851640 1 -- 172.21.15.72:0/3112644121 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380aa540 con 0x55d43558f4e0 2024-04-26T12:52:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8044851640 1 -- 172.21.15.72:0/3112644121 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80380aa6e0 con 0x55d43558f4e0 2024-04-26T12:52:04.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8044851640 1 -- 172.21.15.72:0/3112644121 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380aaa40 con 0x55d43558f4e0 2024-04-26T12:52:04.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8047d38980 1 -- 172.21.15.72:0/3112644121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 msgr2=0x55d43558f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8047d38980 1 --2- 172.21.15.72:0/3112644121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43558f8c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f803800a4e0 tx=0x7f803801b090 comp rx=0 tx=0).stop 2024-04-26T12:52:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8047d38980 1 -- 172.21.15.72:0/3112644121 shutdown_connections 2024-04-26T12:52:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8047d38980 1 --2- 172.21.15.72:0/3112644121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43558f8c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8047d38980 1 -- 172.21.15.72:0/3112644121 >> 172.21.15.72:0/3112644121 conn(0x55d435502bc0 msgr2=0x55d435502fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8047d38980 1 -- 172.21.15.72:0/3112644121 shutdown_connections 2024-04-26T12:52:04.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.080+0000 7f8047d38980 1 -- 172.21.15.72:0/3112644121 wait complete. 2024-04-26T12:52:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8047d38980 1 Processor -- start 2024-04-26T12:52:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8047d38980 1 -- start start 2024-04-26T12:52:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8047d38980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43567ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8047d38980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d435490a70 con 0x55d43558f4e0 2024-04-26T12:52:04.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43567ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43567ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38154/0 (socket says 172.21.15.72:38154) 2024-04-26T12:52:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8045853640 1 -- 172.21.15.72:0/3852796261 learned_addr learned my addr 172.21.15.72:0/3852796261 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8045853640 1 -- 172.21.15.72:0/3852796261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d43567b310 con 0x55d43558f4e0 2024-04-26T12:52:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.096+0000 7f8045853640 1 --2- 172.21.15.72:0/3852796261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43567ad40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8038017ca0 tx=0x7f80380033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8125d01fb1be55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f7f33e07640 1 -- 172.21.15.72:0/3852796261 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380b9070 con 0x55d43558f4e0 2024-04-26T12:52:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f7f33e07640 1 -- 172.21.15.72:0/3852796261 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80380aaa80 con 0x55d43558f4e0 2024-04-26T12:52:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f7f33e07640 1 -- 172.21.15.72:0/3852796261 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380aad60 con 0x55d43558f4e0 2024-04-26T12:52:04.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- 172.21.15.72:0/3852796261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 msgr2=0x55d43567ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 --2- 172.21.15.72:0/3852796261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43567ad40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8038017ca0 tx=0x7f80380033b0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- 172.21.15.72:0/3852796261 shutdown_connections 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 --2- 172.21.15.72:0/3852796261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d43567ad40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- 172.21.15.72:0/3852796261 >> 172.21.15.72:0/3852796261 conn(0x55d435502bc0 msgr2=0x55d4356768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- 172.21.15.72:0/3852796261 shutdown_connections 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- 172.21.15.72:0/3852796261 wait complete. 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 Processor -- start 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- start start 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d435681e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d435599530 con 0x55d43558f4e0 2024-04-26T12:52:04.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d435681e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d435681e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38156/0 (socket says 172.21.15.72:38156) 2024-04-26T12:52:04.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8045853640 1 -- 172.21.15.72:0/1474469103 learned_addr learned my addr 172.21.15.72:0/1474469103 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8045853640 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4356823a0 con 0x55d43558f4e0 2024-04-26T12:52:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8045853640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d435681e60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8038017ca0 tx=0x7f8038017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f7f32604640 1 -- 172.21.15.72:0/1474469103 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380b9070 con 0x55d43558f4e0 2024-04-26T12:52:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f7f32604640 1 -- 172.21.15.72:0/1474469103 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80380c7410 con 0x55d43558f4e0 2024-04-26T12:52:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d435682630 con 0x55d43558f4e0 2024-04-26T12:52:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f7f32604640 1 -- 172.21.15.72:0/1474469103 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380c7730 con 0x55d43558f4e0 2024-04-26T12:52:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.100+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d435685240 con 0x55d43558f4e0 2024-04-26T12:52:04.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f7f32604640 1 -- 172.21.15.72:0/1474469103 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80380b3040 con 0x55d43558f4e0 2024-04-26T12:52:04.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f7f32604640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f2c0346a0 0x7f7f2c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f7f32604640 1 -- 172.21.15.72:0/1474469103 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f80380c4070 con 0x55d43558f4e0 2024-04-26T12:52:04.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8045052640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f2c0346a0 0x7f7f2c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d43558fe00 0x55d435688d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356893d0 con 0x55d43558fe00 2024-04-26T12:52:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8046054640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d43558fe00 0x55d435688d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8045052640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f2c0346a0 0x7f7f2c036b60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f803c000f70 tx=0x7f803c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8046054640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d43558fe00 0x55d435688d60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8046054640 1 -- 172.21.15.72:0/1474469103 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80400083f0 con 0x55d43558fe00 2024-04-26T12:52:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d435686460 con 0x55d43558fe00 2024-04-26T12:52:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8046054640 1 -- 172.21.15.72:0/1474469103 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80400083f0 con 0x55d43558fe00 2024-04-26T12:52:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d43568b720 0x55d43568db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d43568e1e0 con 0x55d43568b720 2024-04-26T12:52:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8045853640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d43568b720 0x55d43568db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.104+0000 7f8045853640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d43568b720 0x55d43568db10 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045853640 1 -- 172.21.15.72:0/1474469103 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f80380cd060 con 0x55d43568b720 2024-04-26T12:52:04.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d43568a590 con 0x55d43558fe00 2024-04-26T12:52:04.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8046054640 1 -- 172.21.15.72:0/1474469103 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80400083f0 con 0x55d43558fe00 2024-04-26T12:52:04.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d43568f620 0x55d435691a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d435692180 con 0x55d43568f620 2024-04-26T12:52:04.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045052640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d43568f620 0x55d435691a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045052640 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d43568f620 0x55d435691a10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045052640 1 -- 172.21.15.72:0/1474469103 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f803c00f6a0 con 0x55d43568f620 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8047d38980 1 Processor -- start 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8047d38980 1 -- start start 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8047d38980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356a01b0 0x55d4356a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8047d38980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d435494ab0 con 0x55d4356a01b0 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356a01b0 0x55d4356a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356a01b0 0x55d4356a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38168/0 (socket says 172.21.15.72:38168) 2024-04-26T12:52:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045853640 1 -- 172.21.15.72:0/1800640854 learned_addr learned my addr 172.21.15.72:0/1800640854 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045853640 1 -- 172.21.15.72:0/1800640854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4356a0b10 con 0x55d4356a01b0 2024-04-26T12:52:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.108+0000 7f8045853640 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356a01b0 0x55d4356a05d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f80380e2e10 tx=0x7f80380c6820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f7f2b7fe640 1 -- 172.21.15.72:0/1800640854 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380b3970 con 0x55d4356a01b0 2024-04-26T12:52:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f7f2b7fe640 1 -- 172.21.15.72:0/1800640854 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80380b3b10 con 0x55d4356a01b0 2024-04-26T12:52:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f7f2b7fe640 1 -- 172.21.15.72:0/1800640854 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380c79a0 con 0x55d4356a01b0 2024-04-26T12:52:04.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4356a15b0 con 0x55d4356a01b0 2024-04-26T12:52:04.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4356a1a80 con 0x55d4356a01b0 2024-04-26T12:52:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f7f2b7fe640 1 -- 172.21.15.72:0/1800640854 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80380eb060 con 0x55d4356a01b0 2024-04-26T12:52:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f7f2b7fe640 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f200346a0 0x7f7f20036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f7f2b7fe640 1 -- 172.21.15.72:0/1800640854 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f80380df030 con 0x55d4356a01b0 2024-04-26T12:52:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8045052640 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f200346a0 0x7f7f20036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8047d38980 1 Processor -- start 2024-04-26T12:52:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8047d38980 1 -- start start 2024-04-26T12:52:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8045052640 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f200346a0 0x7f7f20036b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55d435692560 tx=0x7f803c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8047d38980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8047d38980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d43567b5a0 con 0x55d4356ad180 2024-04-26T12:52:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38178/0 (socket says 172.21.15.72:38178) 2024-04-26T12:52:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.112+0000 7f8045853640 1 -- 172.21.15.72:0/2336798430 learned_addr learned my addr 172.21.15.72:0/2336798430 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8045853640 1 -- 172.21.15.72:0/2336798430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4356adb50 con 0x55d4356ad180 2024-04-26T12:52:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8045853640 1 --2- 172.21.15.72:0/2336798430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356ad580 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f80380c6a50 tx=0x7f80380e4130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23cdf086bbd3a19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f7f297fa640 1 -- 172.21.15.72:0/2336798430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380bd920 con 0x55d4356ad180 2024-04-26T12:52:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f7f297fa640 1 -- 172.21.15.72:0/2336798430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80380bd400 con 0x55d4356ad180 2024-04-26T12:52:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f7f297fa640 1 -- 172.21.15.72:0/2336798430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380e4820 con 0x55d4356ad180 2024-04-26T12:52:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- 172.21.15.72:0/2336798430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 msgr2=0x55d4356ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 --2- 172.21.15.72:0/2336798430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356ad580 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f80380c6a50 tx=0x7f80380e4130 comp rx=0 tx=0).stop 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- 172.21.15.72:0/2336798430 shutdown_connections 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 --2- 172.21.15.72:0/2336798430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356ad580 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- 172.21.15.72:0/2336798430 >> 172.21.15.72:0/2336798430 conn(0x55d4356a9510 msgr2=0x55d4356a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- 172.21.15.72:0/2336798430 shutdown_connections 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- 172.21.15.72:0/2336798430 wait complete. 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 Processor -- start 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- start start 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d4356ae100 con 0x55d4356ad180 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8045853640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38190/0 (socket says 172.21.15.72:38190) 2024-04-26T12:52:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 learned_addr learned my addr 172.21.15.72:0/2300740679 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4356b49b0 con 0x55d4356ad180 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8045853640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356b4470 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f80380d8140 tx=0x7f80380d8070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f7f177fe640 1 -- 172.21.15.72:0/2300740679 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380e4820 con 0x55d4356ad180 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4356b49b0 con 0x55d4356ad180 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4356b49b0 con 0x55d4356ad180 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f7f177fe640 1 -- 172.21.15.72:0/2300740679 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80380e49c0 con 0x55d4356ad180 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.116+0000 7f7f177fe640 1 -- 172.21.15.72:0/2300740679 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380c7c70 con 0x55d4356ad180 2024-04-26T12:52:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f7f177fe640 1 -- 172.21.15.72:0/2300740679 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80380fe040 con 0x55d4356ad180 2024-04-26T12:52:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f7f177fe640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f10034650 0x7f7f10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f7f177fe640 1 -- 172.21.15.72:0/2300740679 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f80380fc020 con 0x55d4356ad180 2024-04-26T12:52:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8045052640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f10034650 0x7f7f10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d4356bf5a0 0x55d4356c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c21b0 con 0x55d4356bf5a0 2024-04-26T12:52:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8046054640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d4356bf5a0 0x55d4356c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8045052640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f10034650 0x7f7f10036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c010 tx=0x7f803c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8046054640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d4356bf5a0 0x55d4356c1a60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80400083f0 con 0x55d4356bf5a0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 realm 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c25c0 con 0x55d4356bf5a0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80400083f0 con 0x55d4356bf5a0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c2e60 con 0x55d4356bf5a0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80400083f0 con 0x55d4356bf5a0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c3200 con 0x55d4356bf5a0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80400083f0 con 0x55d4356bf5a0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d4356c3f60 0x55d4356c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c68d0 con 0x55d4356c3f60 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.120+0000 7f8045853640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d4356c3f60 0x55d4356c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045853640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d4356c3f60 0x55d4356c6350 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8047d38980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8047d38980 20 searching for the correct realm 2024-04-26T12:52:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d4356c87b0 0x55d4356cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cb340 con 0x55d4356c87b0 2024-04-26T12:52:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045052640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d4356c87b0 0x55d4356cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045052640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d4356c87b0 0x55d4356cac70 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045052640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f803c01fbe0 0x7f803c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cb340 con 0x7f803c01fbe0 2024-04-26T12:52:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8046054640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f803c01fbe0 0x7f803c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8046054640 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f803c01fbe0 0x7f803c03a3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80400083f0 con 0x7f803c01fbe0 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c3200 con 0x55d4356c3f60 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c3200 con 0x55d4356bf5a0 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80400083f0 con 0x55d4356bf5a0 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.124+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c3200 con 0x55d4356bf5a0 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c3200 con 0x55d4356c3f60 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f8038122040 con 0x55d4356c3f60 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f8038122040 con 0x7f803c01fbe0 2024-04-26T12:52:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f8038122040 con 0x55d4356c87b0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f8038122040 con 0x55d4356bf5a0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f8038122040 con 0x7f803c01fbe0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356bf5a0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x7f803c01fbe0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c87b0 2024-04-26T12:52:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.128+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c87b0 2024-04-26T12:52:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c3f60 2024-04-26T12:52:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c87b0 2024-04-26T12:52:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c87b0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356bf5a0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356bf5a0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c3f60 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c87b0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x7f803c01fbe0 2024-04-26T12:52:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356bf5a0 2024-04-26T12:52:04.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.132+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c3f60 2024-04-26T12:52:04.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c87b0 2024-04-26T12:52:04.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c3f60 2024-04-26T12:52:04.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x7f803c01fbe0 2024-04-26T12:52:04.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c87b0 2024-04-26T12:52:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356c3f60 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x55d4356bf5a0 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f804002b040 con 0x7f803c01fbe0 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.136+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c7120 con 0x55d4356bf5a0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c7120 con 0x55d4356bf5a0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c7120 con 0x55d4356c87b0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 zone default found 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 4 Realm: () 2024-04-26T12:52:04.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 zonegroup default 2024-04-26T12:52:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356c79c0 con 0x55d4356c3f60 2024-04-26T12:52:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cd1f0 con 0x55d4356c87b0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cd590 con 0x55d4356c87b0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 started sync module instance, tier type = 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc690 con 0x7f803c01fbe0 2024-04-26T12:52:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94369917750192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc690 con 0x7f803c01fbe0 2024-04-26T12:52:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.140+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356ce020 con 0x55d4356bf5a0 2024-04-26T12:52:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.144+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94369917750192] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.144+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.144+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94369917754096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc690 con 0x55d4356bf5a0 2024-04-26T12:52:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.144+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cea30 con 0x55d4356c87b0 2024-04-26T12:52:04.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.144+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94369917754096] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94369917747680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc600 con 0x55d4356c87b0 2024-04-26T12:52:04.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cf800 con 0x7f803c01fbe0 2024-04-26T12:52:04.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94369917760208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d00a0 con 0x7f803c01fbe0 2024-04-26T12:52:04.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d0aa0 con 0x55d4356bf5a0 2024-04-26T12:52:04.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94369917747680] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94369917760208] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94369917759008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cfb70 con 0x55d4356bf5a0 2024-04-26T12:52:04.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.148+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d1340 con 0x55d4356c3f60 2024-04-26T12:52:04.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.152+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94369917759008] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.152+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.152+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94369917767312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cfb70 con 0x55d4356c3f60 2024-04-26T12:52:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.152+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d1b90 con 0x55d4356c3f60 2024-04-26T12:52:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94369917767312] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94369917765040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d1b90 con 0x55d4356c3f60 2024-04-26T12:52:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d2550 con 0x55d4356c3f60 2024-04-26T12:52:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94369917765040] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94369917771936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d24c0 con 0x55d4356c3f60 2024-04-26T12:52:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 20 add_watcher() i=0 2024-04-26T12:52:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 20 add_watcher() i=1 2024-04-26T12:52:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 20 add_watcher() i=2 2024-04-26T12:52:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 20 add_watcher() i=3 2024-04-26T12:52:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 20 add_watcher() i=4 2024-04-26T12:52:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 20 add_watcher() i=5 2024-04-26T12:52:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.156+0000 7f8047d38980 20 add_watcher() i=6 2024-04-26T12:52:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94369917771936] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8047d38980 20 add_watcher() i=7 2024-04-26T12:52:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8047d38980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d5980 con 0x55d4356bf5a0 2024-04-26T12:52:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94369917769440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d2ea0 con 0x55d4356bf5a0 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94369917769440] v35'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f7ef77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8047d38980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8047d38980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f8047d38980 5 note: GC not initialized 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.160+0000 7f7ef67fc640 20 reqs_thread_entry: start 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8047d38980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8047d38980 20 Filter name: none 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f7e67fff640 20 reqs_thread_entry: start 2024-04-26T12:52:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8047d38980 20 rados->read ofs=0 len=0 2024-04-26T12:52:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d4356f8cc0 con 0x55d4356bf5a0 2024-04-26T12:52:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8047d38980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:could not fetch user info: no user info saved 2024-04-26T12:52:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f7ef77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94369917769440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356f8c80 con 0x55d4356bf5a0 2024-04-26T12:52:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94369917769440] v35'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.164+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94369917750192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356f8c80 con 0x7f803c01fbe0 2024-04-26T12:52:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.168+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94369917750192] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.168+0000 7f8047d38980 20 remove_watcher() i=0 2024-04-26T12:52:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.168+0000 7f8047d38980 2 removed watcher, disabling cache 2024-04-26T12:52:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.168+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94369917754096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356f8c80 con 0x55d4356bf5a0 2024-04-26T12:52:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.168+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94369917754096] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.168+0000 7f8047d38980 20 remove_watcher() i=1 2024-04-26T12:52:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.168+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94369917747680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356f8c80 con 0x55d4356c87b0 2024-04-26T12:52:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8045052640 1 -- 172.21.15.72:0/2300740679 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94369917747680] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f803c037040 con 0x55d4356c87b0 2024-04-26T12:52:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8047d38980 20 remove_watcher() i=2 2024-04-26T12:52:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94369917760208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc1e0 con 0x7f803c01fbe0 2024-04-26T12:52:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94369917760208] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x7f803c01fbe0 2024-04-26T12:52:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8047d38980 20 remove_watcher() i=3 2024-04-26T12:52:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94369917759008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc1e0 con 0x55d4356bf5a0 2024-04-26T12:52:04.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94369917759008] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8040026040 con 0x55d4356bf5a0 2024-04-26T12:52:04.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8047d38980 20 remove_watcher() i=4 2024-04-26T12:52:04.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.172+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94369917767312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc1e0 con 0x55d4356c3f60 2024-04-26T12:52:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.176+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94369917767312] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.176+0000 7f8047d38980 20 remove_watcher() i=5 2024-04-26T12:52:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.176+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94369917765040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356d0e90 con 0x55d4356c3f60 2024-04-26T12:52:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94369917765040] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 20 remove_watcher() i=6 2024-04-26T12:52:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94369917771936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d4356cc1e0 con 0x55d4356c3f60 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8045853640 1 -- 172.21.15.72:0/2300740679 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94369917771936] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038111020 con 0x55d4356c3f60 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 20 remove_watcher() i=7 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d4356c3f60 msgr2=0x55d4356c6350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d4356c3f60 0x55d4356c6350 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d4356bf5a0 msgr2=0x55d4356c1a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d4356bf5a0 0x55d4356c1a60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f803c01fbe0 msgr2=0x7f803c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f803c01fbe0 0x7f803c03a3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d4356c87b0 msgr2=0x55d4356cac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d4356c87b0 0x55d4356cac70 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f10034650 msgr2=0x7f7f10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f10034650 0x7f7f10036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c010 tx=0x7f803c010000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 msgr2=0x55d4356b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356b4470 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f80380d8140 tx=0x7f80380d8070 comp rx=0 tx=0).stop 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8046054640 1 -- 172.21.15.72:0/2300740679 reap_dead start 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 shutdown_connections 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/2300740679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356ad180 0x55d4356b4470 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 >> 172.21.15.72:0/2300740679 conn(0x55d4356a9510 msgr2=0x55d4356a6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 shutdown_connections 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/2300740679 wait complete. 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f200346a0 msgr2=0x7f7f20036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f200346a0 0x7f7f20036b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55d435692560 tx=0x7f803c00f000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356a01b0 msgr2=0x55d4356a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356a01b0 0x55d4356a05d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f80380e2e10 tx=0x7f80380c6820 comp rx=0 tx=0).stop 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 shutdown_connections 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f200346a0 0x7f7f20036b60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 --2- 172.21.15.72:0/1800640854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d4356a01b0 0x55d4356a05d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 >> 172.21.15.72:0/1800640854 conn(0x55d435694fc0 msgr2=0x55d435695ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 shutdown_connections 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.180+0000 7f8047d38980 1 -- 172.21.15.72:0/1800640854 wait complete. 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d43568b720 msgr2=0x55d43568db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d43568b720 0x55d43568db10 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d43558fe00 msgr2=0x55d435688d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d43558fe00 0x55d435688d60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d43568f620 msgr2=0x55d435691a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d43568f620 0x55d435691a10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f2c0346a0 msgr2=0x7f7f2c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7f2c0346a0 0x7f7f2c036b60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f803c000f70 tx=0x7f803c001380 comp rx=0 tx=0).stop 2024-04-26T12:52:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 msgr2=0x55d435681e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 --2- 172.21.15.72:0/1474469103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d43558f4e0 0x55d435681e60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8038017ca0 tx=0x7f8038017e30 comp rx=0 tx=0).stop 2024-04-26T12:52:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8046054640 1 -- 172.21.15.72:0/1474469103 reap_dead start 2024-04-26T12:52:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 shutdown_connections 2024-04-26T12:52:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 >> 172.21.15.72:0/1474469103 conn(0x55d435502bc0 msgr2=0x55d4356753e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 shutdown_connections 2024-04-26T12:52:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.184+0000 7f8047d38980 1 -- 172.21.15.72:0/1474469103 wait complete. 2024-04-26T12:52:04.195 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:52:04.195 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-26T12:52:04.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-26T12:52:04.196 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-26T12:52:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:04.269 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:04.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce8df1980 1 Processor -- start 2024-04-26T12:52:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce8df1980 1 -- start start 2024-04-26T12:52:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce8df1980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5647f58ae9d0 0x5647f593f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce8df1980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647f57e7510 con 0x5647f593f950 2024-04-26T12:52:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce8df1980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5647f57ee430 con 0x5647f58ae9d0 2024-04-26T12:52:04.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce690c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5647f58ae9d0 0x5647f593f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce690c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5647f58ae9d0 0x5647f593f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38204/0 (socket says 172.21.15.72:38204) 2024-04-26T12:52:04.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce610b640 1 --1- 172.21.15.72:0/1873387872 >> v1:172.21.15.29:6789/0 conn(0x5647f593f950 0x5647f5941d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48696/0 (socket says 172.21.15.72:48696) 2024-04-26T12:52:04.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce690c640 1 -- 172.21.15.72:0/1873387872 learned_addr learned my addr 172.21.15.72:0/1873387872 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce690c640 1 -- 172.21.15.72:0/1873387872 >> v1:172.21.15.29:6789/0 conn(0x5647f593f950 legacy=0x5647f5941d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.268+0000 7f9ce690c640 1 -- 172.21.15.72:0/1873387872 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f57c3ae0 con 0x5647f58ae9d0 2024-04-26T12:52:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce690c640 1 --2- 172.21.15.72:0/1873387872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f593f410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800a4e0 tx=0x7f9cd801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60d2b8f1d1c3063 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce590a640 1 -- 172.21.15.72:0/1873387872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80aa540 con 0x5647f58ae9d0 2024-04-26T12:52:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce590a640 1 -- 172.21.15.72:0/1873387872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80aa6e0 con 0x5647f58ae9d0 2024-04-26T12:52:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce590a640 1 -- 172.21.15.72:0/1873387872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80aaa40 con 0x5647f58ae9d0 2024-04-26T12:52:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce8df1980 1 -- 172.21.15.72:0/1873387872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 msgr2=0x5647f593f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/1873387872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f593f410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800a4e0 tx=0x7f9cd801b090 comp rx=0 tx=0).stop 2024-04-26T12:52:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce8df1980 1 -- 172.21.15.72:0/1873387872 shutdown_connections 2024-04-26T12:52:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/1873387872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f593f410 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce8df1980 1 -- 172.21.15.72:0/1873387872 >> 172.21.15.72:0/1873387872 conn(0x5647f5934af0 msgr2=0x5647f5936f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce8df1980 1 -- 172.21.15.72:0/1873387872 shutdown_connections 2024-04-26T12:52:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.272+0000 7f9ce8df1980 1 -- 172.21.15.72:0/1873387872 wait complete. 2024-04-26T12:52:04.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 Processor -- start 2024-04-26T12:52:04.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- start start 2024-04-26T12:52:04.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a27710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5647f583da70 con 0x5647f58ae9d0 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a27710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a27710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38214/0 (socket says 172.21.15.72:38214) 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 -- 172.21.15.72:0/2524139229 learned_addr learned my addr 172.21.15.72:0/2524139229 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 -- 172.21.15.72:0/2524139229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f5a27ce0 con 0x5647f58ae9d0 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 --2- 172.21.15.72:0/2524139229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a27710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8017ca0 tx=0x7f9cd80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4d4e653d76f886 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9bd4e09640 1 -- 172.21.15.72:0/2524139229 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80b9030 con 0x5647f58ae9d0 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9bd4e09640 1 -- 172.21.15.72:0/2524139229 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80aaac0 con 0x5647f58ae9d0 2024-04-26T12:52:04.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9bd4e09640 1 -- 172.21.15.72:0/2524139229 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80aada0 con 0x5647f58ae9d0 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2524139229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 msgr2=0x5647f5a27710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2524139229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a27710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8017ca0 tx=0x7f9cd80033b0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2524139229 shutdown_connections 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2524139229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a27710 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2524139229 >> 172.21.15.72:0/2524139229 conn(0x5647f5934af0 msgr2=0x5647f5a232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2524139229 shutdown_connections 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2524139229 wait complete. 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 Processor -- start 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- start start 2024-04-26T12:52:04.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a2e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce8df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5647f5945ec0 con 0x5647f58ae9d0 2024-04-26T12:52:04.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a2e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a2e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38226/0 (socket says 172.21.15.72:38226) 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.292+0000 7f9ce690c640 1 -- 172.21.15.72:0/272412152 learned_addr learned my addr 172.21.15.72:0/272412152 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce690c640 1 -- 172.21.15.72:0/272412152 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f5a2ed90 con 0x5647f58ae9d0 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce690c640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a2e850 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9cd801b0d0 tx=0x7f9cd8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd3606640 1 -- 172.21.15.72:0/272412152 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80b9030 con 0x5647f58ae9d0 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647f5a2f020 con 0x5647f58ae9d0 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd3606640 1 -- 172.21.15.72:0/272412152 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80c3070 con 0x5647f58ae9d0 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd3606640 1 -- 172.21.15.72:0/272412152 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80bf750 con 0x5647f58ae9d0 2024-04-26T12:52:04.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f5a31c60 con 0x5647f58ae9d0 2024-04-26T12:52:04.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce8df1980 1 Processor -- start 2024-04-26T12:52:04.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce8df1980 1 -- start start 2024-04-26T12:52:04.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce8df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a3c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce8df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5647f5841ab0 con 0x5647f5a3bc60 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd3606640 1 -- 172.21.15.72:0/272412152 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9cd80c5030 con 0x5647f58ae9d0 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce710d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a3c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce710d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a3c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38238/0 (socket says 172.21.15.72:38238) 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce710d640 1 -- 172.21.15.72:0/222856744 learned_addr learned my addr 172.21.15.72:0/222856744 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd3606640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bcc034650 0x7f9bcc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd3606640 1 -- 172.21.15.72:0/272412152 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f9cd80ba070 con 0x5647f58ae9d0 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce690c640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bcc034650 0x7f9bcc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce710d640 1 -- 172.21.15.72:0/222856744 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f5a3c5c0 con 0x5647f5a3bc60 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce690c640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bcc034650 0x7f9bcc036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80ac010 tx=0x7f9cd80e5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9ce710d640 1 --2- 172.21.15.72:0/222856744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a3c080 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000a440 tx=0x7f9ce000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881882f4621b4f52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd1602640 1 -- 172.21.15.72:0/222856744 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0008850 con 0x5647f5a3bc60 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd1602640 1 -- 172.21.15.72:0/222856744 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce0008a10 con 0x5647f5a3bc60 2024-04-26T12:52:04.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.296+0000 7f9bd1602640 1 -- 172.21.15.72:0/222856744 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0008d30 con 0x5647f5a3bc60 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- 172.21.15.72:0/222856744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 msgr2=0x5647f5a3c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/222856744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a3c080 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000a440 tx=0x7f9ce000a900 comp rx=0 tx=0).stop 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- 172.21.15.72:0/222856744 shutdown_connections 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/222856744 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a3c080 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- 172.21.15.72:0/222856744 >> 172.21.15.72:0/222856744 conn(0x5647f593f950 msgr2=0x5647f5a370d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- 172.21.15.72:0/222856744 shutdown_connections 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- 172.21.15.72:0/222856744 wait complete. 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 Processor -- start 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- start start 2024-04-26T12:52:04.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a42ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5647f5a3cf80 con 0x5647f5a3bc60 2024-04-26T12:52:04.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce710d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a42ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce710d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a42ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38254/0 (socket says 172.21.15.72:38254) 2024-04-26T12:52:04.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce710d640 1 -- 172.21.15.72:0/2261317764 learned_addr learned my addr 172.21.15.72:0/2261317764 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce710d640 1 -- 172.21.15.72:0/2261317764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f5a43430 con 0x5647f5a3bc60 2024-04-26T12:52:04.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce710d640 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a42ef0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x5647f5a3ca40 tx=0x7f9ce0003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9bcb7fe640 1 -- 172.21.15.72:0/2261317764 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0013a70 con 0x5647f5a3bc60 2024-04-26T12:52:04.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9bcb7fe640 1 -- 172.21.15.72:0/2261317764 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce0023070 con 0x5647f5a3bc60 2024-04-26T12:52:04.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9bcb7fe640 1 -- 172.21.15.72:0/2261317764 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0013d40 con 0x5647f5a3bc60 2024-04-26T12:52:04.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647f5a436c0 con 0x5647f5a3bc60 2024-04-26T12:52:04.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.300+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f5a463a0 con 0x5647f5a3bc60 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9bcb7fe640 1 -- 172.21.15.72:0/2261317764 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9ce0028460 con 0x5647f5a3bc60 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9bcb7fe640 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bc00346a0 0x7f9bc0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9bcb7fe640 1 -- 172.21.15.72:0/2261317764 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f9ce004a1c0 con 0x5647f5a3bc60 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce610b640 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bc00346a0 0x7f9bc0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 1 Processor -- start 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 1 -- start start 2024-04-26T12:52:04.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce610b640 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bc00346a0 0x7f9bc0036b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0000f70 tx=0x7f9cd0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a5ce00 0x5647f5a5d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5647f5a27f70 con 0x5647f5a5ce00 2024-04-26T12:52:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce690c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a5ce00 0x5647f5a5d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce690c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a5ce00 0x5647f5a5d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38258/0 (socket says 172.21.15.72:38258) 2024-04-26T12:52:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce690c640 1 -- 172.21.15.72:0/2927739311 learned_addr learned my addr 172.21.15.72:0/2927739311 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce690c640 1 -- 172.21.15.72:0/2927739311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f5a5d760 con 0x5647f5a5ce00 2024-04-26T12:52:04.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce690c640 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a5ce00 0x5647f5a5d220 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80a9b40 tx=0x7f9cd80a3c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ba6ffd640 1 -- 172.21.15.72:0/2927739311 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80df070 con 0x5647f5a5ce00 2024-04-26T12:52:04.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ba6ffd640 1 -- 172.21.15.72:0/2927739311 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80c5320 con 0x5647f5a5ce00 2024-04-26T12:52:04.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ba6ffd640 1 -- 172.21.15.72:0/2927739311 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd80c5540 con 0x5647f5a5ce00 2024-04-26T12:52:04.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647f5a5e200 con 0x5647f5a5ce00 2024-04-26T12:52:04.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.304+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f5a5e6d0 con 0x5647f5a5ce00 2024-04-26T12:52:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ba6ffd640 1 -- 172.21.15.72:0/2927739311 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9cd80b3040 con 0x5647f5a5ce00 2024-04-26T12:52:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ba6ffd640 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b20034650 0x7f9b20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ba6ffd640 1 -- 172.21.15.72:0/2927739311 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f9cd80b70d0 con 0x5647f5a5ce00 2024-04-26T12:52:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce610b640 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b20034650 0x7f9b20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ba4ff9640 20 reqs_thread_entry: start 2024-04-26T12:52:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce610b640 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b20034650 0x7f9b20036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0001ee0 tx=0x7f9cd000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5647f5a629e0 0x5647f5a64ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5647f5a65570 con 0x5647f5a629e0 2024-04-26T12:52:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce710d640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5647f5a629e0 0x5647f5a64ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce710d640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5647f5a629e0 0x5647f5a64ea0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce710d640 1 -- 172.21.15.72:0/272412152 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ce0044040 con 0x5647f5a629e0 2024-04-26T12:52:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5647f5a67340 0x5647f5a69730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:2 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5647f5a69e30 con 0x5647f5a67340 2024-04-26T12:52:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.308+0000 7f9ce690c640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5647f5a67340 0x5647f5a69730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce690c640 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5647f5a67340 0x5647f5a69730 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce690c640 1 -- 172.21.15.72:0/272412152 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(2 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9cd80eb020 con 0x5647f5a67340 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bc00346a0 msgr2=0x7f9bc0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bc00346a0 0x7f9bc0036b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0000f70 tx=0x7f9cd0001300 comp rx=0 tx=0).stop 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 msgr2=0x5647f5a42ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a42ef0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x5647f5a3ca40 tx=0x7f9ce0003000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 shutdown_connections 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bc00346a0 0x7f9bc0036b60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2261317764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a3bc60 0x5647f5a42ef0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 >> 172.21.15.72:0/2261317764 conn(0x5647f593f950 msgr2=0x5647f5a35ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 shutdown_connections 2024-04-26T12:52:04.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2261317764 wait complete. 2024-04-26T12:52:04.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b20034650 msgr2=0x7f9b20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b20034650 0x7f9b20036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0001ee0 tx=0x7f9cd000f000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a5ce00 msgr2=0x5647f5a5d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a5ce00 0x5647f5a5d220 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80a9b40 tx=0x7f9cd80a3c40 comp rx=0 tx=0).stop 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 shutdown_connections 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9b20034650 0x7f9b20036b10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/2927739311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f5a5ce00 0x5647f5a5d220 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 >> 172.21.15.72:0/2927739311 conn(0x5647f5a51a40 msgr2=0x5647f5a52460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 shutdown_connections 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/2927739311 wait complete. 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5647f5a67340 msgr2=0x5647f5a69730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5647f5a67340 0x5647f5a69730 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5647f5a629e0 msgr2=0x5647f5a64ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5647f5a629e0 0x5647f5a64ea0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bcc034650 msgr2=0x7f9bcc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bcc034650 0x7f9bcc036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80ac010 tx=0x7f9cd80e5040 comp rx=0 tx=0).stop 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 msgr2=0x5647f5a2e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a2e850 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9cd801b0d0 tx=0x7f9cd8017e30 comp rx=0 tx=0).stop 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 shutdown_connections 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5647f5a67340 0x5647f5a69730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5647f5a629e0 0x5647f5a64ea0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9bcc034650 0x7f9bcc036b10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 --2- 172.21.15.72:0/272412152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5647f58ae9d0 0x5647f5a2e850 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.312+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 >> 172.21.15.72:0/272412152 conn(0x5647f5934af0 msgr2=0x5647f5a21db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.316+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 shutdown_connections 2024-04-26T12:52:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.316+0000 7f9ce8df1980 1 -- 172.21.15.72:0/272412152 wait complete. 2024-04-26T12:52:04.327 INFO:teuthology.orchestra.run.smithi072.stdout:{"id":"fe657080-460c-4bb9-93cf-69170ee92cfa","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T12:52:04.328 DEBUG:tasks.util.rgw: json result: {'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T12:52:04.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-26T12:52:04.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-26T12:52:04.328 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-26T12:52:04.407 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:04.408 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:04.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b749d6980 1 Processor -- start 2024-04-26T12:52:04.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b749d6980 1 -- start start 2024-04-26T12:52:04.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b749d6980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5563dea23a80 0x5563dea25e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b749d6980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563de8ca510 con 0x5563de991870 2024-04-26T12:52:04.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b749d6980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5563de8d1430 con 0x5563dea23a80 2024-04-26T12:52:04.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b71cf0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5563dea23a80 0x5563dea25e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b724f1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5563de991870 0x5563dea22360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48704/0 (socket says 172.21.15.72:48704) 2024-04-26T12:52:04.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b724f1640 1 -- 172.21.15.72:0/855000041 learned_addr learned my addr 172.21.15.72:0/855000041 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:04.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b71cf0640 1 -- 172.21.15.72:0/855000041 >> v1:172.21.15.29:6789/0 conn(0x5563de991870 legacy=0x5563dea22360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.408+0000 7f6b71cf0640 1 -- 172.21.15.72:0/855000041 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563de8a6ae0 con 0x5563dea23a80 2024-04-26T12:52:04.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b71cf0640 1 --2- 172.21.15.72:0/855000041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563dea23a80 0x5563dea25e70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00a480 tx=0x7f6b5c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f516179a267a6e0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b714ef640 1 -- 172.21.15.72:0/855000041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c0b0070 con 0x5563dea23a80 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b714ef640 1 -- 172.21.15.72:0/855000041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0ab540 con 0x5563dea23a80 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b714ef640 1 -- 172.21.15.72:0/855000041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c0ab840 con 0x5563dea23a80 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b749d6980 1 -- 172.21.15.72:0/855000041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563dea23a80 msgr2=0x5563dea25e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b749d6980 1 --2- 172.21.15.72:0/855000041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563dea23a80 0x5563dea25e70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00a480 tx=0x7f6b5c01b280 comp rx=0 tx=0).stop 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b749d6980 1 -- 172.21.15.72:0/855000041 shutdown_connections 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b749d6980 1 --2- 172.21.15.72:0/855000041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563dea23a80 0x5563dea25e70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b749d6980 1 -- 172.21.15.72:0/855000041 >> 172.21.15.72:0/855000041 conn(0x5563dea17a40 msgr2=0x5563dea19e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b749d6980 1 -- 172.21.15.72:0/855000041 shutdown_connections 2024-04-26T12:52:04.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.412+0000 7f6b749d6980 1 -- 172.21.15.72:0/855000041 wait complete. 2024-04-26T12:52:04.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 Processor -- start 2024-04-26T12:52:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- start start 2024-04-26T12:52:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb0a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5563de920a70 con 0x5563de991870 2024-04-26T12:52:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b724f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb0a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b724f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb0a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38284/0 (socket says 172.21.15.72:38284) 2024-04-26T12:52:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b724f1640 1 -- 172.21.15.72:0/1362058669 learned_addr learned my addr 172.21.15.72:0/1362058669 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b724f1640 1 -- 172.21.15.72:0/1362058669 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563deb0adc0 con 0x5563de991870 2024-04-26T12:52:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b724f1640 1 --2- 172.21.15.72:0/1362058669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb0a7f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6b64001e20 tx=0x7f6b6400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff70d25b9245bac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6a60608640 1 -- 172.21.15.72:0/1362058669 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b64012020 con 0x5563de991870 2024-04-26T12:52:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6a60608640 1 -- 172.21.15.72:0/1362058669 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6400e7c0 con 0x5563de991870 2024-04-26T12:52:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6a60608640 1 -- 172.21.15.72:0/1362058669 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b6400eb00 con 0x5563de991870 2024-04-26T12:52:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- 172.21.15.72:0/1362058669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 msgr2=0x5563deb0a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1362058669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb0a7f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6b64001e20 tx=0x7f6b6400b790 comp rx=0 tx=0).stop 2024-04-26T12:52:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- 172.21.15.72:0/1362058669 shutdown_connections 2024-04-26T12:52:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1362058669 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb0a7f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- 172.21.15.72:0/1362058669 >> 172.21.15.72:0/1362058669 conn(0x5563dea17a40 msgr2=0x5563deb062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- 172.21.15.72:0/1362058669 shutdown_connections 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- 172.21.15.72:0/1362058669 wait complete. 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 Processor -- start 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- start start 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb11a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.428+0000 7f6b749d6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5563dea28e10 con 0x5563de991870 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b724f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb11a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b724f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb11a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38294/0 (socket says 172.21.15.72:38294) 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 learned_addr learned my addr 172.21.15.72:0/1466039403 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563deb11fc0 con 0x5563de991870 2024-04-26T12:52:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b724f1640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb11a80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6b64001e20 tx=0x7f6b64000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6a5ee05640 1 -- 172.21.15.72:0/1466039403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b64012030 con 0x5563de991870 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6a5ee05640 1 -- 172.21.15.72:0/1466039403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64001480 con 0x5563de991870 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6a5ee05640 1 -- 172.21.15.72:0/1466039403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b6401a940 con 0x5563de991870 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563deb12250 con 0x5563de991870 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563deb14e90 con 0x5563de991870 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b749d6980 1 Processor -- start 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b749d6980 1 -- start start 2024-04-26T12:52:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b749d6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb1faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b749d6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5563de924ab0 con 0x5563deb1f6d0 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b72cf2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb1faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b72cf2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb1faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38304/0 (socket says 172.21.15.72:38304) 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b72cf2640 1 -- 172.21.15.72:0/3600047076 learned_addr learned my addr 172.21.15.72:0/3600047076 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6a5ee05640 1 -- 172.21.15.72:0/1466039403 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b64015020 con 0x5563de991870 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6a5ee05640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a58034650 0x7f6a58036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b72cf2640 1 -- 172.21.15.72:0/3600047076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563deb20030 con 0x5563deb1f6d0 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6a5ee05640 1 -- 172.21.15.72:0/1466039403 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f6b64020030 con 0x5563de991870 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b724f1640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a58034650 0x7f6a58036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/3600047076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb1faf0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00a430 tx=0x7f6b6c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efb97e9737729e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.432+0000 7f6b724f1640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a58034650 0x7f6a58036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402dfd0 tx=0x7f6b6400df70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6a5ce01640 1 -- 172.21.15.72:0/3600047076 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b6c00f6e0 con 0x5563deb1f6d0 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6a5ce01640 1 -- 172.21.15.72:0/3600047076 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6c015070 con 0x5563deb1f6d0 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6a5ce01640 1 -- 172.21.15.72:0/3600047076 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b6c00fa10 con 0x5563deb1f6d0 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- 172.21.15.72:0/3600047076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 msgr2=0x5563deb1faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 --2- 172.21.15.72:0/3600047076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb1faf0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00a430 tx=0x7f6b6c00a8f0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- 172.21.15.72:0/3600047076 shutdown_connections 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 --2- 172.21.15.72:0/3600047076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb1faf0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- 172.21.15.72:0/3600047076 >> 172.21.15.72:0/3600047076 conn(0x5563deb1a2f0 msgr2=0x5563deb1b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- 172.21.15.72:0/3600047076 shutdown_connections 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- 172.21.15.72:0/3600047076 wait complete. 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 Processor -- start 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- start start 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb26520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5563deb20570 con 0x5563deb1f6d0 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b72cf2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb26520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b72cf2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb26520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38314/0 (socket says 172.21.15.72:38314) 2024-04-26T12:52:04.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b72cf2640 1 -- 172.21.15.72:0/3674351840 learned_addr learned my addr 172.21.15.72:0/3674351840 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b72cf2640 1 -- 172.21.15.72:0/3674351840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563deb26a60 con 0x5563deb1f6d0 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb26520 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x5563deb1be20 tx=0x7f6b6c003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6a56ffd640 1 -- 172.21.15.72:0/3674351840 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b6c00fe00 con 0x5563deb1f6d0 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563deb26cf0 con 0x5563deb1f6d0 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563deb299d0 con 0x5563deb1f6d0 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6a56ffd640 1 -- 172.21.15.72:0/3674351840 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6c010a20 con 0x5563deb1f6d0 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.436+0000 7f6a56ffd640 1 -- 172.21.15.72:0/3674351840 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b6c010d80 con 0x5563deb1f6d0 2024-04-26T12:52:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a56ffd640 1 -- 172.21.15.72:0/3674351840 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b6c01a480 con 0x5563deb1f6d0 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 1 Processor -- start 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 1 -- start start 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a56ffd640 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a4c034650 0x7f6a4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a56ffd640 1 -- 172.21.15.72:0/3674351840 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f6b6c04a4c0 con 0x5563deb1f6d0 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb40510 0x5563deb40930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a4c034650 0x7f6a4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5563deb0b110 con 0x5563deb40510 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a4c034650 0x7f6a4c036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c01bfd0 tx=0x7f6b6c005620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b724f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb40510 0x5563deb40930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b724f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb40510 0x5563deb40930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38324/0 (socket says 172.21.15.72:38324) 2024-04-26T12:52:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b724f1640 1 -- 172.21.15.72:0/1881776784 learned_addr learned my addr 172.21.15.72:0/1881776784 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b724f1640 1 -- 172.21.15.72:0/1881776784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563deb40e70 con 0x5563deb40510 2024-04-26T12:52:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b724f1640 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb40510 0x5563deb40930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400e790 tx=0x7f6b6402d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a36fe5640 1 -- 172.21.15.72:0/1881776784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b64035040 con 0x5563deb40510 2024-04-26T12:52:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a36fe5640 1 -- 172.21.15.72:0/1881776784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64016a40 con 0x5563deb40510 2024-04-26T12:52:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563deb41910 con 0x5563deb40510 2024-04-26T12:52:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a36fe5640 1 -- 172.21.15.72:0/1881776784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b640163b0 con 0x5563deb40510 2024-04-26T12:52:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563deb41de0 con 0x5563deb40510 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a36fe5640 1 -- 172.21.15.72:0/1881776784 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b64009070 con 0x5563deb40510 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a36fe5640 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f69b4034600 0x7f69b4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a36fe5640 1 -- 172.21.15.72:0/1881776784 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f6b64005050 con 0x5563deb40510 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6b71cf0640 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f69b4034600 0x7f69b4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.440+0000 7f6a34fe1640 20 reqs_thread_entry: start 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b71cf0640 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f69b4034600 0x7f69b4036ac0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0ad000 tx=0x7f6b5c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5563deb46030 0x5563deb484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563deb48b40 con 0x5563deb46030 2024-04-26T12:52:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5563deb46030 0x5563deb484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5563deb46030 0x5563deb484c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563deb49420 con 0x5563deb46030 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5563deb4ad30 0x5563deb4d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563deb4d910 con 0x5563deb4ad30 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b724f1640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5563deb4ad30 0x5563deb4d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b724f1640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5563deb4ad30 0x5563deb4d180 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563deb584f0 con 0x5563deb46030 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:NOTICE: set zone's realm_id= 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5563deb56e70 0x5563deb53d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.444+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb56e70 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b71cf0640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5563deb56e70 0x5563deb53d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b71cf0640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5563deb56e70 0x5563deb53d80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b71cf0640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x5563dea23a80 0x7f6b5c0b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563dea23a80 2024-04-26T12:52:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x5563dea23a80 0x7f6b5c0b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x5563dea23a80 0x7f6b5c0b7400 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563dea23a80 2024-04-26T12:52:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb4ad30 2024-04-26T12:52:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb46030 2024-04-26T12:52:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb46030 2024-04-26T12:52:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb4ad30 2024-04-26T12:52:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.448+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb4ad30 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563dea23a80 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563dea23a80 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb56e70 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563deb46030 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563deb55ac0 con 0x5563dea23a80 2024-04-26T12:52:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563dea23a80 2024-04-26T12:52:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb46030 2024-04-26T12:52:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563dea23a80 2024-04-26T12:52:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(17 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563dea23a80 2024-04-26T12:52:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb56e70 2024-04-26T12:52:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb56e70 2024-04-26T12:52:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb4ad30 2024-04-26T12:52:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb56e70 2024-04-26T12:52:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.452+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb56e70 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb46030 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb46030 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb4ad30 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb56e70 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563dea23a80 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563dea23a80 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb46030 2024-04-26T12:52:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb4ad30 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb56e70 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.456+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb4ad30 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563dea23a80 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563dea23a80 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb56e70 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c0b3040 con 0x5563deb56e70 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b71cf0640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb4ad30 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563deb46030 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(35 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f6b6c056040 con 0x5563dea23a80 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(36 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563dea23a80 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563deb50c00 con 0x5563deb46030 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:38 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563deb50fa0 con 0x5563deb4ad30 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(38 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.460+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:39 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563deb53040 con 0x5563deb4ad30 2024-04-26T12:52:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.464+0000 7f6b724f1640 1 -- 172.21.15.72:0/1466039403 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(39 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [create,call,writefull 0~1155] v35'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f6b64053070 con 0x5563deb4ad30 2024-04-26T12:52:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.464+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563deb56340 con 0x5563deb46030 2024-04-26T12:52:04.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v35'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563deb56340 con 0x5563deb46030 2024-04-26T12:52:04.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v35'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f6b6c00e070 con 0x5563deb46030 2024-04-26T12:52:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a4c034650 msgr2=0x7f6a4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a4c034650 0x7f6a4c036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c01bfd0 tx=0x7f6b6c005620 comp rx=0 tx=0).stop 2024-04-26T12:52:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 msgr2=0x5563deb26520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb26520 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x5563deb1be20 tx=0x7f6b6c003380 comp rx=0 tx=0).stop 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 shutdown_connections 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a4c034650 0x7f6a4c036b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/3674351840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb1f6d0 0x5563deb26520 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 >> 172.21.15.72:0/3674351840 conn(0x5563deb1a2f0 msgr2=0x5563deb1b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 shutdown_connections 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/3674351840 wait complete. 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f69b4034600 msgr2=0x7f69b4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f69b4034600 0x7f69b4036ac0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0ad000 tx=0x7f6b5c0a5040 comp rx=0 tx=0).stop 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb40510 msgr2=0x5563deb40930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb40510 0x5563deb40930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400e790 tx=0x7f6b6402d7c0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 shutdown_connections 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f69b4034600 0x7f69b4036ac0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1881776784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563deb40510 0x5563deb40930 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 >> 172.21.15.72:0/1881776784 conn(0x5563deb35060 msgr2=0x5563deb35a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 shutdown_connections 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.468+0000 7f6b749d6980 1 -- 172.21.15.72:0/1881776784 wait complete. 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5563deb4ad30 msgr2=0x5563deb4d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5563deb4ad30 0x5563deb4d180 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5563deb46030 msgr2=0x5563deb484c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5563deb46030 0x5563deb484c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x5563dea23a80 msgr2=0x7f6b5c0b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x5563dea23a80 0x7f6b5c0b7400 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5563deb56e70 msgr2=0x5563deb53d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5563deb56e70 0x5563deb53d80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a58034650 msgr2=0x7f6a58036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6a58034650 0x7f6a58036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402dfd0 tx=0x7f6b6400df70 comp rx=0 tx=0).stop 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 msgr2=0x5563deb11a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 --2- 172.21.15.72:0/1466039403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5563de991870 0x5563deb11a80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6b64001e20 tx=0x7f6b64000ee0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 reap_dead start 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b72cf2640 1 -- 172.21.15.72:0/1466039403 reap_dead start 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 shutdown_connections 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 >> 172.21.15.72:0/1466039403 conn(0x5563dea17a40 msgr2=0x5563deb04df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 shutdown_connections 2024-04-26T12:52:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.472+0000 7f6b749d6980 1 -- 172.21.15.72:0/1466039403 wait complete. 2024-04-26T12:52:04.482 INFO:teuthology.orchestra.run.smithi072.stdout:{"id":"fe657080-460c-4bb9-93cf-69170ee92cfa","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-26T12:52:04.482 DEBUG:tasks.util.rgw: json result: {'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-26T12:52:04.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-26T12:52:04.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-26T12:52:04.483 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-26T12:52:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c97e9980 1 Processor -- start 2024-04-26T12:52:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c97e9980 1 -- start start 2024-04-26T12:52:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c97e9980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e1fa4414d0 0x55e1fa4418b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c97e9980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e1fa2ec510 con 0x55e1fa441df0 2024-04-26T12:52:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c97e9980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55e1fa2f3430 con 0x55e1fa4414d0 2024-04-26T12:52:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c7304640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e1fa4414d0 0x55e1fa4418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c6b03640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55e1fa441df0 0x55e1fa4427b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48716/0 (socket says 172.21.15.72:48716) 2024-04-26T12:52:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c6b03640 1 -- 172.21.15.72:0/1833227929 learned_addr learned my addr 172.21.15.72:0/1833227929 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.560+0000 7f98c7304640 1 --2- 172.21.15.72:0/1833227929 >> v2:172.21.15.29:3300/0 conn(0x55e1fa4414d0 0x55e1fa4418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38326/0 (socket says 172.21.15.72:38326) 2024-04-26T12:52:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.564+0000 7f98c7304640 1 -- 172.21.15.72:0/1833227929 >> v1:172.21.15.29:6789/0 conn(0x55e1fa441df0 legacy=0x55e1fa4427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.564+0000 7f98c7304640 1 -- 172.21.15.72:0/1833227929 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1fa2c8ae0 con 0x55e1fa4414d0 2024-04-26T12:52:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.564+0000 7f98c7304640 1 --2- 172.21.15.72:0/1833227929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa4418b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f98b800a420 tx=0x7f98b801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fba7ca119af0d62 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.564+0000 7f98c6302640 1 -- 172.21.15.72:0/1833227929 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80af070 con 0x55e1fa4414d0 2024-04-26T12:52:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.564+0000 7f98c6302640 1 -- 172.21.15.72:0/1833227929 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80aa530 con 0x55e1fa4414d0 2024-04-26T12:52:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.564+0000 7f98c6302640 1 -- 172.21.15.72:0/1833227929 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80aa850 con 0x55e1fa4414d0 2024-04-26T12:52:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.568+0000 7f98c97e9980 1 -- 172.21.15.72:0/1833227929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 msgr2=0x55e1fa4418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.568+0000 7f98c97e9980 1 --2- 172.21.15.72:0/1833227929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa4418b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f98b800a420 tx=0x7f98b801afd0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.568+0000 7f98c97e9980 1 -- 172.21.15.72:0/1833227929 shutdown_connections 2024-04-26T12:52:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.568+0000 7f98c97e9980 1 --2- 172.21.15.72:0/1833227929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa4418b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.568+0000 7f98c97e9980 1 -- 172.21.15.72:0/1833227929 >> 172.21.15.72:0/1833227929 conn(0x55e1fa3b4bb0 msgr2=0x55e1fa3b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.568+0000 7f98c97e9980 1 -- 172.21.15.72:0/1833227929 shutdown_connections 2024-04-26T12:52:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.568+0000 7f98c97e9980 1 -- 172.21.15.72:0/1833227929 wait complete. 2024-04-26T12:52:04.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 Processor -- start 2024-04-26T12:52:04.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 -- start start 2024-04-26T12:52:04.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa52cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e1fa342a70 con 0x55e1fa4414d0 2024-04-26T12:52:04.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c7304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa52cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c7304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa52cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38340/0 (socket says 172.21.15.72:38340) 2024-04-26T12:52:04.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c7304640 1 -- 172.21.15.72:0/179441323 learned_addr learned my addr 172.21.15.72:0/179441323 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c7304640 1 -- 172.21.15.72:0/179441323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1fa52d300 con 0x55e1fa4414d0 2024-04-26T12:52:04.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c7304640 1 --2- 172.21.15.72:0/179441323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa52cd30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f98b800a420 tx=0x7f98b80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8291d0c85bff0349 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f97b560a640 1 -- 172.21.15.72:0/179441323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80af050 con 0x55e1fa4414d0 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f97b560a640 1 -- 172.21.15.72:0/179441323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80b0040 con 0x55e1fa4414d0 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f97b560a640 1 -- 172.21.15.72:0/179441323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80aac60 con 0x55e1fa4414d0 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 -- 172.21.15.72:0/179441323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 msgr2=0x55e1fa52cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 --2- 172.21.15.72:0/179441323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa52cd30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f98b800a420 tx=0x7f98b80033b0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 -- 172.21.15.72:0/179441323 shutdown_connections 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 --2- 172.21.15.72:0/179441323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa52cd30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 -- 172.21.15.72:0/179441323 >> 172.21.15.72:0/179441323 conn(0x55e1fa3b4bb0 msgr2=0x55e1fa5288c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 -- 172.21.15.72:0/179441323 shutdown_connections 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 -- 172.21.15.72:0/179441323 wait complete. 2024-04-26T12:52:04.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.584+0000 7f98c97e9980 1 Processor -- start 2024-04-26T12:52:04.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 -- start start 2024-04-26T12:52:04.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa533e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e1fa44b520 con 0x55e1fa4414d0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa533e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa533e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38350/0 (socket says 172.21.15.72:38350) 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7304640 1 -- 172.21.15.72:0/4085569218 learned_addr learned my addr 172.21.15.72:0/4085569218 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7304640 1 -- 172.21.15.72:0/4085569218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1fa534390 con 0x55e1fa4414d0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7304640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa533e50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f98b801b010 tx=0x7f98b8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f97b3e07640 1 -- 172.21.15.72:0/4085569218 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80c5030 con 0x55e1fa4414d0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f97b3e07640 1 -- 172.21.15.72:0/4085569218 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80c15b0 con 0x55e1fa4414d0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1fa534620 con 0x55e1fa4414d0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f97b3e07640 1 -- 172.21.15.72:0/4085569218 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80c1890 con 0x55e1fa4414d0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1fa537230 con 0x55e1fa4414d0 2024-04-26T12:52:04.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 Processor -- start 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 -- start start 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa5416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c97e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e1fa346ab0 con 0x55e1fa541290 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f97b3e07640 1 -- 172.21.15.72:0/4085569218 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98b80c8070 con 0x55e1fa4414d0 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7b05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa5416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7b05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa5416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38366/0 (socket says 172.21.15.72:38366) 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7b05640 1 -- 172.21.15.72:0/4258288518 learned_addr learned my addr 172.21.15.72:0/4258288518 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f97b3e07640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97ac034650 0x7f97ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f97b3e07640 1 -- 172.21.15.72:0/4085569218 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f98b80c6070 con 0x55e1fa4414d0 2024-04-26T12:52:04.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7304640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97ac034650 0x7f97ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7b05640 1 -- 172.21.15.72:0/4258288518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1fa541bf0 con 0x55e1fa541290 2024-04-26T12:52:04.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7304640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97ac034650 0x7f97ac036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98b80aafd0 tx=0x7f98b80056a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.588+0000 7f98c7b05640 1 --2- 172.21.15.72:0/4258288518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa5416b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a440 tx=0x7f98c000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988071154f0118b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f97b1e03640 1 -- 172.21.15.72:0/4258288518 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c0008850 con 0x55e1fa541290 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f97b1e03640 1 -- 172.21.15.72:0/4258288518 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c0008a10 con 0x55e1fa541290 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f97b1e03640 1 -- 172.21.15.72:0/4258288518 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c0008d30 con 0x55e1fa541290 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- 172.21.15.72:0/4258288518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 msgr2=0x55e1fa5416b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4258288518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa5416b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a440 tx=0x7f98c000a900 comp rx=0 tx=0).stop 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- 172.21.15.72:0/4258288518 shutdown_connections 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4258288518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa5416b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- 172.21.15.72:0/4258288518 >> 172.21.15.72:0/4258288518 conn(0x55e1fa441df0 msgr2=0x55e1fa53c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- 172.21.15.72:0/4258288518 shutdown_connections 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- 172.21.15.72:0/4258288518 wait complete. 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 Processor -- start 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- start start 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa548520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e1fa5425b0 con 0x55e1fa541290 2024-04-26T12:52:04.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c7b05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa548520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c7b05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa548520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38376/0 (socket says 172.21.15.72:38376) 2024-04-26T12:52:04.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c7b05640 1 -- 172.21.15.72:0/807420753 learned_addr learned my addr 172.21.15.72:0/807420753 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c7b05640 1 -- 172.21.15.72:0/807420753 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1fa548a60 con 0x55e1fa541290 2024-04-26T12:52:04.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c7b05640 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa548520 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55e1fa542070 tx=0x7f98c0003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f97a3fff640 1 -- 172.21.15.72:0/807420753 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c0013a70 con 0x55e1fa541290 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1fa548cf0 con 0x55e1fa541290 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f97a3fff640 1 -- 172.21.15.72:0/807420753 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c0023070 con 0x55e1fa541290 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f97a3fff640 1 -- 172.21.15.72:0/807420753 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98c0013d40 con 0x55e1fa541290 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.592+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1fa54b9d0 con 0x55e1fa541290 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f97a3fff640 1 -- 172.21.15.72:0/807420753 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98c0028460 con 0x55e1fa541290 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 1 Processor -- start 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f97a3fff640 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97a8034650 0x7f97a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 1 -- start start 2024-04-26T12:52:04.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f97a3fff640 1 -- 172.21.15.72:0/807420753 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f98c004a020 con 0x55e1fa541290 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c7b05640 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97a8034650 0x7f97a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa562520 0x55e1fa562940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e1fa52d590 con 0x55e1fa562520 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c7b05640 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97a8034650 0x7f97a8036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f98c0011c20 tx=0x7f98c0013ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c7304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa562520 0x55e1fa562940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c7304640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa562520 0x55e1fa562940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38384/0 (socket says 172.21.15.72:38384) 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c7304640 1 -- 172.21.15.72:0/847509046 learned_addr learned my addr 172.21.15.72:0/847509046 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c7304640 1 -- 172.21.15.72:0/847509046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1fa562e80 con 0x55e1fa562520 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c7304640 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa562520 0x55e1fa562940 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f98b80a9940 tx=0x7f98b80e3870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f972ffff640 1 -- 172.21.15.72:0/847509046 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80e3030 con 0x55e1fa562520 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f972ffff640 1 -- 172.21.15.72:0/847509046 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80d0740 con 0x55e1fa562520 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1fa563920 con 0x55e1fa562520 2024-04-26T12:52:04.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f972ffff640 1 -- 172.21.15.72:0/847509046 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b80a8960 con 0x55e1fa562520 2024-04-26T12:52:04.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1fa563920 con 0x55e1fa562520 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.596+0000 7f972ffff640 1 -- 172.21.15.72:0/847509046 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98b80dd040 con 0x55e1fa562520 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f972ffff640 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9700034650 0x7f9700036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f972ffff640 1 -- 172.21.15.72:0/847509046 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f98b80bb070 con 0x55e1fa562520 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c6b03640 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9700034650 0x7f9700036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f972dffb640 20 reqs_thread_entry: start 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e1fa567e70 0x55e1fa56a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e1fa56a940 con 0x55e1fa567e70 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c6b03640 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9700034650 0x7f9700036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f98bc000f70 tx=0x7f98bc001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c7b05640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e1fa567e70 0x55e1fa56a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c7b05640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e1fa567e70 0x55e1fa56a2c0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c7b05640 1 -- 172.21.15.72:0/4085569218 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c001e7a0 con 0x55e1fa567e70 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e1fa56b1f0 con 0x55e1fa567e70 2024-04-26T12:52:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c7b05640 1 -- 172.21.15.72:0/4085569218 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c001e7a0 con 0x55e1fa567e70 2024-04-26T12:52:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e1fa56cab0 0x55e1fa56ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e1fa56f6b0 con 0x55e1fa56cab0 2024-04-26T12:52:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c7304640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e1fa56cab0 0x55e1fa56ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c7304640 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e1fa56cab0 0x55e1fa56ef20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.600+0000 7f98c7304640 1 -- 172.21.15.72:0/4085569218 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f98b80b2070 con 0x55e1fa56cab0 2024-04-26T12:52:04.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97a8034650 msgr2=0x7f97a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97a8034650 0x7f97a8036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f98c0011c20 tx=0x7f98c0013ee0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 msgr2=0x55e1fa548520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa548520 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55e1fa542070 tx=0x7f98c0003000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 shutdown_connections 2024-04-26T12:52:04.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97a8034650 0x7f97a8036b10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/807420753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa541290 0x55e1fa548520 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 >> 172.21.15.72:0/807420753 conn(0x55e1fa441df0 msgr2=0x55e1fa53b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 shutdown_connections 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/807420753 wait complete. 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9700034650 msgr2=0x7f9700036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9700034650 0x7f9700036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f98bc000f70 tx=0x7f98bc001240 comp rx=0 tx=0).stop 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa562520 msgr2=0x55e1fa562940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa562520 0x55e1fa562940 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f98b80a9940 tx=0x7f98b80e3870 comp rx=0 tx=0).stop 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 shutdown_connections 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9700034650 0x7f9700036b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/847509046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa562520 0x55e1fa562940 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 >> 172.21.15.72:0/847509046 conn(0x55e1fa557070 msgr2=0x55e1fa557a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 shutdown_connections 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/847509046 wait complete. 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e1fa56cab0 msgr2=0x55e1fa56ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e1fa56cab0 0x55e1fa56ef20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e1fa567e70 msgr2=0x55e1fa56a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e1fa567e70 0x55e1fa56a2c0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97ac034650 msgr2=0x7f97ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97ac034650 0x7f97ac036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98b80aafd0 tx=0x7f98b80056a0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 msgr2=0x55e1fa533e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa533e50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f98b801b010 tx=0x7f98b8019810 comp rx=0 tx=0).stop 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 shutdown_connections 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e1fa56cab0 0x55e1fa56ef20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e1fa567e70 0x55e1fa56a2c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f97ac034650 0x7f97ac036b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 --2- 172.21.15.72:0/4085569218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e1fa4414d0 0x55e1fa533e50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 >> 172.21.15.72:0/4085569218 conn(0x55e1fa3b4bb0 msgr2=0x55e1fa5273d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 shutdown_connections 2024-04-26T12:52:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.604+0000 7f98c97e9980 1 -- 172.21.15.72:0/4085569218 wait complete. 2024-04-26T12:52:04.616 INFO:teuthology.orchestra.run.smithi072.stdout:{"id":"fe657080-460c-4bb9-93cf-69170ee92cfa","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-26T12:52:04.616 DEBUG:tasks.util.rgw: json result: {'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-26T12:52:04.616 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:52:04.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:52:04.617 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-26T12:52:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f59b7980 1 Processor -- start 2024-04-26T12:52:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f59b7980 1 -- start start 2024-04-26T12:52:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f59b7980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5609af48a6f0 0x5609af48cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f59b7980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609af333510 con 0x5609af3fa920 2024-04-26T12:52:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f59b7980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5609af33a430 con 0x5609af48a6f0 2024-04-26T12:52:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f2cd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5609af48a6f0 0x5609af48cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f2cd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5609af48a6f0 0x5609af48cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38396/0 (socket says 172.21.15.72:38396) 2024-04-26T12:52:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f2cd1640 1 -- 172.21.15.72:0/2035192170 learned_addr learned my addr 172.21.15.72:0/2035192170 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f34d2640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x5609af3fa920 0x5609af488fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48728/0 (socket says 172.21.15.72:48728) 2024-04-26T12:52:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f2cd1640 1 -- 172.21.15.72:0/2035192170 >> v1:172.21.15.29:6789/0 conn(0x5609af3fa920 legacy=0x5609af488fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.696+0000 7f37f2cd1640 1 -- 172.21.15.72:0/2035192170 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af30fae0 con 0x5609af48a6f0 2024-04-26T12:52:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f2cd1640 1 --2- 172.21.15.72:0/2035192170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af48a6f0 0x5609af48cae0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f37e800a5c0 tx=0x7f37e801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fefd020b2edb7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f24d0640 1 -- 172.21.15.72:0/2035192170 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e80a6070 con 0x5609af48a6f0 2024-04-26T12:52:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f24d0640 1 -- 172.21.15.72:0/2035192170 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e80af070 con 0x5609af48a6f0 2024-04-26T12:52:04.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f24d0640 1 -- 172.21.15.72:0/2035192170 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e80aa5c0 con 0x5609af48a6f0 2024-04-26T12:52:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f59b7980 1 -- 172.21.15.72:0/2035192170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af48a6f0 msgr2=0x5609af48cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2035192170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af48a6f0 0x5609af48cae0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f37e800a5c0 tx=0x7f37e801b340 comp rx=0 tx=0).stop 2024-04-26T12:52:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f59b7980 1 -- 172.21.15.72:0/2035192170 shutdown_connections 2024-04-26T12:52:04.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2035192170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af48a6f0 0x5609af48cae0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f59b7980 1 -- 172.21.15.72:0/2035192170 >> 172.21.15.72:0/2035192170 conn(0x5609af480ab0 msgr2=0x5609af482ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f59b7980 1 -- 172.21.15.72:0/2035192170 shutdown_connections 2024-04-26T12:52:04.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.700+0000 7f37f59b7980 1 -- 172.21.15.72:0/2035192170 wait complete. 2024-04-26T12:52:04.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f59b7980 1 Processor -- start 2024-04-26T12:52:04.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f59b7980 1 -- start start 2024-04-26T12:52:04.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f59b7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af5714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f59b7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5609af389a70 con 0x5609af3fa920 2024-04-26T12:52:04.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f34d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af5714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f34d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af5714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38412/0 (socket says 172.21.15.72:38412) 2024-04-26T12:52:04.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f34d2640 1 -- 172.21.15.72:0/64425147 learned_addr learned my addr 172.21.15.72:0/64425147 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f34d2640 1 -- 172.21.15.72:0/64425147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af571ac0 con 0x5609af3fa920 2024-04-26T12:52:04.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f37f34d2640 1 --2- 172.21.15.72:0/64425147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af5714f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b240 tx=0x7f37e400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faac09127e797b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f36e160a640 1 -- 172.21.15.72:0/64425147 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e400e700 con 0x5609af3fa920 2024-04-26T12:52:04.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f36e160a640 1 -- 172.21.15.72:0/64425147 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e400e8a0 con 0x5609af3fa920 2024-04-26T12:52:04.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.716+0000 7f36e160a640 1 -- 172.21.15.72:0/64425147 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e400eb80 con 0x5609af3fa920 2024-04-26T12:52:04.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- 172.21.15.72:0/64425147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 msgr2=0x5609af5714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 --2- 172.21.15.72:0/64425147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af5714f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b240 tx=0x7f37e400b700 comp rx=0 tx=0).stop 2024-04-26T12:52:04.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- 172.21.15.72:0/64425147 shutdown_connections 2024-04-26T12:52:04.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 --2- 172.21.15.72:0/64425147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af5714f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- 172.21.15.72:0/64425147 >> 172.21.15.72:0/64425147 conn(0x5609af480ab0 msgr2=0x5609af56d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- 172.21.15.72:0/64425147 shutdown_connections 2024-04-26T12:52:04.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- 172.21.15.72:0/64425147 wait complete. 2024-04-26T12:52:04.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 Processor -- start 2024-04-26T12:52:04.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- start start 2024-04-26T12:52:04.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af4866d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5609af48db30 con 0x5609af3fa920 2024-04-26T12:52:04.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f34d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af4866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f34d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af4866d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38422/0 (socket says 172.21.15.72:38422) 2024-04-26T12:52:04.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f34d2640 1 -- 172.21.15.72:0/2482382614 learned_addr learned my addr 172.21.15.72:0/2482382614 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f34d2640 1 -- 172.21.15.72:0/2482382614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af486c10 con 0x5609af3fa920 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f34d2640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af4866d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000c10 tx=0x7f37e4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f36dfe07640 1 -- 172.21.15.72:0/2482382614 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e400fa90 con 0x5609af3fa920 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f36dfe07640 1 -- 172.21.15.72:0/2482382614 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e400fc50 con 0x5609af3fa920 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609af484f30 con 0x5609af3fa920 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f36dfe07640 1 -- 172.21.15.72:0/2482382614 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e401a480 con 0x5609af3fa920 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609af485420 con 0x5609af3fa920 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 Processor -- start 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- start start 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af5881b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f59b7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5609af38dab0 con 0x5609af587d90 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f36dfe07640 1 -- 172.21.15.72:0/2482382614 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f37e4017070 con 0x5609af3fa920 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f3cd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af5881b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f3cd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af5881b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38436/0 (socket says 172.21.15.72:38436) 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f37f3cd3640 1 -- 172.21.15.72:0/3855924865 learned_addr learned my addr 172.21.15.72:0/3855924865 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.720+0000 7f36dfe07640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d8034650 0x7f36d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f36dfe07640 1 -- 172.21.15.72:0/2482382614 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f37e4015020 con 0x5609af3fa920 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f34d2640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d8034650 0x7f36d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f3cd3640 1 -- 172.21.15.72:0/3855924865 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af5886f0 con 0x5609af587d90 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f34d2640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d8034650 0x7f36d8036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37e400ffd0 tx=0x7f37e4035040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f3cd3640 1 --2- 172.21.15.72:0/3855924865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af5881b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00a430 tx=0x7f37ec00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae23a398933b221 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f36dde03640 1 -- 172.21.15.72:0/3855924865 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec00f6e0 con 0x5609af587d90 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f36dde03640 1 -- 172.21.15.72:0/3855924865 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec015070 con 0x5609af587d90 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f36dde03640 1 -- 172.21.15.72:0/3855924865 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec00fa10 con 0x5609af587d90 2024-04-26T12:52:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- 172.21.15.72:0/3855924865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 msgr2=0x5609af5881b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 --2- 172.21.15.72:0/3855924865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af5881b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00a430 tx=0x7f37ec00a8f0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- 172.21.15.72:0/3855924865 shutdown_connections 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 --2- 172.21.15.72:0/3855924865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af5881b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- 172.21.15.72:0/3855924865 >> 172.21.15.72:0/3855924865 conn(0x5609af48a6f0 msgr2=0x5609af583200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- 172.21.15.72:0/3855924865 shutdown_connections 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- 172.21.15.72:0/3855924865 wait complete. 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 Processor -- start 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- start start 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af58f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5609af5890b0 con 0x5609af587d90 2024-04-26T12:52:04.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f3cd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af58f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f3cd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af58f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38444/0 (socket says 172.21.15.72:38444) 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f3cd3640 1 -- 172.21.15.72:0/1479461073 learned_addr learned my addr 172.21.15.72:0/1479461073 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f3cd3640 1 -- 172.21.15.72:0/1479461073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af58f550 con 0x5609af587d90 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f3cd3640 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af58f010 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x5609af588b70 tx=0x7f37ec003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f36cffff640 1 -- 172.21.15.72:0/1479461073 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec00fe00 con 0x5609af587d90 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609af58f7e0 con 0x5609af587d90 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f36cffff640 1 -- 172.21.15.72:0/1479461073 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec010a20 con 0x5609af587d90 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.724+0000 7f36cffff640 1 -- 172.21.15.72:0/1479461073 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec010dc0 con 0x5609af587d90 2024-04-26T12:52:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609af5924c0 con 0x5609af587d90 2024-04-26T12:52:04.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 1 Processor -- start 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f36cffff640 1 -- 172.21.15.72:0/1479461073 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f37ec01a480 con 0x5609af587d90 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 1 -- start start 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af5a9000 0x5609af5a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5609af571e10 con 0x5609af5a9000 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f36cffff640 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d40346a0 0x7f36d4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f36cffff640 1 -- 172.21.15.72:0/1479461073 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f37ec04a4c0 con 0x5609af587d90 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f34d2640 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d40346a0 0x7f36d4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f3cd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af5a9000 0x5609af5a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f3cd3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af5a9000 0x5609af5a9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38454/0 (socket says 172.21.15.72:38454) 2024-04-26T12:52:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f3cd3640 1 -- 172.21.15.72:0/2129622939 learned_addr learned my addr 172.21.15.72:0/2129622939 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f34d2640 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d40346a0 0x7f36d4036b60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f37e400f700 tx=0x7f37e4038000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f3cd3640 1 -- 172.21.15.72:0/2129622939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af5a9960 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f3cd3640 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af5a9000 0x5609af5a9420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f37ec048820 tx=0x7f37ec019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f3663fff640 1 -- 172.21.15.72:0/2129622939 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec035040 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609af5aa400 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f3663fff640 1 -- 172.21.15.72:0/2129622939 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec024d30 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f3663fff640 1 -- 172.21.15.72:0/2129622939 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37ec01bc30 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.728+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609af5aa8d0 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f3663fff640 1 -- 172.21.15.72:0/2129622939 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f37ec021c20 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f3663fff640 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f3663fff640 1 -- 172.21.15.72:0/2129622939 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f37ec045d30 con 0x5609af5a9000 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f2cd1640 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f3661ffb640 20 reqs_thread_entry: start 2024-04-26T12:52:04.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5609af5aed30 0x5609af5b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5609af5b1890 con 0x5609af5aed30 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f2cd1640 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37e80ae000 tx=0x7f37e80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f3cd3640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5609af5aed30 0x5609af5b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f3cd3640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5609af5aed30 0x5609af5b11c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f3cd3640 1 -- 172.21.15.72:0/2482382614 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37ec00e070 con 0x5609af5aed30 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5609af5b36b0 0x5609af5b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:2 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5609af5b6170 con 0x5609af5b36b0 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f34d2640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5609af5b36b0 0x5609af5b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f34d2640 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5609af5b36b0 0x5609af5b5aa0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f34d2640 1 -- 172.21.15.72:0/2482382614 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(2 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f37e4039070 con 0x5609af5b36b0 2024-04-26T12:52:04.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.732+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5609af5b2b60 con 0x5609af5b36b0 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.736+0000 7f37f34d2640 1 -- 172.21.15.72:0/2482382614 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [stat,call,call,writefull 0~993] v35'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f37e4039070 con 0x5609af5b36b0 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.736+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d40346a0 msgr2=0x7f36d4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.736+0000 7f37f59b7980 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d40346a0 0x7f36d4036b60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f37e400f700 tx=0x7f37e4038000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.736+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 msgr2=0x5609af58f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.736+0000 7f37f59b7980 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af58f010 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x5609af588b70 tx=0x7f37ec003380 comp rx=0 tx=0).stop 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 shutdown_connections 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d40346a0 0x7f36d4036b60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/1479461073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af587d90 0x5609af58f010 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 >> 172.21.15.72:0/1479461073 conn(0x5609af48a6f0 msgr2=0x5609af582000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 shutdown_connections 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/1479461073 wait complete. 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 msgr2=0x7f362c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37e80ae000 tx=0x7f37e80a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af5a9000 msgr2=0x5609af5a9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af5a9000 0x5609af5a9420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f37ec048820 tx=0x7f37ec019610 comp rx=0 tx=0).stop 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 shutdown_connections 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f362c034650 0x7f362c036b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2129622939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af5a9000 0x5609af5a9420 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 >> 172.21.15.72:0/2129622939 conn(0x5609af59db50 msgr2=0x5609af59e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 shutdown_connections 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2129622939 wait complete. 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5609af5b36b0 msgr2=0x5609af5b5aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5609af5b36b0 0x5609af5b5aa0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5609af5aed30 msgr2=0x5609af5b11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5609af5aed30 0x5609af5b11c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d8034650 msgr2=0x7f36d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d8034650 0x7f36d8036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37e400ffd0 tx=0x7f37e4035040 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 msgr2=0x5609af4866d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af4866d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000c10 tx=0x7f37e4000ee0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 shutdown_connections 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5609af5b36b0 0x5609af5b5aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5609af5aed30 0x5609af5b11c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f36d8034650 0x7f36d8036b10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 --2- 172.21.15.72:0/2482382614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5609af3fa920 0x5609af4866d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 >> 172.21.15.72:0/2482382614 conn(0x5609af480ab0 msgr2=0x5609af56bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 shutdown_connections 2024-04-26T12:52:04.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.740+0000 7f37f59b7980 1 -- 172.21.15.72:0/2482382614 wait complete. 2024-04-26T12:52:04.752 INFO:teuthology.orchestra.run.smithi072.stdout:{"id":"fe657080-460c-4bb9-93cf-69170ee92cfa","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T12:52:04.753 DEBUG:tasks.util.rgw: json result: {'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T12:52:04.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-26T12:52:04.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-26T12:52:04.753 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-26T12:52:04.828 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:04.828 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:04.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f279205e980 1 Processor -- start 2024-04-26T12:52:04.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f279205e980 1 -- start start 2024-04-26T12:52:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f279205e980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555e983096f0 0x555e9830bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f279205e980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e981b3510 con 0x555e98305190 2024-04-26T12:52:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f279205e980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x555e981ba430 con 0x555e983096f0 2024-04-26T12:52:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f278f378640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555e983096f0 0x555e9830bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f278f378640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x555e983096f0 0x555e9830bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38460/0 (socket says 172.21.15.72:38460) 2024-04-26T12:52:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f278f378640 1 -- 172.21.15.72:0/131087098 learned_addr learned my addr 172.21.15.72:0/131087098 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f278fb79640 1 --1- 172.21.15.72:0/131087098 >> v1:172.21.15.29:6789/0 conn(0x555e98305190 0x555e98305570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48738/0 (socket says 172.21.15.72:48738) 2024-04-26T12:52:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f278f378640 1 -- 172.21.15.72:0/131087098 >> v1:172.21.15.29:6789/0 conn(0x555e98305190 legacy=0x555e98305570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.828+0000 7f278f378640 1 -- 172.21.15.72:0/131087098 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9818fae0 con 0x555e983096f0 2024-04-26T12:52:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f278f378640 1 --2- 172.21.15.72:0/131087098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e983096f0 0x555e9830bae0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f277800a5c0 tx=0x7f277801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aeaf440a3240b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f278eb77640 1 -- 172.21.15.72:0/131087098 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27780a6070 con 0x555e983096f0 2024-04-26T12:52:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f278eb77640 1 -- 172.21.15.72:0/131087098 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27780af070 con 0x555e983096f0 2024-04-26T12:52:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f278eb77640 1 -- 172.21.15.72:0/131087098 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27780aa5c0 con 0x555e983096f0 2024-04-26T12:52:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f279205e980 1 -- 172.21.15.72:0/131087098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e983096f0 msgr2=0x555e9830bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f279205e980 1 --2- 172.21.15.72:0/131087098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e983096f0 0x555e9830bae0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f277800a5c0 tx=0x7f277801b340 comp rx=0 tx=0).stop 2024-04-26T12:52:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f279205e980 1 -- 172.21.15.72:0/131087098 shutdown_connections 2024-04-26T12:52:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f279205e980 1 --2- 172.21.15.72:0/131087098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e983096f0 0x555e9830bae0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f279205e980 1 -- 172.21.15.72:0/131087098 >> 172.21.15.72:0/131087098 conn(0x555e98300a60 msgr2=0x555e98302e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f279205e980 1 -- 172.21.15.72:0/131087098 shutdown_connections 2024-04-26T12:52:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.832+0000 7f279205e980 1 -- 172.21.15.72:0/131087098 wait complete. 2024-04-26T12:52:04.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f279205e980 1 Processor -- start 2024-04-26T12:52:04.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f279205e980 1 -- start start 2024-04-26T12:52:04.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f279205e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f279205e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e98209a70 con 0x555e98305190 2024-04-26T12:52:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f278fb79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f278fb79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38462/0 (socket says 172.21.15.72:38462) 2024-04-26T12:52:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f278fb79640 1 -- 172.21.15.72:0/2355859814 learned_addr learned my addr 172.21.15.72:0/2355859814 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f278fb79640 1 -- 172.21.15.72:0/2355859814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e983f1a00 con 0x555e98305190 2024-04-26T12:52:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f278fb79640 1 --2- 172.21.15.72:0/2355859814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f1430 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2788001690 tx=0x7f2788001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73125561a539c8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f267de0b640 1 -- 172.21.15.72:0/2355859814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2788003460 con 0x555e98305190 2024-04-26T12:52:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f267de0b640 1 -- 172.21.15.72:0/2355859814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788003600 con 0x555e98305190 2024-04-26T12:52:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f267de0b640 1 -- 172.21.15.72:0/2355859814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2788003920 con 0x555e98305190 2024-04-26T12:52:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f279205e980 1 -- 172.21.15.72:0/2355859814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 msgr2=0x555e983f1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.848+0000 7f279205e980 1 --2- 172.21.15.72:0/2355859814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f1430 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2788001690 tx=0x7f2788001b50 comp rx=0 tx=0).stop 2024-04-26T12:52:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- 172.21.15.72:0/2355859814 shutdown_connections 2024-04-26T12:52:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 --2- 172.21.15.72:0/2355859814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f1430 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- 172.21.15.72:0/2355859814 >> 172.21.15.72:0/2355859814 conn(0x555e98300a60 msgr2=0x555e98279930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- 172.21.15.72:0/2355859814 shutdown_connections 2024-04-26T12:52:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- 172.21.15.72:0/2355859814 wait complete. 2024-04-26T12:52:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 Processor -- start 2024-04-26T12:52:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- start start 2024-04-26T12:52:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e9830eb10 con 0x555e98305190 2024-04-26T12:52:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f278fb79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f278fb79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38468/0 (socket says 172.21.15.72:38468) 2024-04-26T12:52:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f278fb79640 1 -- 172.21.15.72:0/3959140077 learned_addr learned my addr 172.21.15.72:0/3959140077 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f278fb79640 1 -- 172.21.15.72:0/3959140077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e983f8b70 con 0x555e98305190 2024-04-26T12:52:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f278fb79640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f8630 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2788000f90 tx=0x7f2788001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f2677fff640 1 -- 172.21.15.72:0/3959140077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2788022020 con 0x555e98305190 2024-04-26T12:52:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f2677fff640 1 -- 172.21.15.72:0/3959140077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788006840 con 0x555e98305190 2024-04-26T12:52:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e983f8e00 con 0x555e98305190 2024-04-26T12:52:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f2677fff640 1 -- 172.21.15.72:0/3959140077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f278801e800 con 0x555e98305190 2024-04-26T12:52:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e983fba80 con 0x555e98305190 2024-04-26T12:52:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 Processor -- start 2024-04-26T12:52:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- start start 2024-04-26T12:52:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e98405e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.852+0000 7f279205e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e9820dab0 con 0x555e98405a60 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e98405e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e98405e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38472/0 (socket says 172.21.15.72:38472) 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 -- 172.21.15.72:0/922537063 learned_addr learned my addr 172.21.15.72:0/922537063 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f2677fff640 1 -- 172.21.15.72:0/3959140077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2788025020 con 0x555e98305190 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f2677fff640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2678034600 0x7f2678036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f2677fff640 1 -- 172.21.15.72:0/3959140077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2788049c40 con 0x555e98305190 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f278fb79640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2678034600 0x7f2678036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 -- 172.21.15.72:0/922537063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e984063c0 con 0x555e98405a60 2024-04-26T12:52:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f278fb79640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2678034600 0x7f2678036ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2788048030 tx=0x7f278801df30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 --2- 172.21.15.72:0/922537063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e98405e80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f278000a440 tx=0x7f278000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74f16d2d58d0927 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f2675ffb640 1 -- 172.21.15.72:0/922537063 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2780008850 con 0x555e98405a60 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f2675ffb640 1 -- 172.21.15.72:0/922537063 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2780008a10 con 0x555e98405a60 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f2675ffb640 1 -- 172.21.15.72:0/922537063 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2780008d30 con 0x555e98405a60 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 -- 172.21.15.72:0/922537063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 msgr2=0x555e98405e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 --2- 172.21.15.72:0/922537063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e98405e80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f278000a440 tx=0x7f278000a900 comp rx=0 tx=0).stop 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 -- 172.21.15.72:0/922537063 shutdown_connections 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 --2- 172.21.15.72:0/922537063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e98405e80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 -- 172.21.15.72:0/922537063 >> 172.21.15.72:0/922537063 conn(0x555e983096f0 msgr2=0x555e98400ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 -- 172.21.15.72:0/922537063 shutdown_connections 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 -- 172.21.15.72:0/922537063 wait complete. 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 Processor -- start 2024-04-26T12:52:04.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 -- start start 2024-04-26T12:52:04.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e9840cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279205e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e98406d80 con 0x555e98405a60 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e9840cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e9840cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38478/0 (socket says 172.21.15.72:38478) 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 -- 172.21.15.72:0/410905392 learned_addr learned my addr 172.21.15.72:0/410905392 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 -- 172.21.15.72:0/410905392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9840d2b0 con 0x555e98405a60 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.856+0000 7f279037a640 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e9840cd70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x555e98406840 tx=0x7f2780003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f266ffff640 1 -- 172.21.15.72:0/410905392 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2780013a70 con 0x555e98405a60 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e9840d540 con 0x555e98405a60 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f266ffff640 1 -- 172.21.15.72:0/410905392 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2780023070 con 0x555e98405a60 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f266ffff640 1 -- 172.21.15.72:0/410905392 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2780013d40 con 0x555e98405a60 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e98410220 con 0x555e98405a60 2024-04-26T12:52:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f266ffff640 1 -- 172.21.15.72:0/410905392 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2780028460 con 0x555e98405a60 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f266ffff640 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2668034650 0x7f2668036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 Processor -- start 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f266ffff640 1 -- 172.21.15.72:0/410905392 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f278004a020 con 0x555e98405a60 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279037a640 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2668034650 0x7f2668036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 -- start start 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98426c80 0x555e984270a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e983f1cf0 con 0x555e98426c80 2024-04-26T12:52:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279037a640 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2668034650 0x7f2668036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2780027fd0 tx=0x7f2780013f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f278fb79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98426c80 0x555e984270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f278fb79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98426c80 0x555e984270a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38486/0 (socket says 172.21.15.72:38486) 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f278fb79640 1 -- 172.21.15.72:0/769295450 learned_addr learned my addr 172.21.15.72:0/769295450 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f278fb79640 1 -- 172.21.15.72:0/769295450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e984275e0 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f278fb79640 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98426c80 0x555e984270a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2788012630 tx=0x7f2788012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f25dffff640 1 -- 172.21.15.72:0/769295450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f278801da50 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f25dffff640 1 -- 172.21.15.72:0/769295450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788010ca0 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e98428080 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f25dffff640 1 -- 172.21.15.72:0/769295450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2788010910 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.860+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e98428550 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f25dffff640 1 -- 172.21.15.72:0/769295450 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f278803c040 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f25dffff640 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f25d00346a0 0x7f25d0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f25dffff640 1 -- 172.21.15.72:0/769295450 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2788040070 con 0x555e98426c80 2024-04-26T12:52:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f278f378640 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f25d00346a0 0x7f25d0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f25ddffb640 20 reqs_thread_entry: start 2024-04-26T12:52:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555e9842c860 0x555e9842ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e9842f220 con 0x555e9842c860 2024-04-26T12:52:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f278f378640 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f25d00346a0 0x7f25d0036b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f27780ae000 tx=0x7f27780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279037a640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555e9842c860 0x555e9842ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279037a640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555e9842c860 0x555e9842ec50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279037a640 1 -- 172.21.15.72:0/3959140077 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f278002ecf0 con 0x555e9842c860 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e9842fae0 con 0x555e9842c860 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279037a640 1 -- 172.21.15.72:0/3959140077 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f278002ecf0 con 0x555e9842c860 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555e984313f0 0x555e98433860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:3 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e98433fc0 con 0x555e984313f0 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f278fb79640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555e984313f0 0x555e98433860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f278fb79640 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555e984313f0 0x555e98433860 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.864+0000 7f278fb79640 1 -- 172.21.15.72:0/3959140077 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(3 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f278801b040 con 0x555e984313f0 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2668034650 msgr2=0x7f2668036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2668034650 0x7f2668036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2780027fd0 tx=0x7f2780013f60 comp rx=0 tx=0).stop 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 msgr2=0x555e9840cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e9840cd70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x555e98406840 tx=0x7f2780003000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 shutdown_connections 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2668034650 0x7f2668036b10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/410905392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98405a60 0x555e9840cd70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 >> 172.21.15.72:0/410905392 conn(0x555e983096f0 msgr2=0x555e983ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 shutdown_connections 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/410905392 wait complete. 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f25d00346a0 msgr2=0x7f25d0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f25d00346a0 0x7f25d0036b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f27780ae000 tx=0x7f27780a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98426c80 msgr2=0x555e984270a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98426c80 0x555e984270a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2788012630 tx=0x7f2788012660 comp rx=0 tx=0).stop 2024-04-26T12:52:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 shutdown_connections 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f25d00346a0 0x7f25d0036b60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/769295450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98426c80 0x555e984270a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 >> 172.21.15.72:0/769295450 conn(0x555e9841b860 msgr2=0x555e9841c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 shutdown_connections 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/769295450 wait complete. 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555e9842c860 msgr2=0x555e9842ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555e9842c860 0x555e9842ec50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555e984313f0 msgr2=0x555e98433860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555e984313f0 0x555e98433860 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2678034600 msgr2=0x7f2678036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2678034600 0x7f2678036ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2788048030 tx=0x7f278801df30 comp rx=0 tx=0).stop 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 msgr2=0x555e983f8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f8630 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2788000f90 tx=0x7f2788001260 comp rx=0 tx=0).stop 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 shutdown_connections 2024-04-26T12:52:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x555e984313f0 0x555e98433860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x555e9842c860 0x555e9842ec50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2678034600 0x7f2678036ac0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 --2- 172.21.15.72:0/3959140077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e98305190 0x555e983f8630 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 >> 172.21.15.72:0/3959140077 conn(0x555e98300a60 msgr2=0x555e983ea9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 shutdown_connections 2024-04-26T12:52:04.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.868+0000 7f279205e980 1 -- 172.21.15.72:0/3959140077 wait complete. 2024-04-26T12:52:04.883 INFO:teuthology.orchestra.run.smithi072.stdout:{"id":"f52412b2-0d18-4618-9944-7ddcdd8afe97","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"fe657080-460c-4bb9-93cf-69170ee92cfa","zones":[{"id":"fe657080-460c-4bb9-93cf-69170ee92cfa","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-26T12:52:04.883 DEBUG:tasks.util.rgw: json result: {'id': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'fe657080-460c-4bb9-93cf-69170ee92cfa', 'zones': [{'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-04-26T12:52:04.885 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-26T12:52:04.921 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-26T12:52:04.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-26T12:52:04.922 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-26T12:52:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:04.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2e49e980 1 Processor -- start 2024-04-26T12:52:04.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2e49e980 1 -- start start 2024-04-26T12:52:04.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2e49e980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d1f53ae610 0x55d1f53b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2e49e980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d1f5257510 con 0x55d1f531dfd0 2024-04-26T12:52:04.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2e49e980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55d1f525e430 con 0x55d1f53ae610 2024-04-26T12:52:04.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2b7b8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d1f53ae610 0x55d1f53b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2bfb9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55d1f531dfd0 0x55d1f53acef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48740/0 (socket says 172.21.15.72:48740) 2024-04-26T12:52:04.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2b7b8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55d1f53ae610 0x55d1f53b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38496/0 (socket says 172.21.15.72:38496) 2024-04-26T12:52:04.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.968+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/981457511 learned_addr learned my addr 172.21.15.72:0/981457511 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:04.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/981457511 >> v1:172.21.15.29:6789/0 conn(0x55d1f531dfd0 legacy=0x55d1f53acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/981457511 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f5233ae0 con 0x55d1f53ae610 2024-04-26T12:52:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/981457511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f53ae610 0x55d1f53b0a00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400a420 tx=0x7f2e1401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c05fa6068ddd7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2afb7640 1 -- 172.21.15.72:0/981457511 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e140af070 con 0x55d1f53ae610 2024-04-26T12:52:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2afb7640 1 -- 172.21.15.72:0/981457511 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e140aa530 con 0x55d1f53ae610 2024-04-26T12:52:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2afb7640 1 -- 172.21.15.72:0/981457511 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e140aa850 con 0x55d1f53ae610 2024-04-26T12:52:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2e49e980 1 -- 172.21.15.72:0/981457511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f53ae610 msgr2=0x55d1f53b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/981457511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f53ae610 0x55d1f53b0a00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400a420 tx=0x7f2e1401afd0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2e49e980 1 -- 172.21.15.72:0/981457511 shutdown_connections 2024-04-26T12:52:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/981457511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f53ae610 0x55d1f53b0a00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2e49e980 1 -- 172.21.15.72:0/981457511 >> 172.21.15.72:0/981457511 conn(0x55d1f53a4a10 msgr2=0x55d1f53a6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2e49e980 1 -- 172.21.15.72:0/981457511 shutdown_connections 2024-04-26T12:52:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.972+0000 7f2e2e49e980 1 -- 172.21.15.72:0/981457511 wait complete. 2024-04-26T12:52:04.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2e49e980 1 Processor -- start 2024-04-26T12:52:04.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2e49e980 1 -- start start 2024-04-26T12:52:04.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2e49e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f5495550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2e49e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d1f52ada70 con 0x55d1f531dfd0 2024-04-26T12:52:04.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f5495550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f5495550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38500/0 (socket says 172.21.15.72:38500) 2024-04-26T12:52:04.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/956105488 learned_addr learned my addr 172.21.15.72:0/956105488 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/956105488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f5495b20 con 0x55d1f531dfd0 2024-04-26T12:52:04.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/956105488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f5495550 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c001d90 tx=0x7f2e1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e62db447eea80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2d19e0b640 1 -- 172.21.15.72:0/956105488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c013030 con 0x55d1f531dfd0 2024-04-26T12:52:04.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2d19e0b640 1 -- 172.21.15.72:0/956105488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00e690 con 0x55d1f531dfd0 2024-04-26T12:52:04.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.988+0000 7f2d19e0b640 1 -- 172.21.15.72:0/956105488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c00ea10 con 0x55d1f531dfd0 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- 172.21.15.72:0/956105488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 msgr2=0x55d1f5495550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/956105488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f5495550 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c001d90 tx=0x7f2e1c001e80 comp rx=0 tx=0).stop 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- 172.21.15.72:0/956105488 shutdown_connections 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/956105488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f5495550 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- 172.21.15.72:0/956105488 >> 172.21.15.72:0/956105488 conn(0x55d1f53a4a10 msgr2=0x55d1f54910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- 172.21.15.72:0/956105488 shutdown_connections 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- 172.21.15.72:0/956105488 wait complete. 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 Processor -- start 2024-04-26T12:52:04.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- start start 2024-04-26T12:52:04.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f549c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d1f53b1ae0 con 0x55d1f531dfd0 2024-04-26T12:52:04.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f549c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f549c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38514/0 (socket says 172.21.15.72:38514) 2024-04-26T12:52:04.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/435033169 learned_addr learned my addr 172.21.15.72:0/435033169 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:04.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f549cd80 con 0x55d1f531dfd0 2024-04-26T12:52:04.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f549c840 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55d1f54963e0 tx=0x7f2e1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2d13fff640 1 -- 172.21.15.72:0/435033169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c027070 con 0x55d1f531dfd0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1f549d010 con 0x55d1f531dfd0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2d13fff640 1 -- 172.21.15.72:0/435033169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c019900 con 0x55d1f531dfd0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2d13fff640 1 -- 172.21.15.72:0/435033169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c019c20 con 0x55d1f531dfd0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f549fbd0 con 0x55d1f531dfd0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.992+0000 7f2d13fff640 1 -- 172.21.15.72:0/435033169 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2e1c02a070 con 0x55d1f531dfd0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2d13fff640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d14034650 0x7f2d14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2d13fff640 1 -- 172.21.15.72:0/435033169 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2e1c01f070 con 0x55d1f531dfd0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d14034650 0x7f2d14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f53ae610 0x55d1f54a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54a3d60 con 0x55d1f53ae610 2024-04-26T12:52:04.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2c7ba640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f53ae610 0x55d1f54a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d14034650 0x7f2d14036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e140ac000 tx=0x7f2e140a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2c7ba640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f53ae610 0x55d1f54a36f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/435033169 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f53ae610 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54a0dd0 con 0x55d1f53ae610 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/435033169 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f53ae610 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54a6090 0x55d1f54a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54a8b70 con 0x55d1f54a6090 2024-04-26T12:52:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54a6090 0x55d1f54a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54a6090 0x55d1f54a8480 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/435033169 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e1c029030 con 0x55d1f54a6090 2024-04-26T12:52:05.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54a4f30 con 0x55d1f53ae610 2024-04-26T12:52:05.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/435033169 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f53ae610 2024-04-26T12:52:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54a9fd0 0x55d1f54ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:04.996+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54acb00 con 0x55d1f54a9fd0 2024-04-26T12:52:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54a9fd0 0x55d1f54ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54a9fd0 0x55d1f54ac3c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/435033169 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e140b2070 con 0x55d1f54a9fd0 2024-04-26T12:52:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2e49e980 1 Processor -- start 2024-04-26T12:52:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2e49e980 1 -- start start 2024-04-26T12:52:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2e49e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54bab90 0x55d1f54bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2e49e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d1f52b1ab0 con 0x55d1f54bab90 2024-04-26T12:52:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54bab90 0x55d1f54bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54bab90 0x55d1f54bafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38524/0 (socket says 172.21.15.72:38524) 2024-04-26T12:52:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/631659569 learned_addr learned my addr 172.21.15.72:0/631659569 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/631659569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f54bb4f0 con 0x55d1f54bab90 2024-04-26T12:52:05.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54bab90 0x55d1f54bafb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c048460 tx=0x7f2e1c0485a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2d117fa640 1 -- 172.21.15.72:0/631659569 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c048b50 con 0x55d1f54bab90 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1f54bbf90 con 0x55d1f54bab90 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2d117fa640 1 -- 172.21.15.72:0/631659569 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c048cf0 con 0x55d1f54bab90 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2d117fa640 1 -- 172.21.15.72:0/631659569 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c02a580 con 0x55d1f54bab90 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.000+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f54bc460 con 0x55d1f54bab90 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2d117fa640 1 -- 172.21.15.72:0/631659569 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2e1c036040 con 0x55d1f54bab90 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2d117fa640 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d04034650 0x7f2d04036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2d117fa640 1 -- 172.21.15.72:0/631659569 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2e1c014070 con 0x55d1f54bab90 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d04034650 0x7f2d04036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 Processor -- start 2024-04-26T12:52:05.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- start start 2024-04-26T12:52:05.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f54c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d1f5495e70 con 0x55d1f54c7c10 2024-04-26T12:52:05.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d04034650 0x7f2d04036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55d1f54a4230 tx=0x7f2e14005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f54c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f54c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38532/0 (socket says 172.21.15.72:38532) 2024-04-26T12:52:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/2998349968 learned_addr learned my addr 172.21.15.72:0/2998349968 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/2998349968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f54c85e0 con 0x55d1f54c7c10 2024-04-26T12:52:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/2998349968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f54c8010 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c02c440 tx=0x7f2e1c02c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d078f5cd28c25a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2d0affd640 1 -- 172.21.15.72:0/2998349968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c058040 con 0x55d1f54c7c10 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2d0affd640 1 -- 172.21.15.72:0/2998349968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c02ac20 con 0x55d1f54c7c10 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2d0affd640 1 -- 172.21.15.72:0/2998349968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c019140 con 0x55d1f54c7c10 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- 172.21.15.72:0/2998349968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 msgr2=0x55d1f54c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/2998349968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f54c8010 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c02c440 tx=0x7f2e1c02c530 comp rx=0 tx=0).stop 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- 172.21.15.72:0/2998349968 shutdown_connections 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/2998349968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f54c8010 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- 172.21.15.72:0/2998349968 >> 172.21.15.72:0/2998349968 conn(0x55d1f54c3f50 msgr2=0x55d1f54c1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- 172.21.15.72:0/2998349968 shutdown_connections 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- 172.21.15.72:0/2998349968 wait complete. 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 Processor -- start 2024-04-26T12:52:05.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- start start 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f53aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2e49e980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d1f54c8cc0 con 0x55d1f54c7c10 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.004+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f53aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2bfb9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f53aa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38542/0 (socket says 172.21.15.72:38542) 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 learned_addr learned my addr 172.21.15.72:0/97996242 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f53aad10 con 0x55d1f54c7c10 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f53aa7d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00d010 tx=0x7f2e1c031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2d097fa640 1 -- 172.21.15.72:0/97996242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c06a020 con 0x55d1f54c7c10 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1f53aad10 con 0x55d1f54c7c10 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2d097fa640 1 -- 172.21.15.72:0/97996242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c02cc20 con 0x55d1f54c7c10 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2d097fa640 1 -- 172.21.15.72:0/97996242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c041400 con 0x55d1f54c7c10 2024-04-26T12:52:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f53aad10 con 0x55d1f54c7c10 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2d097fa640 1 -- 172.21.15.72:0/97996242 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2e1c06d020 con 0x55d1f54c7c10 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2d097fa640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cf4034650 0x7f2cf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2d097fa640 1 -- 172.21.15.72:0/97996242 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2e1c005050 con 0x55d1f54c7c10 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cf4034650 0x7f2cf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f54dc210 0x55d1f54de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dee20 con 0x55d1f54dc210 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2c7ba640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f54dc210 0x55d1f54de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cf4034650 0x7f2cf4036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e140aafd0 tx=0x7f2e140b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2c7ba640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f54dc210 0x55d1f54de6d0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f54dc210 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 20 realm 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54df230 con 0x55d1f54dc210 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f54dc210 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.008+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfad0 con 0x55d1f54dc210 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f54dc210 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54dc210 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f54dc210 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54e0bd0 0x55d1f54e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54e3610 con 0x55d1f54e0bd0 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54e0bd0 0x55d1f54e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2bfb9640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54e0bd0 0x55d1f54e2fc0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 20 searching for the correct realm 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54e54f0 0x55d1f54e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54e7fc0 con 0x55d1f54e54f0 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54e54f0 0x55d1f54e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54e54f0 0x55d1f54e7940 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2b7b8640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2e140cc040 0x7f2e140d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54e7fc0 con 0x7f2e140cc040 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2c7ba640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2e140cc040 0x7f2e140d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2c7ba640 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2e140cc040 0x7f2e140d9410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e240083f0 con 0x7f2e140cc040 2024-04-26T12:52:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.012+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54e0bd0 2024-04-26T12:52:05.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54dc210 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e240083f0 con 0x55d1f54dc210 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54dc210 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54e0bd0 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54e0bd0 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x7f2e140cc040 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54e54f0 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54dc210 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x7f2e140cc040 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e2402b040 con 0x55d1f54dc210 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.016+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e2402b040 con 0x7f2e140cc040 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e2402b040 con 0x55d1f54e54f0 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e54f0 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e0bd0 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e54f0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e54f0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54dc210 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54dc210 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e0bd0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e54f0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.020+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x7f2e140cc040 2024-04-26T12:52:05.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54dc210 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e0bd0 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e54f0 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e0bd0 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x7f2e140cc040 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e54f0 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54e0bd0 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.024+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x55d1f54dc210 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2e140e6040 con 0x7f2e140cc040 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54dc210 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54dc210 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54dfe70 con 0x55d1f54e54f0 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 zone default found 2024-04-26T12:52:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 4 Realm: () 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 zonegroup default 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54e44d0 con 0x55d1f54e0bd0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54e9e20 con 0x55d1f54e54f0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ea1c0 con 0x55d1f54e54f0 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 started sync module instance, tier type = 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.028+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54e92c0 con 0x7f2e140cc040 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.032+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.032+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94360252094480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54e92c0 con 0x7f2e140cc040 2024-04-26T12:52:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.032+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eab80 con 0x55d1f54dc210 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.032+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94360252094480] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.032+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.032+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94360252092192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eab80 con 0x55d1f54dc210 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.032+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eb540 con 0x55d1f54e54f0 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94360252092192] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94360252098256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eaaf0 con 0x55d1f54e54f0 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ec240 con 0x7f2e140cc040 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94360252104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ecae0 con 0x7f2e140cc040 2024-04-26T12:52:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ed4a0 con 0x55d1f54dc210 2024-04-26T12:52:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94360252104352] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.036+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94360252098256] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.040+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.040+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94360252108784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eca50 con 0x55d1f54dc210 2024-04-26T12:52:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.040+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ed410 con 0x55d1f54e0bd0 2024-04-26T12:52:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.040+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.040+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94360252110992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ee160 con 0x55d1f54e0bd0 2024-04-26T12:52:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.040+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eeb20 con 0x55d1f54e0bd0 2024-04-26T12:52:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.040+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94360252108784] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.044+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94360252110992] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.044+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.044+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94360252112048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ee0d0 con 0x55d1f54e0bd0 2024-04-26T12:52:05.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.044+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eeff0 con 0x55d1f54e0bd0 2024-04-26T12:52:05.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94360252112048] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94360252114544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54eeff0 con 0x55d1f54e0bd0 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=0 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=1 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=2 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=3 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=4 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=5 2024-04-26T12:52:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=6 2024-04-26T12:52:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94360252114544] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 20 add_watcher() i=7 2024-04-26T12:52:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54f2450 con 0x55d1f54dc210 2024-04-26T12:52:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.048+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94360252115600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f54ef940 con 0x55d1f54dc210 2024-04-26T12:52:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94360252115600] v35'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2ce1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 5 note: GC not initialized 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2ce0fe1640 20 reqs_thread_entry: start 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 Filter name: none 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2c5a7fc640 20 reqs_thread_entry: start 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f5515d10 con 0x55d1f54e0bd0 2024-04-26T12:52:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f5514350 con 0x55d1f54dc210 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-26T12:52:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.052+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f5514d50 con 0x55d1f54e0bd0 2024-04-26T12:52:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v35'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94360252270448 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55197b0 con 0x55d1f54dc210 2024-04-26T12:52:05.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== watch-notify(notify (1) cookie 94360252108784 notify 150323855383 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f2e24010040 con 0x55d1f54dc210 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2d0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855383 cookie 94360252108784 notifier 4839 bl.length()=649 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2d0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2d0affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.4 [notify cookie 94360252270448 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2d0affd640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2cf0003eb0 con 0x55d1f54dc210 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== watch-notify(notify_complete (2) cookie 94360252270448 notify 150323855383 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2e2402c450 con 0x55d1f54dc210 2024-04-26T12:52:05.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f5514770 con 0x55d1f54dc210 2024-04-26T12:52:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v35'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-26T12:52:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T12:52:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.056+0000 7f2e2e49e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-26T12:52:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94360252270448 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55197b0 con 0x55d1f54e54f0 2024-04-26T12:52:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== watch-notify(notify (1) cookie 94360252098256 notify 150323855368 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f2e140e0040 con 0x55d1f54e54f0 2024-04-26T12:52:05.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2d0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94360252098256 notifier 4839 bl.length()=177 2024-04-26T12:52:05.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(68 notify.2 [notify cookie 94360252270448 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2d0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-26T12:52:05.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2d0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T12:52:05.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2d0a7fc640 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2c60003410 con 0x55d1f54e54f0 2024-04-26T12:52:05.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== watch-notify(notify_complete (2) cookie 94360252270448 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d1f5233ae0 con 0x55d1f54e54f0 2024-04-26T12:52:05.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.062 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:05.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2ce1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94360252115600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x55d1f54dc210 2024-04-26T12:52:05.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94360252115600] v35'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.060+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94360252094480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x7f2e140cc040 2024-04-26T12:52:05.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.064+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94360252094480] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.064+0000 7f2e2e49e980 20 remove_watcher() i=0 2024-04-26T12:52:05.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.064+0000 7f2e2e49e980 2 removed watcher, disabling cache 2024-04-26T12:52:05.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.064+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94360252092192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x55d1f54dc210 2024-04-26T12:52:05.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.064+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94360252092192] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.064+0000 7f2e2e49e980 20 remove_watcher() i=1 2024-04-26T12:52:05.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.064+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94360252098256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x55d1f54e54f0 2024-04-26T12:52:05.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.068+0000 7f2e2b7b8640 1 -- 172.21.15.72:0/97996242 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94360252098256] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e140d7070 con 0x55d1f54e54f0 2024-04-26T12:52:05.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.068+0000 7f2e2e49e980 20 remove_watcher() i=2 2024-04-26T12:52:05.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.068+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94360252104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x7f2e140cc040 2024-04-26T12:52:05.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.068+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94360252104352] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x7f2e140cc040 2024-04-26T12:52:05.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.068+0000 7f2e2e49e980 20 remove_watcher() i=3 2024-04-26T12:52:05.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.068+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94360252108784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x55d1f54dc210 2024-04-26T12:52:05.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.068+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94360252108784] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e24026040 con 0x55d1f54dc210 2024-04-26T12:52:05.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.072+0000 7f2e2e49e980 20 remove_watcher() i=4 2024-04-26T12:52:05.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.072+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94360252110992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x55d1f54e0bd0 2024-04-26T12:52:05.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.072+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94360252110992] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.072+0000 7f2e2e49e980 20 remove_watcher() i=5 2024-04-26T12:52:05.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.072+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94360252112048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x55d1f54e0bd0 2024-04-26T12:52:05.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94360252112048] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 20 remove_watcher() i=6 2024-04-26T12:52:05.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94360252114544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1f55139b0 con 0x55d1f54e0bd0 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2bfb9640 1 -- 172.21.15.72:0/97996242 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94360252114544] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c03e020 con 0x55d1f54e0bd0 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 20 remove_watcher() i=7 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54e0bd0 msgr2=0x55d1f54e2fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54e0bd0 0x55d1f54e2fc0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f54dc210 msgr2=0x55d1f54de6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f54dc210 0x55d1f54de6d0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2e140cc040 msgr2=0x7f2e140d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2e140cc040 0x7f2e140d9410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54e54f0 msgr2=0x55d1f54e7940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54e54f0 0x55d1f54e7940 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cf4034650 msgr2=0x7f2cf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cf4034650 0x7f2cf4036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e140aafd0 tx=0x7f2e140b8040 comp rx=0 tx=0).stop 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 msgr2=0x55d1f53aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/97996242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54c7c10 0x55d1f53aa7d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00d010 tx=0x7f2e1c031f50 comp rx=0 tx=0).stop 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 reap_dead start 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/97996242 reap_dead start 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 shutdown_connections 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 >> 172.21.15.72:0/97996242 conn(0x55d1f54c3f50 msgr2=0x55d1f54c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 shutdown_connections 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/97996242 wait complete. 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d04034650 msgr2=0x7f2d04036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d04034650 0x7f2d04036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55d1f54a4230 tx=0x7f2e14005d90 comp rx=0 tx=0).stop 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54bab90 msgr2=0x55d1f54bafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.076+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54bab90 0x55d1f54bafb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c048460 tx=0x7f2e1c0485a0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 shutdown_connections 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d04034650 0x7f2d04036b10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/631659569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f54bab90 0x55d1f54bafb0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 >> 172.21.15.72:0/631659569 conn(0x55d1f54af9a0 msgr2=0x55d1f54b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 shutdown_connections 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/631659569 wait complete. 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54a6090 msgr2=0x55d1f54a8480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55d1f54a6090 0x55d1f54a8480 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f53ae610 msgr2=0x55d1f54a36f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55d1f53ae610 0x55d1f54a36f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54a9fd0 msgr2=0x55d1f54ac3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55d1f54a9fd0 0x55d1f54ac3c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d14034650 msgr2=0x7f2d14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2d14034650 0x7f2d14036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e140ac000 tx=0x7f2e140a5000 comp rx=0 tx=0).stop 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 msgr2=0x55d1f549c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 --2- 172.21.15.72:0/435033169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d1f531dfd0 0x55d1f549c840 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55d1f54963e0 tx=0x7f2e1c000bd0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2c7ba640 1 -- 172.21.15.72:0/435033169 reap_dead start 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 shutdown_connections 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 >> 172.21.15.72:0/435033169 conn(0x55d1f53a4a10 msgr2=0x55d1f548fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 shutdown_connections 2024-04-26T12:52:05.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.080+0000 7f2e2e49e980 1 -- 172.21.15.72:0/435033169 wait complete. 2024-04-26T12:52:05.091 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:05.092 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:05.092 ERROR:root:0 2024-04-26T12:52:05.093 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:05.099 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000abcea80be9bd74e3-00662ba375-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:52:05.099 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-26T12:52:05.113 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:05.114 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-26T12:52:05.133 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-26T12:52:05.133 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-26T12:52:05.158 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-26T12:52:05.158 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-26T12:52:05.170 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-26T12:52:05.170 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:05.174 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:05.174 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-26T12:52:05.179 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:05.179 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:05.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:05.180 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-04-26T12:52:05.215 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:05.215 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:05.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfde0c980 1 Processor -- start 2024-04-26T12:52:05.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfde0c980 1 -- start start 2024-04-26T12:52:05.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfde0c980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557355d5c890 0x557355deaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfde0c980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557355c95510 con 0x557355deb4c0 2024-04-26T12:52:05.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfde0c980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x557355c9c430 con 0x557355d5c890 2024-04-26T12:52:05.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfb927640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557355d5c890 0x557355deaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfb927640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x557355d5c890 0x557355deaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38552/0 (socket says 172.21.15.72:38552) 2024-04-26T12:52:05.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfb126640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x557355deb4c0 0x557355ded8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48754/0 (socket says 172.21.15.72:48754) 2024-04-26T12:52:05.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfb927640 1 -- 172.21.15.72:0/2136159661 learned_addr learned my addr 172.21.15.72:0/2136159661 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfb927640 1 -- 172.21.15.72:0/2136159661 >> v1:172.21.15.29:6789/0 conn(0x557355deb4c0 legacy=0x557355ded8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.216+0000 7f2dfb927640 1 -- 172.21.15.72:0/2136159661 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557355c71ae0 con 0x557355d5c890 2024-04-26T12:52:05.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfb927640 1 --2- 172.21.15.72:0/2136159661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355deaf80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00a5c0 tx=0x7f2dec01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f15eeba1581877c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfa925640 1 -- 172.21.15.72:0/2136159661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0a6070 con 0x557355d5c890 2024-04-26T12:52:05.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfa925640 1 -- 172.21.15.72:0/2136159661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0af070 con 0x557355d5c890 2024-04-26T12:52:05.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfa925640 1 -- 172.21.15.72:0/2136159661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0aa5c0 con 0x557355d5c890 2024-04-26T12:52:05.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2136159661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 msgr2=0x557355deaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/2136159661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355deaf80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00a5c0 tx=0x7f2dec01b340 comp rx=0 tx=0).stop 2024-04-26T12:52:05.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2136159661 shutdown_connections 2024-04-26T12:52:05.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/2136159661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355deaf80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2136159661 >> 172.21.15.72:0/2136159661 conn(0x557355de2a60 msgr2=0x557355de4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2136159661 shutdown_connections 2024-04-26T12:52:05.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.220+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2136159661 wait complete. 2024-04-26T12:52:05.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 Processor -- start 2024-04-26T12:52:05.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- start start 2024-04-26T12:52:05.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355ed34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557355ceba70 con 0x557355d5c890 2024-04-26T12:52:05.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355ed34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355ed34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38554/0 (socket says 172.21.15.72:38554) 2024-04-26T12:52:05.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfb927640 1 -- 172.21.15.72:0/422520524 learned_addr learned my addr 172.21.15.72:0/422520524 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfb927640 1 -- 172.21.15.72:0/422520524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557355ed3ac0 con 0x557355d5c890 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfb927640 1 --2- 172.21.15.72:0/422520524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355ed34f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0ac040 tx=0x7f2dec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b027a3483405ccb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2ce9e0b640 1 -- 172.21.15.72:0/422520524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0aa970 con 0x557355d5c890 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2ce9e0b640 1 -- 172.21.15.72:0/422520524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0aab10 con 0x557355d5c890 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2ce9e0b640 1 -- 172.21.15.72:0/422520524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0aae30 con 0x557355d5c890 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- 172.21.15.72:0/422520524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 msgr2=0x557355ed34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/422520524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355ed34f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0ac040 tx=0x7f2dec003030 comp rx=0 tx=0).stop 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- 172.21.15.72:0/422520524 shutdown_connections 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/422520524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355ed34f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- 172.21.15.72:0/422520524 >> 172.21.15.72:0/422520524 conn(0x557355de2a60 msgr2=0x557355ecf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- 172.21.15.72:0/422520524 shutdown_connections 2024-04-26T12:52:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- 172.21.15.72:0/422520524 wait complete. 2024-04-26T12:52:05.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 Processor -- start 2024-04-26T12:52:05.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- start start 2024-04-26T12:52:05.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355eda690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.236+0000 7f2dfde0c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557355defae0 con 0x557355d5c890 2024-04-26T12:52:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355eda690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355eda690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38566/0 (socket says 172.21.15.72:38566) 2024-04-26T12:52:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfb927640 1 -- 172.21.15.72:0/198770582 learned_addr learned my addr 172.21.15.72:0/198770582 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfb927640 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557355edabd0 con 0x557355d5c890 2024-04-26T12:52:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfb927640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355eda690 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2dec003070 tx=0x7f2dec0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2ce3fff640 1 -- 172.21.15.72:0/198770582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0c6710 con 0x557355d5c890 2024-04-26T12:52:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2ce3fff640 1 -- 172.21.15.72:0/198770582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0c68b0 con 0x557355d5c890 2024-04-26T12:52:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557355edae60 con 0x557355d5c890 2024-04-26T12:52:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2ce3fff640 1 -- 172.21.15.72:0/198770582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0c6b90 con 0x557355d5c890 2024-04-26T12:52:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557355edda90 con 0x557355d5c890 2024-04-26T12:52:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2ce3fff640 1 -- 172.21.15.72:0/198770582 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2dec0d0400 con 0x557355d5c890 2024-04-26T12:52:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2ce3fff640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ce4034650 0x7f2ce4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2ce3fff640 1 -- 172.21.15.72:0/198770582 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2dec0e5b60 con 0x557355d5c890 2024-04-26T12:52:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfb126640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ce4034650 0x7f2ce4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355deb4c0 0x557355ee1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355ee1b90 con 0x557355deb4c0 2024-04-26T12:52:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfc128640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355deb4c0 0x557355ee1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfb126640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ce4034650 0x7f2ce4036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2de4000f70 tx=0x7f2de4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.240+0000 7f2dfc128640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355deb4c0 0x557355ee1570 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfc128640 1 -- 172.21.15.72:0/198770582 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355deb4c0 2024-04-26T12:52:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355edecb0 con 0x557355deb4c0 2024-04-26T12:52:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfc128640 1 -- 172.21.15.72:0/198770582 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355deb4c0 2024-04-26T12:52:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355ee3ee0 0x557355ee62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355ee69a0 con 0x557355ee3ee0 2024-04-26T12:52:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfb927640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355ee3ee0 0x557355ee62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfb927640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355ee3ee0 0x557355ee62d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfb927640 1 -- 172.21.15.72:0/198770582 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355ee3ee0 2024-04-26T12:52:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355ee2d80 con 0x557355deb4c0 2024-04-26T12:52:05.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfc128640 1 -- 172.21.15.72:0/198770582 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355deb4c0 2024-04-26T12:52:05.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355ee7de0 0x557355eea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355eea960 con 0x557355ee7de0 2024-04-26T12:52:05.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfb126640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355ee7de0 0x557355eea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfb126640 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355ee7de0 0x557355eea1d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfb126640 1 -- 172.21.15.72:0/198770582 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2de400f6a0 con 0x557355ee7de0 2024-04-26T12:52:05.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.244+0000 7f2dfde0c980 1 Processor -- start 2024-04-26T12:52:05.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfde0c980 1 -- start start 2024-04-26T12:52:05.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfde0c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355ef89b0 0x557355ef8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfde0c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557355cefab0 con 0x557355ef89b0 2024-04-26T12:52:05.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355ef89b0 0x557355ef8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355ef89b0 0x557355ef8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38582/0 (socket says 172.21.15.72:38582) 2024-04-26T12:52:05.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfb927640 1 -- 172.21.15.72:0/2311830069 learned_addr learned my addr 172.21.15.72:0/2311830069 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfb927640 1 -- 172.21.15.72:0/2311830069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557355ef9310 con 0x557355ef89b0 2024-04-26T12:52:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfb927640 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355ef89b0 0x557355ef8dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0e3fb0 tx=0x7f2dec0d0800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2ce17fa640 1 -- 172.21.15.72:0/2311830069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0bd570 con 0x557355ef89b0 2024-04-26T12:52:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557355ef9db0 con 0x557355ef89b0 2024-04-26T12:52:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2ce17fa640 1 -- 172.21.15.72:0/2311830069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0c53a0 con 0x557355ef89b0 2024-04-26T12:52:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2ce17fa640 1 -- 172.21.15.72:0/2311830069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0bcbc0 con 0x557355ef89b0 2024-04-26T12:52:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557355ef9db0 con 0x557355ef89b0 2024-04-26T12:52:05.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2ce17fa640 1 -- 172.21.15.72:0/2311830069 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2dec0c5730 con 0x557355ef89b0 2024-04-26T12:52:05.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2ce17fa640 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cd4034650 0x7f2cd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2ce17fa640 1 -- 172.21.15.72:0/2311830069 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2dec0eb070 con 0x557355ef89b0 2024-04-26T12:52:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfb126640 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cd4034650 0x7f2cd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.248+0000 7f2dfde0c980 1 Processor -- start 2024-04-26T12:52:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- start start 2024-04-26T12:52:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb126640 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cd4034650 0x7f2cd4036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x557355eead60 tx=0x7f2de400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355de8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557355ed3d50 con 0x557355de8530 2024-04-26T12:52:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355de8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355de8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38598/0 (socket says 172.21.15.72:38598) 2024-04-26T12:52:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 -- 172.21.15.72:0/1793690771 learned_addr learned my addr 172.21.15.72:0/1793690771 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 -- 172.21.15.72:0/1793690771 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557355de6d60 con 0x557355de8530 2024-04-26T12:52:05.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 --2- 172.21.15.72:0/1793690771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355de8910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0b3a20 tx=0x7f2dec0a7350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43434b9ee12742e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2cdaffd640 1 -- 172.21.15.72:0/1793690771 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0bcd60 con 0x557355de8530 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2cdaffd640 1 -- 172.21.15.72:0/1793690771 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0a4a70 con 0x557355de8530 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2cdaffd640 1 -- 172.21.15.72:0/1793690771 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0b3a90 con 0x557355de8530 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- 172.21.15.72:0/1793690771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 msgr2=0x557355de8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/1793690771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355de8910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0b3a20 tx=0x7f2dec0a7350 comp rx=0 tx=0).stop 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- 172.21.15.72:0/1793690771 shutdown_connections 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/1793690771 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355de8910 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- 172.21.15.72:0/1793690771 >> 172.21.15.72:0/1793690771 conn(0x557355f01b50 msgr2=0x557355effbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- 172.21.15.72:0/1793690771 shutdown_connections 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- 172.21.15.72:0/1793690771 wait complete. 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 Processor -- start 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- start start 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355f0ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfde0c980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x557355de7110 con 0x557355de8530 2024-04-26T12:52:05.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355f0ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355f0ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38606/0 (socket says 172.21.15.72:38606) 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 learned_addr learned my addr 172.21.15.72:0/3067684513 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.252+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557355f0f230 con 0x557355de8530 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfb927640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355f0ecf0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0a7390 tx=0x7f2dec0e0ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2cd97fa640 1 -- 172.21.15.72:0/3067684513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec002d50 con 0x557355de8530 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557355f0f230 con 0x557355de8530 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2cd97fa640 1 -- 172.21.15.72:0/3067684513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0b6a10 con 0x557355de8530 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2cd97fa640 1 -- 172.21.15.72:0/3067684513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0b6d30 con 0x557355de8530 2024-04-26T12:52:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557355f0f230 con 0x557355de8530 2024-04-26T12:52:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2cd97fa640 1 -- 172.21.15.72:0/3067684513 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2dec0e0580 con 0x557355de8530 2024-04-26T12:52:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2cd97fa640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cc4034650 0x7f2cc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2cd97fa640 1 -- 172.21.15.72:0/3067684513 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2dec0ff070 con 0x557355de8530 2024-04-26T12:52:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfb126640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cc4034650 0x7f2cc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355f19c20 0x557355f1c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f1c830 con 0x557355f19c20 2024-04-26T12:52:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfc128640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355f19c20 0x557355f1c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfb126640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cc4034650 0x7f2cc4036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2de400c010 tx=0x7f2de4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfc128640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355f19c20 0x557355f1c0e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 20 realm 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f1cc40 con 0x557355f19c20 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.256+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d510 con 0x557355f19c20 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355f1e610 0x557355f20a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f20fd0 con 0x557355f1e610 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb927640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355f1e610 0x557355f20a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb927640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355f1e610 0x557355f20a00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 20 searching for the correct realm 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355f22f20 0x557355f25350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f25a20 con 0x557355f22f20 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb126640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355f22f20 0x557355f25350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb126640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355f22f20 0x557355f25350 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb126640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2de401fbe0 0x7f2de403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f25a20 con 0x7f2de401fbe0 2024-04-26T12:52:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfc128640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2de401fbe0 0x7f2de403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.260+0000 7f2dfc128640 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2de401fbe0 0x7f2de403a3c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df400a4d0 con 0x7f2de401fbe0 2024-04-26T12:52:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x7f2de401fbe0 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df400a4d0 con 0x7f2de401fbe0 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x7f2de401fbe0 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df400a4d0 con 0x7f2de401fbe0 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.264+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df400a4d0 con 0x557355f19c20 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x7f2de401fbe0 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2df4032040 con 0x7f2de401fbe0 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df4032040 con 0x557355f19c20 2024-04-26T12:52:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2df4032040 con 0x557355f19c20 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.268+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x7f2de401fbe0 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df4032040 con 0x7f2de401fbe0 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df4032040 con 0x557355f19c20 2024-04-26T12:52:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x7f2de401fbe0 2024-04-26T12:52:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df4032040 con 0x7f2de401fbe0 2024-04-26T12:52:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f22f20 2024-04-26T12:52:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.272+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f1e610 2024-04-26T12:52:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x557355f19c20 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2df4032040 con 0x557355f19c20 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557355f1d8b0 con 0x7f2de401fbe0 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df4032040 con 0x7f2de401fbe0 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f21890 con 0x557355f19c20 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2df4032040 con 0x557355f19c20 2024-04-26T12:52:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f21890 con 0x557355f19c20 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2df4032040 con 0x557355f19c20 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f21890 con 0x557355f22f20 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 zone default found 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 4 Realm: () 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:05.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 zonegroup default 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f222f0 con 0x557355f1e610 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f27d30 con 0x557355f22f20 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f280d0 con 0x557355f22f20 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 started sync module instance, tier type = 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.276+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f27170 con 0x7f2de401fbe0 2024-04-26T12:52:05.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.280+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4032040 con 0x7f2de401fbe0 2024-04-26T12:52:05.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.280+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93953851553120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f27170 con 0x7f2de401fbe0 2024-04-26T12:52:05.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.280+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f28960 con 0x557355f19c20 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.280+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93953851553120] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x7f2de401fbe0 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.280+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.280+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93953851556976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f27170 con 0x557355f19c20 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.280+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f29370 con 0x557355f22f20 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93953851556976] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93953851550912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f270e0 con 0x557355f22f20 2024-04-26T12:52:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2a0b0 con 0x7f2de401fbe0 2024-04-26T12:52:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x7f2de401fbe0 2024-04-26T12:52:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93953851562944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2a950 con 0x7f2de401fbe0 2024-04-26T12:52:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2b350 con 0x557355f19c20 2024-04-26T12:52:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.284+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93953851550912] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.288+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93953851562944] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x7f2de401fbe0 2024-04-26T12:52:05.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.288+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.288+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93953851561744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2a450 con 0x557355f19c20 2024-04-26T12:52:05.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.288+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2bbf0 con 0x557355f1e610 2024-04-26T12:52:05.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.288+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93953851561744] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.292+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.292+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93953851569984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2a450 con 0x557355f1e610 2024-04-26T12:52:05.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.292+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2c440 con 0x557355f1e610 2024-04-26T12:52:05.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.292+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.292+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93953851574240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2d0b0 con 0x557355f1e610 2024-04-26T12:52:05.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.292+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2dad0 con 0x557355f1e610 2024-04-26T12:52:05.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.292+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93953851569984] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93953851574240] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93953851575296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2ae60 con 0x557355f1e610 2024-04-26T12:52:05.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=0 2024-04-26T12:52:05.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=1 2024-04-26T12:52:05.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=2 2024-04-26T12:52:05.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=3 2024-04-26T12:52:05.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=4 2024-04-26T12:52:05.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=5 2024-04-26T12:52:05.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=6 2024-04-26T12:52:05.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93953851575296] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 20 add_watcher() i=7 2024-04-26T12:52:05.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:05.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f30d10 con 0x557355f19c20 2024-04-26T12:52:05.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.296+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93953851577792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2e260 con 0x557355f19c20 2024-04-26T12:52:05.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93953851577792] v35'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:05.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:05.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 5 note: GC not initialized 2024-04-26T12:52:05.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2cb0fe1640 20 reqs_thread_entry: start 2024-04-26T12:52:05.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:05.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 20 Filter name: none 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2c2a7fc640 20 reqs_thread_entry: start 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f54560 con 0x557355f1e610 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 20 rados_obj.operate() r=0 bl.length=473 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.300+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f5ae40 con 0x557355f1e610 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfde0c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfde0c980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfde0c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93953851762864 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557355f564f0 con 0x557355f19c20 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 93953851561744 notify 150323855385 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f2df4018c50 con 0x557355f19c20 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2cdaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855385 cookie 93953851561744 notifier 4846 bl.length()=636 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2cdaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2cdaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:05.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2cdaffd640 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2cc0003eb0 con 0x557355f19c20 2024-04-26T12:52:05.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 93953851762864 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== watch-notify(notify_complete (2) cookie 93953851762864 notify 150323855385 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2df4043420 con 0x557355f19c20 2024-04-26T12:52:05.306 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:05.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93953851577792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f52260 con 0x557355f19c20 2024-04-26T12:52:05.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93953851577792] v35'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.304+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93953851553120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f52260 con 0x7f2de401fbe0 2024-04-26T12:52:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.308+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93953851553120] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x7f2de401fbe0 2024-04-26T12:52:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.308+0000 7f2dfde0c980 20 remove_watcher() i=0 2024-04-26T12:52:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.308+0000 7f2dfde0c980 2 removed watcher, disabling cache 2024-04-26T12:52:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.308+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93953851556976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f52260 con 0x557355f19c20 2024-04-26T12:52:05.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.308+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93953851556976] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.308+0000 7f2dfde0c980 20 remove_watcher() i=1 2024-04-26T12:52:05.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.308+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93953851550912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f52260 con 0x557355f22f20 2024-04-26T12:52:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.312+0000 7f2dfb126640 1 -- 172.21.15.72:0/3067684513 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93953851550912] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de4037040 con 0x557355f22f20 2024-04-26T12:52:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.312+0000 7f2dfde0c980 20 remove_watcher() i=2 2024-04-26T12:52:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.312+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93953851562944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f26cc0 con 0x7f2de401fbe0 2024-04-26T12:52:05.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.312+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93953851562944] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x7f2de401fbe0 2024-04-26T12:52:05.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.312+0000 7f2dfde0c980 20 remove_watcher() i=3 2024-04-26T12:52:05.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.312+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93953851561744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f26cc0 con 0x557355f19c20 2024-04-26T12:52:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.316+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93953851561744] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df4040040 con 0x557355f19c20 2024-04-26T12:52:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.316+0000 7f2dfde0c980 20 remove_watcher() i=4 2024-04-26T12:52:05.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.316+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93953851569984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f29710 con 0x557355f1e610 2024-04-26T12:52:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.316+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93953851569984] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.316+0000 7f2dfde0c980 20 remove_watcher() i=5 2024-04-26T12:52:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.316+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93953851574240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f26cc0 con 0x557355f1e610 2024-04-26T12:52:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.320+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93953851574240] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.320+0000 7f2dfde0c980 20 remove_watcher() i=6 2024-04-26T12:52:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.320+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93953851575296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557355f2c7e0 con 0x557355f1e610 2024-04-26T12:52:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.320+0000 7f2dfb927640 1 -- 172.21.15.72:0/3067684513 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93953851575296] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dec0cd020 con 0x557355f1e610 2024-04-26T12:52:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 20 remove_watcher() i=7 2024-04-26T12:52:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355f1e610 msgr2=0x557355f20a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355f1e610 0x557355f20a00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355f19c20 msgr2=0x557355f1c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355f19c20 0x557355f1c0e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2de401fbe0 msgr2=0x7f2de403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2de401fbe0 0x7f2de403a3c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355f22f20 msgr2=0x557355f25350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355f22f20 0x557355f25350 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cc4034650 msgr2=0x7f2cc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cc4034650 0x7f2cc4036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2de400c010 tx=0x7f2de4010000 comp rx=0 tx=0).stop 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 msgr2=0x557355f0ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355f0ecf0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0a7390 tx=0x7f2dec0e0ee0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfc128640 1 -- 172.21.15.72:0/3067684513 reap_dead start 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 shutdown_connections 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/3067684513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355de8530 0x557355f0ecf0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 >> 172.21.15.72:0/3067684513 conn(0x557355f01b50 msgr2=0x557355eff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 shutdown_connections 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/3067684513 wait complete. 2024-04-26T12:52:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cd4034650 msgr2=0x7f2cd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cd4034650 0x7f2cd4036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x557355eead60 tx=0x7f2de400f000 comp rx=0 tx=0).stop 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355ef89b0 msgr2=0x557355ef8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355ef89b0 0x557355ef8dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0e3fb0 tx=0x7f2dec0d0800 comp rx=0 tx=0).stop 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 shutdown_connections 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2cd4034650 0x7f2cd4036b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/2311830069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355ef89b0 0x557355ef8dd0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 >> 172.21.15.72:0/2311830069 conn(0x557355eed7c0 msgr2=0x557355eee2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 shutdown_connections 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/2311830069 wait complete. 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355ee3ee0 msgr2=0x557355ee62d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x557355ee3ee0 0x557355ee62d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355deb4c0 msgr2=0x557355ee1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x557355deb4c0 0x557355ee1570 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355ee7de0 msgr2=0x557355eea1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x557355ee7de0 0x557355eea1d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ce4034650 msgr2=0x7f2ce4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2ce4034650 0x7f2ce4036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2de4000f70 tx=0x7f2de4001380 comp rx=0 tx=0).stop 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 msgr2=0x557355eda690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 --2- 172.21.15.72:0/198770582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x557355d5c890 0x557355eda690 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2dec003070 tx=0x7f2dec0180e0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfc128640 1 -- 172.21.15.72:0/198770582 reap_dead start 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 shutdown_connections 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 >> 172.21.15.72:0/198770582 conn(0x557355de2a60 msgr2=0x557355ecdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 shutdown_connections 2024-04-26T12:52:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.324+0000 7f2dfde0c980 1 -- 172.21.15.72:0/198770582 wait complete. 2024-04-26T12:52:05.337 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:05.337 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:05.337 ERROR:root:0 2024-04-26T12:52:05.337 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-26T12:52:05.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-26T12:52:05.338 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-04-26T12:52:05.424 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:05.425 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:05.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d89122980 1 Processor -- start 2024-04-26T12:52:05.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d89122980 1 -- start start 2024-04-26T12:52:05.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d89122980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56055fe17f90 0x56055fea9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d89122980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56055fd51510 con 0x56055fea9870 2024-04-26T12:52:05.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d89122980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x56055fd58430 con 0x56055fe17f90 2024-04-26T12:52:05.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d86c3d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56055fe17f90 0x56055fea9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d8643c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x56055fea9870 0x56055feabc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48762/0 (socket says 172.21.15.72:48762) 2024-04-26T12:52:05.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d86c3d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56055fe17f90 0x56055fea9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38620/0 (socket says 172.21.15.72:38620) 2024-04-26T12:52:05.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d8643c640 1 -- 172.21.15.72:0/1436604905 learned_addr learned my addr 172.21.15.72:0/1436604905 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:05.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1436604905 >> v1:172.21.15.29:6789/0 conn(0x56055fea9870 legacy=0x56055feabc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.424+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1436604905 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055fd2dae0 con 0x56055fe17f90 2024-04-26T12:52:05.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1436604905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055fea9330 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800a480 tx=0x7f6d7801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8b81ccc3bfdb9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d85c3b640 1 -- 172.21.15.72:0/1436604905 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780b0070 con 0x56055fe17f90 2024-04-26T12:52:05.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d85c3b640 1 -- 172.21.15.72:0/1436604905 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d780ab540 con 0x56055fe17f90 2024-04-26T12:52:05.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d85c3b640 1 -- 172.21.15.72:0/1436604905 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780ab840 con 0x56055fe17f90 2024-04-26T12:52:05.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d89122980 1 -- 172.21.15.72:0/1436604905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 msgr2=0x56055fea9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d89122980 1 --2- 172.21.15.72:0/1436604905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055fea9330 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800a480 tx=0x7f6d7801b280 comp rx=0 tx=0).stop 2024-04-26T12:52:05.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d89122980 1 -- 172.21.15.72:0/1436604905 shutdown_connections 2024-04-26T12:52:05.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d89122980 1 --2- 172.21.15.72:0/1436604905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055fea9330 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d89122980 1 -- 172.21.15.72:0/1436604905 >> 172.21.15.72:0/1436604905 conn(0x56055fe9ea10 msgr2=0x56055fea0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d89122980 1 -- 172.21.15.72:0/1436604905 shutdown_connections 2024-04-26T12:52:05.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.428+0000 7f6d89122980 1 -- 172.21.15.72:0/1436604905 wait complete. 2024-04-26T12:52:05.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d89122980 1 Processor -- start 2024-04-26T12:52:05.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d89122980 1 -- start start 2024-04-26T12:52:05.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d89122980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff91610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d89122980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56055fda7a70 con 0x56055fe17f90 2024-04-26T12:52:05.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff91610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff91610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38634/0 (socket says 172.21.15.72:38634) 2024-04-26T12:52:05.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d86c3d640 1 -- 172.21.15.72:0/3335980297 learned_addr learned my addr 172.21.15.72:0/3335980297 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d86c3d640 1 -- 172.21.15.72:0/3335980297 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055ff91be0 con 0x56055fe17f90 2024-04-26T12:52:05.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.444+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/3335980297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff91610 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ae040 tx=0x7f6d78003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8184e990741bcd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6c74e09640 1 -- 172.21.15.72:0/3335980297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780b0040 con 0x56055fe17f90 2024-04-26T12:52:05.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6c74e09640 1 -- 172.21.15.72:0/3335980297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d780ab9b0 con 0x56055fe17f90 2024-04-26T12:52:05.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6c74e09640 1 -- 172.21.15.72:0/3335980297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780abc90 con 0x56055fe17f90 2024-04-26T12:52:05.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- 172.21.15.72:0/3335980297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 msgr2=0x56055ff91610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 --2- 172.21.15.72:0/3335980297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff91610 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ae040 tx=0x7f6d78003030 comp rx=0 tx=0).stop 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- 172.21.15.72:0/3335980297 shutdown_connections 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 --2- 172.21.15.72:0/3335980297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff91610 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- 172.21.15.72:0/3335980297 >> 172.21.15.72:0/3335980297 conn(0x56055fe9ea10 msgr2=0x56055ff8d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- 172.21.15.72:0/3335980297 shutdown_connections 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- 172.21.15.72:0/3335980297 wait complete. 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 Processor -- start 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- start start 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff98710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56055feafde0 con 0x56055fe17f90 2024-04-26T12:52:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff98710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff98710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38646/0 (socket says 172.21.15.72:38646) 2024-04-26T12:52:05.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1898701265 learned_addr learned my addr 172.21.15.72:0/1898701265 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055ff98c50 con 0x56055fe17f90 2024-04-26T12:52:05.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff98710 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d7801bb20 tx=0x7f6d78018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6c73606640 1 -- 172.21.15.72:0/1898701265 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780c5070 con 0x56055fe17f90 2024-04-26T12:52:05.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56055ff98ee0 con 0x56055fe17f90 2024-04-26T12:52:05.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6c73606640 1 -- 172.21.15.72:0/1898701265 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d780b6970 con 0x56055fe17f90 2024-04-26T12:52:05.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6c73606640 1 -- 172.21.15.72:0/1898701265 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780b0050 con 0x56055fe17f90 2024-04-26T12:52:05.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.448+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56055ff9bb10 con 0x56055fe17f90 2024-04-26T12:52:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6c73606640 1 -- 172.21.15.72:0/1898701265 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d780c8070 con 0x56055fe17f90 2024-04-26T12:52:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6c73606640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c6c0346a0 0x7f6c6c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6c73606640 1 -- 172.21.15.72:0/1898701265 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f6d780bc070 con 0x56055fe17f90 2024-04-26T12:52:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c6c0346a0 0x7f6c6c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055fea9870 0x56055ff9f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ff9fc80 con 0x56055fea9870 2024-04-26T12:52:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d8743e640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055fea9870 0x56055ff9f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c6c0346a0 0x7f6c6c036b60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000f70 tx=0x7f6d7c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d8743e640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055fea9870 0x56055ff9f610 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d8743e640 1 -- 172.21.15.72:0/1898701265 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055fea9870 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ff9cd30 con 0x56055fea9870 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d8743e640 1 -- 172.21.15.72:0/1898701265 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055fea9870 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffa1fb0 0x56055ffa43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffa4a70 con 0x56055ffa1fb0 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffa1fb0 0x56055ffa43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.452+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffa1fb0 0x56055ffa43a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1898701265 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d780c7030 con 0x56055ffa1fb0 2024-04-26T12:52:05.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffa0e50 con 0x56055fea9870 2024-04-26T12:52:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d8743e640 1 -- 172.21.15.72:0/1898701265 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055fea9870 2024-04-26T12:52:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffa5eb0 0x56055ffa82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffa8a30 con 0x56055ffa5eb0 2024-04-26T12:52:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffa5eb0 0x56055ffa82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffa5eb0 0x56055ffa82a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d8643c640 1 -- 172.21.15.72:0/1898701265 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffa5eb0 2024-04-26T12:52:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 Processor -- start 2024-04-26T12:52:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 -- start start 2024-04-26T12:52:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffb6a80 0x56055ffb6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56055fdabab0 con 0x56055ffb6a80 2024-04-26T12:52:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffb6a80 0x56055ffb6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffb6a80 0x56055ffb6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38660/0 (socket says 172.21.15.72:38660) 2024-04-26T12:52:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d86c3d640 1 -- 172.21.15.72:0/3824203721 learned_addr learned my addr 172.21.15.72:0/3824203721 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d86c3d640 1 -- 172.21.15.72:0/3824203721 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055ffb73e0 con 0x56055ffb6a80 2024-04-26T12:52:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffb6a80 0x56055ffb6ea0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6d780e2090 tx=0x7f6d780b4610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6c70e01640 1 -- 172.21.15.72:0/3824203721 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780d5040 con 0x56055ffb6a80 2024-04-26T12:52:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6c70e01640 1 -- 172.21.15.72:0/3824203721 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d780ad340 con 0x56055ffb6a80 2024-04-26T12:52:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56055ffb7e80 con 0x56055ffb6a80 2024-04-26T12:52:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.456+0000 7f6c70e01640 1 -- 172.21.15.72:0/3824203721 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780aa500 con 0x56055ffb6a80 2024-04-26T12:52:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56055ffb7e80 con 0x56055ffb6a80 2024-04-26T12:52:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6c70e01640 1 -- 172.21.15.72:0/3824203721 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d780d8070 con 0x56055ffb6a80 2024-04-26T12:52:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6c70e01640 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c60034650 0x7f6c60036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6c70e01640 1 -- 172.21.15.72:0/3824203721 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f6d780a8070 con 0x56055ffb6a80 2024-04-26T12:52:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d8643c640 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c60034650 0x7f6c60036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 Processor -- start 2024-04-26T12:52:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 -- start start 2024-04-26T12:52:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d8643c640 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c60034650 0x7f6c60036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00bf60 tx=0x7f6d7c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffc3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56055ff91e70 con 0x56055ffc3870 2024-04-26T12:52:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffc3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffc3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38672/0 (socket says 172.21.15.72:38672) 2024-04-26T12:52:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1408673694 learned_addr learned my addr 172.21.15.72:0/1408673694 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1408673694 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055ffc4220 con 0x56055ffc3870 2024-04-26T12:52:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1408673694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffc3c50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ad510 tx=0x7f6d780cac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27da9570dfa87032 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6c6a7fc640 1 -- 172.21.15.72:0/1408673694 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780b5a70 con 0x56055ffc3870 2024-04-26T12:52:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6c6a7fc640 1 -- 172.21.15.72:0/1408673694 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d780ad6c0 con 0x56055ffc3870 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6c6a7fc640 1 -- 172.21.15.72:0/1408673694 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780e2b10 con 0x56055ffc3870 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 -- 172.21.15.72:0/1408673694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 msgr2=0x56055ffc3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 --2- 172.21.15.72:0/1408673694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffc3c50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ad510 tx=0x7f6d780cac60 comp rx=0 tx=0).stop 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 -- 172.21.15.72:0/1408673694 shutdown_connections 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 --2- 172.21.15.72:0/1408673694 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffc3c50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.460+0000 7f6d89122980 1 -- 172.21.15.72:0/1408673694 >> 172.21.15.72:0/1408673694 conn(0x56055ffbfbb0 msgr2=0x56055ffbdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 -- 172.21.15.72:0/1408673694 shutdown_connections 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 -- 172.21.15.72:0/1408673694 wait complete. 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 Processor -- start 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 -- start start 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffcab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56055ffc4920 con 0x56055ffc3870 2024-04-26T12:52:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffcab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d86c3d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffcab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38688/0 (socket says 172.21.15.72:38688) 2024-04-26T12:52:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 learned_addr learned my addr 172.21.15.72:0/1287778213 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055ffcb0a0 con 0x56055ffc3870 2024-04-26T12:52:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffcab60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ca970 tx=0x7f6d780de120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6c68ff9640 1 -- 172.21.15.72:0/1287778213 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d78110070 con 0x56055ffc3870 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6c68ff9640 1 -- 172.21.15.72:0/1287778213 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d78106070 con 0x56055ffc3870 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56055ffcb0a0 con 0x56055ffc3870 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6c68ff9640 1 -- 172.21.15.72:0/1287778213 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d780ddc60 con 0x56055ffc3870 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56055ffcb0a0 con 0x56055ffc3870 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6c68ff9640 1 -- 172.21.15.72:0/1287778213 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d78113070 con 0x56055ffc3870 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6c68ff9640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c50034650 0x7f6c50036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6c68ff9640 1 -- 172.21.15.72:0/1287778213 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f6d78116d50 con 0x56055ffc3870 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c50034650 0x7f6c50036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.464+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055ffd5c70 0x56055ffd8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd8880 con 0x56055ffd5c70 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8743e640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055ffd5c70 0x56055ffd8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c50034650 0x7f6c50036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56055ffa8e30 tx=0x7f6d7c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8743e640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055ffd5c70 0x56055ffd8130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 realm 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd8c90 con 0x56055ffd5c70 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9560 con 0x56055ffd5c70 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffda660 0x56055ffdca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffdd020 con 0x56055ffda660 2024-04-26T12:52:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffda660 0x56055ffdca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d86c3d640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffda660 0x56055ffdca50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:05.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 20 searching for the correct realm 2024-04-26T12:52:05.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffdef70 0x56055ffe13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe1a70 con 0x56055ffdef70 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.468+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffdef70 0x56055ffe13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffdef70 0x56055ffe13a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8643c640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6d7c037040 0x7f6d7c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe1a70 con 0x7f6d7c037040 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6d7c037040 0x7f6d7c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6d7c037040 0x7f6d7c036410 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8000a4d0 con 0x7f6d7c037040 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.472+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x7f6d7c037040 2024-04-26T12:52:05.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8000a4d0 con 0x7f6d7c037040 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x7f6d7c037040 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8000a4d0 con 0x7f6d7c037040 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8000a4d0 con 0x56055ffd5c70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x7f6d7c037040 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d80032040 con 0x7f6d7c037040 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.476+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d80032040 con 0x56055ffd5c70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d80032040 con 0x56055ffd5c70 2024-04-26T12:52:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x7f6d7c037040 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d80032040 con 0x7f6d7c037040 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d80032040 con 0x56055ffd5c70 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.480+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x7f6d7c037040 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d80032040 con 0x7f6d7c037040 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffdef70 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffda660 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x56055ffd5c70 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d80032040 con 0x56055ffd5c70 2024-04-26T12:52:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56055ffd9900 con 0x7f6d7c037040 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d80032040 con 0x7f6d7c037040 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffdd8e0 con 0x56055ffd5c70 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d80032040 con 0x56055ffd5c70 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffdd8e0 con 0x56055ffd5c70 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d80032040 con 0x56055ffd5c70 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.484+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffdd8e0 con 0x56055ffdef70 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 zone default found 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 4 Realm: () 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 zonegroup default 2024-04-26T12:52:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffde280 con 0x56055ffda660 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffddde0 con 0x56055ffdef70 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe3e60 con 0x56055ffdef70 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 started sync module instance, tier type = 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe3210 con 0x7f6d7c037040 2024-04-26T12:52:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80032040 con 0x7f6d7c037040 2024-04-26T12:52:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94581085321008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe3210 con 0x7f6d7c037040 2024-04-26T12:52:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.488+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe4960 con 0x56055ffd5c70 2024-04-26T12:52:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.492+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94581085321008] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x7f6d7c037040 2024-04-26T12:52:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.492+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.492+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94581085324336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe3210 con 0x56055ffd5c70 2024-04-26T12:52:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.492+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe5370 con 0x56055ffdef70 2024-04-26T12:52:05.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94581085324336] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94581085318496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe3180 con 0x56055ffdef70 2024-04-26T12:52:05.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe6100 con 0x7f6d7c037040 2024-04-26T12:52:05.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x7f6d7c037040 2024-04-26T12:52:05.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94581085330448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe69a0 con 0x7f6d7c037040 2024-04-26T12:52:05.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe73c0 con 0x56055ffd5c70 2024-04-26T12:52:05.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94581085318496] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94581085330448] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x7f6d7c037040 2024-04-26T12:52:05.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94581085335216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe6470 con 0x56055ffd5c70 2024-04-26T12:52:05.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.496+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe7c60 con 0x56055ffda660 2024-04-26T12:52:05.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.500+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94581085335216] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.500+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.500+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94581085337520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe6470 con 0x56055ffda660 2024-04-26T12:52:05.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.500+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe84b0 con 0x56055ffda660 2024-04-26T12:52:05.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.500+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.500+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94581085340128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe8c70 con 0x56055ffda660 2024-04-26T12:52:05.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe9790 con 0x56055ffda660 2024-04-26T12:52:05.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94581085337520] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94581085340128] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94581085344352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe86c0 con 0x56055ffda660 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 20 add_watcher() i=0 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 20 add_watcher() i=1 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 20 add_watcher() i=2 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 20 add_watcher() i=3 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 20 add_watcher() i=4 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 20 add_watcher() i=5 2024-04-26T12:52:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.504+0000 7f6d89122980 20 add_watcher() i=6 2024-04-26T12:52:05.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94581085344352] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 20 add_watcher() i=7 2024-04-26T12:52:05.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:05.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56055ffec780 con 0x56055ffd5c70 2024-04-26T12:52:05.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94581085329248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56055ffe9c00 con 0x56055ffd5c70 2024-04-26T12:52:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94581085329248] v35'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6c3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 5 note: GC not initialized 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6bb7fff640 20 reqs_thread_entry: start 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 20 Filter name: none 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6bb5ffb640 20 reqs_thread_entry: start 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.508+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56056000ff00 con 0x56055ffda660 2024-04-26T12:52:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-04-26T12:52:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:52:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-04-26T12:52:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56056000e540 con 0x56055ffdef70 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-26T12:52:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000ede0 con 0x56055ffda660 2024-04-26T12:52:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v35'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-26T12:52:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:52:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-26T12:52:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94581085497648 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5605600134f0 con 0x7f6d7c037040 2024-04-26T12:52:05.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== watch-notify(notify (1) cookie 94581085321008 notify 150323855393 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f6d80018be0 con 0x7f6d7c037040 2024-04-26T12:52:05.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6c6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855393 cookie 94581085321008 notifier 4853 bl.length()=533 2024-04-26T12:52:05.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6c6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-26T12:52:05.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6c6a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:52:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(65 notify.0 [notify cookie 94581085497648 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d80040040 con 0x7f6d7c037040 2024-04-26T12:52:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.512+0000 7f6c6a7fc640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6c4c003eb0 con 0x7f6d7c037040 2024-04-26T12:52:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x7f6d7c037040 2024-04-26T12:52:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== watch-notify(notify_complete (2) cookie 94581085497648 notify 150323855393 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d80043420 con 0x7f6d7c037040 2024-04-26T12:52:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000ee50 con 0x56055ffdef70 2024-04-26T12:52:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v35'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d89122980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-26T12:52:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d89122980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T12:52:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d89122980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-26T12:52:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94581085497648 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5605600134f0 con 0x56055ffd5c70 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94581085324336 notify 150323855386 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f6d80043420 con 0x56055ffd5c70 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6c69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855386 cookie 94581085324336 notifier 4853 bl.length()=176 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6c69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6c69ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(68 notify.1 [notify cookie 94581085497648 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6c69ffb640 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6bbc003410 con 0x56055ffd5c70 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify_complete (2) cookie 94581085497648 notify 150323855386 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d800436c0 con 0x56055ffd5c70 2024-04-26T12:52:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.516+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.520 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-04-26T12:52:05.514469Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.514449Z","tags":[],"group_ids":[]} 2024-04-26T12:52:05.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6c3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94581085329248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x56055ffd5c70 2024-04-26T12:52:05.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94581085329248] v35'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94581085321008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x7f6d7c037040 2024-04-26T12:52:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94581085321008] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x7f6d7c037040 2024-04-26T12:52:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6d89122980 20 remove_watcher() i=0 2024-04-26T12:52:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6d89122980 2 removed watcher, disabling cache 2024-04-26T12:52:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.520+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94581085324336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x56055ffd5c70 2024-04-26T12:52:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.524+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94581085324336] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.524+0000 7f6d89122980 20 remove_watcher() i=1 2024-04-26T12:52:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.524+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94581085318496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x56055ffdef70 2024-04-26T12:52:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.524+0000 7f6d8643c640 1 -- 172.21.15.72:0/1287778213 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94581085318496] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c00e620 con 0x56055ffdef70 2024-04-26T12:52:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.524+0000 7f6d89122980 20 remove_watcher() i=2 2024-04-26T12:52:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.524+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94581085330448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x7f6d7c037040 2024-04-26T12:52:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.528+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94581085330448] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x7f6d7c037040 2024-04-26T12:52:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.528+0000 7f6d89122980 20 remove_watcher() i=3 2024-04-26T12:52:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.528+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94581085335216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x56055ffd5c70 2024-04-26T12:52:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.528+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94581085335216] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d80040040 con 0x56055ffd5c70 2024-04-26T12:52:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.528+0000 7f6d89122980 20 remove_watcher() i=4 2024-04-26T12:52:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.528+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94581085337520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x56055ffda660 2024-04-26T12:52:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.532+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94581085337520] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.532+0000 7f6d89122980 20 remove_watcher() i=5 2024-04-26T12:52:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.532+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94581085340128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x56055ffda660 2024-04-26T12:52:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.532+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94581085340128] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.532+0000 7f6d89122980 20 remove_watcher() i=6 2024-04-26T12:52:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.532+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94581085344352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56056000dc00 con 0x56055ffda660 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d86c3d640 1 -- 172.21.15.72:0/1287778213 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94581085344352] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d78112030 con 0x56055ffda660 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 20 remove_watcher() i=7 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffda660 msgr2=0x56055ffdca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffda660 0x56055ffdca50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055ffd5c70 msgr2=0x56055ffd8130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055ffd5c70 0x56055ffd8130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6d7c037040 msgr2=0x7f6d7c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f6d7c037040 0x7f6d7c036410 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffdef70 msgr2=0x56055ffe13a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffdef70 0x56055ffe13a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c50034650 msgr2=0x7f6c50036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c50034650 0x7f6c50036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56055ffa8e30 tx=0x7f6d7c010000 comp rx=0 tx=0).stop 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 msgr2=0x56055ffcab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1287778213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffc3870 0x56055ffcab60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6d780ca970 tx=0x7f6d780de120 comp rx=0 tx=0).stop 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d8743e640 1 -- 172.21.15.72:0/1287778213 reap_dead start 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 shutdown_connections 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 >> 172.21.15.72:0/1287778213 conn(0x56055ffbfbb0 msgr2=0x56055ffbd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 shutdown_connections 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1287778213 wait complete. 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c60034650 msgr2=0x7f6c60036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c60034650 0x7f6c60036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00bf60 tx=0x7f6d7c00f000 comp rx=0 tx=0).stop 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffb6a80 msgr2=0x56055ffb6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffb6a80 0x56055ffb6ea0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6d780e2090 tx=0x7f6d780b4610 comp rx=0 tx=0).stop 2024-04-26T12:52:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 shutdown_connections 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c60034650 0x7f6c60036b10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/3824203721 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055ffb6a80 0x56055ffb6ea0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 >> 172.21.15.72:0/3824203721 conn(0x56055ffab890 msgr2=0x56055ffac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 shutdown_connections 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/3824203721 wait complete. 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffa1fb0 msgr2=0x56055ffa43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56055ffa1fb0 0x56055ffa43a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055fea9870 msgr2=0x56055ff9f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x56055fea9870 0x56055ff9f610 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffa5eb0 msgr2=0x56055ffa82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56055ffa5eb0 0x56055ffa82a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c6c0346a0 msgr2=0x7f6c6c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f6c6c0346a0 0x7f6c6c036b60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000f70 tx=0x7f6d7c0012c0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 msgr2=0x56055ff98710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 --2- 172.21.15.72:0/1898701265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56055fe17f90 0x56055ff98710 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d7801bb20 tx=0x7f6d78018020 comp rx=0 tx=0).stop 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d8743e640 1 -- 172.21.15.72:0/1898701265 reap_dead start 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 shutdown_connections 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 >> 172.21.15.72:0/1898701265 conn(0x56055fe9ea10 msgr2=0x56055ff8bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 shutdown_connections 2024-04-26T12:52:05.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.536+0000 7f6d89122980 1 -- 172.21.15.72:0/1898701265 wait complete. 2024-04-26T12:52:05.551 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-26T12:52:05.514469Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.514449Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:05.551 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-26T12:52:05.514469Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.514449Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:05.551 ERROR:root:0 2024-04-26T12:52:05.552 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:05.556 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:05.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-04-26T12:52:05.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-04-26T12:52:05.557 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-04-26T12:52:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b87a58980 1 Processor -- start 2024-04-26T12:52:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b87a58980 1 -- start start 2024-04-26T12:52:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b87a58980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5606acc869f0 0x5606acc88de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b87a58980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606acb2d510 con 0x5606acc824e0 2024-04-26T12:52:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b87a58980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5606acb34430 con 0x5606acc869f0 2024-04-26T12:52:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b84d72640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5606acc869f0 0x5606acc88de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b84d72640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5606acc869f0 0x5606acc88de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38692/0 (socket says 172.21.15.72:38692) 2024-04-26T12:52:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.628+0000 7f2b84d72640 1 -- 172.21.15.72:0/1058813277 learned_addr learned my addr 172.21.15.72:0/1058813277 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b84d72640 1 -- 172.21.15.72:0/1058813277 >> v1:172.21.15.29:6789/0 conn(0x5606acc824e0 legacy=0x5606acc828c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b84d72640 1 -- 172.21.15.72:0/1058813277 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606acb09ae0 con 0x5606acc869f0 2024-04-26T12:52:05.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b84d72640 1 --2- 172.21.15.72:0/1058813277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc869f0 0x5606acc88de0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a5c0 tx=0x7f2b7c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a847a1554c45db5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b77fff640 1 -- 172.21.15.72:0/1058813277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0a6070 con 0x5606acc869f0 2024-04-26T12:52:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b77fff640 1 -- 172.21.15.72:0/1058813277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7c0af070 con 0x5606acc869f0 2024-04-26T12:52:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b77fff640 1 -- 172.21.15.72:0/1058813277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0aa5c0 con 0x5606acc869f0 2024-04-26T12:52:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b87a58980 1 -- 172.21.15.72:0/1058813277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc869f0 msgr2=0x5606acc88de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b87a58980 1 --2- 172.21.15.72:0/1058813277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc869f0 0x5606acc88de0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a5c0 tx=0x7f2b7c01b340 comp rx=0 tx=0).stop 2024-04-26T12:52:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b87a58980 1 -- 172.21.15.72:0/1058813277 shutdown_connections 2024-04-26T12:52:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b87a58980 1 --2- 172.21.15.72:0/1058813277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc869f0 0x5606acc88de0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b87a58980 1 -- 172.21.15.72:0/1058813277 >> 172.21.15.72:0/1058813277 conn(0x5606acbf5bc0 msgr2=0x5606acbf5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b87a58980 1 -- 172.21.15.72:0/1058813277 shutdown_connections 2024-04-26T12:52:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.632+0000 7f2b87a58980 1 -- 172.21.15.72:0/1058813277 wait complete. 2024-04-26T12:52:05.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.648+0000 7f2b87a58980 1 Processor -- start 2024-04-26T12:52:05.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.648+0000 7f2b87a58980 1 -- start start 2024-04-26T12:52:05.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.648+0000 7f2b87a58980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd6d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.648+0000 7f2b87a58980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606acb83a70 con 0x5606acc824e0 2024-04-26T12:52:05.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.648+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd6d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.648+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd6d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38694/0 (socket says 172.21.15.72:38694) 2024-04-26T12:52:05.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.648+0000 7f2b85573640 1 -- 172.21.15.72:0/1844215387 learned_addr learned my addr 172.21.15.72:0/1844215387 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b85573640 1 -- 172.21.15.72:0/1844215387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606acd6dbd0 con 0x5606acc824e0 2024-04-26T12:52:05.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b85573640 1 --2- 172.21.15.72:0/1844215387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd6d600 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800b1f0 tx=0x7f2b7800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89de049476b8e5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2a73606640 1 -- 172.21.15.72:0/1844215387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7800a040 con 0x5606acc824e0 2024-04-26T12:52:05.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2a73606640 1 -- 172.21.15.72:0/1844215387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7800f750 con 0x5606acc824e0 2024-04-26T12:52:05.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2a73606640 1 -- 172.21.15.72:0/1844215387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7800fa70 con 0x5606acc824e0 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- 172.21.15.72:0/1844215387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 msgr2=0x5606acd6d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 --2- 172.21.15.72:0/1844215387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd6d600 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800b1f0 tx=0x7f2b7800b6b0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- 172.21.15.72:0/1844215387 shutdown_connections 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 --2- 172.21.15.72:0/1844215387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd6d600 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- 172.21.15.72:0/1844215387 >> 172.21.15.72:0/1844215387 conn(0x5606acbf5bc0 msgr2=0x5606acd69190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- 172.21.15.72:0/1844215387 shutdown_connections 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- 172.21.15.72:0/1844215387 wait complete. 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 Processor -- start 2024-04-26T12:52:05.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- start start 2024-04-26T12:52:05.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd748b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606acc8be10 con 0x5606acc824e0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd748b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38700/0 (socket says 172.21.15.72:38700) 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b85573640 1 -- 172.21.15.72:0/242017942 learned_addr learned my addr 172.21.15.72:0/242017942 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b85573640 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606acd74df0 con 0x5606acc824e0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b85573640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd748b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800b6f0 tx=0x7f2b78000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2a71e03640 1 -- 172.21.15.72:0/242017942 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78001300 con 0x5606acc824e0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606acd75080 con 0x5606acc824e0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2a71e03640 1 -- 172.21.15.72:0/242017942 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7801c9c0 con 0x5606acc824e0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.652+0000 7f2a71e03640 1 -- 172.21.15.72:0/242017942 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7801cca0 con 0x5606acc824e0 2024-04-26T12:52:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606acd77cc0 con 0x5606acc824e0 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2a71e03640 1 -- 172.21.15.72:0/242017942 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2b78017050 con 0x5606acc824e0 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2a71e03640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a6c0346a0 0x7f2a6c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2a71e03640 1 -- 172.21.15.72:0/242017942 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2b78015020 con 0x5606acc824e0 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b84d72640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a6c0346a0 0x7f2a6c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acc869f0 0x5606acd7b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acd7be90 con 0x5606acc869f0 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b85d74640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acc869f0 0x5606acd7b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b84d72640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a6c0346a0 0x7f2a6c036b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0ae000 tx=0x7f2b7c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b85d74640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acc869f0 0x5606acd7b910 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b85d74640 1 -- 172.21.15.72:0/242017942 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acc869f0 2024-04-26T12:52:05.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acd78ec0 con 0x5606acc869f0 2024-04-26T12:52:05.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b85d74640 1 -- 172.21.15.72:0/242017942 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acc869f0 2024-04-26T12:52:05.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acd7e1a0 0x5606acd80590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acd80c60 con 0x5606acd7e1a0 2024-04-26T12:52:05.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.656+0000 7f2b85573640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acd7e1a0 0x5606acd80590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b85573640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acd7e1a0 0x5606acd80590 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b85573640 1 -- 172.21.15.72:0/242017942 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acd7e1a0 2024-04-26T12:52:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acd7d010 con 0x5606acc869f0 2024-04-26T12:52:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b85d74640 1 -- 172.21.15.72:0/242017942 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acc869f0 2024-04-26T12:52:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acd820c0 0x5606acd844b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acd84ba0 con 0x5606acd820c0 2024-04-26T12:52:05.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b84d72640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acd820c0 0x5606acd844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b84d72640 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acd820c0 0x5606acd844b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b84d72640 1 -- 172.21.15.72:0/242017942 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acd820c0 2024-04-26T12:52:05.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b87a58980 1 Processor -- start 2024-04-26T12:52:05.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b87a58980 1 -- start start 2024-04-26T12:52:05.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b87a58980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd92c10 0x5606acd93030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b87a58980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606acb87ab0 con 0x5606acd92c10 2024-04-26T12:52:05.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd92c10 0x5606acd93030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd92c10 0x5606acd93030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38716/0 (socket says 172.21.15.72:38716) 2024-04-26T12:52:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.660+0000 7f2b85573640 1 -- 172.21.15.72:0/3190807747 learned_addr learned my addr 172.21.15.72:0/3190807747 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b85573640 1 -- 172.21.15.72:0/3190807747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606acd93570 con 0x5606acd92c10 2024-04-26T12:52:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b85573640 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd92c10 0x5606acd93030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2b78048710 tx=0x7f2b7800e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2a6affd640 1 -- 172.21.15.72:0/3190807747 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78040070 con 0x5606acd92c10 2024-04-26T12:52:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2a6affd640 1 -- 172.21.15.72:0/3190807747 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7800ed90 con 0x5606acd92c10 2024-04-26T12:52:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606acd94010 con 0x5606acd92c10 2024-04-26T12:52:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2a6affd640 1 -- 172.21.15.72:0/3190807747 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7802fca0 con 0x5606acd92c10 2024-04-26T12:52:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606acd944e0 con 0x5606acd92c10 2024-04-26T12:52:05.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2a6affd640 1 -- 172.21.15.72:0/3190807747 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2b7803a070 con 0x5606acd92c10 2024-04-26T12:52:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2a6affd640 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a5c0346a0 0x7f2a5c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2a6affd640 1 -- 172.21.15.72:0/3190807747 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2b78032c20 con 0x5606acd92c10 2024-04-26T12:52:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b84d72640 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a5c0346a0 0x7f2a5c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b87a58980 1 Processor -- start 2024-04-26T12:52:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b87a58980 1 -- start start 2024-04-26T12:52:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b84d72640 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a5c0346a0 0x7f2a5c036b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5606acd7c750 tx=0x7f2b7c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b87a58980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acd9ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b87a58980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606acd6df20 con 0x5606acd9fb90 2024-04-26T12:52:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acd9ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acd9ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38722/0 (socket says 172.21.15.72:38722) 2024-04-26T12:52:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.664+0000 7f2b85573640 1 -- 172.21.15.72:0/1004006812 learned_addr learned my addr 172.21.15.72:0/1004006812 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b85573640 1 -- 172.21.15.72:0/1004006812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606acda0540 con 0x5606acd9fb90 2024-04-26T12:52:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b85573640 1 --2- 172.21.15.72:0/1004006812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acd9ff70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2b7804cfd0 tx=0x7f2b7804ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b43e87ba19ad11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2a68ff9640 1 -- 172.21.15.72:0/1004006812 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78041d40 con 0x5606acd9fb90 2024-04-26T12:52:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2a68ff9640 1 -- 172.21.15.72:0/1004006812 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7801a710 con 0x5606acd9fb90 2024-04-26T12:52:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2a68ff9640 1 -- 172.21.15.72:0/1004006812 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78041ee0 con 0x5606acd9fb90 2024-04-26T12:52:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- 172.21.15.72:0/1004006812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 msgr2=0x5606acd9ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 --2- 172.21.15.72:0/1004006812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acd9ff70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2b7804cfd0 tx=0x7f2b7804ac70 comp rx=0 tx=0).stop 2024-04-26T12:52:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- 172.21.15.72:0/1004006812 shutdown_connections 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 --2- 172.21.15.72:0/1004006812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acd9ff70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- 172.21.15.72:0/1004006812 >> 172.21.15.72:0/1004006812 conn(0x5606acd9bf20 msgr2=0x5606acd99f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- 172.21.15.72:0/1004006812 shutdown_connections 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- 172.21.15.72:0/1004006812 wait complete. 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 Processor -- start 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- start start 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acda6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5606acda0b10 con 0x5606acd9fb90 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acda6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b85573640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acda6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38734/0 (socket says 172.21.15.72:38734) 2024-04-26T12:52:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 learned_addr learned my addr 172.21.15.72:0/2911149473 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606acda73a0 con 0x5606acd9fb90 2024-04-26T12:52:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b85573640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acda6e60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2b78042840 tx=0x7f2b78032890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2a5affd640 1 -- 172.21.15.72:0/2911149473 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7801bac0 con 0x5606acd9fb90 2024-04-26T12:52:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2a5affd640 1 -- 172.21.15.72:0/2911149473 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78069070 con 0x5606acd9fb90 2024-04-26T12:52:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606acda73a0 con 0x5606acd9fb90 2024-04-26T12:52:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2a5affd640 1 -- 172.21.15.72:0/2911149473 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7801a480 con 0x5606acd9fb90 2024-04-26T12:52:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.668+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606acda73a0 con 0x5606acd9fb90 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2a5affd640 1 -- 172.21.15.72:0/2911149473 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2b78042ac0 con 0x5606acd9fb90 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2a5affd640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a50034650 0x7f2a50036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2a5affd640 1 -- 172.21.15.72:0/2911149473 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f2b7806fd60 con 0x5606acd9fb90 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b84d72640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a50034650 0x7f2a50036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acdb1da0 0x5606acdb4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb49b0 con 0x5606acdb1da0 2024-04-26T12:52:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b85d74640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acdb1da0 0x5606acdb4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b84d72640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a50034650 0x7f2a50036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5606acd84f80 tx=0x7f2b7c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b85d74640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acdb1da0 0x5606acdb4260 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 realm 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb4dc0 con 0x5606acdb1da0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5690 con 0x5606acdb1da0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acdb6790 0x5606acdb8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb9190 con 0x5606acdb6790 2024-04-26T12:52:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.672+0000 7f2b85573640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acdb6790 0x5606acdb8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85573640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acdb6790 0x5606acdb8b80 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b87a58980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b87a58980 20 searching for the correct realm 2024-04-26T12:52:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acdbb0e0 0x5606acdbd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdbdbc0 con 0x5606acdbb0e0 2024-04-26T12:52:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b84d72640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acdbb0e0 0x5606acdbd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b84d72640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acdbb0e0 0x5606acdbd4f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b84d72640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2b7c0e0040 0x7f2b7c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdbdbc0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85d74640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2b7c0e0040 0x7f2b7c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85d74640 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2b7c0e0040 0x7f2b7c0e0420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8000a4d0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.676+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x7f2b7c0e0040 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8000a4d0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x7f2b7c0e0040 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8000a4d0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8000a4d0 con 0x5606acdb1da0 2024-04-26T12:52:05.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x7f2b7c0e0040 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b80032040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.680+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80032040 con 0x5606acdb1da0 2024-04-26T12:52:05.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b80032040 con 0x5606acdb1da0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x7f2b7c0e0040 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80032040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80032040 con 0x5606acdb1da0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.684+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x7f2b7c0e0040 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80032040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdbb0e0 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb6790 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x5606acdb1da0 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b80032040 con 0x5606acdb1da0 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb5a30 con 0x7f2b7c0e0040 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80032040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb9a50 con 0x5606acdb1da0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80032040 con 0x5606acdb1da0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.688+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb9a50 con 0x5606acdb1da0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b80032040 con 0x5606acdb1da0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdb9a50 con 0x5606acdbb0e0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 zone default found 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 4 Realm: () 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 zonegroup default 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdba3a0 con 0x5606acdb6790 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdbfa80 con 0x5606acdbb0e0 2024-04-26T12:52:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdbfec0 con 0x5606acdbb0e0 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 started sync module instance, tier type = 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdbeec0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80032040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94586669888480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdbeec0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.692+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc0970 con 0x5606acdb1da0 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.696+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94586669888480] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.696+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.696+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94586669893072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdbeec0 con 0x5606acdb1da0 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.696+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc1380 con 0x5606acdbb0e0 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.696+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.696+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94586669895376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc1c20 con 0x5606acdbb0e0 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.696+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc2620 con 0x7f2b7c0e0040 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94586669893072] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94586669885968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc2a10 con 0x7f2b7c0e0040 2024-04-26T12:52:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc33d0 con 0x5606acdb1da0 2024-04-26T12:52:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94586669895376] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94586669885968] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94586669900080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc2f20 con 0x5606acdb1da0 2024-04-26T12:52:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.700+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc3770 con 0x5606acdb6790 2024-04-26T12:52:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94586669900080] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94586669903648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc3340 con 0x5606acdb6790 2024-04-26T12:52:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc4470 con 0x5606acdb6790 2024-04-26T12:52:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94586669903648] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94586669907184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc4700 con 0x5606acdb6790 2024-04-26T12:52:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.704+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc5220 con 0x5606acdb6790 2024-04-26T12:52:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94586669907184] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94586669911280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc51e0 con 0x5606acdb6790 2024-04-26T12:52:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=0 2024-04-26T12:52:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=1 2024-04-26T12:52:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=2 2024-04-26T12:52:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=3 2024-04-26T12:52:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=4 2024-04-26T12:52:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=5 2024-04-26T12:52:05.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=6 2024-04-26T12:52:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94586669911280] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 20 add_watcher() i=7 2024-04-26T12:52:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc86a0 con 0x5606acdb1da0 2024-04-26T12:52:05.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.708+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94586669908304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc5b60 con 0x5606acdb1da0 2024-04-26T12:52:05.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.712+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94586669908304] v35'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.712+0000 7f2a3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.712+0000 7f2b87a58980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:05.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.712+0000 7f2b87a58980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:05.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.712+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdc84b0 con 0x5606acdb1da0 2024-04-26T12:52:05.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.712+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.712+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd1790 con 0x5606acdb6790 2024-04-26T12:52:05.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.716+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.716+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd1790 con 0x5606acdbb0e0 2024-04-26T12:52:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.716+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.716+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd1dc0 con 0x5606acdb1da0 2024-04-26T12:52:05.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.720+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'246 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.720+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2330 con 0x7f2b7c0e0040 2024-04-26T12:52:05.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.720+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'80 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.720+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd27e0 con 0x5606acdbb0e0 2024-04-26T12:52:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.720+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.720+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd0d40 con 0x5606acdb1da0 2024-04-26T12:52:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.724+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.724+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd0d40 con 0x5606acdb6790 2024-04-26T12:52:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.724+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.724+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd0e10 con 0x7f2b7c0e0040 2024-04-26T12:52:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.728+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.728+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3340 con 0x5606acdbb0e0 2024-04-26T12:52:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.728+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.728+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3340 con 0x7f2b7c0e0040 2024-04-26T12:52:05.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.732+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'81 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.732+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3340 con 0x5606acdb6790 2024-04-26T12:52:05.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.732+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.732+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3340 con 0x7f2b7c0e0040 2024-04-26T12:52:05.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.736+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.736+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3340 con 0x5606acdb6790 2024-04-26T12:52:05.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.736+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.736+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3340 con 0x5606acdb1da0 2024-04-26T12:52:05.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.740+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'247 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.740+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3340 con 0x5606acdbb0e0 2024-04-26T12:52:05.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.740+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'72 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.740+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd33d0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.744+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'82 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.744+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd33d0 con 0x5606acdbb0e0 2024-04-26T12:52:05.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.744+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.744+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdb1da0 2024-04-26T12:52:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.748+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.748+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdb1da0 2024-04-26T12:52:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.748+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'248 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.748+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdbb0e0 2024-04-26T12:52:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.748+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'73 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.748+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd34f0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.752+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.752+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd34f0 con 0x5606acdbb0e0 2024-04-26T12:52:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.752+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.752+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd34f0 con 0x5606acdbb0e0 2024-04-26T12:52:05.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.756+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.756+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdbb0e0 2024-04-26T12:52:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.756+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.756+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdbb0e0 2024-04-26T12:52:05.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.756+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.756+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdb6790 2024-04-26T12:52:05.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.760+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.760+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdbb0e0 2024-04-26T12:52:05.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.764+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.764+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd3460 con 0x5606acdb6790 2024-04-26T12:52:05.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.764+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.764+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd33d0 con 0x5606acdbb0e0 2024-04-26T12:52:05.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.768+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'74 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.768+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd33d0 con 0x5606acdb6790 2024-04-26T12:52:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.772+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.772+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd33d0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.772+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.772+0000 7f2a3a7e4640 20 reqs_thread_entry: start 2024-04-26T12:52:05.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.772+0000 7f2b87a58980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.772+0000 7f2b87a58980 20 Filter name: none 2024-04-26T12:52:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.772+0000 7f29abfff640 20 reqs_thread_entry: start 2024-04-26T12:52:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-26T12:52:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd0800 con 0x5606acdb6790 2024-04-26T12:52:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 20 rados_obj.operate() r=0 bl.length=349 2024-04-26T12:52:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-04-26T12:52:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:52:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd0350 con 0x5606acdb6790 2024-04-26T12:52:05.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 10 removing key index: system_akey 2024-04-26T12:52:05.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd0350 con 0x5606acdbb0e0 2024-04-26T12:52:05.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(96 system_akey [delete] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-26T12:52:05.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.776+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94586670087744 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdf1800 con 0x5606acdb1da0 2024-04-26T12:52:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== watch-notify(notify (1) cookie 94586669893072 notify 150323855387 ret 0) ==== 203+0+0 (crc 0 0 0) 0x5606acdd1410 con 0x5606acdb1da0 2024-04-26T12:52:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2a68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855387 cookie 94586669893072 notifier 4860 bl.length()=161 2024-04-26T12:52:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(97 notify.1 [notify cookie 94586670087744 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2a68ff9640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2a48003d70 con 0x5606acdb1da0 2024-04-26T12:52:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== watch-notify(notify_complete (2) cookie 94586670087744 notify 150323855387 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606acdd1f90 con 0x5606acdb1da0 2024-04-26T12:52:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b87a58980 10 removing email index: 2024-04-26T12:52:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b87a58980 10 removing user buckets index 2024-04-26T12:52:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdef2e0 con 0x5606acdb6790 2024-04-26T12:52:05.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(99 system_user.buckets [delete] v35'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b87a58980 10 removing user index: system_user 2024-04-26T12:52:05.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.780+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdf3340 con 0x5606acdb6790 2024-04-26T12:52:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(100 system_user [call,call,delete] v35'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b87a58980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-04-26T12:52:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b87a58980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-26T12:52:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94586670093088 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606acdf2ca0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== watch-notify(notify (1) cookie 94586669888480 notify 150323855394 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5606acdd1f90 con 0x7f2b7c0e0040 2024-04-26T12:52:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2a68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855394 cookie 94586669888480 notifier 4860 bl.length()=160 2024-04-26T12:52:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(101 notify.0 [notify cookie 94586670093088 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2a68ff9640 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2a48003d70 con 0x7f2b7c0e0040 2024-04-26T12:52:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== watch-notify(notify_complete (2) cookie 94586670093088 notify 150323855394 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606acdd1dc0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.784+0000 7f2a3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.788+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94586669908304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x5606acdb1da0 2024-04-26T12:52:05.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.788+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94586669908304] v35'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.788+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94586669888480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.788+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94586669888480] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.788+0000 7f2b87a58980 20 remove_watcher() i=0 2024-04-26T12:52:05.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.788+0000 7f2b87a58980 2 removed watcher, disabling cache 2024-04-26T12:52:05.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.788+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94586669893072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x5606acdb1da0 2024-04-26T12:52:05.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.792+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94586669893072] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x5606acdb1da0 2024-04-26T12:52:05.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.792+0000 7f2b87a58980 20 remove_watcher() i=1 2024-04-26T12:52:05.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.792+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94586669895376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x5606acdbb0e0 2024-04-26T12:52:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.792+0000 7f2b84d72640 1 -- 172.21.15.72:0/2911149473 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94586669895376] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0aaab0 con 0x5606acdbb0e0 2024-04-26T12:52:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.792+0000 7f2b87a58980 20 remove_watcher() i=2 2024-04-26T12:52:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.792+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94586669885968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x7f2b7c0e0040 2024-04-26T12:52:05.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.796+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94586669885968] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80040040 con 0x7f2b7c0e0040 2024-04-26T12:52:05.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.796+0000 7f2b87a58980 20 remove_watcher() i=3 2024-04-26T12:52:05.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.796+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94586669900080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x5606acdb1da0 2024-04-26T12:52:05.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.796+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94586669900080] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8004b040 con 0x5606acdb1da0 2024-04-26T12:52:05.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.796+0000 7f2b87a58980 20 remove_watcher() i=4 2024-04-26T12:52:05.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.796+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94586669903648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x5606acdb6790 2024-04-26T12:52:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.800+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94586669903648] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.800+0000 7f2b87a58980 20 remove_watcher() i=5 2024-04-26T12:52:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.800+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94586669907184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x5606acdb6790 2024-04-26T12:52:05.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94586669907184] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 20 remove_watcher() i=6 2024-04-26T12:52:05.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94586669911280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606acdd2ef0 con 0x5606acdb6790 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b85573640 1 -- 172.21.15.72:0/2911149473 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94586669911280] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7802e070 con 0x5606acdb6790 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 20 remove_watcher() i=7 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acdb6790 msgr2=0x5606acdb8b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acdb6790 0x5606acdb8b80 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acdb1da0 msgr2=0x5606acdb4260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acdb1da0 0x5606acdb4260 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2b7c0e0040 msgr2=0x7f2b7c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f2b7c0e0040 0x7f2b7c0e0420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acdbb0e0 msgr2=0x5606acdbd4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acdbb0e0 0x5606acdbd4f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a50034650 msgr2=0x7f2a50036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a50034650 0x7f2a50036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5606acd84f80 tx=0x7f2b7c0c1040 comp rx=0 tx=0).stop 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b85d74640 1 -- 172.21.15.72:0/2911149473 reap_dead start 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 msgr2=0x5606acda6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acda6e60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2b78042840 tx=0x7f2b78032890 comp rx=0 tx=0).stop 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 shutdown_connections 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/2911149473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd9fb90 0x5606acda6e60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 >> 172.21.15.72:0/2911149473 conn(0x5606acd9bf20 msgr2=0x5606acd99580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 shutdown_connections 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/2911149473 wait complete. 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a5c0346a0 msgr2=0x7f2a5c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a5c0346a0 0x7f2a5c036b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5606acd7c750 tx=0x7f2b7c005ad0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd92c10 msgr2=0x5606acd93030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.804+0000 7f2b87a58980 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd92c10 0x5606acd93030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2b78048710 tx=0x7f2b7800e900 comp rx=0 tx=0).stop 2024-04-26T12:52:05.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 shutdown_connections 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a5c0346a0 0x7f2a5c036b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 --2- 172.21.15.72:0/3190807747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acd92c10 0x5606acd93030 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 >> 172.21.15.72:0/3190807747 conn(0x5606acd87a20 msgr2=0x5606acd88530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 shutdown_connections 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/3190807747 wait complete. 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acd7e1a0 msgr2=0x5606acd80590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5606acd7e1a0 0x5606acd80590 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acc869f0 msgr2=0x5606acd7b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5606acc869f0 0x5606acd7b910 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acd820c0 msgr2=0x5606acd844b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5606acd820c0 0x5606acd844b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a6c0346a0 msgr2=0x7f2a6c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2a6c0346a0 0x7f2a6c036b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0ae000 tx=0x7f2b7c0a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 msgr2=0x5606acd748b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 --2- 172.21.15.72:0/242017942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5606acc824e0 0x5606acd748b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800b6f0 tx=0x7f2b78000ee0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b85d74640 1 -- 172.21.15.72:0/242017942 reap_dead start 2024-04-26T12:52:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 shutdown_connections 2024-04-26T12:52:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 >> 172.21.15.72:0/242017942 conn(0x5606acbf5bc0 msgr2=0x5606acd67ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 shutdown_connections 2024-04-26T12:52:05.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.808+0000 7f2b87a58980 1 -- 172.21.15.72:0/242017942 wait complete. 2024-04-26T12:52:05.821 ERROR:root:None 2024-04-26T12:52:05.821 ERROR:root:0 2024-04-26T12:52:05.821 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-26T12:52:05.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-26T12:52:05.821 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-04-26T12:52:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1fb17a2980 1 Processor -- start 2024-04-26T12:52:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1fb17a2980 1 -- start start 2024-04-26T12:52:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1fb17a2980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e9c2fc6680 0x55e9c2fc8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1fb17a2980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9c2e70510 con 0x55e9c2fc2120 2024-04-26T12:52:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1fb17a2980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55e9c2e77430 con 0x55e9c2fc6680 2024-04-26T12:52:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1faeabc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e9c2fc6680 0x55e9c2fc8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1faeabc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55e9c2fc6680 0x55e9c2fc8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38740/0 (socket says 172.21.15.72:38740) 2024-04-26T12:52:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1faf2bd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55e9c2fc2120 0x55e9c2fc2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48790/0 (socket says 172.21.15.72:48790) 2024-04-26T12:52:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1faeabc640 1 -- 172.21.15.72:0/3695142140 learned_addr learned my addr 172.21.15.72:0/3695142140 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1faeabc640 1 -- 172.21.15.72:0/3695142140 >> v1:172.21.15.29:6789/0 conn(0x55e9c2fc2120 legacy=0x55e9c2fc2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1faeabc640 1 -- 172.21.15.72:0/3695142140 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c2e4cae0 con 0x55e9c2fc6680 2024-04-26T12:52:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1fae2bb640 1 -- 172.21.15.72:0/3695142140 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896440083 0 0) 0x55e9c2e70510 con 0x55e9c2fc2120 2024-04-26T12:52:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.912+0000 7f1faeabc640 1 --2- 172.21.15.72:0/3695142140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c2fc8a70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a5c0 tx=0x7f1f9801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56bfc3a134c543b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fae2bb640 1 -- 172.21.15.72:0/3695142140 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980a6070 con 0x55e9c2fc6680 2024-04-26T12:52:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fae2bb640 1 -- 172.21.15.72:0/3695142140 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f980af070 con 0x55e9c2fc6680 2024-04-26T12:52:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fae2bb640 1 -- 172.21.15.72:0/3695142140 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980aa5c0 con 0x55e9c2fc6680 2024-04-26T12:52:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3695142140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 msgr2=0x55e9c2fc8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/3695142140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c2fc8a70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a5c0 tx=0x7f1f9801b340 comp rx=0 tx=0).stop 2024-04-26T12:52:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3695142140 shutdown_connections 2024-04-26T12:52:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/3695142140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c2fc8a70 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3695142140 >> 172.21.15.72:0/3695142140 conn(0x55e9c2fbd9f0 msgr2=0x55e9c2fbfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3695142140 shutdown_connections 2024-04-26T12:52:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.916+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3695142140 wait complete. 2024-04-26T12:52:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 Processor -- start 2024-04-26T12:52:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- start start 2024-04-26T12:52:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc2120 0x55e9c2f36f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e9c2ec6a70 con 0x55e9c2fc2120 2024-04-26T12:52:05.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc2120 0x55e9c2f36f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc2120 0x55e9c2f36f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38752/0 (socket says 172.21.15.72:38752) 2024-04-26T12:52:05.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 -- 172.21.15.72:0/4261313247 learned_addr learned my addr 172.21.15.72:0/4261313247 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 -- 172.21.15.72:0/4261313247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c2f37500 con 0x55e9c2fc2120 2024-04-26T12:52:05.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/4261313247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc2120 0x55e9c2f36f30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00016c0 tx=0x7f1fa0001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2558feb5564e749 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1e9d60a640 1 -- 172.21.15.72:0/4261313247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0003460 con 0x55e9c2fc2120 2024-04-26T12:52:05.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1e9d60a640 1 -- 172.21.15.72:0/4261313247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa0003600 con 0x55e9c2fc2120 2024-04-26T12:52:05.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1e9d60a640 1 -- 172.21.15.72:0/4261313247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0003920 con 0x55e9c2fc2120 2024-04-26T12:52:05.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- 172.21.15.72:0/4261313247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc2120 msgr2=0x55e9c2f36f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/4261313247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc2120 0x55e9c2f36f30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00016c0 tx=0x7f1fa0001b80 comp rx=0 tx=0).stop 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- 172.21.15.72:0/4261313247 shutdown_connections 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/4261313247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc2120 0x55e9c2f36f30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- 172.21.15.72:0/4261313247 >> 172.21.15.72:0/4261313247 conn(0x55e9c2fbd9f0 msgr2=0x55e9c30a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- 172.21.15.72:0/4261313247 shutdown_connections 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- 172.21.15.72:0/4261313247 wait complete. 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 Processor -- start 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- start start 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c30b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1fb17a2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e9c2fcbaa0 con 0x55e9c2fc6680 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c30b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c30b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38766/0 (socket says 172.21.15.72:38766) 2024-04-26T12:52:05.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.932+0000 7f1faf2bd640 1 -- 172.21.15.72:0/1469224474 learned_addr learned my addr 172.21.15.72:0/1469224474 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1faf2bd640 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c30b7e30 con 0x55e9c2fc6680 2024-04-26T12:52:05.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c30b78f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00012f0 tx=0x7f1fa0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1e9be07640 1 -- 172.21.15.72:0/1469224474 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0013630 con 0x55e9c2fc6680 2024-04-26T12:52:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9c30b80c0 con 0x55e9c2fc6680 2024-04-26T12:52:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c30bad40 con 0x55e9c2fc6680 2024-04-26T12:52:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1e9be07640 1 -- 172.21.15.72:0/1469224474 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa0023070 con 0x55e9c2fc6680 2024-04-26T12:52:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1e9be07640 1 -- 172.21.15.72:0/1469224474 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0013900 con 0x55e9c2fc6680 2024-04-26T12:52:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1e9be07640 1 -- 172.21.15.72:0/1469224474 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fa0010070 con 0x55e9c2fc6680 2024-04-26T12:52:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1e9be07640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e94034650 0x7f1e94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1e9be07640 1 -- 172.21.15.72:0/1469224474 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1fa0049b60 con 0x55e9c2fc6680 2024-04-26T12:52:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1faeabc640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e94034650 0x7f1e94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30bc810 0x55e9c30bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30bf220 con 0x55e9c30bc810 2024-04-26T12:52:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fafabe640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30bc810 0x55e9c30bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1faeabc640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e94034650 0x7f1e94036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f980ae000 tx=0x7f1f980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fafabe640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30bc810 0x55e9c30bec00 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fafabe640 1 -- 172.21.15.72:0/1469224474 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30bc810 2024-04-26T12:52:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.936+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30bbf40 con 0x55e9c30bc810 2024-04-26T12:52:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fafabe640 1 -- 172.21.15.72:0/1469224474 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30bc810 2024-04-26T12:52:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30c1550 0x55e9c30c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30c4030 con 0x55e9c30c1550 2024-04-26T12:52:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30c1550 0x55e9c30c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30c1550 0x55e9c30c3940 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1faf2bd640 1 -- 172.21.15.72:0/1469224474 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1fa000f030 con 0x55e9c30c1550 2024-04-26T12:52:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30c03f0 con 0x55e9c30bc810 2024-04-26T12:52:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fafabe640 1 -- 172.21.15.72:0/1469224474 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30bc810 2024-04-26T12:52:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30c5490 0x55e9c30c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30c7fc0 con 0x55e9c30c5490 2024-04-26T12:52:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1faeabc640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30c5490 0x55e9c30c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1faeabc640 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30c5490 0x55e9c30c7880 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1faeabc640 1 -- 172.21.15.72:0/1469224474 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f980aaa00 con 0x55e9c30c5490 2024-04-26T12:52:05.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 Processor -- start 2024-04-26T12:52:05.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 -- start start 2024-04-26T12:52:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30d6050 0x55e9c30d6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.940+0000 7f1fb17a2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e9c2ecaab0 con 0x55e9c30d6050 2024-04-26T12:52:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30d6050 0x55e9c30d6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30d6050 0x55e9c30d6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38772/0 (socket says 172.21.15.72:38772) 2024-04-26T12:52:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1faf2bd640 1 -- 172.21.15.72:0/3692637628 learned_addr learned my addr 172.21.15.72:0/3692637628 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1faf2bd640 1 -- 172.21.15.72:0/3692637628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c30d69b0 con 0x55e9c30d6050 2024-04-26T12:52:05.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30d6050 0x55e9c30d6470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0047e60 tx=0x7f1fa001dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1e99602640 1 -- 172.21.15.72:0/3692637628 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0041170 con 0x55e9c30d6050 2024-04-26T12:52:05.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9c30d7450 con 0x55e9c30d6050 2024-04-26T12:52:05.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1e99602640 1 -- 172.21.15.72:0/3692637628 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa0019040 con 0x55e9c30d6050 2024-04-26T12:52:05.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1e99602640 1 -- 172.21.15.72:0/3692637628 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0041820 con 0x55e9c30d6050 2024-04-26T12:52:05.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c30d7920 con 0x55e9c30d6050 2024-04-26T12:52:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1e99602640 1 -- 172.21.15.72:0/3692637628 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fa0010590 con 0x55e9c30d6050 2024-04-26T12:52:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1e99602640 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e88034650 0x7f1e88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1e99602640 1 -- 172.21.15.72:0/3692637628 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1fa0005070 con 0x55e9c30d6050 2024-04-26T12:52:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1faeabc640 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e88034650 0x7f1e88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1fb17a2980 1 Processor -- start 2024-04-26T12:52:05.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1fb17a2980 1 -- start start 2024-04-26T12:52:05.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1faeabc640 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e88034650 0x7f1e88036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55e9c30bf6f0 tx=0x7f1f98005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1fb17a2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30e3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.944+0000 7f1fb17a2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e9c2f37850 con 0x55e9c30e3230 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30e3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38776/0 (socket says 172.21.15.72:38776) 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 -- 172.21.15.72:0/2952884701 learned_addr learned my addr 172.21.15.72:0/2952884701 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 -- 172.21.15.72:0/2952884701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c30e3c20 con 0x55e9c30e3230 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/2952884701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30e3650 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000efd0 tx=0x7f1fa0022240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc09a57dea90b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1e92ffd640 1 -- 172.21.15.72:0/2952884701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0061070 con 0x55e9c30e3230 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1e92ffd640 1 -- 172.21.15.72:0/2952884701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa00468e0 con 0x55e9c30e3230 2024-04-26T12:52:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1e92ffd640 1 -- 172.21.15.72:0/2952884701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa004e040 con 0x55e9c30e3230 2024-04-26T12:52:05.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- 172.21.15.72:0/2952884701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 msgr2=0x55e9c30e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:05.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/2952884701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30e3650 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000efd0 tx=0x7f1fa0022240 comp rx=0 tx=0).stop 2024-04-26T12:52:05.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- 172.21.15.72:0/2952884701 shutdown_connections 2024-04-26T12:52:05.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/2952884701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30e3650 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:05.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- 172.21.15.72:0/2952884701 >> 172.21.15.72:0/2952884701 conn(0x55e9c30df570 msgr2=0x55e9c30dd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:05.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- 172.21.15.72:0/2952884701 shutdown_connections 2024-04-26T12:52:05.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- 172.21.15.72:0/2952884701 wait complete. 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 Processor -- start 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- start start 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55e9c30e42e0 con 0x55e9c30e3230 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30ea5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38790/0 (socket says 172.21.15.72:38790) 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 learned_addr learned my addr 172.21.15.72:0/698823063 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c30eaae0 con 0x55e9c30e3230 2024-04-26T12:52:05.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30ea5a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0046c80 tx=0x7f1fa0004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1e917fa640 1 -- 172.21.15.72:0/698823063 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0069070 con 0x55e9c30e3230 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1e917fa640 1 -- 172.21.15.72:0/698823063 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa00109b0 con 0x55e9c30e3230 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1e917fa640 1 -- 172.21.15.72:0/698823063 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0061040 con 0x55e9c30e3230 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.948+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9c30eaae0 con 0x55e9c30e3230 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c30eaae0 con 0x55e9c30e3230 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1e917fa640 1 -- 172.21.15.72:0/698823063 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fa006c070 con 0x55e9c30e3230 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1e917fa640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e78034650 0x7f1e78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1e917fa640 1 -- 172.21.15.72:0/698823063 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1fa0059050 con 0x55e9c30e3230 2024-04-26T12:52:05.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1faeabc640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e78034650 0x7f1e78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30f5460 0x55e9c30f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f8070 con 0x55e9c30f5460 2024-04-26T12:52:05.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fafabe640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30f5460 0x55e9c30f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1faeabc640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e78034650 0x7f1e78036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f98000c10 tx=0x7f1f980c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fafabe640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30f5460 0x55e9c30f7920 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30f5460 2024-04-26T12:52:05.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 realm 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f8480 con 0x55e9c30f5460 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30f5460 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f8d50 con 0x55e9c30f5460 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30f5460 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f5460 2024-04-26T12:52:05.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30f5460 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30f9e50 0x55e9c30fc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.952+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30fc810 con 0x55e9c30f9e50 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30f9e50 0x55e9c30fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faf2bd640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30f9e50 0x55e9c30fc240 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fb17a2980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fb17a2980 20 searching for the correct realm 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30fe760 0x55e9c3100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3101260 con 0x55e9c30fe760 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faeabc640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30fe760 0x55e9c3100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faeabc640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30fe760 0x55e9c3100b90 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faeabc640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1f980e2040 0x7f1f980e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:05.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3101260 con 0x7f1f980e2040 2024-04-26T12:52:05.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fafabe640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1f980e2040 0x7f1f980e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fafabe640 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1f980e2040 0x7f1f980e2930 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80083f0 con 0x7f1f980e2040 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f9e50 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.956+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f5460 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa80083f0 con 0x55e9c30f5460 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f5460 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f9e50 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f9e50 2024-04-26T12:52:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x7f1f980e2040 2024-04-26T12:52:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30fe760 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f5460 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x7f1f980e2040 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f5460 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x7f1f980e2040 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.960+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30fe760 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30fe760 2024-04-26T12:52:05.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f9e50 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30fe760 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30fe760 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f5460 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f5460 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f9e50 2024-04-26T12:52:05.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30fe760 2024-04-26T12:52:05.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x7f1f980e2040 2024-04-26T12:52:05.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f5460 2024-04-26T12:52:05.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.964+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f9e50 2024-04-26T12:52:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30fe760 2024-04-26T12:52:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f9e50 2024-04-26T12:52:05.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x7f1f980e2040 2024-04-26T12:52:05.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30fe760 2024-04-26T12:52:05.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f9e50 2024-04-26T12:52:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x55e9c30f5460 2024-04-26T12:52:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.968+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1fa802b040 con 0x7f1f980e2040 2024-04-26T12:52:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f5460 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30f5460 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30f90f0 con 0x55e9c30fe760 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 zone default found 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 4 Realm: () 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 zonegroup default 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c30fd690 con 0x55e9c30f9e50 2024-04-26T12:52:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c31030c0 con 0x55e9c30fe760 2024-04-26T12:52:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3103460 con 0x55e9c30fe760 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 started sync module instance, tier type = 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.972+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3102560 con 0x7f1f980e2040 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.976+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.976+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94462488357248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3102560 con 0x7f1f980e2040 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.976+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3103cb0 con 0x55e9c30f5460 2024-04-26T12:52:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.976+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94462488357248] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.976+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.976+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94462488361264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3102560 con 0x55e9c30f5460 2024-04-26T12:52:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.976+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c31046f0 con 0x55e9c30fe760 2024-04-26T12:52:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94462488363584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3104f90 con 0x55e9c30fe760 2024-04-26T12:52:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3105990 con 0x7f1f980e2040 2024-04-26T12:52:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94462488361264] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94462488354992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3105db0 con 0x7f1f980e2040 2024-04-26T12:52:05.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3106770 con 0x55e9c30f5460 2024-04-26T12:52:05.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94462488363584] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.980+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94462488354992] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.984+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.984+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94462488368288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c31062c0 con 0x55e9c30f5460 2024-04-26T12:52:05.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.984+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3106b10 con 0x55e9c30f9e50 2024-04-26T12:52:05.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.984+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94462488368288] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.984+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.984+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94462488371904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c31066e0 con 0x55e9c30f9e50 2024-04-26T12:52:05.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.984+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3107810 con 0x55e9c30f9e50 2024-04-26T12:52:05.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94462488376672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3107fb0 con 0x55e9c30f9e50 2024-04-26T12:52:05.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3108ad0 con 0x55e9c30f9e50 2024-04-26T12:52:05.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94462488371904] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94462488376672] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94462488380832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3107a00 con 0x55e9c30f9e50 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 20 add_watcher() i=0 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 20 add_watcher() i=1 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 20 add_watcher() i=2 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 20 add_watcher() i=3 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 20 add_watcher() i=4 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 20 add_watcher() i=5 2024-04-26T12:52:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.988+0000 7f1fb17a2980 20 add_watcher() i=6 2024-04-26T12:52:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94462488380832] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 20 add_watcher() i=7 2024-04-26T12:52:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c310bac0 con 0x55e9c30f5460 2024-04-26T12:52:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94462488374960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3108fb0 con 0x55e9c30f5460 2024-04-26T12:52:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94462488374960] v35'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1e65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 5 note: GC not initialized 2024-04-26T12:52:05.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1e64fe1640 20 reqs_thread_entry: start 2024-04-26T12:52:05.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:05.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 20 Filter name: none 2024-04-26T12:52:05.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1dde7fc640 20 reqs_thread_entry: start 2024-04-26T12:52:05.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-26T12:52:05.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.992+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312f230 con 0x55e9c30fe760 2024-04-26T12:52:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-04-26T12:52:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:52:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 20 rados->read ofs=0 len=0 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312dd20 con 0x55e9c30fe760 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-26T12:52:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312dd20 con 0x55e9c30fe760 2024-04-26T12:52:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v35'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94462488533424 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3132f80 con 0x55e9c30fe760 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== watch-notify(notify (1) cookie 94462488363584 notify 150323855369 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55e9c3132820 con 0x55e9c30fe760 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1e92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94462488363584 notifier 4867 bl.length()=542 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1e92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1e92ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(65 notify.2 [notify cookie 94462488533424 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1e92ffd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1e74003eb0 con 0x55e9c30fe760 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== watch-notify(notify_complete (2) cookie 94462488533424 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e9c312e340 con 0x55e9c30fe760 2024-04-26T12:52:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:05.996+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312d9b0 con 0x55e9c30fe760 2024-04-26T12:52:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v35'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1fb17a2980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-26T12:52:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1fb17a2980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1fb17a2980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94462488533424 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e9c3131e40 con 0x55e9c30f9e50 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== watch-notify(notify (1) cookie 94462488371904 notify 150323855404 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55e9c30d7920 con 0x55e9c30f9e50 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1e92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855404 cookie 94462488371904 notifier 4867 bl.length()=175 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1e92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1e92ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(68 notify.5 [notify cookie 94462488533424 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1e92ffd640 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1e74003eb0 con 0x55e9c30f9e50 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== watch-notify(notify_complete (2) cookie 94462488533424 notify 150323855404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e9c30d7450 con 0x55e9c30f9e50 2024-04-26T12:52:06.002 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-04-26T12:52:05.997977Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.997963Z","tags":[],"group_ids":[]} 2024-04-26T12:52:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1e65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.000+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94462488374960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x55e9c30f5460 2024-04-26T12:52:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94462488374960] v35'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94462488357248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x7f1f980e2040 2024-04-26T12:52:06.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94462488357248] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:06.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fb17a2980 20 remove_watcher() i=0 2024-04-26T12:52:06.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fb17a2980 2 removed watcher, disabling cache 2024-04-26T12:52:06.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94462488361264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x55e9c30f5460 2024-04-26T12:52:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94462488361264] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fb17a2980 20 remove_watcher() i=1 2024-04-26T12:52:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.004+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94462488363584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x55e9c30fe760 2024-04-26T12:52:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.008+0000 7f1faeabc640 1 -- 172.21.15.72:0/698823063 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94462488363584] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980df040 con 0x55e9c30fe760 2024-04-26T12:52:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.008+0000 7f1fb17a2980 20 remove_watcher() i=2 2024-04-26T12:52:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.008+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94462488354992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x7f1f980e2040 2024-04-26T12:52:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.008+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94462488354992] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x7f1f980e2040 2024-04-26T12:52:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.008+0000 7f1fb17a2980 20 remove_watcher() i=3 2024-04-26T12:52:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.008+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94462488368288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x55e9c30f5460 2024-04-26T12:52:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.012+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94462488368288] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa8026040 con 0x55e9c30f5460 2024-04-26T12:52:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.012+0000 7f1fb17a2980 20 remove_watcher() i=4 2024-04-26T12:52:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.012+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94462488371904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x55e9c30f9e50 2024-04-26T12:52:06.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.012+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94462488371904] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:06.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.012+0000 7f1fb17a2980 20 remove_watcher() i=5 2024-04-26T12:52:06.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.012+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94462488376672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x55e9c30f9e50 2024-04-26T12:52:06.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.016+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94462488376672] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:06.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.016+0000 7f1fb17a2980 20 remove_watcher() i=6 2024-04-26T12:52:06.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.016+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94462488380832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e9c312cf30 con 0x55e9c30f9e50 2024-04-26T12:52:06.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1faf2bd640 1 -- 172.21.15.72:0/698823063 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94462488380832] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa006b030 con 0x55e9c30f9e50 2024-04-26T12:52:06.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 20 remove_watcher() i=7 2024-04-26T12:52:06.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30f9e50 msgr2=0x55e9c30fc240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30f9e50 0x55e9c30fc240 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30f5460 msgr2=0x55e9c30f7920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30f5460 0x55e9c30f7920 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1f980e2040 msgr2=0x7f1f980e2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1f980e2040 0x7f1f980e2930 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30fe760 msgr2=0x55e9c3100b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30fe760 0x55e9c3100b90 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e78034650 msgr2=0x7f1e78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e78034650 0x7f1e78036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f98000c10 tx=0x7f1f980c1040 comp rx=0 tx=0).stop 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fafabe640 1 -- 172.21.15.72:0/698823063 reap_dead start 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 msgr2=0x55e9c30ea5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30ea5a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0046c80 tx=0x7f1fa0004f60 comp rx=0 tx=0).stop 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 shutdown_connections 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/698823063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30e3230 0x55e9c30ea5a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 >> 172.21.15.72:0/698823063 conn(0x55e9c30df570 msgr2=0x55e9c30dd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 shutdown_connections 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/698823063 wait complete. 2024-04-26T12:52:06.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e88034650 msgr2=0x7f1e88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e88034650 0x7f1e88036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55e9c30bf6f0 tx=0x7f1f98005ad0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30d6050 msgr2=0x55e9c30d6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30d6050 0x55e9c30d6470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0047e60 tx=0x7f1fa001dad0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 shutdown_connections 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e88034650 0x7f1e88036b10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/3692637628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c30d6050 0x55e9c30d6470 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 >> 172.21.15.72:0/3692637628 conn(0x55e9c30cae60 msgr2=0x55e9c30cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 shutdown_connections 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/3692637628 wait complete. 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30c1550 msgr2=0x55e9c30c3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55e9c30c1550 0x55e9c30c3940 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30bc810 msgr2=0x55e9c30bec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55e9c30bc810 0x55e9c30bec00 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30c5490 msgr2=0x55e9c30c7880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55e9c30c5490 0x55e9c30c7880 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e94034650 msgr2=0x7f1e94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1e94034650 0x7f1e94036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f980ae000 tx=0x7f1f980a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 msgr2=0x55e9c30b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 --2- 172.21.15.72:0/1469224474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55e9c2fc6680 0x55e9c30b78f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00012f0 tx=0x7f1fa0001260 comp rx=0 tx=0).stop 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fafabe640 1 -- 172.21.15.72:0/1469224474 reap_dead start 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 shutdown_connections 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 >> 172.21.15.72:0/1469224474 conn(0x55e9c2fbd9f0 msgr2=0x55e9c30a7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 shutdown_connections 2024-04-26T12:52:06.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.020+0000 7f1fb17a2980 1 -- 172.21.15.72:0/1469224474 wait complete. 2024-04-26T12:52:06.034 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-26T12:52:05.997977Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.997963Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.034 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-26T12:52:05.997977Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.997963Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.034 ERROR:root:0 2024-04-26T12:52:06.035 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:06.039 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:06.040 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-04-26T12:52:06.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-04-26T12:52:06.040 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-04-26T12:52:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.068+0000 7ffb024f0980 1 Processor -- start 2024-04-26T12:52:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.068+0000 7ffb024f0980 1 -- start start 2024-04-26T12:52:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.068+0000 7ffb024f0980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556f3eea97d0 0x556f3eeabbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.068+0000 7ffb024f0980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f3ed52510 con 0x556f3eea52c0 2024-04-26T12:52:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.068+0000 7ffb024f0980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x556f3ed59430 con 0x556f3eea97d0 2024-04-26T12:52:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff80a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556f3eea97d0 0x556f3eeabbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff80a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x556f3eea97d0 0x556f3eeabbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38800/0 (socket says 172.21.15.72:38800) 2024-04-26T12:52:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffb0000b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x556f3eea52c0 0x556f3eea56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48800/0 (socket says 172.21.15.72:48800) 2024-04-26T12:52:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff80a640 1 -- 172.21.15.72:0/2945939438 learned_addr learned my addr 172.21.15.72:0/2945939438 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff80a640 1 -- 172.21.15.72:0/2945939438 >> v1:172.21.15.29:6789/0 conn(0x556f3eea52c0 legacy=0x556f3eea56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff80a640 1 -- 172.21.15.72:0/2945939438 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3ed2eae0 con 0x556f3eea97d0 2024-04-26T12:52:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff80a640 1 --2- 172.21.15.72:0/2945939438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea97d0 0x556f3eeabbc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffae800a5c0 tx=0x7ffae801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f052675422b5a2ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff009640 1 -- 172.21.15.72:0/2945939438 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae80a6070 con 0x556f3eea97d0 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff009640 1 -- 172.21.15.72:0/2945939438 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae80af070 con 0x556f3eea97d0 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffaff009640 1 -- 172.21.15.72:0/2945939438 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae80aa5c0 con 0x556f3eea97d0 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffb024f0980 1 -- 172.21.15.72:0/2945939438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea97d0 msgr2=0x556f3eeabbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffb024f0980 1 --2- 172.21.15.72:0/2945939438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea97d0 0x556f3eeabbc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffae800a5c0 tx=0x7ffae801b340 comp rx=0 tx=0).stop 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.072+0000 7ffb024f0980 1 -- 172.21.15.72:0/2945939438 shutdown_connections 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.076+0000 7ffb024f0980 1 --2- 172.21.15.72:0/2945939438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea97d0 0x556f3eeabbc0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.076+0000 7ffb024f0980 1 -- 172.21.15.72:0/2945939438 >> 172.21.15.72:0/2945939438 conn(0x556f3eea0b90 msgr2=0x556f3eea2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.076+0000 7ffb024f0980 1 -- 172.21.15.72:0/2945939438 shutdown_connections 2024-04-26T12:52:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.076+0000 7ffb024f0980 1 -- 172.21.15.72:0/2945939438 wait complete. 2024-04-26T12:52:06.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.088+0000 7ffb024f0980 1 Processor -- start 2024-04-26T12:52:06.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.088+0000 7ffb024f0980 1 -- start start 2024-04-26T12:52:06.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.088+0000 7ffb024f0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef90400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.088+0000 7ffb024f0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f3eda8a70 con 0x556f3eea52c0 2024-04-26T12:52:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.088+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef90400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.088+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef90400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38814/0 (socket says 172.21.15.72:38814) 2024-04-26T12:52:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.088+0000 7ffb0000b640 1 -- 172.21.15.72:0/4139935862 learned_addr learned my addr 172.21.15.72:0/4139935862 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb0000b640 1 -- 172.21.15.72:0/4139935862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3ef909d0 con 0x556f3eea52c0 2024-04-26T12:52:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb0000b640 1 --2- 172.21.15.72:0/4139935862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef90400 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00015f0 tx=0x7ffaf0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1e9bd2be971913 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ff9ee60c640 1 -- 172.21.15.72:0/4139935862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0013420 con 0x556f3eea52c0 2024-04-26T12:52:06.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ff9ee60c640 1 -- 172.21.15.72:0/4139935862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf00135e0 con 0x556f3eea52c0 2024-04-26T12:52:06.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ff9ee60c640 1 -- 172.21.15.72:0/4139935862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0013940 con 0x556f3eea52c0 2024-04-26T12:52:06.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 -- 172.21.15.72:0/4139935862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 msgr2=0x556f3ef90400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 --2- 172.21.15.72:0/4139935862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef90400 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00015f0 tx=0x7ffaf0001ab0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 -- 172.21.15.72:0/4139935862 shutdown_connections 2024-04-26T12:52:06.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 --2- 172.21.15.72:0/4139935862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef90400 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 -- 172.21.15.72:0/4139935862 >> 172.21.15.72:0/4139935862 conn(0x556f3eea0b90 msgr2=0x556f3ef8bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 -- 172.21.15.72:0/4139935862 shutdown_connections 2024-04-26T12:52:06.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 -- 172.21.15.72:0/4139935862 wait complete. 2024-04-26T12:52:06.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 Processor -- start 2024-04-26T12:52:06.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 -- start start 2024-04-26T12:52:06.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb024f0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f3eeaebf0 con 0x556f3eea52c0 2024-04-26T12:52:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38828/0 (socket says 172.21.15.72:38828) 2024-04-26T12:52:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb0000b640 1 -- 172.21.15.72:0/3830246390 learned_addr learned my addr 172.21.15.72:0/3830246390 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb0000b640 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3ef97c10 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.092+0000 7ffb0000b640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef976d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0006640 tx=0x7ffaf0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ff9ece09640 1 -- 172.21.15.72:0/3830246390 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0022020 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f3ef97ea0 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ff9ece09640 1 -- 172.21.15.72:0/3830246390 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf0006320 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ff9ece09640 1 -- 172.21.15.72:0/3830246390 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0004ab0 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3ef9aae0 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ff9ece09640 1 -- 172.21.15.72:0/3830246390 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffaf0025020 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ff9ece09640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9e8034650 0x7ff9e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ff9ece09640 1 -- 172.21.15.72:0/3830246390 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ffaf0018030 con 0x556f3eea52c0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9e8034650 0x7ff9e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3eea97d0 0x556f3ef9e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3ef9ec90 con 0x556f3eea97d0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb0080c640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3eea97d0 0x556f3ef9e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9e8034650 0x7ff9e8036b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffae80ae000 tx=0x7ffae80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb0080c640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3eea97d0 0x556f3ef9e670 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb0080c640 1 -- 172.21.15.72:0/3830246390 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3eea97d0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3ef9bd00 con 0x556f3eea97d0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb0080c640 1 -- 172.21.15.72:0/3830246390 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3eea97d0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efa0fe0 0x556f3efa33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efa3aa0 con 0x556f3efa0fe0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.096+0000 7ffb0000b640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efa0fe0 0x556f3efa33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb0000b640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efa0fe0 0x556f3efa33d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb0000b640 1 -- 172.21.15.72:0/3830246390 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffaf001b070 con 0x556f3efa0fe0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3ef9fe80 con 0x556f3eea97d0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb0080c640 1 -- 172.21.15.72:0/3830246390 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3eea97d0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efa4ee0 0x556f3efa72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efa7a60 con 0x556f3efa4ee0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efa4ee0 0x556f3efa72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efa4ee0 0x556f3efa72d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffaff80a640 1 -- 172.21.15.72:0/3830246390 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efa4ee0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb024f0980 1 Processor -- start 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb024f0980 1 -- start start 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb024f0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3ee1bac0 0x556f3ee19f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb024f0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f3edacab0 con 0x556f3ee1bac0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3ee1bac0 0x556f3ee19f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3ee1bac0 0x556f3ee19f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38840/0 (socket says 172.21.15.72:38840) 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.100+0000 7ffb0000b640 1 -- 172.21.15.72:0/2771659117 learned_addr learned my addr 172.21.15.72:0/2771659117 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb0000b640 1 -- 172.21.15.72:0/2771659117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3ee1a4a0 con 0x556f3ee1bac0 2024-04-26T12:52:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb0000b640 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3ee1bac0 0x556f3ee19f60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00069a0 tx=0x7ffaf0010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ff9e5ffb640 1 -- 172.21.15.72:0/2771659117 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf001d580 con 0x556f3ee1bac0 2024-04-26T12:52:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ff9e5ffb640 1 -- 172.21.15.72:0/2771659117 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf001d720 con 0x556f3ee1bac0 2024-04-26T12:52:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f3ee1a790 con 0x556f3ee1bac0 2024-04-26T12:52:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ff9e5ffb640 1 -- 172.21.15.72:0/2771659117 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf001da40 con 0x556f3ee1bac0 2024-04-26T12:52:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3ee1ac60 con 0x556f3ee1bac0 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ff9e5ffb640 1 -- 172.21.15.72:0/2771659117 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffaf0010070 con 0x556f3ee1bac0 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ff9e5ffb640 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d8034650 0x7ff9d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ff9e5ffb640 1 -- 172.21.15.72:0/2771659117 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ffaf001f5a0 con 0x556f3ee1bac0 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffaff80a640 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d8034650 0x7ff9d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb024f0980 1 Processor -- start 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb024f0980 1 -- start start 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffaff80a640 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d8034650 0x7ff9d8036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffae801b380 tx=0x7ffae8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb024f0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efc5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb024f0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f3ef90d20 con 0x556f3efc4c70 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efc5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efc5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38852/0 (socket says 172.21.15.72:38852) 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb0000b640 1 -- 172.21.15.72:0/1249737487 learned_addr learned my addr 172.21.15.72:0/1249737487 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.104+0000 7ffb0000b640 1 -- 172.21.15.72:0/1249737487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3efc5660 con 0x556f3efc4c70 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb0000b640 1 --2- 172.21.15.72:0/1249737487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efc5090 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ffaf001dfd0 tx=0x7ffaf0041380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e03a3c069da2dc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ff9df7fe640 1 -- 172.21.15.72:0/1249737487 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0005da0 con 0x556f3efc4c70 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ff9df7fe640 1 -- 172.21.15.72:0/1249737487 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf0053070 con 0x556f3efc4c70 2024-04-26T12:52:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ff9df7fe640 1 -- 172.21.15.72:0/1249737487 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf00265d0 con 0x556f3efc4c70 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- 172.21.15.72:0/1249737487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 msgr2=0x556f3efc5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 --2- 172.21.15.72:0/1249737487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efc5090 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ffaf001dfd0 tx=0x7ffaf0041380 comp rx=0 tx=0).stop 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- 172.21.15.72:0/1249737487 shutdown_connections 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 --2- 172.21.15.72:0/1249737487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efc5090 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- 172.21.15.72:0/1249737487 >> 172.21.15.72:0/1249737487 conn(0x556f3efc1000 msgr2=0x556f3efbf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- 172.21.15.72:0/1249737487 shutdown_connections 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- 172.21.15.72:0/1249737487 wait complete. 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 Processor -- start 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- start start 2024-04-26T12:52:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efcbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x556f3efc5bf0 con 0x556f3efc4c70 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efcbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb0000b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efcbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38866/0 (socket says 172.21.15.72:38866) 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 learned_addr learned my addr 172.21.15.72:0/3700969570 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3efcc4d0 con 0x556f3efc4c70 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb0000b640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efcbf90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0028fd0 tx=0x7ffaf001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ff9ddffb640 1 -- 172.21.15.72:0/3700969570 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0069070 con 0x556f3efc4c70 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ff9ddffb640 1 -- 172.21.15.72:0/3700969570 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf0049e00 con 0x556f3efc4c70 2024-04-26T12:52:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ff9ddffb640 1 -- 172.21.15.72:0/3700969570 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0026700 con 0x556f3efc4c70 2024-04-26T12:52:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f3efcc4d0 con 0x556f3efc4c70 2024-04-26T12:52:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.108+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3efcc4d0 con 0x556f3efc4c70 2024-04-26T12:52:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ff9ddffb640 1 -- 172.21.15.72:0/3700969570 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffaf0061070 con 0x556f3efc4c70 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ff9ddffb640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d0034600 0x7ff9d0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ff9ddffb640 1 -- 172.21.15.72:0/3700969570 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ffaf005f020 con 0x556f3efc4c70 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d0034600 0x7ff9d0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3efd70d0 0x556f3efd9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efd9cc0 con 0x556f3efd70d0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb0080c640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3efd70d0 0x556f3efd9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d0034600 0x7ff9d0036ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x556f3efa7e60 tx=0x7ffae80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb0080c640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3efd70d0 0x556f3efd9570 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3efd70d0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 realm 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efda120 con 0x556f3efd70d0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3efd70d0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efda9c0 con 0x556f3efd70d0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3efd70d0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efd70d0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3efd70d0 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efdbac0 0x556f3efddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efde550 con 0x556f3efdbac0 2024-04-26T12:52:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.112+0000 7ffb0000b640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efdbac0 0x556f3efddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0000b640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efdbac0 0x556f3efddeb0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb024f0980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb024f0980 20 searching for the correct realm 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efe0430 0x556f3efe28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe2f20 con 0x556f3efe0430 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efe0430 0x556f3efe28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efe0430 0x556f3efe28a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffaff80a640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ffae80e0040 0x7ffae80e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe2f20 con 0x7ffae80e0040 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0080c640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ffae80e0040 0x7ffae80e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0080c640 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ffae80e0040 0x7ffae80e0420 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf80083f0 con 0x7ffae80e0040 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efdbac0 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efd70d0 2024-04-26T12:52:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf80083f0 con 0x556f3efd70d0 2024-04-26T12:52:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.116+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efd70d0 2024-04-26T12:52:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efdbac0 2024-04-26T12:52:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efdbac0 2024-04-26T12:52:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x7ffae80e0040 2024-04-26T12:52:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efe0430 2024-04-26T12:52:06.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efd70d0 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x7ffae80e0040 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efd70d0 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x7ffae80e0040 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efe0430 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.120+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efe0430 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efdbac0 2024-04-26T12:52:06.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efe0430 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efe0430 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efd70d0 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efd70d0 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efdbac0 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efe0430 2024-04-26T12:52:06.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x7ffae80e0040 2024-04-26T12:52:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efd70d0 2024-04-26T12:52:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.124+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efdbac0 2024-04-26T12:52:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efe0430 2024-04-26T12:52:06.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efdbac0 2024-04-26T12:52:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x7ffae80e0040 2024-04-26T12:52:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efe0430 2024-04-26T12:52:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efdbac0 2024-04-26T12:52:06.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x556f3efd70d0 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.128+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ffaf802b040 con 0x7ffae80e0040 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efd70d0 2024-04-26T12:52:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efd70d0 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdad60 con 0x556f3efe0430 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 zone default found 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 4 Realm: () 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:06.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 zonegroup default 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efdf380 con 0x556f3efdbac0 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe4d80 con 0x556f3efe0430 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe5120 con 0x556f3efe0430 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 started sync module instance, tier type = 2024-04-26T12:52:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe4220 con 0x7ffae80e0040 2024-04-26T12:52:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93936286582288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe4220 con 0x7ffae80e0040 2024-04-26T12:52:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.132+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe59b0 con 0x556f3efd70d0 2024-04-26T12:52:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.136+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93936286582288] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.136+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.136+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93936286586048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe4220 con 0x556f3efd70d0 2024-04-26T12:52:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.136+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe63c0 con 0x556f3efe0430 2024-04-26T12:52:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93936286586048] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93936286580080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe4190 con 0x556f3efe0430 2024-04-26T12:52:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe70c0 con 0x7ffae80e0040 2024-04-26T12:52:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93936286592288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe7960 con 0x7ffae80e0040 2024-04-26T12:52:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe8320 con 0x556f3efd70d0 2024-04-26T12:52:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93936286580080] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.140+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93936286592288] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.144+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.144+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93936286596720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe8290 con 0x556f3efd70d0 2024-04-26T12:52:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.144+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe78b0 con 0x556f3efdbac0 2024-04-26T12:52:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.144+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.144+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93936286598928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe8fe0 con 0x556f3efdbac0 2024-04-26T12:52:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.144+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe99a0 con 0x556f3efdbac0 2024-04-26T12:52:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.144+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93936286596720] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93936286602480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe9dc0 con 0x556f3efdbac0 2024-04-26T12:52:06.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efea780 con 0x556f3efdbac0 2024-04-26T12:52:06.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93936286598928] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93936286599984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efea780 con 0x556f3efdbac0 2024-04-26T12:52:06.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=0 2024-04-26T12:52:06.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=1 2024-04-26T12:52:06.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=2 2024-04-26T12:52:06.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=3 2024-04-26T12:52:06.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=4 2024-04-26T12:52:06.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=5 2024-04-26T12:52:06.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93936286602480] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=6 2024-04-26T12:52:06.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93936286599984] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 20 add_watcher() i=7 2024-04-26T12:52:06.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.148+0000 7ffb024f0980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:06.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3efed7b0 con 0x556f3efd70d0 2024-04-26T12:52:06.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93936286606032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efeaba0 con 0x556f3efd70d0 2024-04-26T12:52:06.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93936286606032] v35'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ff9b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ffb024f0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:06.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ffb024f0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:06.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.152+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff6010 con 0x556f3efd70d0 2024-04-26T12:52:06.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.156+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.156+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff66e0 con 0x556f3efdbac0 2024-04-26T12:52:06.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.156+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.156+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff66e0 con 0x556f3efe0430 2024-04-26T12:52:06.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.156+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.156+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff6cf0 con 0x556f3efd70d0 2024-04-26T12:52:06.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.160+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'253 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.160+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff71a0 con 0x7ffae80e0040 2024-04-26T12:52:06.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.160+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'83 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.160+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff1d10 con 0x556f3efe0430 2024-04-26T12:52:06.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.160+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.160+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff1d10 con 0x556f3efd70d0 2024-04-26T12:52:06.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.164+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.164+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff1d10 con 0x556f3efdbac0 2024-04-26T12:52:06.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.164+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.164+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7d00 con 0x7ffae80e0040 2024-04-26T12:52:06.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.168+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.168+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7d00 con 0x556f3efe0430 2024-04-26T12:52:06.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.168+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.168+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7d90 con 0x7ffae80e0040 2024-04-26T12:52:06.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.168+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'84 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.168+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7d90 con 0x556f3efdbac0 2024-04-26T12:52:06.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.172+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.172+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7e40 con 0x7ffae80e0040 2024-04-26T12:52:06.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.172+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.172+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7e40 con 0x556f3efdbac0 2024-04-26T12:52:06.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.176+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.176+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7e40 con 0x556f3efd70d0 2024-04-26T12:52:06.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.176+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'254 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.176+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff7e40 con 0x556f3efe0430 2024-04-26T12:52:06.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.180+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'75 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.180+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x7ffae80e0040 2024-04-26T12:52:06.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.180+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'85 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.180+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.180+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.180+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efd70d0 2024-04-26T12:52:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.184+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.184+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efd70d0 2024-04-26T12:52:06.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.184+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'255 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.184+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.188+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'76 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.188+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x7ffae80e0040 2024-04-26T12:52:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.188+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.188+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.192+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.192+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.192+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.192+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.192+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.192+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.196+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.196+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efdbac0 2024-04-26T12:52:06.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.196+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.196+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.196+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.196+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efdbac0 2024-04-26T12:52:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.200+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.200+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efe0430 2024-04-26T12:52:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.200+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'77 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.200+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x556f3efdbac0 2024-04-26T12:52:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.204+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.204+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff83c0 con 0x7ffae80e0040 2024-04-26T12:52:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.204+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ff9b57e2640 20 reqs_thread_entry: start 2024-04-26T12:52:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 20 Filter name: none 2024-04-26T12:52:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ff926ffd640 20 reqs_thread_entry: start 2024-04-26T12:52:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-26T12:52:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff4290 con 0x556f3efe0430 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 20 rados_obj.operate() r=0 bl.length=363 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3f015f70 con 0x556f3efe0430 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 10 removing key index: true_admin_akey 2024-04-26T12:52:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3f013f50 con 0x556f3efe0430 2024-04-26T12:52:06.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(96 true_admin_akey [delete] v35'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-26T12:52:06.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93936286780000 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3f0164c0 con 0x556f3efdbac0 2024-04-26T12:52:06.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== watch-notify(notify (1) cookie 93936286598928 notify 150323855405 ret 0) ==== 207+0+0 (crc 0 0 0) 0x556f3eff1e10 con 0x556f3efdbac0 2024-04-26T12:52:06.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ff9df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855405 cookie 93936286598928 notifier 4874 bl.length()=165 2024-04-26T12:52:06.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ff9df7fe640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff9c4003d70 con 0x556f3efdbac0 2024-04-26T12:52:06.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.208+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(97 notify.5 [notify cookie 93936286780000 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== watch-notify(notify_complete (2) cookie 93936286780000 notify 150323855405 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f3ee1a4a0 con 0x556f3efdbac0 2024-04-26T12:52:06.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 10 removing email index: 2024-04-26T12:52:06.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 10 removing user buckets index 2024-04-26T12:52:06.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3f016420 con 0x556f3efe0430 2024-04-26T12:52:06.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(99 a_user.buckets [delete] v35'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 10 removing user index: a_user 2024-04-26T12:52:06.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3f015a70 con 0x556f3efe0430 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(100 a_user [call,call,delete] v35'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93936286785296 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f3f014f10 con 0x556f3efe0430 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== watch-notify(notify (1) cookie 93936286580080 notify 150323855370 ret 0) ==== 197+0+0 (crc 0 0 0) 0x556f3eff2360 con 0x556f3efe0430 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ff9deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 93936286580080 notifier 4874 bl.length()=155 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(101 notify.2 [notify cookie 93936286785296 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.212+0000 7ff9deffd640 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff9340032d0 con 0x556f3efe0430 2024-04-26T12:52:06.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.216+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.216+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== watch-notify(notify_complete (2) cookie 93936286785296 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f3eff20b0 con 0x556f3efe0430 2024-04-26T12:52:06.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.216+0000 7ff9b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.216+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93936286606032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3eff77b0 con 0x556f3efd70d0 2024-04-26T12:52:06.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.216+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93936286606032] v35'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.216+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93936286582288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efea2d0 con 0x7ffae80e0040 2024-04-26T12:52:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.220+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93936286582288] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.220+0000 7ffb024f0980 20 remove_watcher() i=0 2024-04-26T12:52:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.220+0000 7ffb024f0980 2 removed watcher, disabling cache 2024-04-26T12:52:06.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.220+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93936286586048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efea2d0 con 0x556f3efd70d0 2024-04-26T12:52:06.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.220+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93936286586048] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.220+0000 7ffb024f0980 20 remove_watcher() i=1 2024-04-26T12:52:06.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.220+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93936286580080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efea2d0 con 0x556f3efe0430 2024-04-26T12:52:06.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.224+0000 7ffaff80a640 1 -- 172.21.15.72:0/3700969570 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93936286580080] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffae80aaac0 con 0x556f3efe0430 2024-04-26T12:52:06.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.224+0000 7ffb024f0980 20 remove_watcher() i=2 2024-04-26T12:52:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.224+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93936286592288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe3d70 con 0x7ffae80e0040 2024-04-26T12:52:06.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.224+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93936286592288] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x7ffae80e0040 2024-04-26T12:52:06.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.224+0000 7ffb024f0980 20 remove_watcher() i=3 2024-04-26T12:52:06.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.224+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93936286596720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efea2d0 con 0x556f3efd70d0 2024-04-26T12:52:06.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.228+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93936286596720] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf8026040 con 0x556f3efd70d0 2024-04-26T12:52:06.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.228+0000 7ffb024f0980 20 remove_watcher() i=4 2024-04-26T12:52:06.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.228+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93936286598928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe6d20 con 0x556f3efdbac0 2024-04-26T12:52:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.228+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93936286598928] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.228+0000 7ffb024f0980 20 remove_watcher() i=5 2024-04-26T12:52:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.228+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93936286602480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe3d70 con 0x556f3efdbac0 2024-04-26T12:52:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93936286602480] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 20 remove_watcher() i=6 2024-04-26T12:52:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93936286599984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f3efe7e70 con 0x556f3efdbac0 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb0000b640 1 -- 172.21.15.72:0/3700969570 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93936286599984] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0039070 con 0x556f3efdbac0 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 20 remove_watcher() i=7 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efdbac0 msgr2=0x556f3efddeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efdbac0 0x556f3efddeb0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3efd70d0 msgr2=0x556f3efd9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3efd70d0 0x556f3efd9570 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ffae80e0040 msgr2=0x7ffae80e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7ffae80e0040 0x7ffae80e0420 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efe0430 msgr2=0x556f3efe28a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efe0430 0x556f3efe28a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d0034600 msgr2=0x7ff9d0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d0034600 0x7ff9d0036ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x556f3efa7e60 tx=0x7ffae80c1040 comp rx=0 tx=0).stop 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 msgr2=0x556f3efcbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3700969570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3efc4c70 0x556f3efcbf90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0028fd0 tx=0x7ffaf001f210 comp rx=0 tx=0).stop 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb0080c640 1 -- 172.21.15.72:0/3700969570 reap_dead start 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 shutdown_connections 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 >> 172.21.15.72:0/3700969570 conn(0x556f3efc1000 msgr2=0x556f3efbe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 shutdown_connections 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/3700969570 wait complete. 2024-04-26T12:52:06.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d8034650 msgr2=0x7ff9d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d8034650 0x7ff9d8036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffae801b380 tx=0x7ffae8005ad0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3ee1bac0 msgr2=0x556f3ee19f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3ee1bac0 0x556f3ee19f60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00069a0 tx=0x7ffaf0010ab0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 shutdown_connections 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9d8034650 0x7ff9d8036b10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.232+0000 7ffb024f0980 1 --2- 172.21.15.72:0/2771659117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3ee1bac0 0x556f3ee19f60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 >> 172.21.15.72:0/2771659117 conn(0x556f3efaa8c0 msgr2=0x556f3efab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 shutdown_connections 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/2771659117 wait complete. 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efa0fe0 msgr2=0x556f3efa33d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x556f3efa0fe0 0x556f3efa33d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3eea97d0 msgr2=0x556f3ef9e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x556f3eea97d0 0x556f3ef9e670 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efa4ee0 msgr2=0x556f3efa72d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x556f3efa4ee0 0x556f3efa72d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9e8034650 msgr2=0x7ff9e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff9e8034650 0x7ff9e8036b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffae80ae000 tx=0x7ffae80a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 msgr2=0x556f3ef976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 --2- 172.21.15.72:0/3830246390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556f3eea52c0 0x556f3ef976d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0006640 tx=0x7ffaf0000f50 comp rx=0 tx=0).stop 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb0080c640 1 -- 172.21.15.72:0/3830246390 reap_dead start 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 shutdown_connections 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 >> 172.21.15.72:0/3830246390 conn(0x556f3eea0b90 msgr2=0x556f3ef8aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 shutdown_connections 2024-04-26T12:52:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.236+0000 7ffb024f0980 1 -- 172.21.15.72:0/3830246390 wait complete. 2024-04-26T12:52:06.248 ERROR:root:None 2024-04-26T12:52:06.248 ERROR:root:0 2024-04-26T12:52:06.248 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-26T12:52:06.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-26T12:52:06.248 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-04-26T12:52:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa8bf8980 1 Processor -- start 2024-04-26T12:52:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa8bf8980 1 -- start start 2024-04-26T12:52:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa8bf8980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651cc9b4a00 0x5651cc9b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa8bf8980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651cc85b510 con 0x5651cc9b04f0 2024-04-26T12:52:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa8bf8980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5651cc862430 con 0x5651cc9b4a00 2024-04-26T12:52:06.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa5f12640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651cc9b4a00 0x5651cc9b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa5f12640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5651cc9b4a00 0x5651cc9b6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38880/0 (socket says 172.21.15.72:38880) 2024-04-26T12:52:06.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa5f12640 1 -- 172.21.15.72:0/3853134964 learned_addr learned my addr 172.21.15.72:0/3853134964 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa6713640 1 --1- 172.21.15.72:0/3853134964 >> v1:172.21.15.29:6789/0 conn(0x5651cc9b04f0 0x5651cc9b08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48814/0 (socket says 172.21.15.72:48814) 2024-04-26T12:52:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa5f12640 1 -- 172.21.15.72:0/3853134964 >> v1:172.21.15.29:6789/0 conn(0x5651cc9b04f0 legacy=0x5651cc9b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.328+0000 7effa5f12640 1 -- 172.21.15.72:0/3853134964 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cc837ae0 con 0x5651cc9b4a00 2024-04-26T12:52:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa5f12640 1 --2- 172.21.15.72:0/3853134964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b4a00 0x5651cc9b6df0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00a5c0 tx=0x7eff9c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37625aa556fe80f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa5711640 1 -- 172.21.15.72:0/3853134964 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c0a6070 con 0x5651cc9b4a00 2024-04-26T12:52:06.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa5711640 1 -- 172.21.15.72:0/3853134964 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c0af070 con 0x5651cc9b4a00 2024-04-26T12:52:06.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa5711640 1 -- 172.21.15.72:0/3853134964 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c0aa5c0 con 0x5651cc9b4a00 2024-04-26T12:52:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa8bf8980 1 -- 172.21.15.72:0/3853134964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b4a00 msgr2=0x5651cc9b6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa8bf8980 1 --2- 172.21.15.72:0/3853134964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b4a00 0x5651cc9b6df0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00a5c0 tx=0x7eff9c01b340 comp rx=0 tx=0).stop 2024-04-26T12:52:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa8bf8980 1 -- 172.21.15.72:0/3853134964 shutdown_connections 2024-04-26T12:52:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa8bf8980 1 --2- 172.21.15.72:0/3853134964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b4a00 0x5651cc9b6df0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa8bf8980 1 -- 172.21.15.72:0/3853134964 >> 172.21.15.72:0/3853134964 conn(0x5651cc923bd0 msgr2=0x5651cc923fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa8bf8980 1 -- 172.21.15.72:0/3853134964 shutdown_connections 2024-04-26T12:52:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.332+0000 7effa8bf8980 1 -- 172.21.15.72:0/3853134964 wait complete. 2024-04-26T12:52:06.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa8bf8980 1 Processor -- start 2024-04-26T12:52:06.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa8bf8980 1 -- start start 2024-04-26T12:52:06.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa8bf8980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651cca9b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa8bf8980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651cc8b1a70 con 0x5651cc9b04f0 2024-04-26T12:52:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651cca9b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651cca9b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38882/0 (socket says 172.21.15.72:38882) 2024-04-26T12:52:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa6713640 1 -- 172.21.15.72:0/3532461355 learned_addr learned my addr 172.21.15.72:0/3532461355 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa6713640 1 -- 172.21.15.72:0/3532461355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cca9bc40 con 0x5651cc9b04f0 2024-04-26T12:52:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7effa6713640 1 --2- 172.21.15.72:0/3532461355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651cca9b670 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7effa00015f0 tx=0x7effa0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa68dbb10abee728 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7efe94608640 1 -- 172.21.15.72:0/3532461355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa0013420 con 0x5651cc9b04f0 2024-04-26T12:52:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7efe94608640 1 -- 172.21.15.72:0/3532461355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00135e0 con 0x5651cc9b04f0 2024-04-26T12:52:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.348+0000 7efe94608640 1 -- 172.21.15.72:0/3532461355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa0013940 con 0x5651cc9b04f0 2024-04-26T12:52:06.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- 172.21.15.72:0/3532461355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 msgr2=0x5651cca9b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 --2- 172.21.15.72:0/3532461355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651cca9b670 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7effa00015f0 tx=0x7effa0001ab0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- 172.21.15.72:0/3532461355 shutdown_connections 2024-04-26T12:52:06.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 --2- 172.21.15.72:0/3532461355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651cca9b670 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- 172.21.15.72:0/3532461355 >> 172.21.15.72:0/3532461355 conn(0x5651cc923bd0 msgr2=0x5651cca97200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- 172.21.15.72:0/3532461355 shutdown_connections 2024-04-26T12:52:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- 172.21.15.72:0/3532461355 wait complete. 2024-04-26T12:52:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 Processor -- start 2024-04-26T12:52:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- start start 2024-04-26T12:52:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651ccaa2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651cc9b9e20 con 0x5651cc9b04f0 2024-04-26T12:52:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651ccaa2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651ccaa2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38896/0 (socket says 172.21.15.72:38896) 2024-04-26T12:52:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa6713640 1 -- 172.21.15.72:0/4288613740 learned_addr learned my addr 172.21.15.72:0/4288613740 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa6713640 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ccaa2e40 con 0x5651cc9b04f0 2024-04-26T12:52:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa6713640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651ccaa2900 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7effa0006640 tx=0x7effa0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7efe92e05640 1 -- 172.21.15.72:0/4288613740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa0022020 con 0x5651cc9b04f0 2024-04-26T12:52:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651ccaa30d0 con 0x5651cc9b04f0 2024-04-26T12:52:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7efe92e05640 1 -- 172.21.15.72:0/4288613740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa0006320 con 0x5651cc9b04f0 2024-04-26T12:52:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7efe92e05640 1 -- 172.21.15.72:0/4288613740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa0004af0 con 0x5651cc9b04f0 2024-04-26T12:52:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.352+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ccaa5d10 con 0x5651cc9b04f0 2024-04-26T12:52:06.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7efe92e05640 1 -- 172.21.15.72:0/4288613740 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7effa0025020 con 0x5651cc9b04f0 2024-04-26T12:52:06.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7efe92e05640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe8c034650 0x7efe8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7efe92e05640 1 -- 172.21.15.72:0/4288613740 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7effa0018030 con 0x5651cc9b04f0 2024-04-26T12:52:06.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa5f12640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe8c034650 0x7efe8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651cc9b4a00 0x5651ccaa9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaa9e70 con 0x5651cc9b4a00 2024-04-26T12:52:06.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa6f14640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651cc9b4a00 0x5651ccaa9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa5f12640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe8c034650 0x7efe8c036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0ae000 tx=0x7eff9c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa6f14640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651cc9b4a00 0x5651ccaa9830 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa6f14640 1 -- 172.21.15.72:0/4288613740 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff980083f0 con 0x5651cc9b4a00 2024-04-26T12:52:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaa6f30 con 0x5651cc9b4a00 2024-04-26T12:52:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa6f14640 1 -- 172.21.15.72:0/4288613740 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff980083f0 con 0x5651cc9b4a00 2024-04-26T12:52:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccaac1c0 0x5651ccaae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaaec80 con 0x5651ccaac1c0 2024-04-26T12:52:06.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa6713640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccaac1c0 0x5651ccaae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa6713640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccaac1c0 0x5651ccaae5b0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.356+0000 7effa6713640 1 -- 172.21.15.72:0/4288613740 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7effa001b070 con 0x5651ccaac1c0 2024-04-26T12:52:06.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaab060 con 0x5651cc9b4a00 2024-04-26T12:52:06.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa6f14640 1 -- 172.21.15.72:0/4288613740 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff980083f0 con 0x5651cc9b4a00 2024-04-26T12:52:06.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccab00c0 0x5651ccab24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccab2c40 con 0x5651ccab00c0 2024-04-26T12:52:06.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa5f12640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccab00c0 0x5651ccab24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa5f12640 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccab00c0 0x5651ccab24b0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa5f12640 1 -- 172.21.15.72:0/4288613740 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccab00c0 2024-04-26T12:52:06.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 Processor -- start 2024-04-26T12:52:06.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 -- start start 2024-04-26T12:52:06.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccac0c90 0x5651ccac10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651cc8b5ab0 con 0x5651ccac0c90 2024-04-26T12:52:06.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccac0c90 0x5651ccac10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccac0c90 0x5651ccac10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38906/0 (socket says 172.21.15.72:38906) 2024-04-26T12:52:06.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa6713640 1 -- 172.21.15.72:0/1059802948 learned_addr learned my addr 172.21.15.72:0/1059802948 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa6713640 1 -- 172.21.15.72:0/1059802948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ccac15f0 con 0x5651ccac0c90 2024-04-26T12:52:06.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa6713640 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccac0c90 0x5651ccac10b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7effa001dfd0 tx=0x7effa0042070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7efe8bfff640 1 -- 172.21.15.72:0/1059802948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa0043040 con 0x5651ccac0c90 2024-04-26T12:52:06.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7efe8bfff640 1 -- 172.21.15.72:0/1059802948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa001d640 con 0x5651ccac0c90 2024-04-26T12:52:06.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651ccac2090 con 0x5651ccac0c90 2024-04-26T12:52:06.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7efe8bfff640 1 -- 172.21.15.72:0/1059802948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa001d9a0 con 0x5651ccac0c90 2024-04-26T12:52:06.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.360+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ccac2560 con 0x5651ccac0c90 2024-04-26T12:52:06.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7efe8bfff640 1 -- 172.21.15.72:0/1059802948 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7effa0010070 con 0x5651ccac0c90 2024-04-26T12:52:06.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7efe8bfff640 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe80034650 0x7efe80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7efe8bfff640 1 -- 172.21.15.72:0/1059802948 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7effa003fd80 con 0x5651ccac0c90 2024-04-26T12:52:06.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa5f12640 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe80034650 0x7efe80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 Processor -- start 2024-04-26T12:52:06.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 -- start start 2024-04-26T12:52:06.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa5f12640 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe80034650 0x7efe80036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7eff9c01b380 tx=0x7eff9c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccace090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651cca9bf90 con 0x5651ccacdcb0 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccace090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccace090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38914/0 (socket says 172.21.15.72:38914) 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa6713640 1 -- 172.21.15.72:0/3120624702 learned_addr learned my addr 172.21.15.72:0/3120624702 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa6713640 1 -- 172.21.15.72:0/3120624702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ccace660 con 0x5651ccacdcb0 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa6713640 1 --2- 172.21.15.72:0/3120624702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccace090 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7effa0029ff0 tx=0x7effa0010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c6d67a373d7482 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7efe89ffb640 1 -- 172.21.15.72:0/3120624702 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa005e020 con 0x5651ccacdcb0 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7efe89ffb640 1 -- 172.21.15.72:0/3120624702 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa001db40 con 0x5651ccacdcb0 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7efe89ffb640 1 -- 172.21.15.72:0/3120624702 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa0041160 con 0x5651ccacdcb0 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 -- 172.21.15.72:0/3120624702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 msgr2=0x5651ccace090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 --2- 172.21.15.72:0/3120624702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccace090 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7effa0029ff0 tx=0x7effa0010b00 comp rx=0 tx=0).stop 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 -- 172.21.15.72:0/3120624702 shutdown_connections 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 --2- 172.21.15.72:0/3120624702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccace090 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 -- 172.21.15.72:0/3120624702 >> 172.21.15.72:0/3120624702 conn(0x5651ccac9ff0 msgr2=0x5651ccac8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 -- 172.21.15.72:0/3120624702 shutdown_connections 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.364+0000 7effa8bf8980 1 -- 172.21.15.72:0/3120624702 wait complete. 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 Processor -- start 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 -- start start 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccad4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5651ccaced60 con 0x5651ccacdcb0 2024-04-26T12:52:06.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccad4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa6713640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccad4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38922/0 (socket says 172.21.15.72:38922) 2024-04-26T12:52:06.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 learned_addr learned my addr 172.21.15.72:0/1822003144 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ccad54d0 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa6713640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccad4f90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7effa0027c60 tx=0x7effa000aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7efe77fff640 1 -- 172.21.15.72:0/1822003144 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa0041610 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651ccad54d0 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7efe77fff640 1 -- 172.21.15.72:0/1822003144 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa002e300 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7efe77fff640 1 -- 172.21.15.72:0/1822003144 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa002e620 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ccad54d0 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7efe77fff640 1 -- 172.21.15.72:0/1822003144 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7effa0061020 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7efe77fff640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe70034650 0x7efe70036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7efe77fff640 1 -- 172.21.15.72:0/1822003144 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7effa006b070 con 0x5651ccacdcb0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa5f12640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe70034650 0x7efe70036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651ccadff10 0x5651ccae23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae2b20 con 0x5651ccadff10 2024-04-26T12:52:06.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.368+0000 7effa6f14640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651ccadff10 0x5651ccae23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa5f12640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe70034650 0x7efe70036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5651ccab3040 tx=0x7eff9c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6f14640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651ccadff10 0x5651ccae23d0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff980083f0 con 0x5651ccadff10 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 realm 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae2f30 con 0x5651ccadff10 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff980083f0 con 0x5651ccadff10 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3800 con 0x5651ccadff10 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff980083f0 con 0x5651ccadff10 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccadff10 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff980083f0 con 0x5651ccadff10 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccae4900 0x5651ccae6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae7300 con 0x5651ccae4900 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6713640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccae4900 0x5651ccae6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6713640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccae4900 0x5651ccae6cf0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 20 searching for the correct realm 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccae9250 0x5651ccaeb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaebd30 con 0x5651ccae9250 2024-04-26T12:52:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa5f12640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccae9250 0x5651ccaeb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.372+0000 7effa5f12640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccae9250 0x5651ccaeb660 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa5f12640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7eff9c0e0040 0x7eff9c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaebd30 con 0x7eff9c0e0040 2024-04-26T12:52:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7eff9c0e0040 0x7eff9c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7eff9c0e0040 0x7eff9c0e0420 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff980083f0 con 0x7eff9c0e0040 2024-04-26T12:52:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccae4900 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccadff10 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff980083f0 con 0x5651ccadff10 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccadff10 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccae4900 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccae4900 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.376+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x7eff9c0e0040 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccae9250 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccadff10 2024-04-26T12:52:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x7eff9c0e0040 2024-04-26T12:52:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccadff10 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x7eff9c0e0040 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae9250 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae9250 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae4900 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae9250 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae9250 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccadff10 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.380+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccadff10 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae4900 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae9250 2024-04-26T12:52:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x7eff9c0e0040 2024-04-26T12:52:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccadff10 2024-04-26T12:52:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae4900 2024-04-26T12:52:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae9250 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae4900 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.384+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x7eff9c0e0040 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae9250 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccae4900 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x5651ccadff10 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7eff9802b040 con 0x7eff9c0e0040 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:06.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccadff10 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccadff10 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae3ba0 con 0x5651ccae9250 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 zone default found 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 4 Realm: () 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 zonegroup default 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccae8230 con 0x5651ccae4900 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaedb90 con 0x5651ccae9250 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.388+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaedf30 con 0x5651ccae9250 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 20 started sync module instance, tier type = 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:06.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaed030 con 0x7eff9c0e0040 2024-04-26T12:52:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94909326349344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaed030 con 0x7eff9c0e0040 2024-04-26T12:52:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaee8f0 con 0x5651ccadff10 2024-04-26T12:52:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.392+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94909326349344] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94909326347408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaee8f0 con 0x5651ccadff10 2024-04-26T12:52:06.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaef2b0 con 0x5651ccae9250 2024-04-26T12:52:06.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94909326355968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaefb00 con 0x5651ccae9250 2024-04-26T12:52:06.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf04c0 con 0x7eff9c0e0040 2024-04-26T12:52:06.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94909326347408] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94909326360592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf0430 con 0x7eff9c0e0040 2024-04-26T12:52:06.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.396+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf1240 con 0x5651ccadff10 2024-04-26T12:52:06.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.400+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94909326355968] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.400+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94909326360592] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.400+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.400+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94909326358096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf0d40 con 0x5651ccadff10 2024-04-26T12:52:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.400+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf1590 con 0x5651ccae4900 2024-04-26T12:52:06.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.400+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94909326358096] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.404+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.404+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94909326363040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf1930 con 0x5651ccae4900 2024-04-26T12:52:06.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.404+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf22f0 con 0x5651ccae4900 2024-04-26T12:52:06.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.404+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94909326363040] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.404+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.404+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94909326364096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf22f0 con 0x5651ccae4900 2024-04-26T12:52:06.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.404+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf2cb0 con 0x5651ccae4900 2024-04-26T12:52:06.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94909326364096] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94909326368320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf2e90 con 0x5651ccae4900 2024-04-26T12:52:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=0 2024-04-26T12:52:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=1 2024-04-26T12:52:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=2 2024-04-26T12:52:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=3 2024-04-26T12:52:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=4 2024-04-26T12:52:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=5 2024-04-26T12:52:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=6 2024-04-26T12:52:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94909326368320] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 20 add_watcher() i=7 2024-04-26T12:52:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.408+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf6180 con 0x5651ccadff10 2024-04-26T12:52:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94909326383920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccaf2f40 con 0x5651ccadff10 2024-04-26T12:52:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94909326383920] v35'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7efe5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 5 note: GC not initialized 2024-04-26T12:52:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7efdd77fe640 20 reqs_thread_entry: start 2024-04-26T12:52:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 20 Filter name: none 2024-04-26T12:52:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7efdd57fa640 20 reqs_thread_entry: start 2024-04-26T12:52:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb19a10 con 0x5651ccae4900 2024-04-26T12:52:06.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T12:52:06.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:06.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.412+0000 7effa8bf8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:06.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb1ff60 con 0x5651ccae4900 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa8bf8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa8bf8980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa8bf8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94909326555600 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb1b690 con 0x5651ccadff10 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94909326358096 notify 150323855388 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7eff98010040 con 0x5651ccadff10 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7efe89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855388 cookie 94909326358096 notifier 4881 bl.length()=666 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7efe89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7efe89ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94909326555600 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7efe89ffb640 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7efe6c003eb0 con 0x5651ccadff10 2024-04-26T12:52:06.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.416+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== watch-notify(notify_complete (2) cookie 94909326555600 notify 150323855388 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff9800aaf0 con 0x5651ccadff10 2024-04-26T12:52:06.421 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:06.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7efe5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94909326383920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x5651ccadff10 2024-04-26T12:52:06.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94909326383920] v35'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94909326349344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x7eff9c0e0040 2024-04-26T12:52:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94909326349344] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa8bf8980 20 remove_watcher() i=0 2024-04-26T12:52:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa8bf8980 2 removed watcher, disabling cache 2024-04-26T12:52:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.420+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94909326347408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x5651ccadff10 2024-04-26T12:52:06.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.424+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94909326347408] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.424+0000 7effa8bf8980 20 remove_watcher() i=1 2024-04-26T12:52:06.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.424+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94909326355968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x5651ccae9250 2024-04-26T12:52:06.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa5f12640 1 -- 172.21.15.72:0/1822003144 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94909326355968] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c0aaac0 con 0x5651ccae9250 2024-04-26T12:52:06.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa8bf8980 20 remove_watcher() i=2 2024-04-26T12:52:06.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94909326360592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x7eff9c0e0040 2024-04-26T12:52:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94909326360592] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x7eff9c0e0040 2024-04-26T12:52:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa8bf8980 20 remove_watcher() i=3 2024-04-26T12:52:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94909326358096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x5651ccadff10 2024-04-26T12:52:06.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94909326358096] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff98026040 con 0x5651ccadff10 2024-04-26T12:52:06.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa8bf8980 20 remove_watcher() i=4 2024-04-26T12:52:06.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.428+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94909326363040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x5651ccae4900 2024-04-26T12:52:06.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.432+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94909326363040] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.432+0000 7effa8bf8980 20 remove_watcher() i=5 2024-04-26T12:52:06.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.432+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94909326364096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x5651ccae4900 2024-04-26T12:52:06.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.432+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94909326364096] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.432+0000 7effa8bf8980 20 remove_watcher() i=6 2024-04-26T12:52:06.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.432+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94909326368320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5651ccb17710 con 0x5651ccae4900 2024-04-26T12:52:06.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa6713640 1 -- 172.21.15.72:0/1822003144 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94909326368320] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0081040 con 0x5651ccae4900 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 20 remove_watcher() i=7 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccae4900 msgr2=0x5651ccae6cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccae4900 0x5651ccae6cf0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651ccadff10 msgr2=0x5651ccae23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651ccadff10 0x5651ccae23d0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7eff9c0e0040 msgr2=0x7eff9c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7eff9c0e0040 0x7eff9c0e0420 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccae9250 msgr2=0x5651ccaeb660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccae9250 0x5651ccaeb660 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe70034650 msgr2=0x7efe70036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe70034650 0x7efe70036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5651ccab3040 tx=0x7eff9c0c1040 comp rx=0 tx=0).stop 2024-04-26T12:52:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 msgr2=0x5651ccad4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa6f14640 1 -- 172.21.15.72:0/1822003144 reap_dead start 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccad4f90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7effa0027c60 tx=0x7effa000aed0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 shutdown_connections 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1822003144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccacdcb0 0x5651ccad4f90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 >> 172.21.15.72:0/1822003144 conn(0x5651ccac9ff0 msgr2=0x5651ccac7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 shutdown_connections 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1822003144 wait complete. 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe80034650 msgr2=0x7efe80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe80034650 0x7efe80036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7eff9c01b380 tx=0x7eff9c005ad0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccac0c90 msgr2=0x5651ccac10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccac0c90 0x5651ccac10b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7effa001dfd0 tx=0x7effa0042070 comp rx=0 tx=0).stop 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 shutdown_connections 2024-04-26T12:52:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe80034650 0x7efe80036b10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 --2- 172.21.15.72:0/1059802948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651ccac0c90 0x5651ccac10b0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 >> 172.21.15.72:0/1059802948 conn(0x5651ccab5aa0 msgr2=0x5651ccab65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 shutdown_connections 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.436+0000 7effa8bf8980 1 -- 172.21.15.72:0/1059802948 wait complete. 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccaac1c0 msgr2=0x5651ccaae5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5651ccaac1c0 0x5651ccaae5b0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651cc9b4a00 msgr2=0x5651ccaa9830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5651cc9b4a00 0x5651ccaa9830 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccab00c0 msgr2=0x5651ccab24b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5651ccab00c0 0x5651ccab24b0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe8c034650 msgr2=0x7efe8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efe8c034650 0x7efe8c036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0ae000 tx=0x7eff9c0a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 msgr2=0x5651ccaa2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 --2- 172.21.15.72:0/4288613740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5651cc9b04f0 0x5651ccaa2900 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7effa0006640 tx=0x7effa0000f50 comp rx=0 tx=0).stop 2024-04-26T12:52:06.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa6f14640 1 -- 172.21.15.72:0/4288613740 reap_dead start 2024-04-26T12:52:06.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 shutdown_connections 2024-04-26T12:52:06.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 >> 172.21.15.72:0/4288613740 conn(0x5651cc923bd0 msgr2=0x5651cca95d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 shutdown_connections 2024-04-26T12:52:06.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.440+0000 7effa8bf8980 1 -- 172.21.15.72:0/4288613740 wait complete. 2024-04-26T12:52:06.451 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.452 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.452 ERROR:root:0 2024-04-26T12:52:06.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:06.456 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:06.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-26T12:52:06.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-26T12:52:06.457 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-04-26T12:52:06.533 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:06.534 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:06.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccdcfaf980 1 Processor -- start 2024-04-26T12:52:06.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccdcfaf980 1 -- start start 2024-04-26T12:52:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccdcfaf980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55904d7887e0 0x55904d78abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccdcfaf980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55904d631510 con 0x55904d7842d0 2024-04-26T12:52:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccdcfaf980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55904d638430 con 0x55904d7887e0 2024-04-26T12:52:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccdaaca640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55904d7842d0 0x55904d7846b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48816/0 (socket says 172.21.15.72:48816) 2024-04-26T12:52:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccdaaca640 1 -- 172.21.15.72:0/2205419824 learned_addr learned my addr 172.21.15.72:0/2205419824 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccda2c9640 1 --2- 172.21.15.72:0/2205419824 >> v2:172.21.15.29:3300/0 conn(0x55904d7887e0 0x55904d78abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccd9ac8640 1 -- 172.21.15.72:0/2205419824 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449282684 0 0) 0x55904d631510 con 0x55904d7842d0 2024-04-26T12:52:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.532+0000 7fccd9ac8640 1 -- 172.21.15.72:0/2205419824 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc8001e20 con 0x55904d7842d0 2024-04-26T12:52:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccda2c9640 1 -- 172.21.15.72:0/2205419824 >> v1:172.21.15.29:6789/0 conn(0x55904d7842d0 legacy=0x55904d7846b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccda2c9640 1 -- 172.21.15.72:0/2205419824 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d60dae0 con 0x55904d7887e0 2024-04-26T12:52:06.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccda2c9640 1 --2- 172.21.15.72:0/2205419824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7887e0 0x55904d78abd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fccc400a480 tx=0x7fccc401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addc0aacdb145c89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccd9ac8640 1 -- 172.21.15.72:0/2205419824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc40b0070 con 0x55904d7887e0 2024-04-26T12:52:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccd9ac8640 1 -- 172.21.15.72:0/2205419824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc40ab540 con 0x55904d7887e0 2024-04-26T12:52:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccd9ac8640 1 -- 172.21.15.72:0/2205419824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc40ab820 con 0x55904d7887e0 2024-04-26T12:52:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2205419824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7887e0 msgr2=0x55904d78abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/2205419824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7887e0 0x55904d78abd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fccc400a480 tx=0x7fccc401b280 comp rx=0 tx=0).stop 2024-04-26T12:52:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2205419824 shutdown_connections 2024-04-26T12:52:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/2205419824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7887e0 0x55904d78abd0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2205419824 >> 172.21.15.72:0/2205419824 conn(0x55904d77fba0 msgr2=0x55904d781fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2205419824 shutdown_connections 2024-04-26T12:52:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.536+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2205419824 wait complete. 2024-04-26T12:52:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdcfaf980 1 Processor -- start 2024-04-26T12:52:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdcfaf980 1 -- start start 2024-04-26T12:52:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdcfaf980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d6fa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdcfaf980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55904d687a70 con 0x55904d7842d0 2024-04-26T12:52:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d6fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d6fa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38946/0 (socket says 172.21.15.72:38946) 2024-04-26T12:52:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdaaca640 1 -- 172.21.15.72:0/509258135 learned_addr learned my addr 172.21.15.72:0/509258135 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.552+0000 7fccdaaca640 1 -- 172.21.15.72:0/509258135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d6face0 con 0x55904d7842d0 2024-04-26T12:52:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdaaca640 1 --2- 172.21.15.72:0/509258135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d6fa710 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcccc006fc0 tx=0x7fcccc001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aff78f888c28bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fcbc8e09640 1 -- 172.21.15.72:0/509258135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc004530 con 0x55904d7842d0 2024-04-26T12:52:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fcbc8e09640 1 -- 172.21.15.72:0/509258135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc0046d0 con 0x55904d7842d0 2024-04-26T12:52:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fcbc8e09640 1 -- 172.21.15.72:0/509258135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc004a70 con 0x55904d7842d0 2024-04-26T12:52:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- 172.21.15.72:0/509258135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 msgr2=0x55904d6fa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/509258135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d6fa710 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcccc006fc0 tx=0x7fcccc001af0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- 172.21.15.72:0/509258135 shutdown_connections 2024-04-26T12:52:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/509258135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d6fa710 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- 172.21.15.72:0/509258135 >> 172.21.15.72:0/509258135 conn(0x55904d77fba0 msgr2=0x55904d86adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- 172.21.15.72:0/509258135 shutdown_connections 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- 172.21.15.72:0/509258135 wait complete. 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 Processor -- start 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- start start 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d878760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55904d78dc00 con 0x55904d7842d0 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d878760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d878760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38960/0 (socket says 172.21.15.72:38960) 2024-04-26T12:52:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdaaca640 1 -- 172.21.15.72:0/3257775863 learned_addr learned my addr 172.21.15.72:0/3257775863 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdaaca640 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d878ca0 con 0x55904d7842d0 2024-04-26T12:52:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdaaca640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d878760 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcccc002260 tx=0x7fcccc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fcbc7606640 1 -- 172.21.15.72:0/3257775863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc013760 con 0x55904d7842d0 2024-04-26T12:52:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55904d878f30 con 0x55904d7842d0 2024-04-26T12:52:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fcbc7606640 1 -- 172.21.15.72:0/3257775863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc013900 con 0x55904d7842d0 2024-04-26T12:52:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fcbc7606640 1 -- 172.21.15.72:0/3257775863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc013be0 con 0x55904d7842d0 2024-04-26T12:52:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.556+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904d87bb70 con 0x55904d7842d0 2024-04-26T12:52:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fcbc7606640 1 -- 172.21.15.72:0/3257775863 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcccc010070 con 0x55904d7842d0 2024-04-26T12:52:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fcbc7606640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbc0034650 0x7fcbc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fcbc7606640 1 -- 172.21.15.72:0/3257775863 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fcccc018070 con 0x55904d7842d0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccda2c9640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbc0034650 0x7fcbc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d7887e0 0x55904d87f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d87fca0 con 0x55904d7887e0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdb2cb640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d7887e0 0x55904d87f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccda2c9640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbc0034650 0x7fcbc0036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fccc40ad000 tx=0x7fccc40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdb2cb640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d7887e0 0x55904d87f650 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdb2cb640 1 -- 172.21.15.72:0/3257775863 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d7887e0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d87cd90 con 0x55904d7887e0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdb2cb640 1 -- 172.21.15.72:0/3257775863 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d7887e0 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d881fd0 0x55904d8843c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d884a90 con 0x55904d881fd0 2024-04-26T12:52:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdaaca640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d881fd0 0x55904d8843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.560+0000 7fccdaaca640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d881fd0 0x55904d8843c0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdaaca640 1 -- 172.21.15.72:0/3257775863 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcccc01b030 con 0x55904d881fd0 2024-04-26T12:52:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d880e70 con 0x55904d7887e0 2024-04-26T12:52:06.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdb2cb640 1 -- 172.21.15.72:0/3257775863 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d7887e0 2024-04-26T12:52:06.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d885ef0 0x55904d8882e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8889e0 con 0x55904d885ef0 2024-04-26T12:52:06.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccda2c9640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d885ef0 0x55904d8882e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccda2c9640 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d885ef0 0x55904d8882e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccda2c9640 1 -- 172.21.15.72:0/3257775863 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fccc40b3040 con 0x55904d885ef0 2024-04-26T12:52:06.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdcfaf980 1 Processor -- start 2024-04-26T12:52:06.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdcfaf980 1 -- start start 2024-04-26T12:52:06.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdcfaf980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d896a70 0x55904d896e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdcfaf980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55904d68bab0 con 0x55904d896a70 2024-04-26T12:52:06.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d896a70 0x55904d896e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d896a70 0x55904d896e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38970/0 (socket says 172.21.15.72:38970) 2024-04-26T12:52:06.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdaaca640 1 -- 172.21.15.72:0/3889725120 learned_addr learned my addr 172.21.15.72:0/3889725120 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdaaca640 1 -- 172.21.15.72:0/3889725120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d8973d0 con 0x55904d896a70 2024-04-26T12:52:06.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.564+0000 7fccdaaca640 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d896a70 0x55904d896e90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcccc048490 tx=0x7fcccc010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbc4e01640 1 -- 172.21.15.72:0/3889725120 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc010e60 con 0x55904d896a70 2024-04-26T12:52:06.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55904d897e70 con 0x55904d896a70 2024-04-26T12:52:06.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbc4e01640 1 -- 172.21.15.72:0/3889725120 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc029840 con 0x55904d896a70 2024-04-26T12:52:06.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbc4e01640 1 -- 172.21.15.72:0/3889725120 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc041ac0 con 0x55904d896a70 2024-04-26T12:52:06.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904d898340 con 0x55904d896a70 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbc4e01640 1 -- 172.21.15.72:0/3889725120 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcccc029d10 con 0x55904d896a70 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbc4e01640 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbb4034650 0x7fcbb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbc4e01640 1 -- 172.21.15.72:0/3889725120 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fcccc03a070 con 0x55904d896a70 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccda2c9640 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbb4034650 0x7fcbb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdcfaf980 1 Processor -- start 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdcfaf980 1 -- start start 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdcfaf980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccda2c9640 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbb4034650 0x7fcbb4036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55904d880580 tx=0x7fccc4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdcfaf980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55904d6f8ed0 con 0x55904d8a3a40 2024-04-26T12:52:06.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8a3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38982/0 (socket says 172.21.15.72:38982) 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdaaca640 1 -- 172.21.15.72:0/2654409501 learned_addr learned my addr 172.21.15.72:0/2654409501 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdaaca640 1 -- 172.21.15.72:0/2654409501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d8a43f0 con 0x55904d8a3a40 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fccdaaca640 1 --2- 172.21.15.72:0/2654409501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8a3e20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0204a0 tx=0x7fcccc0288c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c06696a61eb1c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbbe7fc640 1 -- 172.21.15.72:0/2654409501 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc03fe70 con 0x55904d8a3a40 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbbe7fc640 1 -- 172.21.15.72:0/2654409501 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc05d070 con 0x55904d8a3a40 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.568+0000 7fcbbe7fc640 1 -- 172.21.15.72:0/2654409501 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc048d60 con 0x55904d8a3a40 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2654409501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 msgr2=0x55904d8a3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/2654409501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8a3e20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0204a0 tx=0x7fcccc0288c0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2654409501 shutdown_connections 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/2654409501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8a3e20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2654409501 >> 172.21.15.72:0/2654409501 conn(0x55904d89fdd0 msgr2=0x55904d89de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2654409501 shutdown_connections 2024-04-26T12:52:06.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- 172.21.15.72:0/2654409501 wait complete. 2024-04-26T12:52:06.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 Processor -- start 2024-04-26T12:52:06.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- start start 2024-04-26T12:52:06.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55904d8a49c0 con 0x55904d8a3a40 2024-04-26T12:52:06.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdaaca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:38996/0 (socket says 172.21.15.72:38996) 2024-04-26T12:52:06.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 learned_addr learned my addr 172.21.15.72:0/1754228015 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d8ab230 con 0x55904d8a3a40 2024-04-26T12:52:06.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdaaca640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8aacf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcccc020a00 tx=0x7fcccc01ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fcbbcff9640 1 -- 172.21.15.72:0/1754228015 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0205f0 con 0x55904d8a3a40 2024-04-26T12:52:06.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55904d8ab230 con 0x55904d8a3a40 2024-04-26T12:52:06.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fcbbcff9640 1 -- 172.21.15.72:0/1754228015 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc03fe70 con 0x55904d8a3a40 2024-04-26T12:52:06.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fcbbcff9640 1 -- 172.21.15.72:0/1754228015 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0115a0 con 0x55904d8a3a40 2024-04-26T12:52:06.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904d8ab6a0 con 0x55904d8a3a40 2024-04-26T12:52:06.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fcbbcff9640 1 -- 172.21.15.72:0/1754228015 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcccc011740 con 0x55904d8a3a40 2024-04-26T12:52:06.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.572+0000 7fcbbcff9640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcba4034650 0x7fcba4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fcbbcff9640 1 -- 172.21.15.72:0/1754228015 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fcccc077ce0 con 0x55904d8a3a40 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccda2c9640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcba4034650 0x7fcba4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d8b5e30 0x55904d8b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b8a40 con 0x55904d8b5e30 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdb2cb640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d8b5e30 0x55904d8b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccda2c9640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcba4034650 0x7fcba4036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fccc40acfd0 tx=0x7fccc40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdb2cb640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d8b5e30 0x55904d8b82f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d8b5e30 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 realm 2024-04-26T12:52:06.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b8e50 con 0x55904d8b5e30 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d8b5e30 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9720 con 0x55904d8b5e30 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d8b5e30 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8b5e30 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d8b5e30 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d8ba820 0x55904d8bcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8bd220 con 0x55904d8ba820 2024-04-26T12:52:06.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdaaca640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d8ba820 0x55904d8bcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdaaca640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d8ba820 0x55904d8bcc10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:06.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 20 searching for the correct realm 2024-04-26T12:52:06.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d8bf170 0x55904d8c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c1c50 con 0x55904d8bf170 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.576+0000 7fccda2c9640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d8bf170 0x55904d8c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccda2c9640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d8bf170 0x55904d8c1580 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccda2c9640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fccc40dd040 0x7fccc40cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c1c50 con 0x7fccc40dd040 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fccc40dd040 0x7fccc40cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fccc40dd040 0x7fccc40cf430 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd40083f0 con 0x7fccc40dd040 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8ba820 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8b5e30 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd40083f0 con 0x55904d8b5e30 2024-04-26T12:52:06.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8b5e30 2024-04-26T12:52:06.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8ba820 2024-04-26T12:52:06.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.580+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8ba820 2024-04-26T12:52:06.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x7fccc40dd040 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8bf170 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8b5e30 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x7fccc40dd040 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8b5e30 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x7fccc40dd040 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8bf170 2024-04-26T12:52:06.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8bf170 2024-04-26T12:52:06.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8ba820 2024-04-26T12:52:06.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8bf170 2024-04-26T12:52:06.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.584+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8bf170 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8b5e30 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8b5e30 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8ba820 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8bf170 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x7fccc40dd040 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8b5e30 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8ba820 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8bf170 2024-04-26T12:52:06.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.588+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8ba820 2024-04-26T12:52:06.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x7fccc40dd040 2024-04-26T12:52:06.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8bf170 2024-04-26T12:52:06.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8ba820 2024-04-26T12:52:06.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x55904d8b5e30 2024-04-26T12:52:06.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fccd402b040 con 0x7fccc40dd040 2024-04-26T12:52:06.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8b5e30 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8b5e30 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8b9ac0 con 0x55904d8bf170 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 zone default found 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 4 Realm: () 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 zonegroup default 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.592+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8be130 con 0x55904d8ba820 2024-04-26T12:52:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c3ab0 con 0x55904d8bf170 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c3e50 con 0x55904d8bf170 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 20 started sync module instance, tier type = 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c2f50 con 0x7fccc40dd040 2024-04-26T12:52:06.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078264685648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c2f50 con 0x7fccc40dd040 2024-04-26T12:52:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c4810 con 0x55904d8b5e30 2024-04-26T12:52:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.596+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078264685648] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.600+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.600+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078264683440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c4810 con 0x55904d8b5e30 2024-04-26T12:52:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.600+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c51d0 con 0x55904d8bf170 2024-04-26T12:52:06.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.600+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.600+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078264683440] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.600+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078264689504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c4780 con 0x55904d8bf170 2024-04-26T12:52:06.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.600+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c5f30 con 0x7fccc40dd040 2024-04-26T12:52:06.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078264695328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c67d0 con 0x7fccc40dd040 2024-04-26T12:52:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c71d0 con 0x55904d8b5e30 2024-04-26T12:52:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078264689504] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078264695328] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078264694128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c62a0 con 0x55904d8b5e30 2024-04-26T12:52:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.604+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c7a70 con 0x55904d8ba820 2024-04-26T12:52:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078264694128] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078264702400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c62a0 con 0x55904d8ba820 2024-04-26T12:52:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c82c0 con 0x55904d8ba820 2024-04-26T12:52:06.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078264704800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c89f0 con 0x55904d8ba820 2024-04-26T12:52:06.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c9510 con 0x55904d8ba820 2024-04-26T12:52:06.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.608+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078264702400] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078264704800] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078264709088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c94d0 con 0x55904d8ba820 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 20 add_watcher() i=0 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 20 add_watcher() i=1 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 20 add_watcher() i=2 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 20 add_watcher() i=3 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 20 add_watcher() i=4 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 20 add_watcher() i=5 2024-04-26T12:52:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.612+0000 7fccdcfaf980 20 add_watcher() i=6 2024-04-26T12:52:06.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078264709088] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 20 add_watcher() i=7 2024-04-26T12:52:06.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:06.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c8510 con 0x55904d8b5e30 2024-04-26T12:52:06.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078264700128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8c8510 con 0x55904d8b5e30 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078264700128] v35'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fcb917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 5 note: GC not initialized 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fcb0bfff640 20 reqs_thread_entry: start 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 20 Filter name: none 2024-04-26T12:52:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fcb09ffb640 20 reqs_thread_entry: start 2024-04-26T12:52:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.616+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8efc90 con 0x55904d8ba820 2024-04-26T12:52:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T12:52:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8f6600 con 0x55904d8ba820 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.620+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94078264893552 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55904d8f1cd0 con 0x55904d8b5e30 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94078264694128 notify 150323855389 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fccd4010040 con 0x55904d8b5e30 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fcbbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855389 cookie 94078264694128 notifier 4888 bl.length()=666 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fcbbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fcbbe7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94078264893552 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fcbbe7fc640 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fcba0003eb0 con 0x55904d8b5e30 2024-04-26T12:52:06.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== watch-notify(notify_complete (2) cookie 94078264893552 notify 150323855389 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fccd400a740 con 0x55904d8b5e30 2024-04-26T12:52:06.625 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:06.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fcb917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078264700128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x55904d8b5e30 2024-04-26T12:52:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94078264700128] v35'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.624+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078264685648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x7fccc40dd040 2024-04-26T12:52:06.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.628+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94078264685648] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.628+0000 7fccdcfaf980 20 remove_watcher() i=0 2024-04-26T12:52:06.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.628+0000 7fccdcfaf980 2 removed watcher, disabling cache 2024-04-26T12:52:06.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.628+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078264683440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x55904d8b5e30 2024-04-26T12:52:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.628+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94078264683440] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.628+0000 7fccdcfaf980 20 remove_watcher() i=1 2024-04-26T12:52:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.628+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078264689504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x55904d8bf170 2024-04-26T12:52:06.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.632+0000 7fccda2c9640 1 -- 172.21.15.72:0/1754228015 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94078264689504] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc40ca030 con 0x55904d8bf170 2024-04-26T12:52:06.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.632+0000 7fccdcfaf980 20 remove_watcher() i=2 2024-04-26T12:52:06.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.632+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078264695328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x7fccc40dd040 2024-04-26T12:52:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.632+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94078264695328] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x7fccc40dd040 2024-04-26T12:52:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.632+0000 7fccdcfaf980 20 remove_watcher() i=3 2024-04-26T12:52:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.632+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078264694128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x55904d8b5e30 2024-04-26T12:52:06.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.636+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94078264694128] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd4026040 con 0x55904d8b5e30 2024-04-26T12:52:06.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.636+0000 7fccdcfaf980 20 remove_watcher() i=4 2024-04-26T12:52:06.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.636+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078264702400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x55904d8ba820 2024-04-26T12:52:06.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.636+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94078264702400] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.636+0000 7fccdcfaf980 20 remove_watcher() i=5 2024-04-26T12:52:06.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.636+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078264704800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x55904d8ba820 2024-04-26T12:52:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94078264704800] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 20 remove_watcher() i=6 2024-04-26T12:52:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078264709088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55904d8ed990 con 0x55904d8ba820 2024-04-26T12:52:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdaaca640 1 -- 172.21.15.72:0/1754228015 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94078264709088] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc073020 con 0x55904d8ba820 2024-04-26T12:52:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 20 remove_watcher() i=7 2024-04-26T12:52:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d8ba820 msgr2=0x55904d8bcc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d8ba820 0x55904d8bcc10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d8b5e30 msgr2=0x55904d8b82f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d8b5e30 0x55904d8b82f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fccc40dd040 msgr2=0x7fccc40cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fccc40dd040 0x7fccc40cf430 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d8bf170 msgr2=0x55904d8c1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d8bf170 0x55904d8c1580 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcba4034650 msgr2=0x7fcba4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcba4034650 0x7fcba4036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fccc40acfd0 tx=0x7fccc40a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 msgr2=0x55904d8aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdb2cb640 1 -- 172.21.15.72:0/1754228015 reap_dead start 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8aacf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcccc020a00 tx=0x7fcccc01ae70 comp rx=0 tx=0).stop 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 shutdown_connections 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/1754228015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d8a3a40 0x55904d8aacf0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 >> 172.21.15.72:0/1754228015 conn(0x55904d89fdd0 msgr2=0x55904d89d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 shutdown_connections 2024-04-26T12:52:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.640+0000 7fccdcfaf980 1 -- 172.21.15.72:0/1754228015 wait complete. 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbb4034650 msgr2=0x7fcbb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbb4034650 0x7fcbb4036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55904d880580 tx=0x7fccc4005a10 comp rx=0 tx=0).stop 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d896a70 msgr2=0x55904d896e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d896a70 0x55904d896e90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcccc048490 tx=0x7fcccc010d30 comp rx=0 tx=0).stop 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 shutdown_connections 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbb4034650 0x7fcbb4036b10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3889725120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d896a70 0x55904d896e90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 >> 172.21.15.72:0/3889725120 conn(0x55904d88b880 msgr2=0x55904d88c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 shutdown_connections 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3889725120 wait complete. 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d881fd0 msgr2=0x55904d8843c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55904d881fd0 0x55904d8843c0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d7887e0 msgr2=0x55904d87f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55904d7887e0 0x55904d87f650 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d885ef0 msgr2=0x55904d8882e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55904d885ef0 0x55904d8882e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbc0034650 msgr2=0x7fcbc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcbc0034650 0x7fcbc0036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fccc40ad000 tx=0x7fccc40a5040 comp rx=0 tx=0).stop 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 msgr2=0x55904d878760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 --2- 172.21.15.72:0/3257775863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55904d7842d0 0x55904d878760 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcccc002260 tx=0x7fcccc000f50 comp rx=0 tx=0).stop 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdb2cb640 1 -- 172.21.15.72:0/3257775863 reap_dead start 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 shutdown_connections 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 >> 172.21.15.72:0/3257775863 conn(0x55904d77fba0 msgr2=0x55904d6f93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 shutdown_connections 2024-04-26T12:52:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.644+0000 7fccdcfaf980 1 -- 172.21.15.72:0/3257775863 wait complete. 2024-04-26T12:52:06.656 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.656 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.656 ERROR:root:0 2024-04-26T12:52:06.656 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:06.661 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:06.661 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:06.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:06.662 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T12:52:06.734 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:06.735 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:06.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.732+0000 7f1d62dc6980 1 Processor -- start 2024-04-26T12:52:06.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.732+0000 7f1d62dc6980 1 -- start start 2024-04-26T12:52:06.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.732+0000 7f1d62dc6980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c185598080 0x55c185596680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.732+0000 7f1d62dc6980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c1854cf510 con 0x55c185596bc0 2024-04-26T12:52:06.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.732+0000 7f1d62dc6980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c1854d6430 con 0x55c185598080 2024-04-26T12:52:06.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.736+0000 7f1d608e1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c185598080 0x55c185596680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.736+0000 7f1d608e1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c185598080 0x55c185596680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39002/0 (socket says 172.21.15.72:39002) 2024-04-26T12:52:06.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.736+0000 7f1d608e1640 1 -- 172.21.15.72:0/3724378430 learned_addr learned my addr 172.21.15.72:0/3724378430 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.736+0000 7f1d600e0640 1 --1- 172.21.15.72:0/3724378430 >> v1:172.21.15.29:6789/0 conn(0x55c185596bc0 0x55c18562a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48832/0 (socket says 172.21.15.72:48832) 2024-04-26T12:52:06.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.736+0000 7f1d608e1640 1 -- 172.21.15.72:0/3724378430 >> v1:172.21.15.29:6789/0 conn(0x55c185596bc0 legacy=0x55c18562a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.736+0000 7f1d608e1640 1 -- 172.21.15.72:0/3724378430 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1854abae0 con 0x55c185598080 2024-04-26T12:52:06.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d608e1640 1 --2- 172.21.15.72:0/3724378430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185598080 0x55c185596680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000a5c0 tx=0x7f1d5001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441021d36dfa0c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d5f8df640 1 -- 172.21.15.72:0/3724378430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500a6070 con 0x55c185598080 2024-04-26T12:52:06.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d5f8df640 1 -- 172.21.15.72:0/3724378430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d500af070 con 0x55c185598080 2024-04-26T12:52:06.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d5f8df640 1 -- 172.21.15.72:0/3724378430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500aa5c0 con 0x55c185598080 2024-04-26T12:52:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3724378430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185598080 msgr2=0x55c185596680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/3724378430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185598080 0x55c185596680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000a5c0 tx=0x7f1d5001b340 comp rx=0 tx=0).stop 2024-04-26T12:52:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3724378430 shutdown_connections 2024-04-26T12:52:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/3724378430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185598080 0x55c185596680 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3724378430 >> 172.21.15.72:0/3724378430 conn(0x55c18561dbe0 msgr2=0x55c185620000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3724378430 shutdown_connections 2024-04-26T12:52:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.740+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3724378430 wait complete. 2024-04-26T12:52:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.752+0000 7f1d62dc6980 1 Processor -- start 2024-04-26T12:52:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- start start 2024-04-26T12:52:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c18570fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c185525a70 con 0x55c185596bc0 2024-04-26T12:52:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c18570fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c18570fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39016/0 (socket says 172.21.15.72:39016) 2024-04-26T12:52:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 -- 172.21.15.72:0/664788017 learned_addr learned my addr 172.21.15.72:0/664788017 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 -- 172.21.15.72:0/664788017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1857102e0 con 0x55c185596bc0 2024-04-26T12:52:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 --2- 172.21.15.72:0/664788017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c18570fd10 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1d500199f0 tx=0x7f1d50003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4efce5583edc32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1c4ee0d640 1 -- 172.21.15.72:0/664788017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500aaa00 con 0x55c185596bc0 2024-04-26T12:52:06.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1c4ee0d640 1 -- 172.21.15.72:0/664788017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d500aaba0 con 0x55c185596bc0 2024-04-26T12:52:06.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1c4ee0d640 1 -- 172.21.15.72:0/664788017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500bd3f0 con 0x55c185596bc0 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- 172.21.15.72:0/664788017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 msgr2=0x55c18570fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/664788017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c18570fd10 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1d500199f0 tx=0x7f1d50003030 comp rx=0 tx=0).stop 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- 172.21.15.72:0/664788017 shutdown_connections 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/664788017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c18570fd10 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- 172.21.15.72:0/664788017 >> 172.21.15.72:0/664788017 conn(0x55c18561dbe0 msgr2=0x55c18570b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- 172.21.15.72:0/664788017 shutdown_connections 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- 172.21.15.72:0/664788017 wait complete. 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 Processor -- start 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- start start 2024-04-26T12:52:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c185716e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d62dc6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c18562e4f0 con 0x55c185596bc0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c185716e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c185716e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39028/0 (socket says 172.21.15.72:39028) 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.756+0000 7f1d608e1640 1 -- 172.21.15.72:0/2911622983 learned_addr learned my addr 172.21.15.72:0/2911622983 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d608e1640 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c185717370 con 0x55c185596bc0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d608e1640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c185716e30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1d5001b170 tx=0x7f1d500180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1c4d60a640 1 -- 172.21.15.72:0/2911622983 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500bd7c0 con 0x55c185596bc0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c185717600 con 0x55c185596bc0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c18571a210 con 0x55c185596bc0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1c4d60a640 1 -- 172.21.15.72:0/2911622983 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d500bd960 con 0x55c185596bc0 2024-04-26T12:52:06.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1c4d60a640 1 -- 172.21.15.72:0/2911622983 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500bdc40 con 0x55c185596bc0 2024-04-26T12:52:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1c4d60a640 1 -- 172.21.15.72:0/2911622983 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d500ce020 con 0x55c185596bc0 2024-04-26T12:52:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1c4d60a640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c480346a0 0x7f1c48036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1c4d60a640 1 -- 172.21.15.72:0/2911622983 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1d500cc020 con 0x55c185596bc0 2024-04-26T12:52:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d600e0640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c480346a0 0x7f1c48036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c185598080 0x55c18571dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c18571e310 con 0x55c185598080 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d610e2640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c185598080 0x55c18571dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d600e0640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c480346a0 0x7f1c48036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1d480016c0 tx=0x7f1d480066c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d610e2640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c185598080 0x55c18571dcf0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d610e2640 1 -- 172.21.15.72:0/2911622983 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d580083f0 con 0x55c185598080 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c18571b410 con 0x55c185598080 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d610e2640 1 -- 172.21.15.72:0/2911622983 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d580083f0 con 0x55c185598080 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185720620 0x55c185722a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185723100 con 0x55c185720620 2024-04-26T12:52:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.760+0000 7f1d608e1640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185720620 0x55c185722a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d608e1640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185720620 0x55c185722a10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d608e1640 1 -- 172.21.15.72:0/2911622983 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185720620 2024-04-26T12:52:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c18571f4c0 con 0x55c185598080 2024-04-26T12:52:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d610e2640 1 -- 172.21.15.72:0/2911622983 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d580083f0 con 0x55c185598080 2024-04-26T12:52:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c185724560 0x55c185726950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185727090 con 0x55c185724560 2024-04-26T12:52:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d600e0640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c185724560 0x55c185726950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d600e0640 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c185724560 0x55c185726950 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d600e0640 1 -- 172.21.15.72:0/2911622983 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d4800f070 con 0x55c185724560 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d62dc6980 1 Processor -- start 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d62dc6980 1 -- start start 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d62dc6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185735120 0x55c185735540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d62dc6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c185529ab0 con 0x55c185735120 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185735120 0x55c185735540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185735120 0x55c185735540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39030/0 (socket says 172.21.15.72:39030) 2024-04-26T12:52:06.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d608e1640 1 -- 172.21.15.72:0/2389966530 learned_addr learned my addr 172.21.15.72:0/2389966530 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.764+0000 7f1d608e1640 1 -- 172.21.15.72:0/2389966530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c185735a80 con 0x55c185735120 2024-04-26T12:52:06.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d608e1640 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185735120 0x55c185735540 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1d500bf040 tx=0x7f1d500e51f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1c467fc640 1 -- 172.21.15.72:0/2389966530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500e3560 con 0x55c185735120 2024-04-26T12:52:06.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1c467fc640 1 -- 172.21.15.72:0/2389966530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d500c6480 con 0x55c185735120 2024-04-26T12:52:06.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c185736520 con 0x55c185735120 2024-04-26T12:52:06.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1c467fc640 1 -- 172.21.15.72:0/2389966530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500c6760 con 0x55c185735120 2024-04-26T12:52:06.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1857369f0 con 0x55c185735120 2024-04-26T12:52:06.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1c467fc640 1 -- 172.21.15.72:0/2389966530 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d500a99d0 con 0x55c185735120 2024-04-26T12:52:06.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1c467fc640 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c380346a0 0x7f1c38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1c467fc640 1 -- 172.21.15.72:0/2389966530 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1d500e8120 con 0x55c185735120 2024-04-26T12:52:06.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d600e0640 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c380346a0 0x7f1c38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d62dc6980 1 Processor -- start 2024-04-26T12:52:06.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d62dc6980 1 -- start start 2024-04-26T12:52:06.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d600e0640 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c380346a0 0x7f1c38036b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55c18571e7c0 tx=0x7f1d4800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d62dc6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185742550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d62dc6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c185710570 con 0x55c185742150 2024-04-26T12:52:06.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185742550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185742550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39040/0 (socket says 172.21.15.72:39040) 2024-04-26T12:52:06.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d608e1640 1 -- 172.21.15.72:0/3488237151 learned_addr learned my addr 172.21.15.72:0/3488237151 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.768+0000 7f1d608e1640 1 -- 172.21.15.72:0/3488237151 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c185742b20 con 0x55c185742150 2024-04-26T12:52:06.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d608e1640 1 --2- 172.21.15.72:0/3488237151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185742550 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1d500aab20 tx=0x7f1d500e5c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa381e1d0bb9a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1c37fff640 1 -- 172.21.15.72:0/3488237151 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500b9eb0 con 0x55c185742150 2024-04-26T12:52:06.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1c37fff640 1 -- 172.21.15.72:0/3488237151 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d500be570 con 0x55c185742150 2024-04-26T12:52:06.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1c37fff640 1 -- 172.21.15.72:0/3488237151 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500c4ce0 con 0x55c185742150 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3488237151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 msgr2=0x55c185742550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/3488237151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185742550 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1d500aab20 tx=0x7f1d500e5c70 comp rx=0 tx=0).stop 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3488237151 shutdown_connections 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/3488237151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185742550 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3488237151 >> 172.21.15.72:0/3488237151 conn(0x55c18573e4e0 msgr2=0x55c18573c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3488237151 shutdown_connections 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- 172.21.15.72:0/3488237151 wait complete. 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 Processor -- start 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- start start 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185749420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c1857430d0 con 0x55c185742150 2024-04-26T12:52:06.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185749420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d608e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185749420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39052/0 (socket says 172.21.15.72:39052) 2024-04-26T12:52:06.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 learned_addr learned my addr 172.21.15.72:0/755094949 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c185749960 con 0x55c185742150 2024-04-26T12:52:06.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d608e1640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185749420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1d500bffb0 tx=0x7f1d500c2f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1c367fc640 1 -- 172.21.15.72:0/755094949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d50112070 con 0x55c185742150 2024-04-26T12:52:06.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c185749960 con 0x55c185742150 2024-04-26T12:52:06.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1c367fc640 1 -- 172.21.15.72:0/755094949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d500c6900 con 0x55c185742150 2024-04-26T12:52:06.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1c367fc640 1 -- 172.21.15.72:0/755094949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d500c5580 con 0x55c185742150 2024-04-26T12:52:06.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.772+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c185749960 con 0x55c185742150 2024-04-26T12:52:06.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1c367fc640 1 -- 172.21.15.72:0/755094949 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d500c5720 con 0x55c185742150 2024-04-26T12:52:06.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1c367fc640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c2c034650 0x7f1c2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1c367fc640 1 -- 172.21.15.72:0/755094949 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1d5010a070 con 0x55c185742150 2024-04-26T12:52:06.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d600e0640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c2c034650 0x7f1c2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c1857543f0 0x55c1857568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185757000 con 0x55c1857543f0 2024-04-26T12:52:06.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d610e2640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c1857543f0 0x55c1857568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d600e0640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c2c034650 0x7f1c2c036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1d48004fd0 tx=0x7f1d48010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d610e2640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c1857543f0 0x55c1857568b0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d580083f0 con 0x55c1857543f0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 realm 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185757410 con 0x55c1857543f0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d580083f0 con 0x55c1857543f0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185757ce0 con 0x55c1857543f0 2024-04-26T12:52:06.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d580083f0 con 0x55c1857543f0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c1857543f0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d580083f0 con 0x55c1857543f0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185758de0 0x55c18575b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c18575b7a0 con 0x55c185758de0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d608e1640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185758de0 0x55c18575b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.776+0000 7f1d608e1640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185758de0 0x55c18575b1d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d62dc6980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:06.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d62dc6980 20 searching for the correct realm 2024-04-26T12:52:06.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c18575d6f0 0x55c18575fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1857601f0 con 0x55c18575d6f0 2024-04-26T12:52:06.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d600e0640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c18575d6f0 0x55c18575fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d600e0640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c18575d6f0 0x55c18575fb20 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4800f070 con 0x55c18575d6f0 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d600e0640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1d48024070 0x7f1d48031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1857601f0 con 0x7f1d48024070 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d610e2640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1d48024070 0x7f1d48031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d610e2640 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1d48024070 0x7f1d48031970 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d580083f0 con 0x7f1d48024070 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c185758de0 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c1857543f0 2024-04-26T12:52:06.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d580083f0 con 0x55c1857543f0 2024-04-26T12:52:06.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.780+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c1857543f0 2024-04-26T12:52:06.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c185758de0 2024-04-26T12:52:06.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c185758de0 2024-04-26T12:52:06.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x7f1d48024070 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c18575d6f0 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d4800f070 con 0x55c18575d6f0 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c1857543f0 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x7f1d48024070 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c1857543f0 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x7f1d48024070 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c18575d6f0 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.784+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c18575d6f0 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c185758de0 2024-04-26T12:52:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c18575d6f0 2024-04-26T12:52:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c18575d6f0 2024-04-26T12:52:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c1857543f0 2024-04-26T12:52:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c1857543f0 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c185758de0 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c18575d6f0 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x7f1d48024070 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c1857543f0 2024-04-26T12:52:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.788+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c185758de0 2024-04-26T12:52:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c18575d6f0 2024-04-26T12:52:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c185758de0 2024-04-26T12:52:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x7f1d48024070 2024-04-26T12:52:06.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c18575d6f0 2024-04-26T12:52:06.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c185758de0 2024-04-26T12:52:06.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x55c1857543f0 2024-04-26T12:52:06.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1d5802b040 con 0x7f1d48024070 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d62dc6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d62dc6980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d62dc6980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d62dc6980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d62dc6980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d62dc6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.792+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c1857543f0 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c1857543f0 2024-04-26T12:52:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185758080 con 0x55c18575d6f0 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 zone default found 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 4 Realm: () 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 zonegroup default 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c18575c610 con 0x55c185758de0 2024-04-26T12:52:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c185762050 con 0x55c18575d6f0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1857623f0 con 0x55c18575d6f0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 started sync module instance, tier type = 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1857614f0 con 0x7f1d48024070 2024-04-26T12:52:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.796+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.800+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94289656158480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1857614f0 con 0x7f1d48024070 2024-04-26T12:52:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.800+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185762ca0 con 0x55c1857543f0 2024-04-26T12:52:06.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.800+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94289656158480] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.800+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.800+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94289656162192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1857614f0 con 0x55c1857543f0 2024-04-26T12:52:06.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.800+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1857636b0 con 0x55c18575d6f0 2024-04-26T12:52:06.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94289656164864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185763f50 con 0x55c18575d6f0 2024-04-26T12:52:06.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185764910 con 0x7f1d48024070 2024-04-26T12:52:06.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94289656162192] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94289656169568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185764880 con 0x7f1d48024070 2024-04-26T12:52:06.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185765660 con 0x55c1857543f0 2024-04-26T12:52:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94289656164864] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94289656169568] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94289656167072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185765160 con 0x55c1857543f0 2024-04-26T12:52:06.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.804+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185765f00 con 0x55c185758de0 2024-04-26T12:52:06.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.808+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94289656167072] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.808+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.808+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94289656171696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1857650d0 con 0x55c185758de0 2024-04-26T12:52:06.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.808+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1857663b0 con 0x55c185758de0 2024-04-26T12:52:06.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.808+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94289656171696] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94289656175184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185766320 con 0x55c185758de0 2024-04-26T12:52:06.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185766d60 con 0x55c185758de0 2024-04-26T12:52:06.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94289656178736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1857671d0 con 0x55c185758de0 2024-04-26T12:52:06.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 20 add_watcher() i=0 2024-04-26T12:52:06.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 20 add_watcher() i=1 2024-04-26T12:52:06.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 20 add_watcher() i=2 2024-04-26T12:52:06.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 20 add_watcher() i=3 2024-04-26T12:52:06.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 20 add_watcher() i=4 2024-04-26T12:52:06.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 20 add_watcher() i=5 2024-04-26T12:52:06.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94289656175184] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.812+0000 7f1d62dc6980 20 add_watcher() i=6 2024-04-26T12:52:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94289656178736] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 20 add_watcher() i=7 2024-04-26T12:52:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1857671d0 con 0x55c1857543f0 2024-04-26T12:52:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94289656180000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185767140 con 0x55c1857543f0 2024-04-26T12:52:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94289656180000] v35'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1c16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 5 note: GC not initialized 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1c15fe3640 20 reqs_thread_entry: start 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 20 Filter name: none 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1b877fe640 20 reqs_thread_entry: start 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.816+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c18578db40 con 0x55c185758de0 2024-04-26T12:52:06.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.820+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.820+0000 7f1d62dc6980 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T12:52:06.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.820+0000 7f1d62dc6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:06.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.820+0000 7f1d62dc6980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.820+0000 7f1d62dc6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:06.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.820+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185794420 con 0x55c185758de0 2024-04-26T12:52:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v35'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d62dc6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d62dc6980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d62dc6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:06.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94289656364688 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c18578fab0 con 0x55c1857543f0 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94289656167072 notify 150323855390 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f1d58010040 con 0x55c1857543f0 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1c37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855390 cookie 94289656167072 notifier 4895 bl.length()=679 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94289656364688 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1c37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1c37fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1c37fff640 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1c24003eb0 con 0x55c1857543f0 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify_complete (2) cookie 94289656364688 notify 150323855390 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1d5802c450 con 0x55c1857543f0 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.826 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:06.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1c16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:06.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.824+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94289656180000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c18578b840 con 0x55c1857543f0 2024-04-26T12:52:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94289656180000] v35'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94289656158480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c18578b840 con 0x7f1d48024070 2024-04-26T12:52:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94289656158480] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d62dc6980 20 remove_watcher() i=0 2024-04-26T12:52:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d62dc6980 2 removed watcher, disabling cache 2024-04-26T12:52:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94289656162192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c18578b840 con 0x55c1857543f0 2024-04-26T12:52:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94289656162192] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d62dc6980 20 remove_watcher() i=1 2024-04-26T12:52:06.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.828+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94289656164864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c18578b840 con 0x55c18575d6f0 2024-04-26T12:52:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.832+0000 7f1d600e0640 1 -- 172.21.15.72:0/755094949 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94289656164864] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d48040040 con 0x55c18575d6f0 2024-04-26T12:52:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.832+0000 7f1d62dc6980 20 remove_watcher() i=2 2024-04-26T12:52:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.832+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94289656169568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185762790 con 0x7f1d48024070 2024-04-26T12:52:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.832+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94289656169568] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x7f1d48024070 2024-04-26T12:52:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.832+0000 7f1d62dc6980 20 remove_watcher() i=3 2024-04-26T12:52:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.832+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94289656167072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185764460 con 0x55c1857543f0 2024-04-26T12:52:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.836+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94289656167072] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58026040 con 0x55c1857543f0 2024-04-26T12:52:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.836+0000 7f1d62dc6980 20 remove_watcher() i=4 2024-04-26T12:52:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.836+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94289656171696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185762790 con 0x55c185758de0 2024-04-26T12:52:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.840+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94289656171696] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.840+0000 7f1d62dc6980 20 remove_watcher() i=5 2024-04-26T12:52:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.840+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94289656175184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185764460 con 0x55c185758de0 2024-04-26T12:52:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.840+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94289656175184] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.840+0000 7f1d62dc6980 20 remove_watcher() i=6 2024-04-26T12:52:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.840+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94289656178736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c185762790 con 0x55c185758de0 2024-04-26T12:52:06.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d608e1640 1 -- 172.21.15.72:0/755094949 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94289656178736] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d500c6cd0 con 0x55c185758de0 2024-04-26T12:52:06.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 20 remove_watcher() i=7 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185758de0 msgr2=0x55c18575b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185758de0 0x55c18575b1d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c1857543f0 msgr2=0x55c1857568b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c1857543f0 0x55c1857568b0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1d48024070 msgr2=0x7f1d48031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f1d48024070 0x7f1d48031970 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c18575d6f0 msgr2=0x55c18575fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c18575d6f0 0x55c18575fb20 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c2c034650 msgr2=0x7f1c2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c2c034650 0x7f1c2c036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1d48004fd0 tx=0x7f1d48010000 comp rx=0 tx=0).stop 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d610e2640 1 -- 172.21.15.72:0/755094949 reap_dead start 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 msgr2=0x55c185749420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185749420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1d500bffb0 tx=0x7f1d500c2f40 comp rx=0 tx=0).stop 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 shutdown_connections 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/755094949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185742150 0x55c185749420 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 >> 172.21.15.72:0/755094949 conn(0x55c18573e4e0 msgr2=0x55c18573bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 shutdown_connections 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/755094949 wait complete. 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c380346a0 msgr2=0x7f1c38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c380346a0 0x7f1c38036b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55c18571e7c0 tx=0x7f1d4800f000 comp rx=0 tx=0).stop 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185735120 msgr2=0x55c185735540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185735120 0x55c185735540 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1d500bf040 tx=0x7f1d500e51f0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 shutdown_connections 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c380346a0 0x7f1c38036b60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2389966530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185735120 0x55c185735540 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 >> 172.21.15.72:0/2389966530 conn(0x55c185729f30 msgr2=0x55c18572aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 shutdown_connections 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2389966530 wait complete. 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185720620 msgr2=0x55c185722a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c185720620 0x55c185722a10 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c185598080 msgr2=0x55c18571dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c185598080 0x55c18571dcf0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c185724560 msgr2=0x55c185726950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c185724560 0x55c185726950 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c480346a0 msgr2=0x7f1c48036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1c480346a0 0x7f1c48036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1d480016c0 tx=0x7f1d480066c0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 msgr2=0x55c185716e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 --2- 172.21.15.72:0/2911622983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c185596bc0 0x55c185716e30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1d5001b170 tx=0x7f1d500180e0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d610e2640 1 -- 172.21.15.72:0/2911622983 reap_dead start 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 shutdown_connections 2024-04-26T12:52:06.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 >> 172.21.15.72:0/2911622983 conn(0x55c18561dbe0 msgr2=0x55c18570a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 shutdown_connections 2024-04-26T12:52:06.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.844+0000 7f1d62dc6980 1 -- 172.21.15.72:0/2911622983 wait complete. 2024-04-26T12:52:06.857 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.857 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:06.858 ERROR:root:0 2024-04-26T12:52:06.858 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:06.862 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:06.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-26T12:52:06.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-26T12:52:06.863 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-04-26T12:52:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.940+0000 7fa0ef1ad980 1 Processor -- start 2024-04-26T12:52:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.940+0000 7fa0ef1ad980 1 -- start start 2024-04-26T12:52:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.940+0000 7fa0ef1ad980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56156049f4f0 0x56156049f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0ef1ad980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56156034a510 con 0x56156049fe10 2024-04-26T12:52:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0ef1ad980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x561560351430 con 0x56156049f4f0 2024-04-26T12:52:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0eccc8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56156049f4f0 0x56156049f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0eccc8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x56156049f4f0 0x56156049f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39066/0 (socket says 172.21.15.72:39066) 2024-04-26T12:52:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0eccc8640 1 -- 172.21.15.72:0/775362706 learned_addr learned my addr 172.21.15.72:0/775362706 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0eccc8640 1 -- 172.21.15.72:0/775362706 >> v1:172.21.15.29:6789/0 conn(0x56156049fe10 legacy=0x5615604a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0eccc8640 1 -- 172.21.15.72:0/775362706 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561560326ae0 con 0x56156049f4f0 2024-04-26T12:52:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/775362706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049f4f0 0x56156049f8d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00a4e0 tx=0x7fa0dc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da64c06faf9c60e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.944+0000 7fa0ebcc6640 1 -- 172.21.15.72:0/775362706 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0aa540 con 0x56156049f4f0 2024-04-26T12:52:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ebcc6640 1 -- 172.21.15.72:0/775362706 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0aa6e0 con 0x56156049f4f0 2024-04-26T12:52:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ebcc6640 1 -- 172.21.15.72:0/775362706 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0aaa40 con 0x56156049f4f0 2024-04-26T12:52:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/775362706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049f4f0 msgr2=0x56156049f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/775362706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049f4f0 0x56156049f8d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc00a4e0 tx=0x7fa0dc01b090 comp rx=0 tx=0).stop 2024-04-26T12:52:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/775362706 shutdown_connections 2024-04-26T12:52:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/775362706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049f4f0 0x56156049f8d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/775362706 >> 172.21.15.72:0/775362706 conn(0x561560412bd0 msgr2=0x561560412fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/775362706 shutdown_connections 2024-04-26T12:52:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.948+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/775362706 wait complete. 2024-04-26T12:52:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.960+0000 7fa0ef1ad980 1 Processor -- start 2024-04-26T12:52:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- start start 2024-04-26T12:52:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x56156058af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615603a0a70 con 0x56156049fe10 2024-04-26T12:52:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x56156058af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x56156058af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39082/0 (socket says 172.21.15.72:39082) 2024-04-26T12:52:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2090541583 learned_addr learned my addr 172.21.15.72:0/2090541583 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2090541583 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56156058b510 con 0x56156049fe10 2024-04-26T12:52:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/2090541583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x56156058af40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc019740 tx=0x7fa0dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a68bac5ba0bef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7f9fdae0d640 1 -- 172.21.15.72:0/2090541583 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0b9070 con 0x56156049fe10 2024-04-26T12:52:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7f9fdae0d640 1 -- 172.21.15.72:0/2090541583 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0aa990 con 0x56156049fe10 2024-04-26T12:52:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7f9fdae0d640 1 -- 172.21.15.72:0/2090541583 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0aac70 con 0x56156049fe10 2024-04-26T12:52:06.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2090541583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 msgr2=0x56156058af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2090541583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x56156058af40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc019740 tx=0x7fa0dc0033b0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2090541583 shutdown_connections 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2090541583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x56156058af40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2090541583 >> 172.21.15.72:0/2090541583 conn(0x561560412bd0 msgr2=0x561560586a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2090541583 shutdown_connections 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2090541583 wait complete. 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 Processor -- start 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- start start 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x561560592000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0ef1ad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615604a9540 con 0x56156049fe10 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x561560592000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x561560592000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39096/0 (socket says 172.21.15.72:39096) 2024-04-26T12:52:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.964+0000 7fa0eccc8640 1 -- 172.21.15.72:0/3879118442 learned_addr learned my addr 172.21.15.72:0/3879118442 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0eccc8640 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561560592540 con 0x56156049fe10 2024-04-26T12:52:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x561560592000 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc01b0d0 tx=0x7fa0dc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7f9fd960a640 1 -- 172.21.15.72:0/3879118442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0b9070 con 0x56156049fe10 2024-04-26T12:52:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615605927d0 con 0x56156049fe10 2024-04-26T12:52:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561560595430 con 0x56156049fe10 2024-04-26T12:52:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7f9fd960a640 1 -- 172.21.15.72:0/3879118442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0b5ad0 con 0x56156049fe10 2024-04-26T12:52:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7f9fd960a640 1 -- 172.21.15.72:0/3879118442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0b5db0 con 0x56156049fe10 2024-04-26T12:52:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7f9fd960a640 1 -- 172.21.15.72:0/3879118442 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0dc0b3040 con 0x56156049fe10 2024-04-26T12:52:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7f9fd960a640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd40346a0 0x7f9fd4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7f9fd960a640 1 -- 172.21.15.72:0/3879118442 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa0dc002030 con 0x56156049fe10 2024-04-26T12:52:06.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd40346a0 0x7f9fd4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561560596f00 0x5615605992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561560599960 con 0x561560596f00 2024-04-26T12:52:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ed4c9640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561560596f00 0x5615605992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd40346a0 0x7f9fd4036b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4001e20 tx=0x7fa0d40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ed4c9640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561560596f00 0x5615605992f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/3879118442 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083f0 con 0x561560596f00 2024-04-26T12:52:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561560596650 con 0x561560596f00 2024-04-26T12:52:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.968+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/3879118442 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0e40083f0 con 0x561560596f00 2024-04-26T12:52:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56156059bcb0 0x56156059e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56156059e790 con 0x56156059bcb0 2024-04-26T12:52:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56156059bcb0 0x56156059e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56156059bcb0 0x56156059e0a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0eccc8640 1 -- 172.21.15.72:0/3879118442 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa0dc0070a0 con 0x56156059bcb0 2024-04-26T12:52:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56156059ab50 con 0x561560596f00 2024-04-26T12:52:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/3879118442 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0e40083f0 con 0x561560596f00 2024-04-26T12:52:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56156059fbf0 0x5615605a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605a2720 con 0x56156059fbf0 2024-04-26T12:52:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56156059fbf0 0x5615605a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56156059fbf0 0x5615605a1fe0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/3879118442 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa0d400d040 con 0x56156059fbf0 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 Processor -- start 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 -- start start 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605b07b0 0x5615605b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0ef1ad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615603a4ab0 con 0x5615605b07b0 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.972+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605b07b0 0x5615605b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605b07b0 0x5615605b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39102/0 (socket says 172.21.15.72:39102) 2024-04-26T12:52:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2004223623 learned_addr learned my addr 172.21.15.72:0/2004223623 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2004223623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615605b1110 con 0x5615605b07b0 2024-04-26T12:52:06.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605b07b0 0x5615605b0bd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0d2fd0 tx=0x7fa0dc0a9870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7f9fd27fc640 1 -- 172.21.15.72:0/2004223623 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc006e50 con 0x5615605b07b0 2024-04-26T12:52:06.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615605b1bb0 con 0x5615605b07b0 2024-04-26T12:52:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7f9fd27fc640 1 -- 172.21.15.72:0/2004223623 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0c8670 con 0x5615605b07b0 2024-04-26T12:52:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7f9fd27fc640 1 -- 172.21.15.72:0/2004223623 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0c8950 con 0x5615605b07b0 2024-04-26T12:52:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615605b2080 con 0x5615605b07b0 2024-04-26T12:52:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7f9fd27fc640 1 -- 172.21.15.72:0/2004223623 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0dc0b47e0 con 0x5615605b07b0 2024-04-26T12:52:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7f9fd27fc640 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fc4034650 0x7f9fc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7f9fd27fc640 1 -- 172.21.15.72:0/2004223623 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa0dc0c4070 con 0x5615605b07b0 2024-04-26T12:52:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fc4034650 0x7f9fc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ef1ad980 1 Processor -- start 2024-04-26T12:52:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ef1ad980 1 -- start start 2024-04-26T12:52:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fc4034650 0x7f9fc4036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x561560599e30 tx=0x7fa0d4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ef1ad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0ef1ad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56156058b7a0 con 0x5615605bd720 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605bdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39114/0 (socket says 172.21.15.72:39114) 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.976+0000 7fa0eccc8640 1 -- 172.21.15.72:0/158338215 learned_addr learned my addr 172.21.15.72:0/158338215 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0eccc8640 1 -- 172.21.15.72:0/158338215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615605be110 con 0x5615605bd720 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/158338215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605bdb40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0ecec0 tx=0x7fa0dc0c74f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a2d4482bb4f836 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7f9fc3fff640 1 -- 172.21.15.72:0/158338215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc100070 con 0x5615605bd720 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7f9fc3fff640 1 -- 172.21.15.72:0/158338215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0076f0 con 0x5615605bd720 2024-04-26T12:52:06.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7f9fc3fff640 1 -- 172.21.15.72:0/158338215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0ec510 con 0x5615605bd720 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/158338215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 msgr2=0x5615605bdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/158338215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605bdb40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0ecec0 tx=0x7fa0dc0c74f0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/158338215 shutdown_connections 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/158338215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605bdb40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/158338215 >> 172.21.15.72:0/158338215 conn(0x5615605b9ab0 msgr2=0x5615605b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/158338215 shutdown_connections 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/158338215 wait complete. 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 Processor -- start 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- start start 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5615605be6a0 con 0x5615605bd720 2024-04-26T12:52:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0eccc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39120/0 (socket says 172.21.15.72:39120) 2024-04-26T12:52:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 learned_addr learned my addr 172.21.15.72:0/2546315762 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615605c4fa0 con 0x5615605bd720 2024-04-26T12:52:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605c4a60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc002f80 tx=0x7fa0dc006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7f9fc27fc640 1 -- 172.21.15.72:0/2546315762 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc115070 con 0x5615605bd720 2024-04-26T12:52:06.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615605c4fa0 con 0x5615605bd720 2024-04-26T12:52:06.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7f9fc27fc640 1 -- 172.21.15.72:0/2546315762 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0d18d0 con 0x5615605bd720 2024-04-26T12:52:06.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7f9fc27fc640 1 -- 172.21.15.72:0/2546315762 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc0d1bb0 con 0x5615605bd720 2024-04-26T12:52:06.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.980+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615605c5410 con 0x5615605bd720 2024-04-26T12:52:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7f9fc27fc640 1 -- 172.21.15.72:0/2546315762 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0dc118070 con 0x5615605bd720 2024-04-26T12:52:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7f9fc27fc640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fb8034650 0x7f9fb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7f9fc27fc640 1 -- 172.21.15.72:0/2546315762 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa0dc10c030 con 0x5615605bd720 2024-04-26T12:52:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fb8034650 0x7f9fb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615605cfbc0 0x5615605d2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d27d0 con 0x5615605cfbc0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ed4c9640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615605cfbc0 0x5615605d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fb8034650 0x7f9fb8036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5615605a2b20 tx=0x7fa0d4011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ed4c9640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615605cfbc0 0x5615605d2080 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083f0 con 0x5615605cfbc0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 realm 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d2be0 con 0x5615605cfbc0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083f0 con 0x5615605cfbc0 2024-04-26T12:52:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3480 con 0x5615605cfbc0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e40083f0 con 0x5615605cfbc0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605cfbc0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0e40083f0 con 0x5615605cfbc0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615605d4580 0x5615605d6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.984+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d6fc0 con 0x5615605d4580 2024-04-26T12:52:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615605d4580 0x5615605d6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0eccc8640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615605d4580 0x5615605d6970 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ef1ad980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ef1ad980 20 searching for the correct realm 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615605d8ea0 0x5615605db310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605db990 con 0x5615605d8ea0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615605d8ea0 0x5615605db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615605d8ea0 0x5615605db310 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ec4c7640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0d400f3d0 0x7fa0d400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605db990 con 0x7fa0d400f3d0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ed4c9640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0d400f3d0 0x7fa0d400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ed4c9640 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0d400f3d0 0x7fa0d400f7f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e40083f0 con 0x7fa0d400f3d0 2024-04-26T12:52:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.988+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605d4580 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605cfbc0 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e40083f0 con 0x5615605cfbc0 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605cfbc0 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605d4580 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605d4580 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x7fa0d400f3d0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605d8ea0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605cfbc0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x7fa0d400f3d0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605cfbc0 2024-04-26T12:52:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.992+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x7fa0d400f3d0 2024-04-26T12:52:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d4580 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605cfbc0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605cfbc0 2024-04-26T12:52:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d4580 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d8ea0 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:06.996+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605cfbc0 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d4580 2024-04-26T12:52:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d8ea0 2024-04-26T12:52:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d4580 2024-04-26T12:52:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d8ea0 2024-04-26T12:52:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605d4580 2024-04-26T12:52:07.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x5615605cfbc0 2024-04-26T12:52:07.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.000+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa0e402b040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605cfbc0 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605cfbc0 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d3820 con 0x5615605d8ea0 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 zone default found 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 4 Realm: () 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 zonegroup default 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605d7e60 con 0x5615605d4580 2024-04-26T12:52:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605dd7f0 con 0x5615605d8ea0 2024-04-26T12:52:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605ddb90 con 0x5615605d8ea0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 started sync module instance, tier type = 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.004+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605dcc90 con 0x7fa0d400f3d0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.008+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.008+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94649811063216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605dcc90 con 0x7fa0d400f3d0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.008+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605de590 con 0x5615605cfbc0 2024-04-26T12:52:07.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.008+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94649811063216] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.008+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.008+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94649811067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605dcc90 con 0x5615605cfbc0 2024-04-26T12:52:07.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.008+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605defd0 con 0x5615605d8ea0 2024-04-26T12:52:07.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94649811069728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605df820 con 0x5615605d8ea0 2024-04-26T12:52:07.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e0240 con 0x7fa0d400f3d0 2024-04-26T12:52:07.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94649811067040] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94649811074352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e0200 con 0x7fa0d400f3d0 2024-04-26T12:52:07.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e0c50 con 0x5615605cfbc0 2024-04-26T12:52:07.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.012+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94649811069728] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94649811071856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e0c50 con 0x5615605cfbc0 2024-04-26T12:52:07.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e14a0 con 0x5615605d4580 2024-04-26T12:52:07.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94649811074352] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94649811071856] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94649811077024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e1070 con 0x5615605d4580 2024-04-26T12:52:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.016+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e1d40 con 0x5615605d4580 2024-04-26T12:52:07.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94649811083488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e29b0 con 0x5615605d4580 2024-04-26T12:52:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e3370 con 0x5615605d4580 2024-04-26T12:52:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94649811077024] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94649811083488] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94649811084544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e2920 con 0x5615605d4580 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 20 add_watcher() i=0 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 20 add_watcher() i=1 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 20 add_watcher() i=2 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 20 add_watcher() i=3 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 20 add_watcher() i=4 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 20 add_watcher() i=5 2024-04-26T12:52:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.020+0000 7fa0ef1ad980 20 add_watcher() i=6 2024-04-26T12:52:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94649811084544] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 20 add_watcher() i=7 2024-04-26T12:52:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5615605e63a0 con 0x5615605cfbc0 2024-04-26T12:52:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94649811087040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615605e3790 con 0x5615605cfbc0 2024-04-26T12:52:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94649811087040] v35'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7f9fa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 5 note: GC not initialized 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7f9fa27e4640 20 reqs_thread_entry: start 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 20 Filter name: none 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7f9f9bfff640 20 reqs_thread_entry: start 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.024+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561560609ad0 con 0x5615605d4580 2024-04-26T12:52:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.028+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.028+0000 7fa0ef1ad980 20 rados_obj.operate() r=0 bl.length=503 2024-04-26T12:52:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.028+0000 7fa0ef1ad980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.028+0000 7fa0ef1ad980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.028+0000 7fa0ef1ad980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.028+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606104b0 con 0x5615605d4580 2024-04-26T12:52:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ef1ad980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ef1ad980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ef1ad980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94649811271456 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56156060bb80 con 0x5615605cfbc0 2024-04-26T12:52:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94649811071856 notify 150323855391 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fa0e4010040 con 0x5615605cfbc0 2024-04-26T12:52:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7f9fc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855391 cookie 94649811071856 notifier 4902 bl.length()=636 2024-04-26T12:52:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94649811271456 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7f9fc3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7f9fc3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7f9fc3fff640 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9fb0003eb0 con 0x5615605cfbc0 2024-04-26T12:52:07.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify_complete (2) cookie 94649811271456 notify 150323855391 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa0e400aaf0 con 0x5615605cfbc0 2024-04-26T12:52:07.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.034 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:07.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7f9fa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94649811087040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x5615605cfbc0 2024-04-26T12:52:07.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94649811087040] v35'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.032+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94649811063216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x7fa0d400f3d0 2024-04-26T12:52:07.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.036+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94649811063216] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.036+0000 7fa0ef1ad980 20 remove_watcher() i=0 2024-04-26T12:52:07.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.036+0000 7fa0ef1ad980 2 removed watcher, disabling cache 2024-04-26T12:52:07.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.036+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94649811067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x5615605cfbc0 2024-04-26T12:52:07.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.036+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94649811067040] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.036+0000 7fa0ef1ad980 20 remove_watcher() i=1 2024-04-26T12:52:07.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.036+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94649811069728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x5615605d8ea0 2024-04-26T12:52:07.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.040+0000 7fa0ec4c7640 1 -- 172.21.15.72:0/2546315762 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94649811069728] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d4036040 con 0x5615605d8ea0 2024-04-26T12:52:07.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.040+0000 7fa0ef1ad980 20 remove_watcher() i=2 2024-04-26T12:52:07.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.040+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94649811074352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x7fa0d400f3d0 2024-04-26T12:52:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.040+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94649811074352] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x7fa0d400f3d0 2024-04-26T12:52:07.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.040+0000 7fa0ef1ad980 20 remove_watcher() i=3 2024-04-26T12:52:07.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.040+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94649811071856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x5615605cfbc0 2024-04-26T12:52:07.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.044+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94649811071856] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0e4026040 con 0x5615605cfbc0 2024-04-26T12:52:07.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.044+0000 7fa0ef1ad980 20 remove_watcher() i=4 2024-04-26T12:52:07.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.044+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94649811077024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x5615605d4580 2024-04-26T12:52:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.044+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94649811077024] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.044+0000 7fa0ef1ad980 20 remove_watcher() i=5 2024-04-26T12:52:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.044+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94649811083488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x5615605d4580 2024-04-26T12:52:07.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.048+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94649811083488] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.048+0000 7fa0ef1ad980 20 remove_watcher() i=6 2024-04-26T12:52:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.048+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94649811084544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5615606077c0 con 0x5615605d4580 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0eccc8640 1 -- 172.21.15.72:0/2546315762 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94649811084544] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0dc117030 con 0x5615605d4580 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 20 remove_watcher() i=7 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615605d4580 msgr2=0x5615605d6970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5615605d4580 0x5615605d6970 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615605cfbc0 msgr2=0x5615605d2080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5615605cfbc0 0x5615605d2080 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0d400f3d0 msgr2=0x7fa0d400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fa0d400f3d0 0x7fa0d400f7f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615605d8ea0 msgr2=0x5615605db310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5615605d8ea0 0x5615605db310 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fb8034650 msgr2=0x7f9fb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fb8034650 0x7f9fb8036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5615605a2b20 tx=0x7fa0d4011000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 msgr2=0x5615605c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605c4a60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc002f80 tx=0x7fa0dc006cb0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/2546315762 reap_dead start 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 shutdown_connections 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2546315762 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605bd720 0x5615605c4a60 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 >> 172.21.15.72:0/2546315762 conn(0x5615605b9ab0 msgr2=0x5615605b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 shutdown_connections 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2546315762 wait complete. 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fc4034650 msgr2=0x7f9fc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fc4034650 0x7f9fc4036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x561560599e30 tx=0x7fa0d4006000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605b07b0 msgr2=0x5615605b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605b07b0 0x5615605b0bd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0d2fd0 tx=0x7fa0dc0a9870 comp rx=0 tx=0).stop 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 shutdown_connections 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fc4034650 0x7f9fc4036b10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/2004223623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5615605b07b0 0x5615605b0bd0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 >> 172.21.15.72:0/2004223623 conn(0x5615605a55c0 msgr2=0x5615605a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 shutdown_connections 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/2004223623 wait complete. 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56156059bcb0 msgr2=0x56156059e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x56156059bcb0 0x56156059e0a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561560596f00 msgr2=0x5615605992f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x561560596f00 0x5615605992f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56156059fbf0 msgr2=0x5615605a1fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x56156059fbf0 0x5615605a1fe0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd40346a0 msgr2=0x7f9fd4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9fd40346a0 0x7f9fd4036b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4001e20 tx=0x7fa0d40013a0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 msgr2=0x561560592000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 --2- 172.21.15.72:0/3879118442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56156049fe10 0x561560592000 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc01b0d0 tx=0x7fa0dc017e30 comp rx=0 tx=0).stop 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ed4c9640 1 -- 172.21.15.72:0/3879118442 reap_dead start 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 shutdown_connections 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 >> 172.21.15.72:0/3879118442 conn(0x561560412bd0 msgr2=0x561560585540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 shutdown_connections 2024-04-26T12:52:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.052+0000 7fa0ef1ad980 1 -- 172.21.15.72:0/3879118442 wait complete. 2024-04-26T12:52:07.065 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.065 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.065 ERROR:root:0 2024-04-26T12:52:07.065 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:52:07.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:52:07.066 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-04-26T12:52:07.146 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:07.146 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e37bc5980 1 Processor -- start 2024-04-26T12:52:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e37bc5980 1 -- start start 2024-04-26T12:52:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e37bc5980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f6ff68f6f0 0x55f6ff691ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e37bc5980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6ff539510 con 0x55f6ff68b190 2024-04-26T12:52:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e37bc5980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f6ff540430 con 0x55f6ff68f6f0 2024-04-26T12:52:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e34edf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f6ff68f6f0 0x55f6ff691ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e356e0640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f6ff68b190 0x55f6ff68b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48846/0 (socket says 172.21.15.72:48846) 2024-04-26T12:52:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e34edf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f6ff68f6f0 0x55f6ff691ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39136/0 (socket says 172.21.15.72:39136) 2024-04-26T12:52:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.144+0000 7f9e356e0640 1 -- 172.21.15.72:0/1427965084 learned_addr learned my addr 172.21.15.72:0/1427965084 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.148+0000 7f9e34edf640 1 -- 172.21.15.72:0/1427965084 >> v1:172.21.15.29:6789/0 conn(0x55f6ff68b190 legacy=0x55f6ff68b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.148+0000 7f9e34edf640 1 -- 172.21.15.72:0/1427965084 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff515ae0 con 0x55f6ff68f6f0 2024-04-26T12:52:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.148+0000 7f9e34edf640 1 --2- 172.21.15.72:0/1427965084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68f6f0 0x55f6ff691ae0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00a480 tx=0x7f9e2c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d67a42e6910e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.148+0000 7f9e27fff640 1 -- 172.21.15.72:0/1427965084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c0b0070 con 0x55f6ff68f6f0 2024-04-26T12:52:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.148+0000 7f9e27fff640 1 -- 172.21.15.72:0/1427965084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0ab540 con 0x55f6ff68f6f0 2024-04-26T12:52:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.148+0000 7f9e27fff640 1 -- 172.21.15.72:0/1427965084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c0ab840 con 0x55f6ff68f6f0 2024-04-26T12:52:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.152+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1427965084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68f6f0 msgr2=0x55f6ff691ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.152+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/1427965084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68f6f0 0x55f6ff691ae0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00a480 tx=0x7f9e2c01b280 comp rx=0 tx=0).stop 2024-04-26T12:52:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.152+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1427965084 shutdown_connections 2024-04-26T12:52:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.152+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/1427965084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68f6f0 0x55f6ff691ae0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.152+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1427965084 >> 172.21.15.72:0/1427965084 conn(0x55f6ff686a60 msgr2=0x55f6ff688e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.152+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1427965084 shutdown_connections 2024-04-26T12:52:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.152+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1427965084 wait complete. 2024-04-26T12:52:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.164+0000 7f9e37bc5980 1 Processor -- start 2024-04-26T12:52:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.164+0000 7f9e37bc5980 1 -- start start 2024-04-26T12:52:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.164+0000 7f9e37bc5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff7752a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.164+0000 7f9e37bc5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff58fa70 con 0x55f6ff68b190 2024-04-26T12:52:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.164+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff7752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.164+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff7752a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39138/0 (socket says 172.21.15.72:39138) 2024-04-26T12:52:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.164+0000 7f9e356e0640 1 -- 172.21.15.72:0/2388563858 learned_addr learned my addr 172.21.15.72:0/2388563858 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e356e0640 1 -- 172.21.15.72:0/2388563858 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff775870 con 0x55f6ff68b190 2024-04-26T12:52:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e356e0640 1 --2- 172.21.15.72:0/2388563858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff7752a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9e28001d90 tx=0x7f9e28001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446c7a1849d6dfb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9d23606640 1 -- 172.21.15.72:0/2388563858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28013030 con 0x55f6ff68b190 2024-04-26T12:52:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9d23606640 1 -- 172.21.15.72:0/2388563858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2800e690 con 0x55f6ff68b190 2024-04-26T12:52:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9d23606640 1 -- 172.21.15.72:0/2388563858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e2800ea10 con 0x55f6ff68b190 2024-04-26T12:52:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2388563858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 msgr2=0x55f6ff7752a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2388563858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff7752a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9e28001d90 tx=0x7f9e28001e80 comp rx=0 tx=0).stop 2024-04-26T12:52:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2388563858 shutdown_connections 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2388563858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff7752a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2388563858 >> 172.21.15.72:0/2388563858 conn(0x55f6ff686a60 msgr2=0x55f6ff770e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2388563858 shutdown_connections 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2388563858 wait complete. 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 Processor -- start 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- start start 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff77c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff5ffc80 con 0x55f6ff68b190 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff77c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff77c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39152/0 (socket says 172.21.15.72:39152) 2024-04-26T12:52:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e356e0640 1 -- 172.21.15.72:0/2664352098 learned_addr learned my addr 172.21.15.72:0/2664352098 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e356e0640 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff77ca70 con 0x55f6ff68b190 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e356e0640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff77c530 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55f6ff776130 tx=0x7f9e28000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9d21e03640 1 -- 172.21.15.72:0/2664352098 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28027070 con 0x55f6ff68b190 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6ff77cd00 con 0x55f6ff68b190 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9d21e03640 1 -- 172.21.15.72:0/2664352098 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e28019900 con 0x55f6ff68b190 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ff77f940 con 0x55f6ff68b190 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.168+0000 7f9d21e03640 1 -- 172.21.15.72:0/2664352098 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28019be0 con 0x55f6ff68b190 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9d21e03640 1 -- 172.21.15.72:0/2664352098 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9e2802a070 con 0x55f6ff68b190 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9d21e03640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d1c0346a0 0x7f9d1c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9d21e03640 1 -- 172.21.15.72:0/2664352098 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f9e2801f070 con 0x55f6ff68b190 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d1c0346a0 0x7f9d1c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff68f6f0 0x55f6ff783440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff783ab0 con 0x55f6ff68f6f0 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e35ee1640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff68f6f0 0x55f6ff783440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d1c0346a0 0x7f9d1c036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0ad000 tx=0x7f9e2c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e35ee1640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff68f6f0 0x55f6ff783440 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2664352098 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff68f6f0 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff780b60 con 0x55f6ff68f6f0 2024-04-26T12:52:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2664352098 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff68f6f0 2024-04-26T12:52:07.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff785e00 0x55f6ff7881f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7888e0 con 0x55f6ff785e00 2024-04-26T12:52:07.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e356e0640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff785e00 0x55f6ff7881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.172+0000 7f9e356e0640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff785e00 0x55f6ff7881f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e356e0640 1 -- 172.21.15.72:0/2664352098 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff785e00 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff784ca0 con 0x55f6ff68f6f0 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2664352098 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff68f6f0 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff789d40 0x55f6ff78c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff78c870 con 0x55f6ff789d40 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff789d40 0x55f6ff78c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff789d40 0x55f6ff78c130 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e34edf640 1 -- 172.21.15.72:0/2664352098 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff789d40 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 Processor -- start 2024-04-26T12:52:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 -- start start 2024-04-26T12:52:07.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff79a8c0 0x55f6ff79ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff593ab0 con 0x55f6ff79a8c0 2024-04-26T12:52:07.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff79a8c0 0x55f6ff79ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff79a8c0 0x55f6ff79ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39156/0 (socket says 172.21.15.72:39156) 2024-04-26T12:52:07.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e356e0640 1 -- 172.21.15.72:0/394034863 learned_addr learned my addr 172.21.15.72:0/394034863 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e356e0640 1 -- 172.21.15.72:0/394034863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff79b220 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e356e0640 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff79a8c0 0x55f6ff79ace0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9e28001400 tx=0x7f9e28041e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9d1affd640 1 -- 172.21.15.72:0/394034863 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28022ab0 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6ff79bcc0 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.176+0000 7f9d1affd640 1 -- 172.21.15.72:0/394034863 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2802a360 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ff79c190 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9d1affd640 1 -- 172.21.15.72:0/394034863 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28022410 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9d1affd640 1 -- 172.21.15.72:0/394034863 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9e2803a070 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9d1affd640 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d0c034650 0x7f9d0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9d1affd640 1 -- 172.21.15.72:0/394034863 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f9e28037070 con 0x55f6ff79a8c0 2024-04-26T12:52:07.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e34edf640 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d0c034650 0x7f9d0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e37bc5980 1 Processor -- start 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e37bc5980 1 -- start start 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e34edf640 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d0c034650 0x7f9d0c036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55f6ff783f80 tx=0x7f9e2c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e37bc5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e37bc5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff775bc0 con 0x55f6ff7abb10 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39166/0 (socket says 172.21.15.72:39166) 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e356e0640 1 -- 172.21.15.72:0/1745352052 learned_addr learned my addr 172.21.15.72:0/1745352052 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e356e0640 1 -- 172.21.15.72:0/1745352052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff7ac500 con 0x55f6ff7abb10 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e356e0640 1 --2- 172.21.15.72:0/1745352052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7abf30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9e28042160 tx=0x7f9e2804e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18d9dd12ab44451 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9d18ff9640 1 -- 172.21.15.72:0/1745352052 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28050e00 con 0x55f6ff7abb10 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9d18ff9640 1 -- 172.21.15.72:0/1745352052 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e280412b0 con 0x55f6ff7abb10 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9d18ff9640 1 -- 172.21.15.72:0/1745352052 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e2802b5d0 con 0x55f6ff7abb10 2024-04-26T12:52:07.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1745352052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 msgr2=0x55f6ff7abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.180+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/1745352052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7abf30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9e28042160 tx=0x7f9e2804e720 comp rx=0 tx=0).stop 2024-04-26T12:52:07.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1745352052 shutdown_connections 2024-04-26T12:52:07.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/1745352052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7abf30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1745352052 >> 172.21.15.72:0/1745352052 conn(0x55f6ff7a3a40 msgr2=0x55f6ff7a1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1745352052 shutdown_connections 2024-04-26T12:52:07.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- 172.21.15.72:0/1745352052 wait complete. 2024-04-26T12:52:07.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 Processor -- start 2024-04-26T12:52:07.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- start start 2024-04-26T12:52:07.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff7acbc0 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e356e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39182/0 (socket says 172.21.15.72:39182) 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 learned_addr learned my addr 172.21.15.72:0/2183449453 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff7b3440 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e356e0640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7b2f00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9e2804fff0 tx=0x7f9e2804ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9d0affd640 1 -- 172.21.15.72:0/2183449453 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28067040 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6ff7b3440 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9d0affd640 1 -- 172.21.15.72:0/2183449453 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e28050e00 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9d0affd640 1 -- 172.21.15.72:0/2183449453 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e2802b740 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ff7b38b0 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9d0affd640 1 -- 172.21.15.72:0/2183449453 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9e28074020 con 0x55f6ff7abb10 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9d0affd640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d00034600 0x7f9d00036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9d0affd640 1 -- 172.21.15.72:0/2183449453 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f9e28072020 con 0x55f6ff7abb10 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d00034600 0x7f9d00036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff7bdff0 0x55f6ff7c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c0c00 con 0x55f6ff7bdff0 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.184+0000 7f9e35ee1640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff7bdff0 0x55f6ff7c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d00034600 0x7f9d00036ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b6fd0 tx=0x7f9e2c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e35ee1640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff7bdff0 0x55f6ff7c04b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 realm 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1010 con 0x55f6ff7bdff0 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c18b0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff7c29b0 0x55f6ff7c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c5440 con 0x55f6ff7c29b0 2024-04-26T12:52:07.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e356e0640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff7c29b0 0x55f6ff7c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e356e0640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff7c29b0 0x55f6ff7c4da0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:07.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 20 searching for the correct realm 2024-04-26T12:52:07.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff7c7320 0x55f6ff7c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c9e10 con 0x55f6ff7c7320 2024-04-26T12:52:07.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff7c7320 0x55f6ff7c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.188+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff7c7320 0x55f6ff7c9790 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e34edf640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9e2c0ab030 0x7f9e2c0b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c9e10 con 0x7f9e2c0ab030 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9e2c0ab030 0x7f9e2c0b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9e2c0ab030 0x7f9e2c0b7400 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a4d0 con 0x7f9e2c0ab030 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x7f9e2c0ab030 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a4d0 con 0x7f9e2c0ab030 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.192+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x7f9e2c0ab030 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a4d0 con 0x7f9e2c0ab030 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a4d0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x7f9e2c0ab030 2024-04-26T12:52:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9e30032040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e30032040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9e30032040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.196+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x7f9e2c0ab030 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e30032040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e30032040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x7f9e2c0ab030 2024-04-26T12:52:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e30032040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c7320 2024-04-26T12:52:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.200+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7c29b0 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9e30032040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c1c50 con 0x7f9e2c0ab030 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e30032040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c5c90 con 0x55f6ff7bdff0 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e30032040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c5c90 con 0x55f6ff7bdff0 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9e30032040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c5c90 con 0x55f6ff7c7320 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 zone default found 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 4 Realm: () 2024-04-26T12:52:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 zonegroup default 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7c65c0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cbca0 con 0x55f6ff7c7320 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cc100 con 0x55f6ff7c7320 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 started sync module instance, tier type = 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.204+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cb110 con 0x7f9e2c0ab030 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.208+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30032040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.208+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94519336678960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cb110 con 0x7f9e2c0ab030 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.208+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7ccbf0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.208+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94519336678960] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.208+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.208+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94519336683264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cb110 con 0x55f6ff7bdff0 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.208+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cd600 con 0x55f6ff7c7320 2024-04-26T12:52:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94519336685904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cde50 con 0x55f6ff7c7320 2024-04-26T12:52:07.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7ce870 con 0x7f9e2c0ab030 2024-04-26T12:52:07.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94519336683264] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94519336690528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cec60 con 0x7f9e2c0ab030 2024-04-26T12:52:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cf620 con 0x55f6ff7bdff0 2024-04-26T12:52:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94519336685904] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94519336690528] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94519336676448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cf170 con 0x55f6ff7bdff0 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.212+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cf9c0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.216+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94519336676448] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.216+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.216+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94519336694128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7cf590 con 0x55f6ff7c29b0 2024-04-26T12:52:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.216+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7d06c0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94519336694128] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(56 notify.6 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94519336697184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7d0630 con 0x55f6ff7c29b0 2024-04-26T12:52:07.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7d1080 con 0x55f6ff7c29b0 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94519336700784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7d14f0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=0 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=1 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=2 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=3 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=4 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=5 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94519336697184] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=6 2024-04-26T12:52:07.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94519336700784] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 20 add_watcher() i=7 2024-04-26T12:52:07.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:07.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7d0180 con 0x55f6ff7bdff0 2024-04-26T12:52:07.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.220+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94519336702016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7d0180 con 0x55f6ff7bdff0 2024-04-26T12:52:07.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94519336702016] v35'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9ceb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 5 note: GC not initialized 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9cea7e4640 20 reqs_thread_entry: start 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 20 Filter name: none 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9c5bfff640 20 reqs_thread_entry: start 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f7df0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T12:52:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.224+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7fe390 con 0x55f6ff7c29b0 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e37bc5980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e37bc5980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e37bc5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94519336885760 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f9a20 con 0x55f6ff7bdff0 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94519336676448 notify 150323855392 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f9e30018c50 con 0x55f6ff7bdff0 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9d18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855392 cookie 94519336676448 notifier 4909 bl.length()=666 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9d18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9d18ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94519336885760 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9d18ff9640 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9cf8003eb0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify_complete (2) cookie 94519336885760 notify 150323855392 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9e30043420 con 0x55f6ff7bdff0 2024-04-26T12:52:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.228+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.232 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9ceb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94519336702016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94519336702016] v35'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94519336678960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x7f9e2c0ab030 2024-04-26T12:52:07.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94519336678960] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9e37bc5980 20 remove_watcher() i=0 2024-04-26T12:52:07.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9e37bc5980 2 removed watcher, disabling cache 2024-04-26T12:52:07.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.232+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94519336683264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94519336683264] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e37bc5980 20 remove_watcher() i=1 2024-04-26T12:52:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94519336685904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x55f6ff7c7320 2024-04-26T12:52:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e34edf640 1 -- 172.21.15.72:0/2183449453 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94519336685904] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e2c0b3040 con 0x55f6ff7c7320 2024-04-26T12:52:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e37bc5980 20 remove_watcher() i=2 2024-04-26T12:52:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94519336690528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x7f9e2c0ab030 2024-04-26T12:52:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94519336690528] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x7f9e2c0ab030 2024-04-26T12:52:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e37bc5980 20 remove_watcher() i=3 2024-04-26T12:52:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.236+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94519336676448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x55f6ff7bdff0 2024-04-26T12:52:07.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.240+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94519336676448] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e30040040 con 0x55f6ff7bdff0 2024-04-26T12:52:07.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.240+0000 7f9e37bc5980 20 remove_watcher() i=4 2024-04-26T12:52:07.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.240+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94519336694128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.244+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94519336694128] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.244+0000 7f9e37bc5980 20 remove_watcher() i=5 2024-04-26T12:52:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.244+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94519336697184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.244+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94519336697184] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.244+0000 7f9e37bc5980 20 remove_watcher() i=6 2024-04-26T12:52:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.244+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94519336700784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f6ff7f5af0 con 0x55f6ff7c29b0 2024-04-26T12:52:07.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e356e0640 1 -- 172.21.15.72:0/2183449453 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94519336700784] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e28029030 con 0x55f6ff7c29b0 2024-04-26T12:52:07.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 20 remove_watcher() i=7 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff7c29b0 msgr2=0x55f6ff7c4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff7c29b0 0x55f6ff7c4da0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff7bdff0 msgr2=0x55f6ff7c04b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff7bdff0 0x55f6ff7c04b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9e2c0ab030 msgr2=0x7f9e2c0b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f9e2c0ab030 0x7f9e2c0b7400 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff7c7320 msgr2=0x55f6ff7c9790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff7c7320 0x55f6ff7c9790 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d00034600 msgr2=0x7f9d00036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d00034600 0x7f9d00036ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b6fd0 tx=0x7f9e2c0a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2183449453 reap_dead start 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 msgr2=0x55f6ff7b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7b2f00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9e2804fff0 tx=0x7f9e2804ef70 comp rx=0 tx=0).stop 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 shutdown_connections 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2183449453 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff7abb10 0x55f6ff7b2f00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 >> 172.21.15.72:0/2183449453 conn(0x55f6ff7a3a40 msgr2=0x55f6ff7a10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 shutdown_connections 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2183449453 wait complete. 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d0c034650 msgr2=0x7f9d0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d0c034650 0x7f9d0c036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55f6ff783f80 tx=0x7f9e2c005a10 comp rx=0 tx=0).stop 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff79a8c0 msgr2=0x55f6ff79ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff79a8c0 0x55f6ff79ace0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9e28001400 tx=0x7f9e28041e40 comp rx=0 tx=0).stop 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 shutdown_connections 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d0c034650 0x7f9d0c036b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/394034863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff79a8c0 0x55f6ff79ace0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 >> 172.21.15.72:0/394034863 conn(0x55f6ff78f6d0 msgr2=0x55f6ff7901e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 shutdown_connections 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/394034863 wait complete. 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff785e00 msgr2=0x55f6ff7881f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f6ff785e00 0x55f6ff7881f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff68f6f0 msgr2=0x55f6ff783440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f6ff68f6f0 0x55f6ff783440 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff789d40 msgr2=0x55f6ff78c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f6ff789d40 0x55f6ff78c130 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d1c0346a0 msgr2=0x7f9d1c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f9d1c0346a0 0x7f9d1c036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0ad000 tx=0x7f9e2c0a5040 comp rx=0 tx=0).stop 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 msgr2=0x55f6ff77c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 --2- 172.21.15.72:0/2664352098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f6ff68b190 0x55f6ff77c530 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55f6ff776130 tx=0x7f9e28000bd0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e35ee1640 1 -- 172.21.15.72:0/2664352098 reap_dead start 2024-04-26T12:52:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 shutdown_connections 2024-04-26T12:52:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 >> 172.21.15.72:0/2664352098 conn(0x55f6ff686a60 msgr2=0x55f6ff76f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 shutdown_connections 2024-04-26T12:52:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.248+0000 7f9e37bc5980 1 -- 172.21.15.72:0/2664352098 wait complete. 2024-04-26T12:52:07.259 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.259 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.259 ERROR:root:0 2024-04-26T12:52:07.259 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.263 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000008dff0b108e650176-00662ba377-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:52:07.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:52:07.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:52:07.264 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-04-26T12:52:07.335 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f14321f9980 1 Processor -- start 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f14321f9980 1 -- start start 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f14321f9980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f2c4c02890 0x55f2c4c93380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f14321f9980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f2c4b3b510 con 0x55f2c4c938c0 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f14321f9980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55f2c4b42430 con 0x55f2c4c02890 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f142fd14640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f2c4c02890 0x55f2c4c93380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f142fd14640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55f2c4c02890 0x55f2c4c93380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39194/0 (socket says 172.21.15.72:39194) 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f142f513640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55f2c4c938c0 0x55f2c4c95cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48856/0 (socket says 172.21.15.72:48856) 2024-04-26T12:52:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f142fd14640 1 -- 172.21.15.72:0/2069922369 learned_addr learned my addr 172.21.15.72:0/2069922369 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f142fd14640 1 -- 172.21.15.72:0/2069922369 >> v1:172.21.15.29:6789/0 conn(0x55f2c4c938c0 legacy=0x55f2c4c95cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.332+0000 7f142fd14640 1 -- 172.21.15.72:0/2069922369 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c4b17ae0 con 0x55f2c4c02890 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f142fd14640 1 --2- 172.21.15.72:0/2069922369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4c93380 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f142800a4e0 tx=0x7f142801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e212e36f04364f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f142ed12640 1 -- 172.21.15.72:0/2069922369 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280aa540 con 0x55f2c4c02890 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f142ed12640 1 -- 172.21.15.72:0/2069922369 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14280aa6e0 con 0x55f2c4c02890 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f142ed12640 1 -- 172.21.15.72:0/2069922369 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280aaa40 con 0x55f2c4c02890 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f14321f9980 1 -- 172.21.15.72:0/2069922369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 msgr2=0x55f2c4c93380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f14321f9980 1 --2- 172.21.15.72:0/2069922369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4c93380 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f142800a4e0 tx=0x7f142801b090 comp rx=0 tx=0).stop 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f14321f9980 1 -- 172.21.15.72:0/2069922369 shutdown_connections 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f14321f9980 1 --2- 172.21.15.72:0/2069922369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4c93380 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f14321f9980 1 -- 172.21.15.72:0/2069922369 >> 172.21.15.72:0/2069922369 conn(0x55f2c4c88a60 msgr2=0x55f2c4c8ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f14321f9980 1 -- 172.21.15.72:0/2069922369 shutdown_connections 2024-04-26T12:52:07.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.336+0000 7f14321f9980 1 -- 172.21.15.72:0/2069922369 wait complete. 2024-04-26T12:52:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f14321f9980 1 Processor -- start 2024-04-26T12:52:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f14321f9980 1 -- start start 2024-04-26T12:52:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f14321f9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d7b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f14321f9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f2c4b91a70 con 0x55f2c4c02890 2024-04-26T12:52:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d7b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d7b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39200/0 (socket says 172.21.15.72:39200) 2024-04-26T12:52:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f142fd14640 1 -- 172.21.15.72:0/2224236473 learned_addr learned my addr 172.21.15.72:0/2224236473 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f142fd14640 1 -- 172.21.15.72:0/2224236473 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c4d7bc30 con 0x55f2c4c02890 2024-04-26T12:52:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f142fd14640 1 --2- 172.21.15.72:0/2224236473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d7b660 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1428017ca0 tx=0x7f14280033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86c3ae6b1700623 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.348+0000 7f131de0b640 1 -- 172.21.15.72:0/2224236473 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280b9030 con 0x55f2c4c02890 2024-04-26T12:52:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f131de0b640 1 -- 172.21.15.72:0/2224236473 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14280aaac0 con 0x55f2c4c02890 2024-04-26T12:52:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f131de0b640 1 -- 172.21.15.72:0/2224236473 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280aada0 con 0x55f2c4c02890 2024-04-26T12:52:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- 172.21.15.72:0/2224236473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 msgr2=0x55f2c4d7b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 --2- 172.21.15.72:0/2224236473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d7b660 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1428017ca0 tx=0x7f14280033b0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- 172.21.15.72:0/2224236473 shutdown_connections 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 --2- 172.21.15.72:0/2224236473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d7b660 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- 172.21.15.72:0/2224236473 >> 172.21.15.72:0/2224236473 conn(0x55f2c4c88a60 msgr2=0x55f2c4d771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- 172.21.15.72:0/2224236473 shutdown_connections 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- 172.21.15.72:0/2224236473 wait complete. 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 Processor -- start 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- start start 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d828a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f2c4c99e30 con 0x55f2c4c02890 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d828a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39206/0 (socket says 172.21.15.72:39206) 2024-04-26T12:52:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f142fd14640 1 -- 172.21.15.72:0/516759326 learned_addr learned my addr 172.21.15.72:0/516759326 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f142fd14640 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c4d82de0 con 0x55f2c4c02890 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f142fd14640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d828a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f142801b0d0 tx=0x7f1428017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f1317fff640 1 -- 172.21.15.72:0/516759326 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280b9030 con 0x55f2c4c02890 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c4d83070 con 0x55f2c4c02890 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f1317fff640 1 -- 172.21.15.72:0/516759326 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14280c3070 con 0x55f2c4c02890 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f1317fff640 1 -- 172.21.15.72:0/516759326 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280bf620 con 0x55f2c4c02890 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.352+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c4d85cb0 con 0x55f2c4c02890 2024-04-26T12:52:07.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1317fff640 1 -- 172.21.15.72:0/516759326 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f14280c5030 con 0x55f2c4c02890 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1317fff640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1318034650 0x7f1318036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1317fff640 1 -- 172.21.15.72:0/516759326 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f14280ba070 con 0x55f2c4c02890 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f142f513640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1318034650 0x7f1318036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4c938c0 0x55f2c4d89790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4d89dd0 con 0x55f2c4c938c0 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1430515640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4c938c0 0x55f2c4d89790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f142f513640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1318034650 0x7f1318036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1424000f70 tx=0x7f1424001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1430515640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4c938c0 0x55f2c4d89790 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1430515640 1 -- 172.21.15.72:0/516759326 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4c938c0 2024-04-26T12:52:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4d86ed0 con 0x55f2c4c938c0 2024-04-26T12:52:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1430515640 1 -- 172.21.15.72:0/516759326 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4c938c0 2024-04-26T12:52:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4d8c100 0x55f2c4d8e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4d8ebc0 con 0x55f2c4d8c100 2024-04-26T12:52:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f142fd14640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4d8c100 0x55f2c4d8e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f142fd14640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4d8c100 0x55f2c4d8e4f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f142fd14640 1 -- 172.21.15.72:0/516759326 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4d8c100 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4d8afa0 con 0x55f2c4c938c0 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f1430515640 1 -- 172.21.15.72:0/516759326 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4c938c0 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4d90000 0x55f2c4d923f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4d92b80 con 0x55f2c4d90000 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.356+0000 7f142f513640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4d90000 0x55f2c4d923f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142f513640 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4d90000 0x55f2c4d923f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142f513640 1 -- 172.21.15.72:0/516759326 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f142400f6a0 con 0x55f2c4d90000 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f14321f9980 1 Processor -- start 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f14321f9980 1 -- start start 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f14321f9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4da0bd0 0x55f2c4da0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f14321f9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f2c4b95ab0 con 0x55f2c4da0bd0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4da0bd0 0x55f2c4da0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4da0bd0 0x55f2c4da0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39222/0 (socket says 172.21.15.72:39222) 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142fd14640 1 -- 172.21.15.72:0/2714232266 learned_addr learned my addr 172.21.15.72:0/2714232266 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142fd14640 1 -- 172.21.15.72:0/2714232266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c4da1530 con 0x55f2c4da0bd0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142fd14640 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4da0bd0 0x55f2c4da0ff0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f14280a4070 tx=0x7f14280c6b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f13157fa640 1 -- 172.21.15.72:0/2714232266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280cc040 con 0x55f2c4da0bd0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f13157fa640 1 -- 172.21.15.72:0/2714232266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14280a9a90 con 0x55f2c4da0bd0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c4da1fd0 con 0x55f2c4da0bd0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f13157fa640 1 -- 172.21.15.72:0/2714232266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280bf930 con 0x55f2c4da0bd0 2024-04-26T12:52:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c4da24a0 con 0x55f2c4da0bd0 2024-04-26T12:52:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f13157fa640 1 -- 172.21.15.72:0/2714232266 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f14280e0040 con 0x55f2c4da0bd0 2024-04-26T12:52:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f13157fa640 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1308034650 0x7f1308036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f13157fa640 1 -- 172.21.15.72:0/2714232266 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f14280e9d50 con 0x55f2c4da0bd0 2024-04-26T12:52:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.360+0000 7f142f513640 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1308034650 0x7f1308036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 Processor -- start 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- start start 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142f513640 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1308034650 0x7f1308036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55f2c4d92f80 tx=0x7f142400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4dadf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f2c4d7bec0 con 0x55f2c4dadb50 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4dadf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4dadf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39226/0 (socket says 172.21.15.72:39226) 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 -- 172.21.15.72:0/707495355 learned_addr learned my addr 172.21.15.72:0/707495355 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 -- 172.21.15.72:0/707495355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c4dae500 con 0x55f2c4dadb50 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 --2- 172.21.15.72:0/707495355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4dadf30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f14280c65a0 tx=0x7f14280db690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595d722c267128a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f130effd640 1 -- 172.21.15.72:0/707495355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280b4d60 con 0x55f2c4dadb50 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f130effd640 1 -- 172.21.15.72:0/707495355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14280dcae0 con 0x55f2c4dadb50 2024-04-26T12:52:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f130effd640 1 -- 172.21.15.72:0/707495355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280d30e0 con 0x55f2c4dadb50 2024-04-26T12:52:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- 172.21.15.72:0/707495355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 msgr2=0x55f2c4dadf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 --2- 172.21.15.72:0/707495355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4dadf30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f14280c65a0 tx=0x7f14280db690 comp rx=0 tx=0).stop 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- 172.21.15.72:0/707495355 shutdown_connections 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 --2- 172.21.15.72:0/707495355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4dadf30 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- 172.21.15.72:0/707495355 >> 172.21.15.72:0/707495355 conn(0x55f2c4da9ee0 msgr2=0x55f2c4da7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- 172.21.15.72:0/707495355 shutdown_connections 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- 172.21.15.72:0/707495355 wait complete. 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 Processor -- start 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- start start 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4db4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f14321f9980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f2c4daead0 con 0x55f2c4dadb50 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4db4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4db4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39230/0 (socket says 172.21.15.72:39230) 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 learned_addr learned my addr 172.21.15.72:0/332975436 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c4db5310 con 0x55f2c4dadb50 2024-04-26T12:52:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.364+0000 7f142fd14640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4db4dd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f14280d1fd0 tx=0x7f14280e3fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f130d7fa640 1 -- 172.21.15.72:0/332975436 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1428109020 con 0x55f2c4dadb50 2024-04-26T12:52:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f130d7fa640 1 -- 172.21.15.72:0/332975436 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14280e3590 con 0x55f2c4dadb50 2024-04-26T12:52:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c4db5310 con 0x55f2c4dadb50 2024-04-26T12:52:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f130d7fa640 1 -- 172.21.15.72:0/332975436 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14280c7410 con 0x55f2c4dadb50 2024-04-26T12:52:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c4db5310 con 0x55f2c4dadb50 2024-04-26T12:52:07.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f130d7fa640 1 -- 172.21.15.72:0/332975436 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f142810c020 con 0x55f2c4dadb50 2024-04-26T12:52:07.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f130d7fa640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f12f8034650 0x7f12f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f130d7fa640 1 -- 172.21.15.72:0/332975436 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1428100070 con 0x55f2c4dadb50 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f142f513640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f12f8034650 0x7f12f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4dbff80 0x55f2c4dc2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc2b90 con 0x55f2c4dbff80 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f1430515640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4dbff80 0x55f2c4dc2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f142f513640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f12f8034650 0x7f12f8036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f142400c010 tx=0x7f1424010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f1430515640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4dbff80 0x55f2c4dc2440 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4dbff80 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 realm 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc2fa0 con 0x55f2c4dbff80 2024-04-26T12:52:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4dbff80 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3840 con 0x55f2c4dbff80 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4dbff80 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dbff80 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4dbff80 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4dc4940 0x55f2c4dc6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc73d0 con 0x55f2c4dc4940 2024-04-26T12:52:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.368+0000 7f142fd14640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4dc4940 0x55f2c4dc6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142fd14640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4dc4940 0x55f2c4dc6d30 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f14321f9980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f14321f9980 20 searching for the correct realm 2024-04-26T12:52:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4dc92b0 0x55f2c4dcb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcbda0 con 0x55f2c4dc92b0 2024-04-26T12:52:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142f513640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4dc92b0 0x55f2c4dcb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142f513640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4dc92b0 0x55f2c4dcb720 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142f513640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f142401fbe0 0x7f142403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcbda0 con 0x7f142401fbe0 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f1430515640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f142401fbe0 0x7f142403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f1430515640 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f142401fbe0 0x7f142403a3c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14200083f0 con 0x7f142401fbe0 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dc4940 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.372+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dbff80 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14200083f0 con 0x55f2c4dbff80 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dbff80 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dc4940 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dc4940 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x7f142401fbe0 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dc92b0 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dbff80 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x7f142401fbe0 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dbff80 2024-04-26T12:52:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x7f142401fbe0 2024-04-26T12:52:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.376+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc4940 2024-04-26T12:52:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dbff80 2024-04-26T12:52:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dbff80 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc4940 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x7f142401fbe0 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dbff80 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc4940 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.380+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc4940 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x7f142401fbe0 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dc4940 2024-04-26T12:52:07.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x55f2c4dbff80 2024-04-26T12:52:07.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f142002b040 con 0x7f142401fbe0 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dbff80 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dbff80 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc3be0 con 0x55f2c4dc92b0 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 zone default found 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 4 Realm: () 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 zonegroup default 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.384+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dc8270 con 0x55f2c4dc4940 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcdc00 con 0x55f2c4dc92b0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcdfa0 con 0x55f2c4dc92b0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 20 started sync module instance, tier type = 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcd0a0 con 0x7f142401fbe0 2024-04-26T12:52:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94501173253536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcd0a0 con 0x7f142401fbe0 2024-04-26T12:52:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.388+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dce960 con 0x55f2c4dbff80 2024-04-26T12:52:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94501173253536] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94501173251328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dce960 con 0x55f2c4dbff80 2024-04-26T12:52:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcf320 con 0x55f2c4dc92b0 2024-04-26T12:52:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94501173259888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcfb70 con 0x55f2c4dc92b0 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd0530 con 0x7f142401fbe0 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94501173251328] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94501173264512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd04a0 con 0x7f142401fbe0 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.392+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd12b0 con 0x55f2c4dbff80 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94501173259888] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94501173264512] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94501173262016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd0d70 con 0x55f2c4dbff80 2024-04-26T12:52:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd1600 con 0x55f2c4dc4940 2024-04-26T12:52:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94501173262016] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94501173266896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd19f0 con 0x55f2c4dc4940 2024-04-26T12:52:07.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.396+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd23b0 con 0x55f2c4dc4940 2024-04-26T12:52:07.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.400+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.400+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94501173274448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd3020 con 0x55f2c4dc4940 2024-04-26T12:52:07.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.400+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd39e0 con 0x55f2c4dc4940 2024-04-26T12:52:07.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.400+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94501173266896] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.400+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94501173274448] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94501173275504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd2f90 con 0x55f2c4dc4940 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=0 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=1 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=2 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=3 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=4 2024-04-26T12:52:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=5 2024-04-26T12:52:07.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=6 2024-04-26T12:52:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94501173275504] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 add_watcher() i=7 2024-04-26T12:52:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd6a10 con 0x55f2c4dbff80 2024-04-26T12:52:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94501173278000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd3e00 con 0x55f2c4dbff80 2024-04-26T12:52:07.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94501173278000] v35'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f12e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:07.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.404+0000 7f14321f9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:07.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 5 note: GC not initialized 2024-04-26T12:52:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f12e4fe1640 20 reqs_thread_entry: start 2024-04-26T12:52:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 20 Filter name: none 2024-04-26T12:52:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f125e7fc640 20 reqs_thread_entry: start 2024-04-26T12:52:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dfa160 con 0x55f2c4dc4940 2024-04-26T12:52:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T12:52:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.408+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4e00a90 con 0x55f2c4dc4940 2024-04-26T12:52:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f14321f9980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f14321f9980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f14321f9980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94501173462272 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dfc1a0 con 0x55f2c4dbff80 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94501173262016 notify 150323855393 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f1420010040 con 0x55f2c4dbff80 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f130effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855393 cookie 94501173262016 notifier 4916 bl.length()=636 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f130effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94501173462272 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f130effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f130effd640 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f12f4003eb0 con 0x55f2c4dbff80 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== watch-notify(notify_complete (2) cookie 94501173462272 notify 150323855393 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f142000aad0 con 0x55f2c4dbff80 2024-04-26T12:52:07.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.415 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:07.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f12e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94501173278000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4df7e60 con 0x55f2c4dbff80 2024-04-26T12:52:07.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94501173278000] v35'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.412+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94501173253536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4df7e60 con 0x7f142401fbe0 2024-04-26T12:52:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.416+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94501173253536] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.416+0000 7f14321f9980 20 remove_watcher() i=0 2024-04-26T12:52:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.416+0000 7f14321f9980 2 removed watcher, disabling cache 2024-04-26T12:52:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.416+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94501173251328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4df7e60 con 0x55f2c4dbff80 2024-04-26T12:52:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.416+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94501173251328] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.416+0000 7f14321f9980 20 remove_watcher() i=1 2024-04-26T12:52:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.416+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94501173259888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4df7e60 con 0x55f2c4dc92b0 2024-04-26T12:52:07.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.420+0000 7f142f513640 1 -- 172.21.15.72:0/332975436 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94501173259888] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1424037040 con 0x55f2c4dc92b0 2024-04-26T12:52:07.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.420+0000 7f14321f9980 20 remove_watcher() i=2 2024-04-26T12:52:07.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.420+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94501173264512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcd5a0 con 0x7f142401fbe0 2024-04-26T12:52:07.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.420+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94501173264512] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x7f142401fbe0 2024-04-26T12:52:07.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.420+0000 7f14321f9980 20 remove_watcher() i=3 2024-04-26T12:52:07.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.420+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94501173262016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcee70 con 0x55f2c4dbff80 2024-04-26T12:52:07.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.424+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94501173262016] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1420026040 con 0x55f2c4dbff80 2024-04-26T12:52:07.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.424+0000 7f14321f9980 20 remove_watcher() i=4 2024-04-26T12:52:07.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.424+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94501173266896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dd0080 con 0x55f2c4dc4940 2024-04-26T12:52:07.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.424+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94501173266896] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.424+0000 7f14321f9980 20 remove_watcher() i=5 2024-04-26T12:52:07.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.424+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94501173274448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcd5a0 con 0x55f2c4dc4940 2024-04-26T12:52:07.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94501173274448] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 20 remove_watcher() i=6 2024-04-26T12:52:07.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94501173275504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f2c4dcee70 con 0x55f2c4dc4940 2024-04-26T12:52:07.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f142fd14640 1 -- 172.21.15.72:0/332975436 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94501173275504] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14280ce070 con 0x55f2c4dc4940 2024-04-26T12:52:07.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 20 remove_watcher() i=7 2024-04-26T12:52:07.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4dc4940 msgr2=0x55f2c4dc6d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4dc4940 0x55f2c4dc6d30 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4dbff80 msgr2=0x55f2c4dc2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4dbff80 0x55f2c4dc2440 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f142401fbe0 msgr2=0x7f142403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f142401fbe0 0x7f142403a3c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4dc92b0 msgr2=0x55f2c4dcb720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4dc92b0 0x55f2c4dcb720 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f12f8034650 msgr2=0x7f12f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f12f8034650 0x7f12f8036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f142400c010 tx=0x7f1424010000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 msgr2=0x55f2c4db4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f1430515640 1 -- 172.21.15.72:0/332975436 reap_dead start 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4db4dd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f14280d1fd0 tx=0x7f14280e3fa0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 shutdown_connections 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/332975436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4dadb50 0x55f2c4db4dd0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 >> 172.21.15.72:0/332975436 conn(0x55f2c4da9ee0 msgr2=0x55f2c4da7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 shutdown_connections 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/332975436 wait complete. 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1308034650 msgr2=0x7f1308036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1308034650 0x7f1308036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55f2c4d92f80 tx=0x7f142400f000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4da0bd0 msgr2=0x55f2c4da0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4da0bd0 0x55f2c4da0ff0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f14280a4070 tx=0x7f14280c6b60 comp rx=0 tx=0).stop 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 shutdown_connections 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1308034650 0x7f1308036b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/2714232266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4da0bd0 0x55f2c4da0ff0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 >> 172.21.15.72:0/2714232266 conn(0x55f2c4d959e0 msgr2=0x55f2c4d964f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 shutdown_connections 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/2714232266 wait complete. 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4d8c100 msgr2=0x55f2c4d8e4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55f2c4d8c100 0x55f2c4d8e4f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4c938c0 msgr2=0x55f2c4d89790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55f2c4c938c0 0x55f2c4d89790 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4d90000 msgr2=0x55f2c4d923f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55f2c4d90000 0x55f2c4d923f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1318034650 msgr2=0x7f1318036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1318034650 0x7f1318036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1424000f70 tx=0x7f1424001380 comp rx=0 tx=0).stop 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 msgr2=0x55f2c4d828a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 --2- 172.21.15.72:0/516759326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f2c4c02890 0x55f2c4d828a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f142801b0d0 tx=0x7f1428017e30 comp rx=0 tx=0).stop 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f1430515640 1 -- 172.21.15.72:0/516759326 reap_dead start 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 shutdown_connections 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 >> 172.21.15.72:0/516759326 conn(0x55f2c4c88a60 msgr2=0x55f2c4d75d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 shutdown_connections 2024-04-26T12:52:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.428+0000 7f14321f9980 1 -- 172.21.15.72:0/516759326 wait complete. 2024-04-26T12:52:07.440 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.441 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.441 ERROR:root:0 2024-04-26T12:52:07.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:07.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:07.441 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T12:52:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40db9cd980 1 Processor -- start 2024-04-26T12:52:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40db9cd980 1 -- start start 2024-04-26T12:52:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40db9cd980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c0425fa040 0x55c042688f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40db9cd980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c042533510 con 0x55c0426894a0 2024-04-26T12:52:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40db9cd980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55c04253a430 con 0x55c0425fa040 2024-04-26T12:52:07.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40d94e8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55c0425fa040 0x55c042688f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40d8ce7640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55c0426894a0 0x55c04268b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48872/0 (socket says 172.21.15.72:48872) 2024-04-26T12:52:07.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40d8ce7640 1 -- 172.21.15.72:0/1320889404 learned_addr learned my addr 172.21.15.72:0/1320889404 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-04-26T12:52:07.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40d94e8640 1 -- 172.21.15.72:0/1320889404 >> v1:172.21.15.29:6789/0 conn(0x55c0426894a0 legacy=0x55c04268b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.520+0000 7f40d94e8640 1 -- 172.21.15.72:0/1320889404 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04250fae0 con 0x55c0425fa040 2024-04-26T12:52:07.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40d94e8640 1 --2- 172.21.15.72:0/1320889404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042688f60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00a480 tx=0x7f40cc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4fc38e1e244ab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40cbfff640 1 -- 172.21.15.72:0/1320889404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0b0070 con 0x55c0425fa040 2024-04-26T12:52:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40cbfff640 1 -- 172.21.15.72:0/1320889404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc0ab540 con 0x55c0425fa040 2024-04-26T12:52:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40cbfff640 1 -- 172.21.15.72:0/1320889404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0ab840 con 0x55c0425fa040 2024-04-26T12:52:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40db9cd980 1 -- 172.21.15.72:0/1320889404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 msgr2=0x55c042688f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1320889404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042688f60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00a480 tx=0x7f40cc01b280 comp rx=0 tx=0).stop 2024-04-26T12:52:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40db9cd980 1 -- 172.21.15.72:0/1320889404 shutdown_connections 2024-04-26T12:52:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1320889404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042688f60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40db9cd980 1 -- 172.21.15.72:0/1320889404 >> 172.21.15.72:0/1320889404 conn(0x55c042680a80 msgr2=0x55c042682ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40db9cd980 1 -- 172.21.15.72:0/1320889404 shutdown_connections 2024-04-26T12:52:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.524+0000 7f40db9cd980 1 -- 172.21.15.72:0/1320889404 wait complete. 2024-04-26T12:52:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.536+0000 7f40db9cd980 1 Processor -- start 2024-04-26T12:52:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.536+0000 7f40db9cd980 1 -- start start 2024-04-26T12:52:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.536+0000 7f40db9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042771520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.536+0000 7f40db9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c042589a70 con 0x55c0425fa040 2024-04-26T12:52:07.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.536+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042771520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.536+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042771520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39240/0 (socket says 172.21.15.72:39240) 2024-04-26T12:52:07.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.536+0000 7f40d94e8640 1 -- 172.21.15.72:0/819838113 learned_addr learned my addr 172.21.15.72:0/819838113 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40d94e8640 1 -- 172.21.15.72:0/819838113 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c042771af0 con 0x55c0425fa040 2024-04-26T12:52:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40d94e8640 1 --2- 172.21.15.72:0/819838113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042771520 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0ae040 tx=0x7f40cc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03bf281fe701613 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f3fc7606640 1 -- 172.21.15.72:0/819838113 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0b0040 con 0x55c0425fa040 2024-04-26T12:52:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f3fc7606640 1 -- 172.21.15.72:0/819838113 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc0ab9d0 con 0x55c0425fa040 2024-04-26T12:52:07.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f3fc7606640 1 -- 172.21.15.72:0/819838113 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0abcf0 con 0x55c0425fa040 2024-04-26T12:52:07.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- 172.21.15.72:0/819838113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 msgr2=0x55c042771520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 --2- 172.21.15.72:0/819838113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042771520 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0ae040 tx=0x7f40cc003030 comp rx=0 tx=0).stop 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- 172.21.15.72:0/819838113 shutdown_connections 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 --2- 172.21.15.72:0/819838113 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042771520 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- 172.21.15.72:0/819838113 >> 172.21.15.72:0/819838113 conn(0x55c042680a80 msgr2=0x55c04276d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- 172.21.15.72:0/819838113 shutdown_connections 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- 172.21.15.72:0/819838113 wait complete. 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 Processor -- start 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- start start 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042778620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c04268dac0 con 0x55c0425fa040 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042778620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042778620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39242/0 (socket says 172.21.15.72:39242) 2024-04-26T12:52:07.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40d94e8640 1 -- 172.21.15.72:0/1703621715 learned_addr learned my addr 172.21.15.72:0/1703621715 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40d94e8640 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c042778b60 con 0x55c0425fa040 2024-04-26T12:52:07.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40d94e8640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042778620 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f40cc018eb0 tx=0x7f40cc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f3fc5e03640 1 -- 172.21.15.72:0/1703621715 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0b0070 con 0x55c0425fa040 2024-04-26T12:52:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c042778df0 con 0x55c0425fa040 2024-04-26T12:52:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f3fc5e03640 1 -- 172.21.15.72:0/1703621715 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc0b68f0 con 0x55c0425fa040 2024-04-26T12:52:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f3fc5e03640 1 -- 172.21.15.72:0/1703621715 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0b6bd0 con 0x55c0425fa040 2024-04-26T12:52:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.540+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04277ba20 con 0x55c0425fa040 2024-04-26T12:52:07.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f3fc5e03640 1 -- 172.21.15.72:0/1703621715 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40cc0bf3f0 con 0x55c0425fa040 2024-04-26T12:52:07.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f3fc5e03640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc0034650 0x7f3fc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f3fc5e03640 1 -- 172.21.15.72:0/1703621715 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f40cc0bc070 con 0x55c0425fa040 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0426894a0 0x55c04277f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c04277fb20 con 0x55c0426894a0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc0034650 0x7f3fc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d9ce9640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0426894a0 0x55c04277f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d9ce9640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0426894a0 0x55c04277f500 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc0034650 0x7f3fc0036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000f70 tx=0x7f40d00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d9ce9640 1 -- 172.21.15.72:0/1703621715 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0426894a0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c04277cc20 con 0x55c0426894a0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d9ce9640 1 -- 172.21.15.72:0/1703621715 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0426894a0 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c042781ea0 0x55c042784290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c042784980 con 0x55c042781ea0 2024-04-26T12:52:07.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d94e8640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c042781ea0 0x55c042784290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.544+0000 7f40d94e8640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c042781ea0 0x55c042784290 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d94e8640 1 -- 172.21.15.72:0/1703621715 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c042781ea0 2024-04-26T12:52:07.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c042780d40 con 0x55c0426894a0 2024-04-26T12:52:07.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d9ce9640 1 -- 172.21.15.72:0/1703621715 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0426894a0 2024-04-26T12:52:07.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c042785de0 0x55c0427881d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c042788910 con 0x55c042785de0 2024-04-26T12:52:07.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c042785de0 0x55c0427881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c042785de0 0x55c0427881d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d8ce7640 1 -- 172.21.15.72:0/1703621715 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40d000e620 con 0x55c042785de0 2024-04-26T12:52:07.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 Processor -- start 2024-04-26T12:52:07.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 -- start start 2024-04-26T12:52:07.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427969a0 0x55c042796dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c04258dab0 con 0x55c0427969a0 2024-04-26T12:52:07.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427969a0 0x55c042796dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427969a0 0x55c042796dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39250/0 (socket says 172.21.15.72:39250) 2024-04-26T12:52:07.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d94e8640 1 -- 172.21.15.72:0/751231499 learned_addr learned my addr 172.21.15.72:0/751231499 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d94e8640 1 -- 172.21.15.72:0/751231499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c042797300 con 0x55c0427969a0 2024-04-26T12:52:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40d94e8640 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427969a0 0x55c042796dc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0e3060 tx=0x7f40cc0b5cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f3fbeffd640 1 -- 172.21.15.72:0/751231499 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0dce70 con 0x55c0427969a0 2024-04-26T12:52:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f3fbeffd640 1 -- 172.21.15.72:0/751231499 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc0e4bc0 con 0x55c0427969a0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c042797da0 con 0x55c0427969a0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f3fbeffd640 1 -- 172.21.15.72:0/751231499 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0b5760 con 0x55c0427969a0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.548+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c042798270 con 0x55c0427969a0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f3fbeffd640 1 -- 172.21.15.72:0/751231499 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40cc0b5900 con 0x55c0427969a0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f3fbeffd640 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb0034650 0x7f3fb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f3fbeffd640 1 -- 172.21.15.72:0/751231499 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f40cc0d6050 con 0x55c0427969a0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb0034650 0x7f3fb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 Processor -- start 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 -- start start 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb0034650 0x7f3fb0036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f40d000bf60 tx=0x7f40d000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c042771d80 con 0x55c0427a3900 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427a3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39256/0 (socket says 172.21.15.72:39256) 2024-04-26T12:52:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40d94e8640 1 -- 172.21.15.72:0/191872221 learned_addr learned my addr 172.21.15.72:0/191872221 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40d94e8640 1 -- 172.21.15.72:0/191872221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0427a42f0 con 0x55c0427a3900 2024-04-26T12:52:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40d94e8640 1 --2- 172.21.15.72:0/191872221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427a3d20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0e1010 tx=0x7f40cc0dc300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721a2b85dfd7e405 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f3fbcff9640 1 -- 172.21.15.72:0/191872221 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0be7d0 con 0x55c0427a3900 2024-04-26T12:52:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f3fbcff9640 1 -- 172.21.15.72:0/191872221 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc0dae60 con 0x55c0427a3900 2024-04-26T12:52:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f3fbcff9640 1 -- 172.21.15.72:0/191872221 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0e18f0 con 0x55c0427a3900 2024-04-26T12:52:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 -- 172.21.15.72:0/191872221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 msgr2=0x55c0427a3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 --2- 172.21.15.72:0/191872221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427a3d20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0e1010 tx=0x7f40cc0dc300 comp rx=0 tx=0).stop 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 -- 172.21.15.72:0/191872221 shutdown_connections 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 --2- 172.21.15.72:0/191872221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427a3d20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 -- 172.21.15.72:0/191872221 >> 172.21.15.72:0/191872221 conn(0x55c04279fc90 msgr2=0x55c04279dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 -- 172.21.15.72:0/191872221 shutdown_connections 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 -- 172.21.15.72:0/191872221 wait complete. 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.552+0000 7f40db9cd980 1 Processor -- start 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 1 -- start start 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c0427a42f0 con 0x55c0427a3900 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d94e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39272/0 (socket says 172.21.15.72:39272) 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 learned_addr learned my addr 172.21.15.72:0/3320251166 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0427aafe0 con 0x55c0427a3900 2024-04-26T12:52:07.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d94e8640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427aaaa0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0e2e00 tx=0x7f40cc0c8210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f3faeffd640 1 -- 172.21.15.72:0/3320251166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc106020 con 0x55c0427a3900 2024-04-26T12:52:07.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f3faeffd640 1 -- 172.21.15.72:0/3320251166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc0c8020 con 0x55c0427a3900 2024-04-26T12:52:07.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0427aafe0 con 0x55c0427a3900 2024-04-26T12:52:07.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f3faeffd640 1 -- 172.21.15.72:0/3320251166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40cc0bf8a0 con 0x55c0427a3900 2024-04-26T12:52:07.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0427ab450 con 0x55c0427a3900 2024-04-26T12:52:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f3faeffd640 1 -- 172.21.15.72:0/3320251166 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40cc109020 con 0x55c0427a3900 2024-04-26T12:52:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f3faeffd640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa4034650 0x7f3fa4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f3faeffd640 1 -- 172.21.15.72:0/3320251166 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f40cc0fc050 con 0x55c0427a3900 2024-04-26T12:52:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa4034650 0x7f3fa4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0427b59d0 0x55c0427b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b85e0 con 0x55c0427b59d0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d9ce9640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0427b59d0 0x55c0427b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa4034650 0x7f3fa4036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55c042780040 tx=0x7f40d0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.556+0000 7f40d9ce9640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0427b59d0 0x55c0427b7e90 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 realm 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b89f0 con 0x55c0427b59d0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9290 con 0x55c0427b59d0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0427ba390 0x55c0427bc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427bce20 con 0x55c0427ba390 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d94e8640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0427ba390 0x55c0427bc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d94e8640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0427ba390 0x55c0427bc780 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 20 searching for the correct realm 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0427bed00 0x55c0427c1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c17f0 con 0x55c0427bed00 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0427bed00 0x55c0427c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0427bed00 0x55c0427c1170 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d8ce7640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40d0037040 0x7f40d0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.560+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c17f0 con 0x7f40d0037040 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40d0037040 0x7f40d0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40d0037040 0x7f40d0036410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d400a4d0 con 0x7f40d0037040 2024-04-26T12:52:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x7f40d0037040 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d400a4d0 con 0x7f40d0037040 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.564+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x7f40d0037040 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d400a4d0 con 0x7f40d0037040 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d400a4d0 con 0x55c0427b59d0 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x7f40d0037040 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40d4032040 con 0x7f40d0037040 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d4032040 con 0x55c0427b59d0 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40d4032040 con 0x55c0427b59d0 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.568+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x7f40d0037040 2024-04-26T12:52:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d4032040 con 0x7f40d0037040 2024-04-26T12:52:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d4032040 con 0x55c0427b59d0 2024-04-26T12:52:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x7f40d0037040 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d4032040 con 0x7f40d0037040 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427bed00 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427ba390 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x55c0427b59d0 2024-04-26T12:52:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40d4032040 con 0x55c0427b59d0 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.572+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0427b9630 con 0x7f40d0037040 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d4032040 con 0x7f40d0037040 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427bd670 con 0x55c0427b59d0 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d4032040 con 0x55c0427b59d0 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427bd670 con 0x55c0427b59d0 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40d4032040 con 0x55c0427b59d0 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427bd670 con 0x55c0427bed00 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 zone default found 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 4 Realm: () 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 zonegroup default 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427be000 con 0x55c0427ba390 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427bdbb0 con 0x55c0427bed00 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c3c30 con 0x55c0427bed00 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 started sync module instance, tier type = 2024-04-26T12:52:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c2f90 con 0x7f40d0037040 2024-04-26T12:52:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4032040 con 0x7f40d0037040 2024-04-26T12:52:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94284237517968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c2f90 con 0x7f40d0037040 2024-04-26T12:52:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.576+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c46b0 con 0x55c0427b59d0 2024-04-26T12:52:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.580+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94284237517968] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x7f40d0037040 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.580+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.580+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94284237515760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c46b0 con 0x55c0427b59d0 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.580+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c5070 con 0x55c0427bed00 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.580+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.580+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94284237523904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c58c0 con 0x55c0427bed00 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.580+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c62e0 con 0x7f40d0037040 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94284237515760] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x7f40d0037040 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94284237528528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c66d0 con 0x7f40d0037040 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c7090 con 0x55c0427b59d0 2024-04-26T12:52:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94284237523904] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94284237528528] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x7f40d0037040 2024-04-26T12:52:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94284237521408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c6be0 con 0x55c0427b59d0 2024-04-26T12:52:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.584+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c7430 con 0x55c0427ba390 2024-04-26T12:52:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94284237521408] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94284237532128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c7000 con 0x55c0427ba390 2024-04-26T12:52:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c8130 con 0x55c0427ba390 2024-04-26T12:52:07.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94284237536384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c8550 con 0x55c0427ba390 2024-04-26T12:52:07.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c9070 con 0x55c0427ba390 2024-04-26T12:52:07.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.588+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94284237532128] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94284237536384] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94284237540160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c80a0 con 0x55c0427ba390 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=0 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=1 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=2 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=3 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=4 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=5 2024-04-26T12:52:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=6 2024-04-26T12:52:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94284237540160] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 20 add_watcher() i=7 2024-04-26T12:52:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427cc170 con 0x55c0427b59d0 2024-04-26T12:52:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.592+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94284237535184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427c95f0 con 0x55c0427b59d0 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94284237535184] v35'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f3f8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 5 note: GC not initialized 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f3f8e7e4640 20 reqs_thread_entry: start 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 20 Filter name: none 2024-04-26T12:52:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f3efffff640 20 reqs_thread_entry: start 2024-04-26T12:52:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427ef7b0 con 0x55c0427ba390 2024-04-26T12:52:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T12:52:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.596+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f5db0 con 0x55c0427ba390 2024-04-26T12:52:07.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40db9cd980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40db9cd980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40db9cd980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94284237723680 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f1440 con 0x55c0427b59d0 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94284237521408 notify 150323855394 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f40d4018960 con 0x55c0427b59d0 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f3fbcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855394 cookie 94284237521408 notifier 4923 bl.length()=649 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f3fbcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f3fbcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94284237723680 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f3fbcff9640 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3f9c003eb0 con 0x55c0427b59d0 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== watch-notify(notify_complete (2) cookie 94284237723680 notify 150323855394 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40d4018c00 con 0x55c0427b59d0 2024-04-26T12:52:07.604 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:07.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f3f8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.600+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94284237535184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f50c0 con 0x55c0427b59d0 2024-04-26T12:52:07.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.604+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94284237535184] v35'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.604+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94284237517968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f50c0 con 0x7f40d0037040 2024-04-26T12:52:07.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.604+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94284237517968] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x7f40d0037040 2024-04-26T12:52:07.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.604+0000 7f40db9cd980 20 remove_watcher() i=0 2024-04-26T12:52:07.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.604+0000 7f40db9cd980 2 removed watcher, disabling cache 2024-04-26T12:52:07.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.604+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94284237515760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f50c0 con 0x55c0427b59d0 2024-04-26T12:52:07.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94284237515760] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40db9cd980 20 remove_watcher() i=1 2024-04-26T12:52:07.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94284237523904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f50c0 con 0x55c0427bed00 2024-04-26T12:52:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40d8ce7640 1 -- 172.21.15.72:0/3320251166 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94284237523904] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d000e620 con 0x55c0427bed00 2024-04-26T12:52:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40db9cd980 20 remove_watcher() i=2 2024-04-26T12:52:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94284237528528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f50c0 con 0x7f40d0037040 2024-04-26T12:52:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94284237528528] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x7f40d0037040 2024-04-26T12:52:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40db9cd980 20 remove_watcher() i=3 2024-04-26T12:52:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.608+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94284237521408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f50c0 con 0x55c0427b59d0 2024-04-26T12:52:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.612+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94284237521408] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d4040040 con 0x55c0427b59d0 2024-04-26T12:52:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.612+0000 7f40db9cd980 20 remove_watcher() i=4 2024-04-26T12:52:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.612+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94284237532128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427f50c0 con 0x55c0427ba390 2024-04-26T12:52:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.612+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94284237532128] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.612+0000 7f40db9cd980 20 remove_watcher() i=5 2024-04-26T12:52:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.612+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94284237536384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427ed4b0 con 0x55c0427ba390 2024-04-26T12:52:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94284237536384] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 20 remove_watcher() i=6 2024-04-26T12:52:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94284237540160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0427ed4b0 con 0x55c0427ba390 2024-04-26T12:52:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40d94e8640 1 -- 172.21.15.72:0/3320251166 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94284237540160] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40cc0b3040 con 0x55c0427ba390 2024-04-26T12:52:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 20 remove_watcher() i=7 2024-04-26T12:52:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0427ba390 msgr2=0x55c0427bc780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c0427ba390 0x55c0427bc780 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0427b59d0 msgr2=0x55c0427b7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0427b59d0 0x55c0427b7e90 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40d0037040 msgr2=0x7f40d0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f40d0037040 0x7f40d0036410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0427bed00 msgr2=0x55c0427c1170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c0427bed00 0x55c0427c1170 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa4034650 msgr2=0x7f3fa4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fa4034650 0x7f3fa4036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55c042780040 tx=0x7f40d0010000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 msgr2=0x55c0427aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/3320251166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427a3900 0x55c0427aaaa0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0e2e00 tx=0x7f40cc0c8210 comp rx=0 tx=0).stop 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 reap_dead start 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40d9ce9640 1 -- 172.21.15.72:0/3320251166 reap_dead start 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 shutdown_connections 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 >> 172.21.15.72:0/3320251166 conn(0x55c04279fc90 msgr2=0x55c04279d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 shutdown_connections 2024-04-26T12:52:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/3320251166 wait complete. 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb0034650 msgr2=0x7f3fb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb0034650 0x7f3fb0036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f40d000bf60 tx=0x7f40d000f000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427969a0 msgr2=0x55c042796dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427969a0 0x55c042796dc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0e3060 tx=0x7f40cc0b5cf0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 shutdown_connections 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fb0034650 0x7f3fb0036b10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.616+0000 7f40db9cd980 1 --2- 172.21.15.72:0/751231499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0427969a0 0x55c042796dc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 >> 172.21.15.72:0/751231499 conn(0x55c04278b7b0 msgr2=0x55c04278c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 shutdown_connections 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/751231499 wait complete. 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c042781ea0 msgr2=0x55c042784290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55c042781ea0 0x55c042784290 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0426894a0 msgr2=0x55c04277f500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55c0426894a0 0x55c04277f500 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c042785de0 msgr2=0x55c0427881d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55c042785de0 0x55c0427881d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc0034650 msgr2=0x7f3fc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f3fc0034650 0x7f3fc0036b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f40d0000f70 tx=0x7f40d00012c0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 msgr2=0x55c042778620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 --2- 172.21.15.72:0/1703621715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c0425fa040 0x55c042778620 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f40cc018eb0 tx=0x7f40cc018020 comp rx=0 tx=0).stop 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40d9ce9640 1 -- 172.21.15.72:0/1703621715 reap_dead start 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 shutdown_connections 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 >> 172.21.15.72:0/1703621715 conn(0x55c042680a80 msgr2=0x55c04276bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 shutdown_connections 2024-04-26T12:52:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.620+0000 7f40db9cd980 1 -- 172.21.15.72:0/1703621715 wait complete. 2024-04-26T12:52:07.629 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.629 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.630 ERROR:root:0 2024-04-26T12:52:07.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:07.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:52:07.630 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T12:52:07.700 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:52:07.701 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:52:07.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2dffb980 1 Processor -- start 2024-04-26T12:52:07.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2dffb980 1 -- start start 2024-04-26T12:52:07.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2dffb980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5631fee69d90 0x5631feef7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2dffb980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631feda2510 con 0x5631fee6b080 2024-04-26T12:52:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2dffb980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x5631feda9430 con 0x5631fee69d90 2024-04-26T12:52:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2b315640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5631fee69d90 0x5631feef7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2b315640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x5631fee69d90 0x5631feef7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39280/0 (socket says 172.21.15.72:39280) 2024-04-26T12:52:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2b315640 1 -- 172.21.15.72:0/3944344782 learned_addr learned my addr 172.21.15.72:0/3944344782 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2bb16640 1 --1- 172.21.15.72:0/3944344782 >> v1:172.21.15.29:6789/0 conn(0x5631fee6b080 0x5631fee69680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:48880/0 (socket says 172.21.15.72:48880) 2024-04-26T12:52:07.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2b315640 1 -- 172.21.15.72:0/3944344782 >> v1:172.21.15.29:6789/0 conn(0x5631fee6b080 legacy=0x5631fee69680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.699+0000 7fce2b315640 1 -- 172.21.15.72:0/3944344782 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fed7eae0 con 0x5631fee69d90 2024-04-26T12:52:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2b315640 1 --2- 172.21.15.72:0/3944344782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631feef7f00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a5c0 tx=0x7fce2001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a66be1b353557c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2ab14640 1 -- 172.21.15.72:0/3944344782 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce200a6070 con 0x5631fee69d90 2024-04-26T12:52:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2ab14640 1 -- 172.21.15.72:0/3944344782 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce200af070 con 0x5631fee69d90 2024-04-26T12:52:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2ab14640 1 -- 172.21.15.72:0/3944344782 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce200aa5c0 con 0x5631fee69d90 2024-04-26T12:52:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2dffb980 1 -- 172.21.15.72:0/3944344782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 msgr2=0x5631feef7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3944344782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631feef7f00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fce2000a5c0 tx=0x7fce2001b340 comp rx=0 tx=0).stop 2024-04-26T12:52:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2dffb980 1 -- 172.21.15.72:0/3944344782 shutdown_connections 2024-04-26T12:52:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3944344782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631feef7f00 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2dffb980 1 -- 172.21.15.72:0/3944344782 >> 172.21.15.72:0/3944344782 conn(0x5631feef0be0 msgr2=0x5631feef3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2dffb980 1 -- 172.21.15.72:0/3944344782 shutdown_connections 2024-04-26T12:52:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.703+0000 7fce2dffb980 1 -- 172.21.15.72:0/3944344782 wait complete. 2024-04-26T12:52:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.715+0000 7fce2dffb980 1 Processor -- start 2024-04-26T12:52:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.715+0000 7fce2dffb980 1 -- start start 2024-04-26T12:52:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.715+0000 7fce2dffb980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631fefe6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.715+0000 7fce2dffb980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5631fedf8a70 con 0x5631fee69d90 2024-04-26T12:52:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.715+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631fefe6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.715+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631fefe6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39290/0 (socket says 172.21.15.72:39290) 2024-04-26T12:52:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.715+0000 7fce2bb16640 1 -- 172.21.15.72:0/1159103342 learned_addr learned my addr 172.21.15.72:0/1159103342 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2bb16640 1 -- 172.21.15.72:0/1159103342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fefe7540 con 0x5631fee69d90 2024-04-26T12:52:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2bb16640 1 --2- 172.21.15.72:0/1159103342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631fefe6f70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fce1c001e50 tx=0x7fce1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff65a9b7593fcda7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fcd19e0b640 1 -- 172.21.15.72:0/1159103342 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c00e5d0 con 0x5631fee69d90 2024-04-26T12:52:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fcd19e0b640 1 -- 172.21.15.72:0/1159103342 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c00e770 con 0x5631fee69d90 2024-04-26T12:52:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fcd19e0b640 1 -- 172.21.15.72:0/1159103342 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c00eab0 con 0x5631fee69d90 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- 172.21.15.72:0/1159103342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 msgr2=0x5631fefe6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 --2- 172.21.15.72:0/1159103342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631fefe6f70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fce1c001e50 tx=0x7fce1c001e80 comp rx=0 tx=0).stop 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- 172.21.15.72:0/1159103342 shutdown_connections 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 --2- 172.21.15.72:0/1159103342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee69d90 0x5631fefe6f70 secure :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fce1c001e50 tx=0x7fce1c001e80 comp rx=0 tx=0).stop 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- 172.21.15.72:0/1159103342 >> 172.21.15.72:0/1159103342 conn(0x5631feef0be0 msgr2=0x5631fefe2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- 172.21.15.72:0/1159103342 shutdown_connections 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- 172.21.15.72:0/1159103342 wait complete. 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 Processor -- start 2024-04-26T12:52:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- start start 2024-04-26T12:52:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee6b080 0x5631fefee440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5631feef8ef0 con 0x5631fee6b080 2024-04-26T12:52:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee6b080 0x5631fefee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee6b080 0x5631fefee440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39300/0 (socket says 172.21.15.72:39300) 2024-04-26T12:52:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2bb16640 1 -- 172.21.15.72:0/3555412279 learned_addr learned my addr 172.21.15.72:0/3555412279 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2bb16640 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fefee980 con 0x5631fee6b080 2024-04-26T12:52:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2bb16640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee6b080 0x5631fefee440 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fce1c004000 tx=0x7fce1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fcd13fff640 1 -- 172.21.15.72:0/3555412279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c001260 con 0x5631fee6b080 2024-04-26T12:52:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631fefeec10 con 0x5631fee6b080 2024-04-26T12:52:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fcd13fff640 1 -- 172.21.15.72:0/3555412279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c00f9a0 con 0x5631fee6b080 2024-04-26T12:52:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fcd13fff640 1 -- 172.21.15.72:0/3555412279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c00fce0 con 0x5631fee6b080 2024-04-26T12:52:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.719+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631feff1850 con 0x5631fee6b080 2024-04-26T12:52:07.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fcd13fff640 1 -- 172.21.15.72:0/3555412279 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce1c017070 con 0x5631fee6b080 2024-04-26T12:52:07.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fcd13fff640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd140346a0 0x7fcd14036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fcd13fff640 1 -- 172.21.15.72:0/3555412279 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fce1c015020 con 0x5631fee6b080 2024-04-26T12:52:07.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2b315640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd140346a0 0x7fcd14036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631feff3490 0x5631feff5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631feff5e00 con 0x5631feff3490 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2c317640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631feff3490 0x5631feff5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2b315640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd140346a0 0x7fcd14036b60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce200ae000 tx=0x7fce200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2c317640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631feff3490 0x5631feff5880 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2c317640 1 -- 172.21.15.72:0/3555412279 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631feff3490 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631feff2a70 con 0x5631feff3490 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2c317640 1 -- 172.21.15.72:0/3555412279 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631feff3490 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631feff8130 0x5631feffa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631feffac10 con 0x5631feff8130 2024-04-26T12:52:07.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2bb16640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631feff8130 0x5631feffa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.723+0000 7fce2bb16640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631feff8130 0x5631feffa520 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2bb16640 1 -- 172.21.15.72:0/3555412279 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce1c02e070 con 0x5631feff8130 2024-04-26T12:52:07.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631feff6fd0 con 0x5631feff3490 2024-04-26T12:52:07.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2c317640 1 -- 172.21.15.72:0/3555412279 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631feff3490 2024-04-26T12:52:07.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631feffc070 0x5631feffe460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631feffeba0 con 0x5631feffc070 2024-04-26T12:52:07.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2b315640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631feffc070 0x5631feffe460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2b315640 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631feffc070 0x5631feffe460 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2b315640 1 -- 172.21.15.72:0/3555412279 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce200aaac0 con 0x5631feffc070 2024-04-26T12:52:07.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 Processor -- start 2024-04-26T12:52:07.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 -- start start 2024-04-26T12:52:07.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff00ccd0 0x5631ff00d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5631fedfcab0 con 0x5631ff00ccd0 2024-04-26T12:52:07.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff00ccd0 0x5631ff00d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff00ccd0 0x5631ff00d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39306/0 (socket says 172.21.15.72:39306) 2024-04-26T12:52:07.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2bb16640 1 -- 172.21.15.72:0/2836257066 learned_addr learned my addr 172.21.15.72:0/2836257066 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2bb16640 1 -- 172.21.15.72:0/2836257066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631ff00d630 con 0x5631ff00ccd0 2024-04-26T12:52:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2bb16640 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff00ccd0 0x5631ff00d0f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fce1c01cfd0 tx=0x7fce1c01b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fcd117fa640 1 -- 172.21.15.72:0/2836257066 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c041070 con 0x5631ff00ccd0 2024-04-26T12:52:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fcd117fa640 1 -- 172.21.15.72:0/2836257066 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c01a7c0 con 0x5631ff00ccd0 2024-04-26T12:52:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631ff00df90 con 0x5631ff00ccd0 2024-04-26T12:52:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fcd117fa640 1 -- 172.21.15.72:0/2836257066 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c042390 con 0x5631ff00ccd0 2024-04-26T12:52:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.727+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631ff00df90 con 0x5631ff00ccd0 2024-04-26T12:52:07.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fcd117fa640 1 -- 172.21.15.72:0/2836257066 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce1c03a070 con 0x5631ff00ccd0 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fcd117fa640 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd040346a0 0x7fcd04036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fcd117fa640 1 -- 172.21.15.72:0/2836257066 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fce1c0328e0 con 0x5631ff00ccd0 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2b315640 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd040346a0 0x7fcd04036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 Processor -- start 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- start start 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2b315640 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd040346a0 0x7fcd04036b60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5631feff62b0 tx=0x7fce20005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff019dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5631fefe7890 con 0x5631ff0199f0 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff019dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff019dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39310/0 (socket says 172.21.15.72:39310) 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2bb16640 1 -- 172.21.15.72:0/819107414 learned_addr learned my addr 172.21.15.72:0/819107414 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2bb16640 1 -- 172.21.15.72:0/819107414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631ff01a3a0 con 0x5631ff0199f0 2024-04-26T12:52:07.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2bb16640 1 --2- 172.21.15.72:0/819107414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff019dd0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fce1c017490 tx=0x7fce1c025b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4884e9a779fd91e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fcd0affd640 1 -- 172.21.15.72:0/819107414 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c019d50 con 0x5631ff0199f0 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fcd0affd640 1 -- 172.21.15.72:0/819107414 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c019830 con 0x5631ff0199f0 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fcd0affd640 1 -- 172.21.15.72:0/819107414 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c032b80 con 0x5631ff0199f0 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- 172.21.15.72:0/819107414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 msgr2=0x5631ff019dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 --2- 172.21.15.72:0/819107414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff019dd0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fce1c017490 tx=0x7fce1c025b90 comp rx=0 tx=0).stop 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- 172.21.15.72:0/819107414 shutdown_connections 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 --2- 172.21.15.72:0/819107414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff019dd0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- 172.21.15.72:0/819107414 >> 172.21.15.72:0/819107414 conn(0x5631ff015d30 msgr2=0x5631ff013d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- 172.21.15.72:0/819107414 shutdown_connections 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- 172.21.15.72:0/819107414 wait complete. 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 Processor -- start 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.731+0000 7fce2dffb980 1 -- start start 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2dffb980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff020d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2dffb980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5631ff01aaa0 con 0x5631ff0199f0 2024-04-26T12:52:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff020d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2bb16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff020d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:39312/0 (socket says 172.21.15.72:39312) 2024-04-26T12:52:07.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 learned_addr learned my addr 172.21.15.72:0/2522502804 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:52:07.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631ff021270 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2bb16640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff020d30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fce1c011ff0 tx=0x7fce1c0325b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fcd097fa640 1 -- 172.21.15.72:0/2522502804 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c06e070 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fcd097fa640 1 -- 172.21.15.72:0/2522502804 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c032170 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631ff021270 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fcd097fa640 1 -- 172.21.15.72:0/2522502804 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c031820 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631ff021270 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fcd097fa640 1 -- 172.21.15.72:0/2522502804 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce1c071070 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fcd097fa640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fccf40346a0 0x7fccf4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fcd097fa640 1 -- 172.21.15.72:0/2522502804 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fce1c065030 con 0x5631ff0199f0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2b315640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fccf40346a0 0x7fccf4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631ff02bdc0 0x5631ff02e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02e9b0 con 0x5631ff02bdc0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2c317640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631ff02bdc0 0x5631ff02e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2b315640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fccf40346a0 0x7fccf4036b60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce20018f70 tx=0x7fce200c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.735+0000 7fce2c317640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631ff02bdc0 0x5631ff02e260 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 realm 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02edc0 con 0x5631ff02bdc0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02f660 con 0x5631ff02bdc0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631ff030760 0x5631ff032b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff0331f0 con 0x5631ff030760 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2bb16640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631ff030760 0x5631ff032b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2bb16640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631ff030760 0x5631ff032b50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 20 searching for the correct realm 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631ff0350d0 0x5631ff037540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff037bc0 con 0x5631ff0350d0 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2b315640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631ff0350d0 0x5631ff037540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2b315640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631ff0350d0 0x5631ff037540 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2b315640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fce200e0040 0x7fce200e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff037bc0 con 0x7fce200e0040 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2c317640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fce200e0040 0x7fce200e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.739+0000 7fce2c317640 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fce200e0040 0x7fce200e0420 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:52:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2400a4d0 con 0x7fce200e0040 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x7fce200e0040 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2400a4d0 con 0x7fce200e0040 2024-04-26T12:52:07.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x7fce200e0040 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2400a4d0 con 0x7fce200e0040 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce2400a4d0 con 0x5631ff02bdc0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.743+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x7fce200e0040 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce24032040 con 0x7fce200e0040 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce24032040 con 0x5631ff02bdc0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce24032040 con 0x5631ff02bdc0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x7fce200e0040 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce24032040 con 0x7fce200e0040 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce24032040 con 0x5631ff02bdc0 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.747+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x7fce200e0040 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce24032040 con 0x7fce200e0040 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff0350d0 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff030760 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x5631ff02bdc0 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce24032040 con 0x5631ff02bdc0 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5631ff02fa00 con 0x7fce200e0040 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce24032040 con 0x7fce200e0040 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff033a40 con 0x5631ff02bdc0 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce24032040 con 0x5631ff02bdc0 2024-04-26T12:52:07.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.751+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff033a40 con 0x5631ff02bdc0 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce24032040 con 0x5631ff02bdc0 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff033a40 con 0x5631ff0350d0 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 zone default found 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 4 Realm: () 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:52:07.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 zonegroup default 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff0343d0 con 0x5631ff030760 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff033f80 con 0x5631ff0350d0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff039f70 con 0x5631ff0350d0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 started sync module instance, tier type = 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff039360 con 0x7fce200e0040 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24032040 con 0x7fce200e0040 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94772731811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff039360 con 0x7fce200e0040 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03a9f0 con 0x5631ff02bdc0 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.755+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94772731811936] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x7fce200e0040 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.759+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.759+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94772731815504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff039360 con 0x5631ff02bdc0 2024-04-26T12:52:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.759+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03b400 con 0x5631ff0350d0 2024-04-26T12:52:07.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.759+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.759+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94772731817808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03bca0 con 0x5631ff0350d0 2024-04-26T12:52:07.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.759+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03c6a0 con 0x7fce200e0040 2024-04-26T12:52:07.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.759+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94772731815504] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x7fce200e0040 2024-04-26T12:52:07.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94772731809456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03ca90 con 0x7fce200e0040 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03d450 con 0x5631ff02bdc0 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94772731817808] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94772731809456] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x7fce200e0040 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94772731822512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03cfa0 con 0x5631ff02bdc0 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.763+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03d7f0 con 0x5631ff030760 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94772731826384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03e040 con 0x5631ff030760 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03ea00 con 0x5631ff030760 2024-04-26T12:52:07.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94772731822512] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94772731820016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03f250 con 0x5631ff030760 2024-04-26T12:52:07.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03fc10 con 0x5631ff030760 2024-04-26T12:52:07.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.767+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94772731826384] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(58 notify.7 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94772731829136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff03fc10 con 0x5631ff030760 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=0 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=1 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=2 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=3 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=4 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=5 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94772731820016] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=6 2024-04-26T12:52:07.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94772731829136] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 add_watcher() i=7 2024-04-26T12:52:07.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 2 all 8 watchers are set, enabling cache 2024-04-26T12:52:07.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff042c40 con 0x5631ff02bdc0 2024-04-26T12:52:07.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94772731836256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff040030 con 0x5631ff02bdc0 2024-04-26T12:52:07.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94772731836256] v35'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fcce1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:52:07.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.771+0000 7fce2dffb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:52:07.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 5 note: GC not initialized 2024-04-26T12:52:07.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fcce0fe1640 20 reqs_thread_entry: start 2024-04-26T12:52:07.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 20 init_complete bucket index max shards: 11 2024-04-26T12:52:07.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 20 Filter name: none 2024-04-26T12:52:07.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fcc5a7fc640 20 reqs_thread_entry: start 2024-04-26T12:52:07.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:52:07.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 20 rados->read ofs=0 len=0 2024-04-26T12:52:07.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff0662a0 con 0x5631ff030760 2024-04-26T12:52:07.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 20 rados_obj.operate() r=0 bl.length=473 2024-04-26T12:52:07.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:52:07.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:52:07.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.775+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff06cba0 con 0x5631ff030760 2024-04-26T12:52:07.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2dffb980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2dffb980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2dffb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94772732020240 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5631ff0682b0 con 0x5631ff02bdc0 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== watch-notify(notify (1) cookie 94772731822512 notify 150323855395 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fce24018960 con 0x5631ff02bdc0 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fcd0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855395 cookie 94772731822512 notifier 4930 bl.length()=649 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fcd0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fcd0affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(64 notify.4 [notify cookie 94772732020240 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fcd0affd640 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fccf0003eb0 con 0x5631ff02bdc0 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== watch-notify(notify_complete (2) cookie 94772732020240 notify 150323855395 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fce24018c00 con 0x5631ff02bdc0 2024-04-26T12:52:07.782 INFO:teuthology.orchestra.run.smithi072.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:52:05.056337Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:52:05.056320Z","tags":[],"group_ids":[]} 2024-04-26T12:52:07.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fcce1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:52:07.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94772731836256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff06bef0 con 0x5631ff02bdc0 2024-04-26T12:52:07.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94772731836256] v35'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.779+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94772731811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff06bef0 con 0x7fce200e0040 2024-04-26T12:52:07.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.783+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94772731811936] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x7fce200e0040 2024-04-26T12:52:07.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.783+0000 7fce2dffb980 20 remove_watcher() i=0 2024-04-26T12:52:07.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.783+0000 7fce2dffb980 2 removed watcher, disabling cache 2024-04-26T12:52:07.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.783+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94772731815504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff06bef0 con 0x5631ff02bdc0 2024-04-26T12:52:07.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.783+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94772731815504] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.783+0000 7fce2dffb980 20 remove_watcher() i=1 2024-04-26T12:52:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.783+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94772731817808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff06bef0 con 0x5631ff0350d0 2024-04-26T12:52:07.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2b315640 1 -- 172.21.15.72:0/2522502804 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94772731817808] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce200aaac0 con 0x5631ff0350d0 2024-04-26T12:52:07.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2dffb980 20 remove_watcher() i=2 2024-04-26T12:52:07.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94772731809456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff063fa0 con 0x7fce200e0040 2024-04-26T12:52:07.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94772731809456] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x7fce200e0040 2024-04-26T12:52:07.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2dffb980 20 remove_watcher() i=3 2024-04-26T12:52:07.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94772731822512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff063fa0 con 0x5631ff02bdc0 2024-04-26T12:52:07.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94772731822512] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce24040040 con 0x5631ff02bdc0 2024-04-26T12:52:07.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2dffb980 20 remove_watcher() i=4 2024-04-26T12:52:07.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.787+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94772731826384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff063fa0 con 0x5631ff030760 2024-04-26T12:52:07.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.791+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94772731826384] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.791+0000 7fce2dffb980 20 remove_watcher() i=5 2024-04-26T12:52:07.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.791+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94772731820016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff063fa0 con 0x5631ff030760 2024-04-26T12:52:07.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94772731820016] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 20 remove_watcher() i=6 2024-04-26T12:52:07.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94772731829136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5631ff063fa0 con 0x5631ff030760 2024-04-26T12:52:07.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2bb16640 1 -- 172.21.15.72:0/2522502804 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94772731829136] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c070030 con 0x5631ff030760 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 20 remove_watcher() i=7 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631ff030760 msgr2=0x5631ff032b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631ff030760 0x5631ff032b50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631ff02bdc0 msgr2=0x5631ff02e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631ff02bdc0 0x5631ff02e260 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fce200e0040 msgr2=0x7fce200e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7fce200e0040 0x7fce200e0420 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631ff0350d0 msgr2=0x5631ff037540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631ff0350d0 0x5631ff037540 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fccf40346a0 msgr2=0x7fccf4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fccf40346a0 0x7fccf4036b60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce20018f70 tx=0x7fce200c1040 comp rx=0 tx=0).stop 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2c317640 1 -- 172.21.15.72:0/2522502804 reap_dead start 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 msgr2=0x5631ff020d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff020d30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fce1c011ff0 tx=0x7fce1c0325b0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 shutdown_connections 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2522502804 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff0199f0 0x5631ff020d30 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 >> 172.21.15.72:0/2522502804 conn(0x5631ff015d30 msgr2=0x5631ff0133b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 shutdown_connections 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2522502804 wait complete. 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd040346a0 msgr2=0x7fcd04036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd040346a0 0x7fcd04036b60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5631feff62b0 tx=0x7fce20005ad0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff00ccd0 msgr2=0x5631ff00d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff00ccd0 0x5631ff00d0f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fce1c01cfd0 tx=0x7fce1c01b960 comp rx=0 tx=0).stop 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 shutdown_connections 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd040346a0 0x7fcd04036b60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/2836257066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631ff00ccd0 0x5631ff00d0f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 >> 172.21.15.72:0/2836257066 conn(0x5631ff001a40 msgr2=0x5631ff002550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 shutdown_connections 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/2836257066 wait complete. 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631feff8130 msgr2=0x5631feffa520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x5631feff8130 0x5631feffa520 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631feff3490 msgr2=0x5631feff5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x5631feff3490 0x5631feff5880 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631feffc070 msgr2=0x5631feffe460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x5631feffc070 0x5631feffe460 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd140346a0 msgr2=0x7fcd14036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fcd140346a0 0x7fcd14036b60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fce200ae000 tx=0x7fce200a6000 comp rx=0 tx=0).stop 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee6b080 msgr2=0x5631fefee440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 --2- 172.21.15.72:0/3555412279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5631fee6b080 0x5631fefee440 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fce1c004000 tx=0x7fce1c000bd0 comp rx=0 tx=0).stop 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2c317640 1 -- 172.21.15.72:0/3555412279 reap_dead start 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 shutdown_connections 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 >> 172.21.15.72:0/3555412279 conn(0x5631feef0be0 msgr2=0x5631fefe1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:52:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 shutdown_connections 2024-04-26T12:52:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:52:07.795+0000 7fce2dffb980 1 -- 172.21.15.72:0/3555412279 wait complete. 2024-04-26T12:52:07.809 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.809 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:52:05.056337Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:52:05.056320Z', 'tags': [], 'group_ids': []} 2024-04-26T12:52:07.809 ERROR:root:0 2024-04-26T12:52:07.809 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-26T12:52:07.816 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.816 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.821 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.822 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-26T12:52:07.827 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.828 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.831 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-26T12:52:07.841 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-04-26T12:52:07.842 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.845 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.846 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-26T12:52:07.854 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:07.855 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.858 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.859 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-26T12:52:07.866 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-26T12:52:07.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.870 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.870 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-26T12:52:07.880 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-26T12:52:07.880 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.885 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.885 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-26T12:52:07.892 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:07.892 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.896 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.896 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-26T12:52:07.901 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:07.901 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.905 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.906 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-26T12:52:07.914 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:07.914 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.918 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:07.918 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.923 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T12:52:07.924 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-26T12:52:07.930 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T12:52:07.951 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-26T12:52:07.956 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-26T12:52:07.956 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T12:52:07.961 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:52:07.943485Z', 'creation_time': '2024-04-26T12:52:07.936077Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:52:07.961 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-26T12:52:07.966 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:52:07.943485Z', 'creation_time': '2024-04-26T12:52:07.936077Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-26T12:52:07.972 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T12:52:07.977 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:52:07.943485Z', 'creation_time': '2024-04-26T12:52:07.936077Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:52:07.977 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-26T12:52:07.982 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000005d2cf02bede556e3-00662ba377-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:52:07.988 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-26T12:52:07.997 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:07.998 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-26T12:52:08.013 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:52:08.073 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11'} 2024-04-26T12:52:08.094 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:08.098 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11'} 2024-04-26T12:52:08.119 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:08.119 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-26T12:52:08.140 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:08.153 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-26T12:52:08.170 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:52:08.171 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T12:52:08.177 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f52412b2-0d18-4618-9944-7ddcdd8afe97', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'marker': 'fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:52:08.107526Z', 'creation_time': '2024-04-26T12:52:07.936077Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:53:08.294 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-26T12:53:08.326 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-04-26T12:53:08.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-26T12:53:08.354 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-04-26T12:53:08.354 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-26T12:53:08.360 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-04-26T12:53:08.361 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-26T12:53:08.366 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-04-26T12:53:08.366 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-26T12:53:08.371 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-04-26T12:53:08.372 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-26T12:53:08.377 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-04-26T12:53:08.377 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-26T12:53:08.383 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-04-26T12:53:08.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-26T12:53:08.393 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:53:08.394 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-26T12:53:08.399 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-26T12:53:08.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-26T12:53:08.415 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:53:08.420 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-26T12:53:08.435 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:53:08.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-26T12:53:08.808 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000d9cebb9fbfc88c27-00662ba3b4-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.033 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-26T12:53:09.039 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-26T12:53:09.049 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-26T12:53:09.055 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-26T12:53:09.199 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-26T12:53:09.291 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:53:09.292 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-26T12:53:09.301 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-26T12:53:09.301 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-26T12:53:09.310 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T12:53:09.334 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-26T12:53:09.340 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000174d1e5ab2d3b0db-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.389 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-26T12:53:09.465 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:53:09.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:53:09.471 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000092c4a5350d644268-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.471 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-26T12:53:09.475 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'e9a80640-28c1-4a64-ae98-6666131f9984'}]}} 2024-04-26T12:53:09.476 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-26T12:53:09.498 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:53:09.498 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-26T12:53:09.502 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T12:53:09.503 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-26T12:53:09.508 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000c3a67a513eba2796-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.508 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-26T12:53:09.513 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008c64a509158dab26-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.538 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-26T12:53:09.543 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T12:53:09.543 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-26T12:53:09.549 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000000a8953685160a084-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.549 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-26T12:53:09.553 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000fe962b72efa83f84-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.554 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-26T12:53:09.559 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T12:53:09.559 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-26T12:53:09.563 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000052f03063623242ee-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.563 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-26T12:53:09.567 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000007a91fad721908ec3-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.567 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-26T12:53:09.572 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000cd242a964e42b5ea-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.572 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-26T12:53:09.576 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000393598f876c61f4f-00662ba3b5-4237-default', 'HostId': '4237-default-default'} 2024-04-26T12:53:09.576 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-26T12:53:09.596 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:53:09.596 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-26T12:53:09.600 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-26T12:53:09.601 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-26T12:53:09.610 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:53:09.610 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-26T12:53:09.615 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-26T12:53:09.615 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-26T12:53:09.624 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:53:09.629 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-26T12:53:09.639 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-26T12:53:09.639 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:53:09.640 INFO:tasks.rgw.client.0.smithi072.stdout:2024-04-26T12:53:09.634+0000 7f759f963640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28431) UID: 0 2024-04-26T12:53:09.640 INFO:tasks.rgw.client.0.smithi072.stdout:2024-04-26T12:53:09.634+0000 7f75a31aba40 -1 shutting down 2024-04-26T12:53:10.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-26T12:53:15.741 INFO:tasks.rgw.client.0:Stopped 2024-04-26T12:53:15.741 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-26T12:53:15.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/vault-root-token 2024-04-26T12:53:15.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-26T12:53:15.859 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-26T12:53:15.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-26T12:53:15.860 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-26T12:53:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:53:15.934 INFO:teuthology.orchestra.run.smithi072.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:53:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f20821df980 1 Processor -- start 2024-04-26T12:53:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f20821df980 1 -- start start 2024-04-26T12:53:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f20821df980 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b73480a1a0 0x55b73480a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f20821df980 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7346b8510 con 0x55b73480aac0 2024-04-26T12:53:15.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f20821df980 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x55b7346bf430 con 0x55b73480a1a0 2024-04-26T12:53:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f207fcfa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b73480a1a0 0x55b73480a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f207fcfa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x55b73480a1a0 0x55b73480a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:44542/0 (socket says 172.21.15.72:44542) 2024-04-26T12:53:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f207f4f9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x55b73480aac0 0x55b73480b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.72:55600/0 (socket says 172.21.15.72:55600) 2024-04-26T12:53:15.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.930+0000 7f207fcfa640 1 -- 172.21.15.72:0/2484255240 learned_addr learned my addr 172.21.15.72:0/2484255240 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:53:15.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f207fcfa640 1 -- 172.21.15.72:0/2484255240 >> v1:172.21.15.29:6789/0 conn(0x55b73480aac0 legacy=0x55b73480b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:15.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f207fcfa640 1 -- 172.21.15.72:0/2484255240 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b734694ae0 con 0x55b73480a1a0 2024-04-26T12:53:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f207fcfa640 1 --2- 172.21.15.72:0/2484255240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b73480a580 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f207000a4e0 tx=0x7f207001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6761ecda7e83f8f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f207ecf8640 1 -- 172.21.15.72:0/2484255240 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700aa540 con 0x55b73480a1a0 2024-04-26T12:53:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f207ecf8640 1 -- 172.21.15.72:0/2484255240 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20700aa6e0 con 0x55b73480a1a0 2024-04-26T12:53:15.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f207ecf8640 1 -- 172.21.15.72:0/2484255240 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700aaa40 con 0x55b73480a1a0 2024-04-26T12:53:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f20821df980 1 -- 172.21.15.72:0/2484255240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 msgr2=0x55b73480a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f20821df980 1 --2- 172.21.15.72:0/2484255240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b73480a580 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f207000a4e0 tx=0x7f207001b090 comp rx=0 tx=0).stop 2024-04-26T12:53:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f20821df980 1 -- 172.21.15.72:0/2484255240 shutdown_connections 2024-04-26T12:53:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f20821df980 1 --2- 172.21.15.72:0/2484255240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b73480a580 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:15.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f20821df980 1 -- 172.21.15.72:0/2484255240 >> 172.21.15.72:0/2484255240 conn(0x55b734805a70 msgr2=0x55b734807e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:15.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f20821df980 1 -- 172.21.15.72:0/2484255240 shutdown_connections 2024-04-26T12:53:15.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.934+0000 7f20821df980 1 -- 172.21.15.72:0/2484255240 wait complete. 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.950+0000 7f20821df980 1 Processor -- start 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.950+0000 7f20821df980 1 -- start start 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.950+0000 7f20821df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.950+0000 7f20821df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b73470ea70 con 0x55b73480a1a0 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:44556/0 (socket says 172.21.15.72:44556) 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 -- 172.21.15.72:0/1649447041 learned_addr learned my addr 172.21.15.72:0/1649447041 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:53:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 -- 172.21.15.72:0/1649447041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7348f7160 con 0x55b73480a1a0 2024-04-26T12:53:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 --2- 172.21.15.72:0/1649447041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348f6b90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2070017ca0 tx=0x7f20700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380633c25e483a7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f1f6de0b640 1 -- 172.21.15.72:0/1649447041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700b9070 con 0x55b73480a1a0 2024-04-26T12:53:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f1f6de0b640 1 -- 172.21.15.72:0/1649447041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20700aaa80 con 0x55b73480a1a0 2024-04-26T12:53:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f1f6de0b640 1 -- 172.21.15.72:0/1649447041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700aad60 con 0x55b73480a1a0 2024-04-26T12:53:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 -- 172.21.15.72:0/1649447041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 msgr2=0x55b7348f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 --2- 172.21.15.72:0/1649447041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348f6b90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2070017ca0 tx=0x7f20700033b0 comp rx=0 tx=0).stop 2024-04-26T12:53:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 -- 172.21.15.72:0/1649447041 shutdown_connections 2024-04-26T12:53:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 --2- 172.21.15.72:0/1649447041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348f6b90 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 -- 172.21.15.72:0/1649447041 >> 172.21.15.72:0/1649447041 conn(0x55b734805a70 msgr2=0x55b7348f2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 -- 172.21.15.72:0/1649447041 shutdown_connections 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 -- 172.21.15.72:0/1649447041 wait complete. 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 Processor -- start 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 -- start start 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f20821df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b734812230 con 0x55b73480a1a0 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:44572/0 (socket says 172.21.15.72:44572) 2024-04-26T12:53:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 -- 172.21.15.72:0/2845023379 learned_addr learned my addr 172.21.15.72:0/2845023379 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:53:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.954+0000 7f207fcfa640 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7348145f0 con 0x55b73480a1a0 2024-04-26T12:53:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f207fcfa640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348140b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2070017ca0 tx=0x7f2070017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f1f67fff640 1 -- 172.21.15.72:0/2845023379 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700b9070 con 0x55b73480a1a0 2024-04-26T12:53:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7348128b0 con 0x55b73480a1a0 2024-04-26T12:53:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f1f67fff640 1 -- 172.21.15.72:0/2845023379 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20700c7410 con 0x55b73480a1a0 2024-04-26T12:53:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f1f67fff640 1 -- 172.21.15.72:0/2845023379 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700c7730 con 0x55b73480a1a0 2024-04-26T12:53:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b734812da0 con 0x55b73480a1a0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f1f67fff640 1 -- 172.21.15.72:0/2845023379 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20700b3040 con 0x55b73480a1a0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f1f67fff640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f68034650 0x7f1f68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f1f67fff640 1 -- 172.21.15.72:0/2845023379 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f20700c4070 con 0x55b73480a1a0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f207f4f9640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f68034650 0x7f1f68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73480aac0 0x55b734907120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734907660 con 0x55b73480aac0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20804fb640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73480aac0 0x55b734907120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f207f4f9640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f68034650 0x7f1f68036b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2068001e50 tx=0x7f20680013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20804fb640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73480aac0 0x55b734907120 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20804fb640 1 -- 172.21.15.72:0/2845023379 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780083f0 con 0x55b73480aac0 2024-04-26T12:53:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734907a00 con 0x55b73480aac0 2024-04-26T12:53:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20804fb640 1 -- 172.21.15.72:0/2845023379 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20780083f0 con 0x55b73480aac0 2024-04-26T12:53:15.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b7349097c0 0x55b73490bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:3 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73490c2a0 con 0x55b7349097c0 2024-04-26T12:53:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.958+0000 7f207fcfa640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b7349097c0 0x55b73490bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207fcfa640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b7349097c0 0x55b73490bbb0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207fcfa640 1 -- 172.21.15.72:0/2845023379 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(3 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20700cd060 con 0x55b7349097c0 2024-04-26T12:53:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734908630 con 0x55b73480aac0 2024-04-26T12:53:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20804fb640 1 -- 172.21.15.72:0/2845023379 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20780083f0 con 0x55b73480aac0 2024-04-26T12:53:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b73490d700 0x55b73490faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:5 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349101f0 con 0x55b73490d700 2024-04-26T12:53:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207f4f9640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b73490d700 0x55b73490faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207f4f9640 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b73490d700 0x55b73490faf0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207f4f9640 1 -- 172.21.15.72:0/2845023379 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(5 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f206800f700 con 0x55b73490d700 2024-04-26T12:53:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20821df980 1 Processor -- start 2024-04-26T12:53:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20821df980 1 -- start start 2024-04-26T12:53:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20821df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73491e280 0x55b73491e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f20821df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b734712ab0 con 0x55b73491e280 2024-04-26T12:53:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73491e280 0x55b73491e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73491e280 0x55b73491e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:44584/0 (socket says 172.21.15.72:44584) 2024-04-26T12:53:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.962+0000 7f207fcfa640 1 -- 172.21.15.72:0/3596779922 learned_addr learned my addr 172.21.15.72:0/3596779922 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:53:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207fcfa640 1 -- 172.21.15.72:0/3596779922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b73491ebe0 con 0x55b73491e280 2024-04-26T12:53:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207fcfa640 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73491e280 0x55b73491e6a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f20700e2e10 tx=0x7f20700c6e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f1f657fa640 1 -- 172.21.15.72:0/3596779922 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700c6860 con 0x55b73491e280 2024-04-26T12:53:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f1f657fa640 1 -- 172.21.15.72:0/3596779922 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20700b3970 con 0x55b73491e280 2024-04-26T12:53:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b73491f680 con 0x55b73491e280 2024-04-26T12:53:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f1f657fa640 1 -- 172.21.15.72:0/3596779922 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700b3c70 con 0x55b73491e280 2024-04-26T12:53:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b73491fb50 con 0x55b73491e280 2024-04-26T12:53:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f1f657fa640 1 -- 172.21.15.72:0/3596779922 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20700eb060 con 0x55b73491e280 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f1f657fa640 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f58034600 0x7f1f58036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f1f657fa640 1 -- 172.21.15.72:0/3596779922 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f20700df030 con 0x55b73491e280 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207f4f9640 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f58034600 0x7f1f58036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f20821df980 1 Processor -- start 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f20821df980 1 -- start start 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207f4f9640 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f58034600 0x7f1f58036ac0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55b734813120 tx=0x7f206800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f20821df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b73492b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f20821df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b7348f73f0 con 0x55b73492b230 2024-04-26T12:53:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b73492b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b73492b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:44588/0 (socket says 172.21.15.72:44588) 2024-04-26T12:53:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207fcfa640 1 -- 172.21.15.72:0/1357185893 learned_addr learned my addr 172.21.15.72:0/1357185893 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:53:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207fcfa640 1 -- 172.21.15.72:0/1357185893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b73492bc20 con 0x55b73492b230 2024-04-26T12:53:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.966+0000 7f207fcfa640 1 --2- 172.21.15.72:0/1357185893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b73492b650 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f20700b3f60 tx=0x7f20700c2130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fc94ff714486c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f1f5effd640 1 -- 172.21.15.72:0/1357185893 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700bda50 con 0x55b73492b230 2024-04-26T12:53:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f1f5effd640 1 -- 172.21.15.72:0/1357185893 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20700fc070 con 0x55b73492b230 2024-04-26T12:53:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f1f5effd640 1 -- 172.21.15.72:0/1357185893 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700b4dc0 con 0x55b73492b230 2024-04-26T12:53:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- 172.21.15.72:0/1357185893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 msgr2=0x55b73492b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 --2- 172.21.15.72:0/1357185893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b73492b650 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f20700b3f60 tx=0x7f20700c2130 comp rx=0 tx=0).stop 2024-04-26T12:53:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- 172.21.15.72:0/1357185893 shutdown_connections 2024-04-26T12:53:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 --2- 172.21.15.72:0/1357185893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b73492b650 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- 172.21.15.72:0/1357185893 >> 172.21.15.72:0/1357185893 conn(0x55b7349275c0 msgr2=0x55b734925620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- 172.21.15.72:0/1357185893 shutdown_connections 2024-04-26T12:53:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- 172.21.15.72:0/1357185893 wait complete. 2024-04-26T12:53:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 Processor -- start 2024-04-26T12:53:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- start start 2024-04-26T12:53:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b734932550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55b73492c1b0 con 0x55b73492b230 2024-04-26T12:53:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b734932550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f207fcfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b734932550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.72:44602/0 (socket says 172.21.15.72:44602) 2024-04-26T12:53:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 learned_addr learned my addr 172.21.15.72:0/436397824 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-04-26T12:53:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b734932a90 con 0x55b73492b230 2024-04-26T12:53:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f207fcfa640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b734932550 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f20700c2170 tx=0x7f20700c2f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f1f5d7fa640 1 -- 172.21.15.72:0/436397824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700bb440 con 0x55b73492b230 2024-04-26T12:53:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f1f5d7fa640 1 -- 172.21.15.72:0/436397824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2070107070 con 0x55b73492b230 2024-04-26T12:53:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b734932a90 con 0x55b73492b230 2024-04-26T12:53:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f1f5d7fa640 1 -- 172.21.15.72:0/436397824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20700bbc40 con 0x55b73492b230 2024-04-26T12:53:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.970+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b734932a90 con 0x55b73492b230 2024-04-26T12:53:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f1f5d7fa640 1 -- 172.21.15.72:0/436397824 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20700f6070 con 0x55b73492b230 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f1f5d7fa640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f48034600 0x7f1f48036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f1f5d7fa640 1 -- 172.21.15.72:0/436397824 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f20700f3030 con 0x55b73492b230 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f207f4f9640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f48034600 0x7f1f48036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73493d680 0x55b73493fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734940290 con 0x55b73493d680 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20804fb640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73493d680 0x55b73493fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f207f4f9640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f48034600 0x7f1f48036ac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55b7349105f0 tx=0x7f2068010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20804fb640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73493d680 0x55b73493fb40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780083f0 con 0x55b73493d680 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 realm 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349406a0 con 0x55b73493d680 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780083f0 con 0x55b73493d680 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:53:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734940f70 con 0x55b73493d680 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780083f0 con 0x55b73493d680 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b73493d680 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20780083f0 con 0x55b73493d680 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b734942070 0x55b734944460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:5 5.1e 5:786b1c7f:::zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734944a70 con 0x55b734942070 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f207fcfa640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b734942070 0x55b734944460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.974+0000 7f207fcfa640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b734942070 0x55b734944460 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== osd_op_reply(5 zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20821df980 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:53:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20821df980 20 searching for the correct realm 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b7349469c0 0x55b734948dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b7349494a0 con 0x55b7349469c0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207f4f9640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b7349469c0 0x55b734948dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207f4f9640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b7349469c0 0x55b734948dd0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207f4f9640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f206801fbe0 0x7f206803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b7349494a0 con 0x7f206801fbe0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20804fb640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f206801fbe0 0x7f206803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20804fb640 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f206801fbe0 0x7f206803a3c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780083f0 con 0x7f206801fbe0 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b734942070 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b73493d680 2024-04-26T12:53:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780083f0 con 0x55b73493d680 2024-04-26T12:53:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.978+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b73493d680 2024-04-26T12:53:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b734942070 2024-04-26T12:53:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b734942070 2024-04-26T12:53:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x7f206801fbe0 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b7349469c0 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b73493d680 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x7f206801fbe0 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b73493d680 2024-04-26T12:53:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x7f206801fbe0 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b7349469c0 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b7349469c0 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.982+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b734942070 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b7349469c0 2024-04-26T12:53:15.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b7349469c0 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b73493d680 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b73493d680 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b734942070 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b7349469c0 2024-04-26T12:53:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x7f206801fbe0 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b73493d680 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.986+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b734942070 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=82b] v35'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b7349469c0 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b734942070 2024-04-26T12:53:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x7f206801fbe0 2024-04-26T12:53:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 6 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b7349469c0 2024-04-26T12:53:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b734942070 2024-04-26T12:53:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x55b73493d680 2024-04-26T12:53:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f207802b040 con 0x7f206801fbe0 2024-04-26T12:53:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 7 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:53:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 RGWRados::pool_iterate: got zone_info.fe657080-460c-4bb9-93cf-69170ee92cfa 2024-04-26T12:53:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:53:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 RGWRados::pool_iterate: got zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 2024-04-26T12:53:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 RGWRados::pool_iterate: got period_config.default 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b73493d680 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.990+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b73493d680 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:40 5.15 5:acb72df9:::zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734941310 con 0x55b7349469c0 2024-04-26T12:53:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 10 ==== osd_op_reply(40 zonegroup_info.f52412b2-0d18-4618-9944-7ddcdd8afe97 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 zone default found 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 4 Realm: () 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 4 ZoneGroup: default (f52412b2-0d18-4618-9944-7ddcdd8afe97) 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 4 Zone: default (fe657080-460c-4bb9-93cf-69170ee92cfa) 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 zonegroup default 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734945960 con 0x55b734942070 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados_obj.operate() r=0 bl.length=187 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734945dd0 con 0x55b7349469c0 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados->read ofs=0 len=0 2024-04-26T12:53:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73494b300 con 0x55b7349469c0 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 started sync module instance, tier type = 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 20 started zone id=fe657080-460c-4bb9-93cf-69170ee92cfa (name=default) with tier type = 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494a7a0 con 0x7f206801fbe0 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.994+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 8 ==== osd_op_reply(44 notify.0 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.998+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94245349534960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494a7a0 con 0x7f206801fbe0 2024-04-26T12:53:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.998+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494bd90 con 0x55b73493d680 2024-04-26T12:53:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.998+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94245349534960] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.998+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 15 ==== osd_op_reply(46 notify.1 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.998+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94245349537888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494a7a0 con 0x55b73493d680 2024-04-26T12:53:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:15.998+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494c7a0 con 0x55b7349469c0 2024-04-26T12:53:16.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94245349537888] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 13 ==== osd_op_reply(48 notify.2 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94245349532400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494a710 con 0x55b7349469c0 2024-04-26T12:53:16.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494d4f0 con 0x7f206801fbe0 2024-04-26T12:53:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 10 ==== osd_op_reply(50 notify.3 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94245349544304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494dd90 con 0x7f206801fbe0 2024-04-26T12:53:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494e750 con 0x55b73493d680 2024-04-26T12:53:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94245349532400] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.002+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94245349544304] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.006+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 17 ==== osd_op_reply(52 notify.4 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.006+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94245349548704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494e6c0 con 0x55b73493d680 2024-04-26T12:53:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.006+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494dce0 con 0x55b734942070 2024-04-26T12:53:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.006+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94245349548704] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.006+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 11 ==== osd_op_reply(54 notify.5 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.006+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94245349546032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494dc50 con 0x55b734942070 2024-04-26T12:53:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.006+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494f4a0 con 0x55b734942070 2024-04-26T12:53:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 12 ==== osd_op_reply(56 notify.6 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94245349552112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494f8c0 con 0x55b734942070 2024-04-26T12:53:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349502c0 con 0x55b734942070 2024-04-26T12:53:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94245349546032] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94245349552112] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 15 ==== osd_op_reply(58 notify.7 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94245349550912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494f410 con 0x55b734942070 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 20 add_watcher() i=0 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 20 add_watcher() i=1 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 20 add_watcher() i=2 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 20 add_watcher() i=3 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 20 add_watcher() i=4 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 20 add_watcher() i=5 2024-04-26T12:53:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.010+0000 7f20821df980 20 add_watcher() i=6 2024-04-26T12:53:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94245349550912] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20821df980 20 add_watcher() i=7 2024-04-26T12:53:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20821df980 2 all 8 watchers are set, enabling cache 2024-04-26T12:53:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349533c0 con 0x55b73493d680 2024-04-26T12:53:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94245349555664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b734950840 con 0x55b73493d680 2024-04-26T12:53:16.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94245349555664] v35'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f1f35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:53:16.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20821df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:53:16.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20821df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:53:16.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.014+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495bb00 con 0x55b73493d680 2024-04-26T12:53:16.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.018+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.018+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495c1d0 con 0x55b734942070 2024-04-26T12:53:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.018+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.018+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495c1d0 con 0x55b7349469c0 2024-04-26T12:53:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.022+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.022+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495cc70 con 0x55b73493d680 2024-04-26T12:53:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.022+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'275 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.022+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349577c0 con 0x7f206801fbe0 2024-04-26T12:53:16.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.022+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'86 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.022+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349577c0 con 0x55b7349469c0 2024-04-26T12:53:16.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.026+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'56 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.026+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495d9a0 con 0x55b73493d680 2024-04-26T12:53:16.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.026+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.026+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495d9a0 con 0x55b734942070 2024-04-26T12:53:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.030+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.030+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495da30 con 0x7f206801fbe0 2024-04-26T12:53:16.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.030+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.030+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495dc00 con 0x55b7349469c0 2024-04-26T12:53:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.034+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.034+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e060 con 0x7f206801fbe0 2024-04-26T12:53:16.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.034+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'87 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.034+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e040 con 0x55b734942070 2024-04-26T12:53:16.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.038+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.038+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e000 con 0x7f206801fbe0 2024-04-26T12:53:16.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.038+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.038+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e000 con 0x55b734942070 2024-04-26T12:53:16.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.042+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.042+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e000 con 0x55b73493d680 2024-04-26T12:53:16.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.042+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'276 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.042+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e000 con 0x55b7349469c0 2024-04-26T12:53:16.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.046+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'78 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.046+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e000 con 0x7f206801fbe0 2024-04-26T12:53:16.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.046+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'88 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.046+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e000 con 0x55b7349469c0 2024-04-26T12:53:16.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.046+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.046+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b73493d680 2024-04-26T12:53:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.050+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.050+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b73493d680 2024-04-26T12:53:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.050+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'277 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.050+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b7349469c0 2024-04-26T12:53:16.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.054+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'79 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.054+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x7f206801fbe0 2024-04-26T12:53:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.054+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.054+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b7349469c0 2024-04-26T12:53:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.058+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.058+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b7349469c0 2024-04-26T12:53:16.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.058+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.058+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b7349469c0 2024-04-26T12:53:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.062+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.062+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b7349469c0 2024-04-26T12:53:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.062+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.062+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b734942070 2024-04-26T12:53:16.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.066+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.066+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b7349469c0 2024-04-26T12:53:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.066+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.066+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b734942070 2024-04-26T12:53:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.070+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.070+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b7349469c0 2024-04-26T12:53:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.070+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'80 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.070+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x55b734942070 2024-04-26T12:53:16.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.074+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.074+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73495e440 con 0x7f206801fbe0 2024-04-26T12:53:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f1f34fe1640 20 reqs_thread_entry: start 2024-04-26T12:53:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20821df980 20 init_complete bucket index max shards: 11 2024-04-26T12:53:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20821df980 20 Filter name: none 2024-04-26T12:53:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f1eae7fc640 20 reqs_thread_entry: start 2024-04-26T12:53:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-26T12:53:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:94 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 19 ==== osd_op_reply(94 gc.10 [call] v35'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:95 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 20 ==== osd_op_reply(95 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.078+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:96 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x7f206801fbe0 2024-04-26T12:53:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 21 ==== osd_op_reply(96 gc.10 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:97 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 22 ==== osd_op_reply(97 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:98 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 23 ==== osd_op_reply(98 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:99 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 24 ==== osd_op_reply(99 gc.10 [call] v35'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-26T12:53:16.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.082+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:100 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 24 ==== osd_op_reply(100 gc.11 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:101 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 25 ==== osd_op_reply(101 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:102 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b734942070 2024-04-26T12:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 26 ==== osd_op_reply(102 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:103 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 27 ==== osd_op_reply(103 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.086+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:104 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.090+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 28 ==== osd_op_reply(104 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.090+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.090+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:105 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.090+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 29 ==== osd_op_reply(105 gc.11 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.090+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-26T12:53:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.090+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:106 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 25 ==== osd_op_reply(106 gc.12 [call] v35'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:107 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 26 ==== osd_op_reply(107 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:108 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x7f206801fbe0 2024-04-26T12:53:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 27 ==== osd_op_reply(108 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:109 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 28 ==== osd_op_reply(109 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:110 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 29 ==== osd_op_reply(110 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:111 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 30 ==== osd_op_reply(111 gc.12 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.094+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:112 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 30 ==== osd_op_reply(112 gc.13 [call] v35'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:113 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 31 ==== osd_op_reply(113 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:114 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b734942070 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 32 ==== osd_op_reply(114 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:115 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 33 ==== osd_op_reply(115 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:116 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 34 ==== osd_op_reply(116 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.098+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:117 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 35 ==== osd_op_reply(117 gc.13 [call] v35'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-26T12:53:16.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:118 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 27 ==== osd_op_reply(118 gc.14 [call] v35'278 uv278 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:119 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 28 ==== osd_op_reply(119 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.102+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:120 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b73493d680 2024-04-26T12:53:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 29 ==== osd_op_reply(120 gc.14 [call out=24b] v0'0 uv278 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:121 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 30 ==== osd_op_reply(121 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:122 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 31 ==== osd_op_reply(122 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:123 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 32 ==== osd_op_reply(123 gc.14 [call] v35'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-26T12:53:16.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.106+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:124 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 27 ==== osd_op_reply(124 gc.15 [call] v35'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:125 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 28 ==== osd_op_reply(125 gc.15 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:126 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 29 ==== osd_op_reply(126 gc.15 [call out=24b] v0'0 uv81 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:127 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 30 ==== osd_op_reply(127 gc.15 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:128 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 31 ==== osd_op_reply(128 gc.15 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.110+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:129 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 32 ==== osd_op_reply(129 gc.15 [call] v35'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-26T12:53:16.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:130 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 31 ==== osd_op_reply(130 gc.16 [call] v35'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:131 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 32 ==== osd_op_reply(131 gc.16 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:132 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x7f206801fbe0 2024-04-26T12:53:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 33 ==== osd_op_reply(132 gc.16 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:133 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 34 ==== osd_op_reply(133 gc.16 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:134 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 35 ==== osd_op_reply(134 gc.16 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.114+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:135 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 36 ==== osd_op_reply(135 gc.16 [call] v35'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-26T12:53:16.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:136 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 33 ==== osd_op_reply(136 gc.17 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:137 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 34 ==== osd_op_reply(137 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:138 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 35 ==== osd_op_reply(138 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:139 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 36 ==== osd_op_reply(139 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:140 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 37 ==== osd_op_reply(140 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.118+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:141 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 38 ==== osd_op_reply(141 gc.17 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-26T12:53:16.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:142 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 33 ==== osd_op_reply(142 gc.18 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:143 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 34 ==== osd_op_reply(143 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:144 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b73493d680 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 35 ==== osd_op_reply(144 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.122+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:145 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 36 ==== osd_op_reply(145 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:146 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 37 ==== osd_op_reply(146 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:147 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 38 ==== osd_op_reply(147 gc.18 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-26T12:53:16.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.126+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:148 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 39 ==== osd_op_reply(148 gc.19 [call] v35'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:149 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 40 ==== osd_op_reply(149 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:150 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 41 ==== osd_op_reply(150 gc.19 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 43 ==== osd_op_reply(152 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 44 ==== osd_op_reply(153 gc.19 [call] v35'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-26T12:53:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.130+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 39 ==== osd_op_reply(154 gc.20 [call] v35'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 40 ==== osd_op_reply(155 gc.20 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 41 ==== osd_op_reply(156 gc.20 [call out=24b] v0'0 uv83 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:157 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 42 ==== osd_op_reply(157 gc.20 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:158 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.134+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 43 ==== osd_op_reply(158 gc.20 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.138+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.138+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:159 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.138+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 44 ==== osd_op_reply(159 gc.20 [call] v35'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.138+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-26T12:53:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.138+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:160 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 37 ==== osd_op_reply(160 gc.21 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:161 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 38 ==== osd_op_reply(161 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:162 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x7f206801fbe0 2024-04-26T12:53:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 39 ==== osd_op_reply(162 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:163 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 40 ==== osd_op_reply(163 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:164 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 41 ==== osd_op_reply(164 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:165 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 42 ==== osd_op_reply(165 gc.21 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-26T12:53:16.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.142+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:166 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 45 ==== osd_op_reply(166 gc.22 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:167 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 46 ==== osd_op_reply(167 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:168 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 47 ==== osd_op_reply(168 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:169 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 48 ==== osd_op_reply(169 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:170 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 49 ==== osd_op_reply(170 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.146+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:171 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 50 ==== osd_op_reply(171 gc.22 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-26T12:53:16.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:172 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 51 ==== osd_op_reply(172 gc.23 [call] v35'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:173 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 52 ==== osd_op_reply(173 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:174 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 53 ==== osd_op_reply(174 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:175 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 54 ==== osd_op_reply(175 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:176 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 55 ==== osd_op_reply(176 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.150+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:177 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 56 ==== osd_op_reply(177 gc.23 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-26T12:53:16.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:178 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 57 ==== osd_op_reply(178 gc.24 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:179 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 58 ==== osd_op_reply(179 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:180 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 59 ==== osd_op_reply(180 gc.24 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:181 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 60 ==== osd_op_reply(181 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:182 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 61 ==== osd_op_reply(182 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.154+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:183 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 62 ==== osd_op_reply(183 gc.24 [call] v35'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-26T12:53:16.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:184 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 63 ==== osd_op_reply(184 gc.25 [call] v35'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:185 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 64 ==== osd_op_reply(185 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:186 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 65 ==== osd_op_reply(186 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:187 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.158+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 66 ==== osd_op_reply(187 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:188 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 67 ==== osd_op_reply(188 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:189 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 68 ==== osd_op_reply(189 gc.25 [call] v35'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-26T12:53:16.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:190 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 36 ==== osd_op_reply(190 gc.26 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.162+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:191 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 37 ==== osd_op_reply(191 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:192 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b734942070 2024-04-26T12:53:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 38 ==== osd_op_reply(192 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:193 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 39 ==== osd_op_reply(193 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:194 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 40 ==== osd_op_reply(194 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.166+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:195 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 41 ==== osd_op_reply(195 gc.26 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-26T12:53:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:196 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 69 ==== osd_op_reply(196 gc.27 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:197 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 70 ==== osd_op_reply(197 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.170+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:198 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 71 ==== osd_op_reply(198 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:199 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 72 ==== osd_op_reply(199 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:200 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 73 ==== osd_op_reply(200 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:201 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 74 ==== osd_op_reply(201 gc.27 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-26T12:53:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.174+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:202 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 42 ==== osd_op_reply(202 gc.28 [call] v35'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:203 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 43 ==== osd_op_reply(203 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:204 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b734942070 2024-04-26T12:53:16.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 44 ==== osd_op_reply(204 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:205 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 45 ==== osd_op_reply(205 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:206 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.178+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 46 ==== osd_op_reply(206 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.182+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.182+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:207 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.182+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 47 ==== osd_op_reply(207 gc.28 [call] v35'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.182+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-26T12:53:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.182+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:208 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 75 ==== osd_op_reply(208 gc.29 [call] v35'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:209 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 76 ==== osd_op_reply(209 gc.29 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:210 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 77 ==== osd_op_reply(210 gc.29 [call out=24b] v0'0 uv85 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:211 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 78 ==== osd_op_reply(211 gc.29 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:212 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 79 ==== osd_op_reply(212 gc.29 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.186+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:213 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 80 ==== osd_op_reply(213 gc.29 [call] v35'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-26T12:53:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:214 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 48 ==== osd_op_reply(214 gc.30 [call] v35'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:215 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 49 ==== osd_op_reply(215 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.190+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:216 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b734942070 2024-04-26T12:53:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 50 ==== osd_op_reply(216 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:217 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 51 ==== osd_op_reply(217 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:218 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 52 ==== osd_op_reply(218 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.194+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:219 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 53 ==== osd_op_reply(219 gc.30 [call] v35'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-26T12:53:16.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:220 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 43 ==== osd_op_reply(220 gc.31 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:221 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 44 ==== osd_op_reply(221 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:222 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 45 ==== osd_op_reply(222 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:223 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 46 ==== osd_op_reply(223 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.198+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:224 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.202+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 47 ==== osd_op_reply(224 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.202+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.202+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:225 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.202+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 48 ==== osd_op_reply(225 gc.31 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.202+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-26T12:53:16.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.202+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:226 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 45 ==== osd_op_reply(226 gc.0 [call] v35'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:227 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 46 ==== osd_op_reply(227 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:228 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b73493d680 2024-04-26T12:53:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 47 ==== osd_op_reply(228 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:229 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 48 ==== osd_op_reply(229 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:230 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 49 ==== osd_op_reply(230 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.206+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:231 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 50 ==== osd_op_reply(231 gc.0 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-26T12:53:16.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:232 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 54 ==== osd_op_reply(232 gc.1 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:233 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 55 ==== osd_op_reply(233 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.210+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:234 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b734942070 2024-04-26T12:53:16.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 56 ==== osd_op_reply(234 gc.1 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:235 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 57 ==== osd_op_reply(235 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:236 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 58 ==== osd_op_reply(236 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.214+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:237 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b734942070 2024-04-26T12:53:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.218+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 59 ==== osd_op_reply(237 gc.1 [call] v35'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.218+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-26T12:53:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.218+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:238 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.218+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 81 ==== osd_op_reply(238 gc.2 [call] v35'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.218+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:239 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.218+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 82 ==== osd_op_reply(239 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.218+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:240 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 83 ==== osd_op_reply(240 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:241 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 84 ==== osd_op_reply(241 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:242 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 85 ==== osd_op_reply(242 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.222+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:243 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 86 ==== osd_op_reply(243 gc.2 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-26T12:53:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:244 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 51 ==== osd_op_reply(244 gc.3 [call] v35'282 uv282 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:245 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 52 ==== osd_op_reply(245 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.226+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:246 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b73493d680 2024-04-26T12:53:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 53 ==== osd_op_reply(246 gc.3 [call out=24b] v0'0 uv282 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:247 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 54 ==== osd_op_reply(247 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:248 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 55 ==== osd_op_reply(248 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.230+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:249 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b73493d680 2024-04-26T12:53:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.234+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 56 ==== osd_op_reply(249 gc.3 [call] v35'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.234+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-26T12:53:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.234+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:250 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.234+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 49 ==== osd_op_reply(250 gc.4 [call] v35'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.234+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:251 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.234+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 50 ==== osd_op_reply(251 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:252 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x7f206801fbe0 2024-04-26T12:53:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 51 ==== osd_op_reply(252 gc.4 [call out=24b] v0'0 uv93 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:253 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 52 ==== osd_op_reply(253 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:254 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 53 ==== osd_op_reply(254 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.238+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:255 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x7f206801fbe0 2024-04-26T12:53:16.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 54 ==== osd_op_reply(255 gc.4 [call] v35'94 uv94 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-26T12:53:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:256 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 87 ==== osd_op_reply(256 gc.5 [call] v35'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:257 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 88 ==== osd_op_reply(257 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:258 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b734979a10 con 0x55b7349469c0 2024-04-26T12:53:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 89 ==== osd_op_reply(258 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:259 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 90 ==== osd_op_reply(259 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.242+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:260 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aa20 con 0x55b7349469c0 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 91 ==== osd_op_reply(260 gc.5 [call out=1715b] v0'0 uv60 ondisk = 0) ==== 148+0+1715 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 20 garbage collection: RGWGC::process iterating over entry tag='fe657080-460c-4bb9-93cf-69170ee92cfa.4237.5846599397964323796', time=2024-04-26T12:53:23.796476+0000, chain.objs.size()=7 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_1 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:261 3.36s0 3:6d8099c9:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497aed0 con 0x7f206801fbe0 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_2 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:262 3.23s0 3:c46e6cd9:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497d8a0 con 0x55b734942070 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_3 2024-04-26T12:53:16.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:263 3.2fs0 3:f6d7a7ea:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349804b0 con 0x55b7349469c0 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_4 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:264 3.28s0 3:15aa4a9a:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b7349469c0 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_5 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:265 3.es0 3:72a0079c:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b734985b40 con 0x7f206801fbe0 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_6 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:266 3.22s0 3:467871e7:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349883b0 con 0x55b7349469c0 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_7 2024-04-26T12:53:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.246+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:267 3.3fs0 3:fcb2993f:::fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497d8a0 con 0x7f206801fbe0 2024-04-26T12:53:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.250+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 55 ==== osd_op_reply(267 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_7 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.250+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 56 ==== osd_op_reply(261 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_1 [call] v35'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.250+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 60 ==== osd_op_reply(262 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_2 [call] v35'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.254+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 92 ==== osd_op_reply(264 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_4 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.254+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 93 ==== osd_op_reply(266 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_6 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.254+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 57 ==== osd_op_reply(265 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_5 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.254+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 94 ==== osd_op_reply(263 fe657080-460c-4bb9-93cf-69170ee92cfa.4237.11__shadow_.sZ2RRbXnI0D2bqgJCC-4--DGVOiYVbG_3 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.254+0000 7f20821df980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-26T12:53:16.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.254+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:268 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b7349469c0 2024-04-26T12:53:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.262+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 95 ==== osd_op_reply(268 gc.5 [call] v35'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.262+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:269 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497d8a0 con 0x55b7349469c0 2024-04-26T12:53:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.262+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 96 ==== osd_op_reply(269 gc.5 [call] v35'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.262+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-26T12:53:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.262+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:270 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b73493d680 2024-04-26T12:53:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 57 ==== osd_op_reply(270 gc.6 [call] v35'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:271 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497d8a0 con 0x55b73493d680 2024-04-26T12:53:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 58 ==== osd_op_reply(271 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:272 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b73493d680 2024-04-26T12:53:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 59 ==== osd_op_reply(272 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:273 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497d8a0 con 0x55b73493d680 2024-04-26T12:53:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 60 ==== osd_op_reply(273 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:274 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b73493d680 2024-04-26T12:53:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 61 ==== osd_op_reply(274 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.266+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:275 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497d8a0 con 0x55b73493d680 2024-04-26T12:53:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.270+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 62 ==== osd_op_reply(275 gc.6 [call] v35'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.270+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-26T12:53:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.270+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:276 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b734942070 2024-04-26T12:53:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 61 ==== osd_op_reply(276 gc.7 [call] v35'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:277 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b73497d8a0 con 0x55b734942070 2024-04-26T12:53:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 62 ==== osd_op_reply(277 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:278 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b734942070 2024-04-26T12:53:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 63 ==== osd_op_reply(278 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:279 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b734942070 2024-04-26T12:53:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 64 ==== osd_op_reply(279 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.274+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:280 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b734942070 2024-04-26T12:53:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.278+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 65 ==== osd_op_reply(280 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.278+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.278+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:281 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b734942070 2024-04-26T12:53:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.278+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 66 ==== osd_op_reply(281 gc.7 [call] v35'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.278+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-26T12:53:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.278+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:282 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x7f206801fbe0 2024-04-26T12:53:16.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 58 ==== osd_op_reply(282 gc.8 [call] v35'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:283 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x7f206801fbe0 2024-04-26T12:53:16.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 59 ==== osd_op_reply(283 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:284 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x7f206801fbe0 2024-04-26T12:53:16.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 60 ==== osd_op_reply(284 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:285 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x7f206801fbe0 2024-04-26T12:53:16.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 61 ==== osd_op_reply(285 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.282+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.286+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:286 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x7f206801fbe0 2024-04-26T12:53:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.286+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 62 ==== osd_op_reply(286 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.286+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.286+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:287 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x7f206801fbe0 2024-04-26T12:53:16.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.286+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 63 ==== osd_op_reply(287 gc.8 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.286+0000 7f20821df980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-26T12:53:16.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.286+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:288 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b7349469c0 2024-04-26T12:53:16.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 97 ==== osd_op_reply(288 gc.9 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:289 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b7349469c0 2024-04-26T12:53:16.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 98 ==== osd_op_reply(289 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:290 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b7349469c0 2024-04-26T12:53:16.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 99 ==== osd_op_reply(290 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:291 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b7349469c0 2024-04-26T12:53:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 100 ==== osd_op_reply(291 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:53:16.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:292 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b7349830d0 con 0x55b7349469c0 2024-04-26T12:53:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 101 ==== osd_op_reply(292 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:53:16.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.290+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:293 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73497b270 con 0x55b7349469c0 2024-04-26T12:53:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.294+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 102 ==== osd_op_reply(293 gc.9 [call] v35'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.294+0000 7f1f35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:53:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.294+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94245349555664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b734979ec0 con 0x55b73493d680 2024-04-26T12:53:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.298+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 63 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94245349555664] v35'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.298+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94245349534960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494fdd0 con 0x7f206801fbe0 2024-04-26T12:53:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.302+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94245349534960] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.302+0000 7f20821df980 20 remove_watcher() i=0 2024-04-26T12:53:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.302+0000 7f20821df980 2 removed watcher, disabling cache 2024-04-26T12:53:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.302+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94245349537888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494fdd0 con 0x55b73493d680 2024-04-26T12:53:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.302+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 64 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94245349537888] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.302+0000 7f20821df980 20 remove_watcher() i=1 2024-04-26T12:53:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.302+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94245349532400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494fdd0 con 0x55b7349469c0 2024-04-26T12:53:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.306+0000 7f207f4f9640 1 -- 172.21.15.72:0/436397824 <== osd.3 v2:172.21.15.72:6808/671626845 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94245349532400] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2068037040 con 0x55b7349469c0 2024-04-26T12:53:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.306+0000 7f20821df980 20 remove_watcher() i=2 2024-04-26T12:53:16.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.306+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94245349544304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494fdd0 con 0x7f206801fbe0 2024-04-26T12:53:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.310+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.2 v2:172.21.15.72:6800/1931234624 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94245349544304] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x7f206801fbe0 2024-04-26T12:53:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.310+0000 7f20821df980 20 remove_watcher() i=3 2024-04-26T12:53:16.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.310+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94245349548704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494d170 con 0x55b73493d680 2024-04-26T12:53:16.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-26T12:53:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.310+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 <== osd.1 v2:172.21.15.72:6816/1811201389 65 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94245349548704] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2078026040 con 0x55b73493d680 2024-04-26T12:53:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.310+0000 7f20821df980 20 remove_watcher() i=4 2024-04-26T12:53:16.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.310+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94245349546032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494fdd0 con 0x55b734942070 2024-04-26T12:53:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.314+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94245349546032] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.314+0000 7f20821df980 20 remove_watcher() i=5 2024-04-26T12:53:16.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.314+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94245349552112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494e2a0 con 0x55b734942070 2024-04-26T12:53:16.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94245349552112] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 20 remove_watcher() i=6 2024-04-26T12:53:16.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94245349550912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b73494d170 con 0x55b734942070 2024-04-26T12:53:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f207fcfa640 1 -- 172.21.15.72:0/436397824 <== osd.0 v2:172.21.15.29:6800/1895601642 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94245349550912] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20700cd060 con 0x55b734942070 2024-04-26T12:53:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 20 remove_watcher() i=7 2024-04-26T12:53:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b734942070 msgr2=0x55b734944460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b734942070 0x55b734944460 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73493d680 msgr2=0x55b73493fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73493d680 0x55b73493fb40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f206801fbe0 msgr2=0x7f206803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7f206801fbe0 0x7f206803a3c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b7349469c0 msgr2=0x55b734948dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b7349469c0 0x55b734948dd0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f48034600 msgr2=0x7f1f48036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f48034600 0x7f1f48036ac0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55b7349105f0 tx=0x7f2068010000 comp rx=0 tx=0).stop 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20804fb640 1 -- 172.21.15.72:0/436397824 reap_dead start 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 msgr2=0x55b734932550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.318+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b734932550 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f20700c2170 tx=0x7f20700c2f60 comp rx=0 tx=0).stop 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 shutdown_connections 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/436397824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73492b230 0x55b734932550 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 >> 172.21.15.72:0/436397824 conn(0x55b7349275c0 msgr2=0x55b734924c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 shutdown_connections 2024-04-26T12:53:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/436397824 wait complete. 2024-04-26T12:53:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f58034600 msgr2=0x7f1f58036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f58034600 0x7f1f58036ac0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55b734813120 tx=0x7f206800f000 comp rx=0 tx=0).stop 2024-04-26T12:53:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73491e280 msgr2=0x55b73491e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73491e280 0x55b73491e6a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f20700e2e10 tx=0x7f20700c6e20 comp rx=0 tx=0).stop 2024-04-26T12:53:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 shutdown_connections 2024-04-26T12:53:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f58034600 0x7f1f58036ac0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/3596779922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73491e280 0x55b73491e6a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 >> 172.21.15.72:0/3596779922 conn(0x55b734913090 msgr2=0x55b734913ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 shutdown_connections 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/3596779922 wait complete. 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b7349097c0 msgr2=0x55b73490bbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x55b7349097c0 0x55b73490bbb0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73480aac0 msgr2=0x55b734907120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x55b73480aac0 0x55b734907120 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b73490d700 msgr2=0x55b73490faf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x55b73490d700 0x55b73490faf0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f68034650 msgr2=0x7f1f68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1f68034650 0x7f1f68036b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2068001e50 tx=0x7f20680013b0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 msgr2=0x55b7348140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 --2- 172.21.15.72:0/2845023379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55b73480a1a0 0x55b7348140b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2070017ca0 tx=0x7f2070017e30 comp rx=0 tx=0).stop 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20804fb640 1 -- 172.21.15.72:0/2845023379 reap_dead start 2024-04-26T12:53:16.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 shutdown_connections 2024-04-26T12:53:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 >> 172.21.15.72:0/2845023379 conn(0x55b734805a70 msgr2=0x55b7348f1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 shutdown_connections 2024-04-26T12:53:16.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T12:53:16.322+0000 7f20821df980 1 -- 172.21.15.72:0/2845023379 wait complete. 2024-04-26T12:53:16.345 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:53:16.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:53:16.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:53:16.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc826d60640 1 Processor -- start 2024-04-26T12:53:16.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc826d60640 1 -- start start 2024-04-26T12:53:16.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc826d60640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc820099900 0x7fc820133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:16.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc826d60640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82009ae10 con 0x7fc820098e10 2024-04-26T12:53:16.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc826d60640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc82009ab00 con 0x7fc820099900 2024-04-26T12:53:16.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc81ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc820099900 0x7fc820133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:16.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc824afc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc820098e10 0x7fc8200991f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55228/0 (socket says 172.21.15.29:55228) 2024-04-26T12:53:16.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc824afc640 1 -- 172.21.15.29:0/3392213624 learned_addr learned my addr 172.21.15.29:0/3392213624 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc81ffff640 1 -- 172.21.15.29:0/3392213624 >> v1:172.21.15.29:6789/0 conn(0x7fc820098e10 legacy=0x7fc8200991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc81ffff640 1 -- 172.21.15.29:0/3392213624 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8200a00c0 con 0x7fc820099900 2024-04-26T12:53:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc81ffff640 1 --2- 172.21.15.29:0/3392213624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820099900 0x7fc820133a80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc814009740 tx=0x7fc81401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939651d395554491 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.486+0000 7fc81f7fe640 1 -- 172.21.15.29:0/3392213624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8140b0070 con 0x7fc820099900 2024-04-26T12:53:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc81f7fe640 1 -- 172.21.15.29:0/3392213624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8140ab530 con 0x7fc820099900 2024-04-26T12:53:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc81f7fe640 1 -- 172.21.15.29:0/3392213624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8140ab830 con 0x7fc820099900 2024-04-26T12:53:16.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- 172.21.15.29:0/3392213624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820099900 msgr2=0x7fc820133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 --2- 172.21.15.29:0/3392213624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820099900 0x7fc820133a80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc814009740 tx=0x7fc81401c370 comp rx=0 tx=0).stop 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- 172.21.15.29:0/3392213624 shutdown_connections 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 --2- 172.21.15.29:0/3392213624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820099900 0x7fc820133a80 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- 172.21.15.29:0/3392213624 >> 172.21.15.29:0/3392213624 conn(0x7fc82009ee00 msgr2=0x7fc82009f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- 172.21.15.29:0/3392213624 shutdown_connections 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- 172.21.15.29:0/3392213624 wait complete. 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 Processor -- start 2024-04-26T12:53:16.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- start start 2024-04-26T12:53:16.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820098e10 0x7fc820132710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:16.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc820136b70 con 0x7fc820098e10 2024-04-26T12:53:16.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc824afc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820098e10 0x7fc820132710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:16.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc824afc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820098e10 0x7fc820132710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59944/0 (socket says 172.21.15.29:59944) 2024-04-26T12:53:16.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc824afc640 1 -- 172.21.15.29:0/584241660 learned_addr learned my addr 172.21.15.29:0/584241660 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:16.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc824afc640 1 -- 172.21.15.29:0/584241660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc820092e00 con 0x7fc820098e10 2024-04-26T12:53:16.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc824afc640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820098e10 0x7fc820132710 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c480 tx=0x7fc81000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:16.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc81d7fa640 1 -- 172.21.15.29:0/584241660 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc810017070 con 0x7fc820098e10 2024-04-26T12:53:16.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc81d7fa640 1 -- 172.21.15.29:0/584241660 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc810005c20 con 0x7fc820098e10 2024-04-26T12:53:16.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc81d7fa640 1 -- 172.21.15.29:0/584241660 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc810007070 con 0x7fc820098e10 2024-04-26T12:53:16.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8200934e0 con 0x7fc820098e10 2024-04-26T12:53:16.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.490+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc820094100 con 0x7fc820098e10 2024-04-26T12:53:16.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.494+0000 7fc81d7fa640 1 -- 172.21.15.29:0/584241660 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc81001a070 con 0x7fc820098e10 2024-04-26T12:53:16.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.494+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc820125fb0 con 0x7fc820098e10 2024-04-26T12:53:16.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.494+0000 7fc81d7fa640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc80c035db0 0x7fc80c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:16.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.494+0000 7fc81d7fa640 1 -- 172.21.15.29:0/584241660 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fc810048480 con 0x7fc820098e10 2024-04-26T12:53:16.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.494+0000 7fc81ffff640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc80c035db0 0x7fc80c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:16.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.494+0000 7fc81ffff640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc80c035db0 0x7fc80c038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc8140ad000 tx=0x7fc8140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:16.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.498+0000 7fc81d7fa640 1 -- 172.21.15.29:0/584241660 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc82009ae10 con 0x7fc820098e10 2024-04-26T12:53:16.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.658+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc820093a50 con 0x7fc80c035db0 2024-04-26T12:53:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.706+0000 7fc81d7fa640 1 -- 172.21.15.29:0/584241660 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665708 (secure 0 0 0) 0x7fc820093a50 con 0x7fc80c035db0 2024-04-26T12:53:16.714 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:53:16.721 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc80c035db0 msgr2=0x7fc80c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc80c035db0 0x7fc80c038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc8140ad000 tx=0x7fc8140a6000 comp rx=0 tx=0).stop 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820098e10 msgr2=0x7fc820132710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820098e10 0x7fc820132710 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c480 tx=0x7fc81000c940 comp rx=0 tx=0).stop 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 shutdown_connections 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fc80c035db0 0x7fc80c038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 --2- 172.21.15.29:0/584241660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820098e10 0x7fc820132710 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 >> 172.21.15.29:0/584241660 conn(0x7fc82009ee00 msgr2=0x7fc820096280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:16.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 shutdown_connections 2024-04-26T12:53:16.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.710+0000 7fc826d60640 1 -- 172.21.15.29:0/584241660 wait complete. 2024-04-26T12:53:16.730 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-26T12:53:15.234344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2106,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4477,"ondisk_log_size":4477,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173780,"kb_used_data":40756,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377313580,"statfs":{"total":386547056640,"available":386369105920,"internally_reserved":0,"allocated":41734144,"data_stored":40510918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":136177427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":465,"num_write":386,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006754"},"pg_stats":[{"pgid":"3.3f","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.960256+0000","last_change":"2024-04-26T12:49:54.242608+0000","last_active":"2024-04-26T12:52:02.960256+0000","last_peered":"2024-04-26T12:52:02.960256+0000","last_clean":"2024-04-26T12:52:02.960256+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:52:02.960256+0000","last_undegraded":"2024-04-26T12:52:02.960256+0000","last_fullsized":"2024-04-26T12:52:02.960256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.951421+0000","last_change":"2024-04-26T12:49:56.222755+0000","last_active":"2024-04-26T12:52:03.951421+0000","last_peered":"2024-04-26T12:52:03.951421+0000","last_clean":"2024-04-26T12:52:03.951421+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:52:03.951421+0000","last_undegraded":"2024-04-26T12:52:03.951421+0000","last_fullsized":"2024-04-26T12:52:03.951421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:40.027829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303872+0000","last_change":"2024-04-26T12:49:54.235378+0000","last_active":"2024-04-26T12:50:34.303872+0000","last_peered":"2024-04-26T12:50:34.303872+0000","last_clean":"2024-04-26T12:50:34.303872+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:50:34.303872+0000","last_undegraded":"2024-04-26T12:50:34.303872+0000","last_fullsized":"2024-04-26T12:50:34.303872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.979752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420744+0000","last_change":"2024-04-26T12:49:56.223502+0000","last_active":"2024-04-26T12:53:09.420744+0000","last_peered":"2024-04-26T12:53:09.420744+0000","last_clean":"2024-04-26T12:53:09.420744+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:53:09.420744+0000","last_undegraded":"2024-04-26T12:53:09.420744+0000","last_fullsized":"2024-04-26T12:53:09.420744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:55.385814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.443926+0000","last_change":"2024-04-26T12:49:54.259543+0000","last_active":"2024-04-26T12:50:38.443926+0000","last_peered":"2024-04-26T12:50:38.443926+0000","last_clean":"2024-04-26T12:50:38.443926+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:50:38.443926+0000","last_undegraded":"2024-04-26T12:50:38.443926+0000","last_fullsized":"2024-04-26T12:50:38.443926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:21.397944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439652+0000","last_change":"2024-04-26T12:49:56.230220+0000","last_active":"2024-04-26T12:53:09.439652+0000","last_peered":"2024-04-26T12:53:09.439652+0000","last_clean":"2024-04-26T12:53:09.439652+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:09.439652+0000","last_undegraded":"2024-04-26T12:53:09.439652+0000","last_fullsized":"2024-04-26T12:53:09.439652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:52.667520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.986056+0000","last_change":"2024-04-26T12:49:54.243452+0000","last_active":"2024-04-26T12:52:07.986056+0000","last_peered":"2024-04-26T12:52:07.986056+0000","last_clean":"2024-04-26T12:52:07.986056+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:52:07.986056+0000","last_undegraded":"2024-04-26T12:52:07.986056+0000","last_fullsized":"2024-04-26T12:52:07.986056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265864+0000","last_change":"2024-04-26T12:50:34.320557+0000","last_active":"2024-04-26T12:53:09.265864+0000","last_peered":"2024-04-26T12:53:09.265864+0000","last_clean":"2024-04-26T12:53:09.265864+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:53:09.265864+0000","last_undegraded":"2024-04-26T12:53:09.265864+0000","last_fullsized":"2024-04-26T12:53:09.265864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:36.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.171393+0000","last_change":"2024-04-26T12:49:54.237140+0000","last_active":"2024-04-26T12:52:08.171393+0000","last_peered":"2024-04-26T12:52:08.171393+0000","last_clean":"2024-04-26T12:52:08.171393+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:52:08.171393+0000","last_undegraded":"2024-04-26T12:52:08.171393+0000","last_fullsized":"2024-04-26T12:52:08.171393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:58.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945401+0000","last_change":"2024-04-26T12:49:56.231677+0000","last_active":"2024-04-26T12:50:39.945401+0000","last_peered":"2024-04-26T12:50:39.945401+0000","last_clean":"2024-04-26T12:50:39.945401+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:50:39.945401+0000","last_undegraded":"2024-04-26T12:50:39.945401+0000","last_fullsized":"2024-04-26T12:50:39.945401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:40.895169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296361+0000","last_change":"2024-04-26T12:49:54.242489+0000","last_active":"2024-04-26T12:50:34.296361+0000","last_peered":"2024-04-26T12:50:34.296361+0000","last_clean":"2024-04-26T12:50:34.296361+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:50:34.296361+0000","last_undegraded":"2024-04-26T12:50:34.296361+0000","last_fullsized":"2024-04-26T12:50:34.296361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.944960+0000","last_change":"2024-04-26T12:49:56.229364+0000","last_active":"2024-04-26T12:50:39.944960+0000","last_peered":"2024-04-26T12:50:39.944960+0000","last_clean":"2024-04-26T12:50:39.944960+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:50:39.944960+0000","last_undegraded":"2024-04-26T12:50:39.944960+0000","last_fullsized":"2024-04-26T12:50:39.944960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.707668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.932592+0000","last_change":"2024-04-26T12:49:54.238559+0000","last_active":"2024-04-26T12:52:03.932592+0000","last_peered":"2024-04-26T12:52:03.932592+0000","last_clean":"2024-04-26T12:52:03.932592+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:52:03.932592+0000","last_undegraded":"2024-04-26T12:52:03.932592+0000","last_fullsized":"2024-04-26T12:52:03.932592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:18.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.525120+0000","last_change":"2024-04-26T12:49:56.219293+0000","last_active":"2024-04-26T12:53:09.525120+0000","last_peered":"2024-04-26T12:53:09.525120+0000","last_clean":"2024-04-26T12:53:09.525120+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:09.525120+0000","last_undegraded":"2024-04-26T12:53:09.525120+0000","last_fullsized":"2024-04-26T12:53:09.525120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297946+0000","last_change":"2024-04-26T12:49:54.238122+0000","last_active":"2024-04-26T12:50:34.297946+0000","last_peered":"2024-04-26T12:50:34.297946+0000","last_clean":"2024-04-26T12:50:34.297946+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:50:34.297946+0000","last_undegraded":"2024-04-26T12:50:34.297946+0000","last_fullsized":"2024-04-26T12:50:34.297946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:44.405285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.935848+0000","last_change":"2024-04-26T12:49:56.214215+0000","last_active":"2024-04-26T12:52:03.935848+0000","last_peered":"2024-04-26T12:52:03.935848+0000","last_clean":"2024-04-26T12:52:03.935848+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:52:03.935848+0000","last_undegraded":"2024-04-26T12:52:03.935848+0000","last_fullsized":"2024-04-26T12:52:03.935848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.065457+0000","last_change":"2024-04-26T12:49:56.220575+0000","last_active":"2024-04-26T12:53:09.065457+0000","last_peered":"2024-04-26T12:53:09.065457+0000","last_clean":"2024-04-26T12:53:09.065457+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:53:09.065457+0000","last_undegraded":"2024-04-26T12:53:09.065457+0000","last_fullsized":"2024-04-26T12:53:09.065457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:18.310904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.927312+0000","last_change":"2024-04-26T12:49:54.245871+0000","last_active":"2024-04-26T12:50:39.927312+0000","last_peered":"2024-04-26T12:50:39.927312+0000","last_clean":"2024-04-26T12:50:39.927312+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:50:39.927312+0000","last_undegraded":"2024-04-26T12:50:39.927312+0000","last_fullsized":"2024-04-26T12:50:39.927312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265368+0000","last_change":"2024-04-26T12:49:56.220421+0000","last_active":"2024-04-26T12:53:09.265368+0000","last_peered":"2024-04-26T12:53:09.265368+0000","last_clean":"2024-04-26T12:53:09.265368+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:09.265368+0000","last_undegraded":"2024-04-26T12:53:09.265368+0000","last_fullsized":"2024-04-26T12:53:09.265368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'3","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964829+0000","last_change":"2024-04-26T12:49:54.250106+0000","last_active":"2024-04-26T12:52:22.964829+0000","last_peered":"2024-04-26T12:52:22.964829+0000","last_clean":"2024-04-26T12:52:22.964829+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:52:22.964829+0000","last_undegraded":"2024-04-26T12:52:22.964829+0000","last_fullsized":"2024-04-26T12:52:22.964829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.348707+0000","last_change":"2024-04-26T12:49:56.222834+0000","last_active":"2024-04-26T12:53:09.348707+0000","last_peered":"2024-04-26T12:53:09.348707+0000","last_clean":"2024-04-26T12:53:09.348707+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:09.348707+0000","last_undegraded":"2024-04-26T12:53:09.348707+0000","last_fullsized":"2024-04-26T12:53:09.348707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:55.139601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317543+0000","last_change":"2024-04-26T12:49:54.244413+0000","last_active":"2024-04-26T12:50:34.317543+0000","last_peered":"2024-04-26T12:50:34.317543+0000","last_clean":"2024-04-26T12:50:34.317543+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:50:34.317543+0000","last_undegraded":"2024-04-26T12:50:34.317543+0000","last_fullsized":"2024-04-26T12:50:34.317543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.920847+0000","last_change":"2024-04-26T12:49:56.221481+0000","last_active":"2024-04-26T12:53:08.920847+0000","last_peered":"2024-04-26T12:53:08.920847+0000","last_clean":"2024-04-26T12:53:08.920847+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:53:08.920847+0000","last_undegraded":"2024-04-26T12:53:08.920847+0000","last_fullsized":"2024-04-26T12:53:08.920847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:18.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.218924+0000","last_change":"2024-04-26T12:49:54.246419+0000","last_active":"2024-04-26T12:53:09.218924+0000","last_peered":"2024-04-26T12:53:09.218924+0000","last_clean":"2024-04-26T12:53:09.218924+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:09.218924+0000","last_undegraded":"2024-04-26T12:53:09.218924+0000","last_fullsized":"2024-04-26T12:53:09.218924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298569+0000","last_change":"2024-04-26T12:49:56.215781+0000","last_active":"2024-04-26T12:50:34.298569+0000","last_peered":"2024-04-26T12:50:34.298569+0000","last_clean":"2024-04-26T12:50:34.298569+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:50:34.298569+0000","last_undegraded":"2024-04-26T12:50:34.298569+0000","last_fullsized":"2024-04-26T12:50:34.298569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:05.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301528+0000","last_change":"2024-04-26T12:49:54.235967+0000","last_active":"2024-04-26T12:50:34.301528+0000","last_peered":"2024-04-26T12:50:34.301528+0000","last_clean":"2024-04-26T12:50:34.301528+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:50:34.301528+0000","last_undegraded":"2024-04-26T12:50:34.301528+0000","last_fullsized":"2024-04-26T12:50:34.301528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:38.031959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.349371+0000","last_change":"2024-04-26T12:49:56.230516+0000","last_active":"2024-04-26T12:53:09.349371+0000","last_peered":"2024-04-26T12:53:09.349371+0000","last_clean":"2024-04-26T12:53:09.349371+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:09.349371+0000","last_undegraded":"2024-04-26T12:53:09.349371+0000","last_fullsized":"2024-04-26T12:53:09.349371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:43.529519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307407+0000","last_change":"2024-04-26T12:49:54.231273+0000","last_active":"2024-04-26T12:50:34.307407+0000","last_peered":"2024-04-26T12:50:34.307407+0000","last_clean":"2024-04-26T12:50:34.307407+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:50:34.307407+0000","last_undegraded":"2024-04-26T12:50:34.307407+0000","last_fullsized":"2024-04-26T12:50:34.307407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:04.131902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.309725+0000","last_change":"2024-04-26T12:50:04.290015+0000","last_active":"2024-04-26T12:53:09.309725+0000","last_peered":"2024-04-26T12:53:09.309725+0000","last_clean":"2024-04-26T12:53:09.309725+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:53:09.309725+0000","last_undegraded":"2024-04-26T12:53:09.309725+0000","last_fullsized":"2024-04-26T12:53:09.309725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:43.725242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966748+0000","last_change":"2024-04-26T12:49:56.230418+0000","last_active":"2024-04-26T12:52:17.966748+0000","last_peered":"2024-04-26T12:52:17.966748+0000","last_clean":"2024-04-26T12:52:17.966748+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:52:17.966748+0000","last_undegraded":"2024-04-26T12:52:17.966748+0000","last_fullsized":"2024-04-26T12:52:17.966748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:45.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308000+0000","last_change":"2024-04-26T12:49:54.258161+0000","last_active":"2024-04-26T12:50:34.308000+0000","last_peered":"2024-04-26T12:50:34.308000+0000","last_clean":"2024-04-26T12:50:34.308000+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:50:34.308000+0000","last_undegraded":"2024-04-26T12:50:34.308000+0000","last_fullsized":"2024-04-26T12:50:34.308000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:00.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.757841+0000","last_change":"2024-04-26T12:49:58.245109+0000","last_active":"2024-04-26T12:52:07.757841+0000","last_peered":"2024-04-26T12:52:07.757841+0000","last_clean":"2024-04-26T12:52:07.757841+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:52:07.757841+0000","last_undegraded":"2024-04-26T12:52:07.757841+0000","last_fullsized":"2024-04-26T12:52:07.757841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:01.452307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.184804+0000","last_change":"2024-04-26T12:50:00.267183+0000","last_active":"2024-04-26T12:52:06.184804+0000","last_peered":"2024-04-26T12:52:06.184804+0000","last_clean":"2024-04-26T12:52:06.184804+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:52:06.184804+0000","last_undegraded":"2024-04-26T12:52:06.184804+0000","last_fullsized":"2024-04-26T12:52:06.184804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:20.694030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318971+0000","last_change":"2024-04-26T12:50:02.286913+0000","last_active":"2024-04-26T12:50:34.318971+0000","last_peered":"2024-04-26T12:50:34.318971+0000","last_clean":"2024-04-26T12:50:34.318971+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:50:34.318971+0000","last_undegraded":"2024-04-26T12:50:34.318971+0000","last_fullsized":"2024-04-26T12:50:34.318971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.009156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.021133+0000","last_change":"2024-04-26T12:50:04.289706+0000","last_active":"2024-04-26T12:51:23.021133+0000","last_peered":"2024-04-26T12:51:23.021133+0000","last_clean":"2024-04-26T12:51:23.021133+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:51:23.021133+0000","last_undegraded":"2024-04-26T12:51:23.021133+0000","last_fullsized":"2024-04-26T12:51:23.021133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420741+0000","last_change":"2024-04-26T12:49:56.230756+0000","last_active":"2024-04-26T12:53:09.420741+0000","last_peered":"2024-04-26T12:53:09.420741+0000","last_clean":"2024-04-26T12:53:09.420741+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:09.420741+0000","last_undegraded":"2024-04-26T12:53:09.420741+0000","last_fullsized":"2024-04-26T12:53:09.420741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:08.686460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295413+0000","last_change":"2024-04-26T12:49:54.239992+0000","last_active":"2024-04-26T12:50:34.295413+0000","last_peered":"2024-04-26T12:50:34.295413+0000","last_clean":"2024-04-26T12:50:34.295413+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:50:34.295413+0000","last_undegraded":"2024-04-26T12:50:34.295413+0000","last_fullsized":"2024-04-26T12:50:34.295413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298746+0000","last_change":"2024-04-26T12:49:58.222832+0000","last_active":"2024-04-26T12:50:34.298746+0000","last_peered":"2024-04-26T12:50:34.298746+0000","last_clean":"2024-04-26T12:50:34.298746+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:50:34.298746+0000","last_undegraded":"2024-04-26T12:50:34.298746+0000","last_fullsized":"2024-04-26T12:50:34.298746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:55.234724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317827+0000","last_change":"2024-04-26T12:50:00.237541+0000","last_active":"2024-04-26T12:50:34.317827+0000","last_peered":"2024-04-26T12:50:34.317827+0000","last_clean":"2024-04-26T12:50:34.317827+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:50:34.317827+0000","last_undegraded":"2024-04-26T12:50:34.317827+0000","last_fullsized":"2024-04-26T12:50:34.317827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:55.963923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317973+0000","last_change":"2024-04-26T12:50:02.279094+0000","last_active":"2024-04-26T12:50:34.317973+0000","last_peered":"2024-04-26T12:50:34.317973+0000","last_clean":"2024-04-26T12:50:34.317973+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:50:34.317973+0000","last_undegraded":"2024-04-26T12:50:34.317973+0000","last_fullsized":"2024-04-26T12:50:34.317973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:59.872989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297515+0000","last_change":"2024-04-26T12:50:04.281974+0000","last_active":"2024-04-26T12:50:34.297515+0000","last_peered":"2024-04-26T12:50:34.297515+0000","last_clean":"2024-04-26T12:50:34.297515+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:50:34.297515+0000","last_undegraded":"2024-04-26T12:50:34.297515+0000","last_fullsized":"2024-04-26T12:50:34.297515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:37.632879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301288+0000","last_change":"2024-04-26T12:49:56.230322+0000","last_active":"2024-04-26T12:51:23.301288+0000","last_peered":"2024-04-26T12:51:23.301288+0000","last_clean":"2024-04-26T12:51:23.301288+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:51:23.301288+0000","last_undegraded":"2024-04-26T12:51:23.301288+0000","last_fullsized":"2024-04-26T12:51:23.301288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:53.550517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302460+0000","last_change":"2024-04-26T12:49:54.238247+0000","last_active":"2024-04-26T12:50:34.302460+0000","last_peered":"2024-04-26T12:50:34.302460+0000","last_clean":"2024-04-26T12:50:34.302460+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:50:34.302460+0000","last_undegraded":"2024-04-26T12:50:34.302460+0000","last_fullsized":"2024-04-26T12:50:34.302460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:27.411968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304667+0000","last_change":"2024-04-26T12:49:58.227229+0000","last_active":"2024-04-26T12:50:34.304667+0000","last_peered":"2024-04-26T12:50:34.304667+0000","last_clean":"2024-04-26T12:50:34.304667+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:50:34.304667+0000","last_undegraded":"2024-04-26T12:50:34.304667+0000","last_fullsized":"2024-04-26T12:50:34.304667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.728074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299915+0000","last_change":"2024-04-26T12:50:00.265817+0000","last_active":"2024-04-26T12:50:34.299915+0000","last_peered":"2024-04-26T12:50:34.299915+0000","last_clean":"2024-04-26T12:50:34.299915+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:50:34.299915+0000","last_undegraded":"2024-04-26T12:50:34.299915+0000","last_fullsized":"2024-04-26T12:50:34.299915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":386,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.611107+0000","last_change":"2024-04-26T12:50:02.294244+0000","last_active":"2024-04-26T12:53:09.611107+0000","last_peered":"2024-04-26T12:53:09.611107+0000","last_clean":"2024-04-26T12:53:09.611107+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:09.611107+0000","last_undegraded":"2024-04-26T12:53:09.611107+0000","last_fullsized":"2024-04-26T12:53:09.611107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295111+0000","last_change":"2024-04-26T12:50:04.283093+0000","last_active":"2024-04-26T12:50:34.295111+0000","last_peered":"2024-04-26T12:50:34.295111+0000","last_clean":"2024-04-26T12:50:34.295111+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:50:34.295111+0000","last_undegraded":"2024-04-26T12:50:34.295111+0000","last_fullsized":"2024-04-26T12:50:34.295111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:54.841461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352362+0000","last_change":"2024-04-26T12:49:56.227048+0000","last_active":"2024-04-26T12:53:09.352362+0000","last_peered":"2024-04-26T12:53:09.352362+0000","last_clean":"2024-04-26T12:53:09.352362+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:09.352362+0000","last_undegraded":"2024-04-26T12:53:09.352362+0000","last_fullsized":"2024-04-26T12:53:09.352362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:09.070129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.905801+0000","last_change":"2024-04-26T12:49:54.236350+0000","last_active":"2024-04-26T12:50:39.905801+0000","last_peered":"2024-04-26T12:50:39.905801+0000","last_clean":"2024-04-26T12:50:39.905801+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:50:39.905801+0000","last_undegraded":"2024-04-26T12:50:39.905801+0000","last_fullsized":"2024-04-26T12:50:39.905801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.325536+0000","last_change":"2024-04-26T12:49:58.245623+0000","last_active":"2024-04-26T12:50:34.325536+0000","last_peered":"2024-04-26T12:50:34.325536+0000","last_clean":"2024-04-26T12:50:34.325536+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:50:34.325536+0000","last_undegraded":"2024-04-26T12:50:34.325536+0000","last_fullsized":"2024-04-26T12:50:34.325536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:58.925636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.176499+0000","last_change":"2024-04-26T12:50:00.265428+0000","last_active":"2024-04-26T12:52:06.176499+0000","last_peered":"2024-04-26T12:52:06.176499+0000","last_clean":"2024-04-26T12:52:06.176499+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:52:06.176499+0000","last_undegraded":"2024-04-26T12:52:06.176499+0000","last_fullsized":"2024-04-26T12:52:06.176499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:23.018038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.428698+0000","last_change":"2024-04-26T12:50:02.264756+0000","last_active":"2024-04-26T12:53:09.428698+0000","last_peered":"2024-04-26T12:53:09.428698+0000","last_clean":"2024-04-26T12:53:09.428698+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:09.428698+0000","last_undegraded":"2024-04-26T12:53:09.428698+0000","last_fullsized":"2024-04-26T12:53:09.428698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:39.304818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.930226+0000","last_change":"2024-04-26T12:49:56.225947+0000","last_active":"2024-04-26T12:53:08.930226+0000","last_peered":"2024-04-26T12:53:08.930226+0000","last_clean":"2024-04-26T12:53:08.930226+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:53:08.930226+0000","last_undegraded":"2024-04-26T12:53:08.930226+0000","last_fullsized":"2024-04-26T12:53:08.930226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:51.767496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.227207+0000","last_change":"2024-04-26T12:49:54.242591+0000","last_active":"2024-04-26T12:53:09.227207+0000","last_peered":"2024-04-26T12:53:09.227207+0000","last_clean":"2024-04-26T12:53:09.227207+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:53:09.227207+0000","last_undegraded":"2024-04-26T12:53:09.227207+0000","last_fullsized":"2024-04-26T12:53:09.227207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310114+0000","last_change":"2024-04-26T12:49:58.241965+0000","last_active":"2024-04-26T12:50:34.310114+0000","last_peered":"2024-04-26T12:50:34.310114+0000","last_clean":"2024-04-26T12:50:34.310114+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:50:34.310114+0000","last_undegraded":"2024-04-26T12:50:34.310114+0000","last_fullsized":"2024-04-26T12:50:34.310114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:10.690590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'40","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.192218+0000","last_change":"2024-04-26T12:50:00.235080+0000","last_active":"2024-04-26T12:52:06.192218+0000","last_peered":"2024-04-26T12:52:06.192218+0000","last_clean":"2024-04-26T12:52:06.192218+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:52:06.192218+0000","last_undegraded":"2024-04-26T12:52:06.192218+0000","last_fullsized":"2024-04-26T12:52:06.192218+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.158126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300728+0000","last_change":"2024-04-26T12:50:02.273873+0000","last_active":"2024-04-26T12:50:34.300728+0000","last_peered":"2024-04-26T12:50:34.300728+0000","last_clean":"2024-04-26T12:50:34.300728+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:50:34.300728+0000","last_undegraded":"2024-04-26T12:50:34.300728+0000","last_fullsized":"2024-04-26T12:50:34.300728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:53.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.326178+0000","last_change":"2024-04-26T12:50:04.291139+0000","last_active":"2024-04-26T12:53:09.326178+0000","last_peered":"2024-04-26T12:53:09.326178+0000","last_clean":"2024-04-26T12:53:09.326178+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:53:09.326178+0000","last_undegraded":"2024-04-26T12:53:09.326178+0000","last_fullsized":"2024-04-26T12:53:09.326178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:27.099715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302331+0000","last_change":"2024-04-26T12:49:56.227916+0000","last_active":"2024-04-26T12:51:23.302331+0000","last_peered":"2024-04-26T12:51:23.302331+0000","last_clean":"2024-04-26T12:51:23.302331+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:51:23.302331+0000","last_undegraded":"2024-04-26T12:51:23.302331+0000","last_fullsized":"2024-04-26T12:51:23.302331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:18.700267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.961996+0000","last_change":"2024-04-26T12:49:54.247789+0000","last_active":"2024-04-26T12:52:12.961996+0000","last_peered":"2024-04-26T12:52:12.961996+0000","last_clean":"2024-04-26T12:52:12.961996+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:52:12.961996+0000","last_undegraded":"2024-04-26T12:52:12.961996+0000","last_fullsized":"2024-04-26T12:52:12.961996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298328+0000","last_change":"2024-04-26T12:49:58.227616+0000","last_active":"2024-04-26T12:50:34.298328+0000","last_peered":"2024-04-26T12:50:34.298328+0000","last_clean":"2024-04-26T12:50:34.298328+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:50:34.298328+0000","last_undegraded":"2024-04-26T12:50:34.298328+0000","last_fullsized":"2024-04-26T12:50:34.298328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:46.747008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.160904+0000","last_change":"2024-04-26T12:50:00.253636+0000","last_active":"2024-04-26T12:52:06.160904+0000","last_peered":"2024-04-26T12:52:06.160904+0000","last_clean":"2024-04-26T12:52:06.160904+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:52:06.160904+0000","last_undegraded":"2024-04-26T12:52:06.160904+0000","last_fullsized":"2024-04-26T12:52:06.160904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:36.115587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298542+0000","last_change":"2024-04-26T12:50:02.278315+0000","last_active":"2024-04-26T12:50:34.298542+0000","last_peered":"2024-04-26T12:50:34.298542+0000","last_clean":"2024-04-26T12:50:34.298542+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:50:34.298542+0000","last_undegraded":"2024-04-26T12:50:34.298542+0000","last_fullsized":"2024-04-26T12:50:34.298542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:49.074190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:17.319401+0000","last_change":"2024-04-26T12:50:04.276914+0000","last_active":"2024-04-26T12:51:17.319401+0000","last_peered":"2024-04-26T12:51:17.319401+0000","last_clean":"2024-04-26T12:51:17.319401+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:51:17.319401+0000","last_undegraded":"2024-04-26T12:51:17.319401+0000","last_fullsized":"2024-04-26T12:51:17.319401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:42.273211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945853+0000","last_change":"2024-04-26T12:49:56.217097+0000","last_active":"2024-04-26T12:50:39.945853+0000","last_peered":"2024-04-26T12:50:39.945853+0000","last_clean":"2024-04-26T12:50:39.945853+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:50:39.945853+0000","last_undegraded":"2024-04-26T12:50:39.945853+0000","last_fullsized":"2024-04-26T12:50:39.945853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.297824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316635+0000","last_change":"2024-04-26T12:49:54.252650+0000","last_active":"2024-04-26T12:50:34.316635+0000","last_peered":"2024-04-26T12:50:34.316635+0000","last_clean":"2024-04-26T12:50:34.316635+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:50:34.316635+0000","last_undegraded":"2024-04-26T12:50:34.316635+0000","last_fullsized":"2024-04-26T12:50:34.316635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:16.696005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304364+0000","last_change":"2024-04-26T12:49:58.230763+0000","last_active":"2024-04-26T12:50:34.304364+0000","last_peered":"2024-04-26T12:50:34.304364+0000","last_clean":"2024-04-26T12:50:34.304364+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:50:34.304364+0000","last_undegraded":"2024-04-26T12:50:34.304364+0000","last_fullsized":"2024-04-26T12:50:34.304364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:45.346897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.194958+0000","last_change":"2024-04-26T12:50:00.268771+0000","last_active":"2024-04-26T12:52:06.194958+0000","last_peered":"2024-04-26T12:52:06.194958+0000","last_clean":"2024-04-26T12:52:06.194958+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:52:06.194958+0000","last_undegraded":"2024-04-26T12:52:06.194958+0000","last_fullsized":"2024-04-26T12:52:06.194958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:54.149076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":349,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.625390+0000","last_change":"2024-04-26T12:50:02.271777+0000","last_active":"2024-04-26T12:53:09.625390+0000","last_peered":"2024-04-26T12:53:09.625390+0000","last_clean":"2024-04-26T12:53:09.625390+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:09.625390+0000","last_undegraded":"2024-04-26T12:53:09.625390+0000","last_fullsized":"2024-04-26T12:53:09.625390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.220287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300846+0000","last_change":"2024-04-26T12:50:04.295468+0000","last_active":"2024-04-26T12:50:34.300846+0000","last_peered":"2024-04-26T12:50:34.300846+0000","last_clean":"2024-04-26T12:50:34.300846+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:50:34.300846+0000","last_undegraded":"2024-04-26T12:50:34.300846+0000","last_fullsized":"2024-04-26T12:50:34.300846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:16.734503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420472+0000","last_change":"2024-04-26T12:49:56.213567+0000","last_active":"2024-04-26T12:53:09.420472+0000","last_peered":"2024-04-26T12:53:09.420472+0000","last_clean":"2024-04-26T12:53:09.420472+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:09.420472+0000","last_undegraded":"2024-04-26T12:53:09.420472+0000","last_fullsized":"2024-04-26T12:53:09.420472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.363361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.408215+0000","last_change":"2024-04-26T12:49:54.259981+0000","last_active":"2024-04-26T12:53:09.408215+0000","last_peered":"2024-04-26T12:53:09.408215+0000","last_clean":"2024-04-26T12:53:09.408215+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:53:09.408215+0000","last_undegraded":"2024-04-26T12:53:09.408215+0000","last_fullsized":"2024-04-26T12:53:09.408215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:38.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:37.943080+0000","last_change":"2024-04-26T12:50:34.307424+0000","last_active":"2024-04-26T12:50:37.943080+0000","last_peered":"2024-04-26T12:50:37.943080+0000","last_clean":"2024-04-26T12:50:37.943080+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:50:37.943080+0000","last_undegraded":"2024-04-26T12:50:37.943080+0000","last_fullsized":"2024-04-26T12:50:37.943080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:48.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'55","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965106+0000","last_change":"2024-04-26T12:50:00.266463+0000","last_active":"2024-04-26T12:52:12.965106+0000","last_peered":"2024-04-26T12:52:12.965106+0000","last_clean":"2024-04-26T12:52:12.965106+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:52:12.965106+0000","last_undegraded":"2024-04-26T12:52:12.965106+0000","last_fullsized":"2024-04-26T12:52:12.965106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:23.507988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297422+0000","last_change":"2024-04-26T12:50:02.276572+0000","last_active":"2024-04-26T12:50:34.297422+0000","last_peered":"2024-04-26T12:50:34.297422+0000","last_clean":"2024-04-26T12:50:34.297422+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:50:34.297422+0000","last_undegraded":"2024-04-26T12:50:34.297422+0000","last_fullsized":"2024-04-26T12:50:34.297422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:09.557600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'20","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.585189+0000","last_change":"2024-04-26T12:50:04.303330+0000","last_active":"2024-04-26T12:53:09.585189+0000","last_peered":"2024-04-26T12:53:09.585189+0000","last_clean":"2024-04-26T12:53:09.585189+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:53:09.585189+0000","last_undegraded":"2024-04-26T12:53:09.585189+0000","last_fullsized":"2024-04-26T12:53:09.585189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:39.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302853+0000","last_change":"2024-04-26T12:49:56.234590+0000","last_active":"2024-04-26T12:51:23.302853+0000","last_peered":"2024-04-26T12:51:23.302853+0000","last_clean":"2024-04-26T12:51:23.302853+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:51:23.302853+0000","last_undegraded":"2024-04-26T12:51:23.302853+0000","last_fullsized":"2024-04-26T12:51:23.302853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:30.414057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300414+0000","last_change":"2024-04-26T12:49:54.239087+0000","last_active":"2024-04-26T12:50:34.300414+0000","last_peered":"2024-04-26T12:50:34.300414+0000","last_clean":"2024-04-26T12:50:34.300414+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:50:34.300414+0000","last_undegraded":"2024-04-26T12:50:34.300414+0000","last_fullsized":"2024-04-26T12:50:34.300414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299450+0000","last_change":"2024-04-26T12:49:58.226242+0000","last_active":"2024-04-26T12:50:34.299450+0000","last_peered":"2024-04-26T12:50:34.299450+0000","last_clean":"2024-04-26T12:50:34.299450+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:50:34.299450+0000","last_undegraded":"2024-04-26T12:50:34.299450+0000","last_fullsized":"2024-04-26T12:50:34.299450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:55.303173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.166823+0000","last_change":"2024-04-26T12:50:00.235211+0000","last_active":"2024-04-26T12:52:06.166823+0000","last_peered":"2024-04-26T12:52:06.166823+0000","last_clean":"2024-04-26T12:52:06.166823+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:52:06.166823+0000","last_undegraded":"2024-04-26T12:52:06.166823+0000","last_fullsized":"2024-04-26T12:52:06.166823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.091284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322784+0000","last_change":"2024-04-26T12:50:02.283252+0000","last_active":"2024-04-26T12:50:34.322784+0000","last_peered":"2024-04-26T12:50:34.322784+0000","last_clean":"2024-04-26T12:50:34.322784+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:50:34.322784+0000","last_undegraded":"2024-04-26T12:50:34.322784+0000","last_fullsized":"2024-04-26T12:50:34.322784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:56.381142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964007+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:52:07.964007+0000","last_peered":"2024-04-26T12:52:07.964007+0000","last_clean":"2024-04-26T12:52:07.964007+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:52:07.964007+0000","last_undegraded":"2024-04-26T12:52:07.964007+0000","last_fullsized":"2024-04-26T12:52:07.964007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:12.923913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352421+0000","last_change":"2024-04-26T12:49:56.229878+0000","last_active":"2024-04-26T12:53:09.352421+0000","last_peered":"2024-04-26T12:53:09.352421+0000","last_clean":"2024-04-26T12:53:09.352421+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:09.352421+0000","last_undegraded":"2024-04-26T12:53:09.352421+0000","last_fullsized":"2024-04-26T12:53:09.352421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:32.609926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308940+0000","last_change":"2024-04-26T12:49:54.231974+0000","last_active":"2024-04-26T12:50:34.308940+0000","last_peered":"2024-04-26T12:50:34.308940+0000","last_clean":"2024-04-26T12:50:34.308940+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:50:34.308940+0000","last_undegraded":"2024-04-26T12:50:34.308940+0000","last_fullsized":"2024-04-26T12:50:34.308940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:49.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299022+0000","last_change":"2024-04-26T12:49:58.230663+0000","last_active":"2024-04-26T12:50:34.299022+0000","last_peered":"2024-04-26T12:50:34.299022+0000","last_clean":"2024-04-26T12:50:34.299022+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:50:34.299022+0000","last_undegraded":"2024-04-26T12:50:34.299022+0000","last_fullsized":"2024-04-26T12:50:34.299022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:00.488394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.963417+0000","last_change":"2024-04-26T12:50:00.249967+0000","last_active":"2024-04-26T12:52:17.963417+0000","last_peered":"2024-04-26T12:52:17.963417+0000","last_clean":"2024-04-26T12:52:17.963417+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:52:17.963417+0000","last_undegraded":"2024-04-26T12:52:17.963417+0000","last_fullsized":"2024-04-26T12:52:17.963417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:37.320719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":404,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.597422+0000","last_change":"2024-04-26T12:50:02.276171+0000","last_active":"2024-04-26T12:53:09.597422+0000","last_peered":"2024-04-26T12:53:09.597422+0000","last_clean":"2024-04-26T12:53:09.597422+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:09.597422+0000","last_undegraded":"2024-04-26T12:53:09.597422+0000","last_fullsized":"2024-04-26T12:53:09.597422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:55.900264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.539446+0000","last_change":"2024-04-26T12:50:04.296504+0000","last_active":"2024-04-26T12:53:09.539446+0000","last_peered":"2024-04-26T12:53:09.539446+0000","last_clean":"2024-04-26T12:53:09.539446+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:53:09.539446+0000","last_undegraded":"2024-04-26T12:53:09.539446+0000","last_fullsized":"2024-04-26T12:53:09.539446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.592447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.287114+0000","last_change":"2024-04-26T12:49:56.221290+0000","last_active":"2024-04-26T12:52:08.287114+0000","last_peered":"2024-04-26T12:52:08.287114+0000","last_clean":"2024-04-26T12:52:08.287114+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:52:08.287114+0000","last_undegraded":"2024-04-26T12:52:08.287114+0000","last_fullsized":"2024-04-26T12:52:08.287114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:22.996331+0000","last_change":"2024-04-26T12:49:54.237237+0000","last_active":"2024-04-26T12:51:22.996331+0000","last_peered":"2024-04-26T12:51:22.996331+0000","last_clean":"2024-04-26T12:51:22.996331+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:51:22.996331+0000","last_undegraded":"2024-04-26T12:51:22.996331+0000","last_fullsized":"2024-04-26T12:51:22.996331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:54.152136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.757550+0000","last_change":"2024-04-26T12:49:58.226903+0000","last_active":"2024-04-26T12:52:07.757550+0000","last_peered":"2024-04-26T12:52:07.757550+0000","last_clean":"2024-04-26T12:52:07.757550+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:52:07.757550+0000","last_undegraded":"2024-04-26T12:52:07.757550+0000","last_fullsized":"2024-04-26T12:52:07.757550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:35.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316978+0000","last_change":"2024-04-26T12:50:00.268687+0000","last_active":"2024-04-26T12:50:34.316978+0000","last_peered":"2024-04-26T12:50:34.316978+0000","last_clean":"2024-04-26T12:50:34.316978+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:50:34.316978+0000","last_undegraded":"2024-04-26T12:50:34.316978+0000","last_fullsized":"2024-04-26T12:50:34.316978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:31.569888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":466,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.536293+0000","last_change":"2024-04-26T12:50:02.273006+0000","last_active":"2024-04-26T12:53:09.536293+0000","last_peered":"2024-04-26T12:53:09.536293+0000","last_clean":"2024-04-26T12:53:09.536293+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:09.536293+0000","last_undegraded":"2024-04-26T12:53:09.536293+0000","last_fullsized":"2024-04-26T12:53:09.536293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:51.983823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.914810+0000","last_change":"2024-04-26T12:50:04.274718+0000","last_active":"2024-04-26T12:52:07.914810+0000","last_peered":"2024-04-26T12:52:07.914810+0000","last_clean":"2024-04-26T12:52:07.914810+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:52:07.914810+0000","last_undegraded":"2024-04-26T12:52:07.914810+0000","last_fullsized":"2024-04-26T12:52:07.914810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:59.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067278+0000","last_change":"2024-04-26T12:49:56.234752+0000","last_active":"2024-04-26T12:53:09.067278+0000","last_peered":"2024-04-26T12:53:09.067278+0000","last_clean":"2024-04-26T12:53:09.067278+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:09.067278+0000","last_undegraded":"2024-04-26T12:53:09.067278+0000","last_fullsized":"2024-04-26T12:53:09.067278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:23.826434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301149+0000","last_change":"2024-04-26T12:49:54.243701+0000","last_active":"2024-04-26T12:50:34.301149+0000","last_peered":"2024-04-26T12:50:34.301149+0000","last_clean":"2024-04-26T12:50:34.301149+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:50:34.301149+0000","last_undegraded":"2024-04-26T12:50:34.301149+0000","last_fullsized":"2024-04-26T12:50:34.301149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:34.229879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322953+0000","last_change":"2024-04-26T12:49:58.244322+0000","last_active":"2024-04-26T12:50:34.322953+0000","last_peered":"2024-04-26T12:50:34.322953+0000","last_clean":"2024-04-26T12:50:34.322953+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:50:34.322953+0000","last_undegraded":"2024-04-26T12:50:34.322953+0000","last_fullsized":"2024-04-26T12:50:34.322953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:20.832753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'39","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.187089+0000","last_change":"2024-04-26T12:50:00.235679+0000","last_active":"2024-04-26T12:52:06.187089+0000","last_peered":"2024-04-26T12:52:06.187089+0000","last_clean":"2024-04-26T12:52:06.187089+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:52:06.187089+0000","last_undegraded":"2024-04-26T12:52:06.187089+0000","last_fullsized":"2024-04-26T12:52:06.187089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:26.195044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299317+0000","last_change":"2024-04-26T12:50:02.289768+0000","last_active":"2024-04-26T12:50:34.299317+0000","last_peered":"2024-04-26T12:50:34.299317+0000","last_clean":"2024-04-26T12:50:34.299317+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:50:34.299317+0000","last_undegraded":"2024-04-26T12:50:34.299317+0000","last_fullsized":"2024-04-26T12:50:34.299317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:01.413730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.492082+0000","last_change":"2024-04-26T12:50:04.271998+0000","last_active":"2024-04-26T12:53:09.492082+0000","last_peered":"2024-04-26T12:53:09.492082+0000","last_clean":"2024-04-26T12:53:09.492082+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:09.492082+0000","last_undegraded":"2024-04-26T12:53:09.492082+0000","last_fullsized":"2024-04-26T12:53:09.492082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:39.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.936230+0000","last_change":"2024-04-26T12:49:56.231794+0000","last_active":"2024-04-26T12:52:03.936230+0000","last_peered":"2024-04-26T12:52:03.936230+0000","last_clean":"2024-04-26T12:52:03.936230+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:52:03.936230+0000","last_undegraded":"2024-04-26T12:52:03.936230+0000","last_fullsized":"2024-04-26T12:52:03.936230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:53.041573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":202,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301216+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:50:34.301216+0000","last_peered":"2024-04-26T12:50:34.301216+0000","last_clean":"2024-04-26T12:50:34.301216+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:50:34.301216+0000","last_undegraded":"2024-04-26T12:50:34.301216+0000","last_fullsized":"2024-04-26T12:50:34.301216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:51.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307677+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:50:34.307677+0000","last_peered":"2024-04-26T12:50:34.307677+0000","last_clean":"2024-04-26T12:50:34.307677+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:50:34.307677+0000","last_undegraded":"2024-04-26T12:50:34.307677+0000","last_fullsized":"2024-04-26T12:50:34.307677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:44.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.874345+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:08.874345+0000","last_peered":"2024-04-26T12:53:08.874345+0000","last_clean":"2024-04-26T12:53:08.874345+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:08.874345+0000","last_undegraded":"2024-04-26T12:53:08.874345+0000","last_fullsized":"2024-04-26T12:53:08.874345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:07.492609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309753+0000","last_change":"2024-04-26T12:49:58.226523+0000","last_active":"2024-04-26T12:50:34.309753+0000","last_peered":"2024-04-26T12:50:34.309753+0000","last_clean":"2024-04-26T12:50:34.309753+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:50:34.309753+0000","last_undegraded":"2024-04-26T12:50:34.309753+0000","last_fullsized":"2024-04-26T12:50:34.309753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:34.614055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'77","reported_seq":146,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.205039+0000","last_change":"2024-04-26T12:50:00.264564+0000","last_active":"2024-04-26T12:52:06.205039+0000","last_peered":"2024-04-26T12:52:06.205039+0000","last_clean":"2024-04-26T12:52:06.205039+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:52:06.205039+0000","last_undegraded":"2024-04-26T12:52:06.205039+0000","last_fullsized":"2024-04-26T12:52:06.205039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:14.296275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301186+0000","last_change":"2024-04-26T12:50:02.283713+0000","last_active":"2024-04-26T12:50:34.301186+0000","last_peered":"2024-04-26T12:50:34.301186+0000","last_clean":"2024-04-26T12:50:34.301186+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:50:34.301186+0000","last_undegraded":"2024-04-26T12:50:34.301186+0000","last_fullsized":"2024-04-26T12:50:34.301186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:57.660351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.447691+0000","last_change":"2024-04-26T12:50:04.295222+0000","last_active":"2024-04-26T12:53:09.447691+0000","last_peered":"2024-04-26T12:53:09.447691+0000","last_clean":"2024-04-26T12:53:09.447691+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:53:09.447691+0000","last_undegraded":"2024-04-26T12:53:09.447691+0000","last_fullsized":"2024-04-26T12:53:09.447691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:45.205005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.950283+0000","last_change":"2024-04-26T12:49:56.229772+0000","last_active":"2024-04-26T12:52:03.950283+0000","last_peered":"2024-04-26T12:52:03.950283+0000","last_clean":"2024-04-26T12:52:03.950283+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:52:03.950283+0000","last_undegraded":"2024-04-26T12:52:03.950283+0000","last_fullsized":"2024-04-26T12:52:03.950283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:51.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300329+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:50:34.300329+0000","last_peered":"2024-04-26T12:50:34.300329+0000","last_clean":"2024-04-26T12:50:34.300329+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:50:34.300329+0000","last_undegraded":"2024-04-26T12:50:34.300329+0000","last_fullsized":"2024-04-26T12:50:34.300329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:26.774107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297560+0000","last_change":"2024-04-26T12:49:54.242621+0000","last_active":"2024-04-26T12:50:34.297560+0000","last_peered":"2024-04-26T12:50:34.297560+0000","last_clean":"2024-04-26T12:50:34.297560+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:50:34.297560+0000","last_undegraded":"2024-04-26T12:50:34.297560+0000","last_fullsized":"2024-04-26T12:50:34.297560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:13.443714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326393+0000","last_change":"2024-04-26T12:49:58.244054+0000","last_active":"2024-04-26T12:50:34.326393+0000","last_peered":"2024-04-26T12:50:34.326393+0000","last_clean":"2024-04-26T12:50:34.326393+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:50:34.326393+0000","last_undegraded":"2024-04-26T12:50:34.326393+0000","last_fullsized":"2024-04-26T12:50:34.326393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:25.847014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'273","reported_seq":477,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.475259+0000","last_change":"2024-04-26T12:50:00.249276+0000","last_active":"2024-04-26T12:53:08.475259+0000","last_peered":"2024-04-26T12:53:08.475259+0000","last_clean":"2024-04-26T12:53:08.475259+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:08.475259+0000","last_undegraded":"2024-04-26T12:53:08.475259+0000","last_fullsized":"2024-04-26T12:53:08.475259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:57.562801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.314485+0000","last_change":"2024-04-26T12:50:02.283171+0000","last_active":"2024-04-26T12:50:34.314485+0000","last_peered":"2024-04-26T12:50:34.314485+0000","last_clean":"2024-04-26T12:50:34.314485+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:50:34.314485+0000","last_undegraded":"2024-04-26T12:50:34.314485+0000","last_fullsized":"2024-04-26T12:50:34.314485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.718547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.017577+0000","last_change":"2024-04-26T12:50:04.282566+0000","last_active":"2024-04-26T12:51:23.017577+0000","last_peered":"2024-04-26T12:51:23.017577+0000","last_clean":"2024-04-26T12:51:23.017577+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:51:23.017577+0000","last_undegraded":"2024-04-26T12:51:23.017577+0000","last_fullsized":"2024-04-26T12:51:23.017577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:35.825570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420031+0000","last_change":"2024-04-26T12:49:56.225899+0000","last_active":"2024-04-26T12:53:09.420031+0000","last_peered":"2024-04-26T12:53:09.420031+0000","last_clean":"2024-04-26T12:53:09.420031+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:09.420031+0000","last_undegraded":"2024-04-26T12:53:09.420031+0000","last_fullsized":"2024-04-26T12:53:09.420031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:53.411007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295191+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:50:34.295191+0000","last_peered":"2024-04-26T12:50:34.295191+0000","last_clean":"2024-04-26T12:50:34.295191+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:50:34.295191+0000","last_undegraded":"2024-04-26T12:50:34.295191+0000","last_fullsized":"2024-04-26T12:50:34.295191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:41.462105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.243990+0000","last_change":"2024-04-26T12:49:54.236038+0000","last_active":"2024-04-26T12:53:09.243990+0000","last_peered":"2024-04-26T12:53:09.243990+0000","last_clean":"2024-04-26T12:53:09.243990+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:53:09.243990+0000","last_undegraded":"2024-04-26T12:53:09.243990+0000","last_fullsized":"2024-04-26T12:53:09.243990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:40.296155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.329321+0000","last_change":"2024-04-26T12:50:34.328152+0000","last_active":"2024-04-26T12:50:34.329321+0000","last_peered":"2024-04-26T12:50:34.329321+0000","last_clean":"2024-04-26T12:50:34.329321+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:50:34.329321+0000","last_undegraded":"2024-04-26T12:50:34.329321+0000","last_fullsized":"2024-04-26T12:50:34.329321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:37.685088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.474919+0000","last_change":"2024-04-26T12:50:00.249900+0000","last_active":"2024-04-26T12:53:08.474919+0000","last_peered":"2024-04-26T12:53:08.474919+0000","last_clean":"2024-04-26T12:53:08.474919+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:08.474919+0000","last_undegraded":"2024-04-26T12:53:08.474919+0000","last_fullsized":"2024-04-26T12:53:08.474919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:05.719952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300488+0000","last_change":"2024-04-26T12:50:02.279258+0000","last_active":"2024-04-26T12:50:34.300488+0000","last_peered":"2024-04-26T12:50:34.300488+0000","last_clean":"2024-04-26T12:50:34.300488+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:50:34.300488+0000","last_undegraded":"2024-04-26T12:50:34.300488+0000","last_fullsized":"2024-04-26T12:50:34.300488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:01.556723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.071153+0000","last_change":"2024-04-26T12:50:04.302141+0000","last_active":"2024-04-26T12:53:09.071153+0000","last_peered":"2024-04-26T12:53:09.071153+0000","last_clean":"2024-04-26T12:53:09.071153+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:53:09.071153+0000","last_undegraded":"2024-04-26T12:53:09.071153+0000","last_fullsized":"2024-04-26T12:53:09.071153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:27.014519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301204+0000","last_change":"2024-04-26T12:49:56.218654+0000","last_active":"2024-04-26T12:51:23.301204+0000","last_peered":"2024-04-26T12:51:23.301204+0000","last_clean":"2024-04-26T12:51:23.301204+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:51:23.301204+0000","last_undegraded":"2024-04-26T12:51:23.301204+0000","last_fullsized":"2024-04-26T12:51:23.301204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.466458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306739+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:50:34.306739+0000","last_peered":"2024-04-26T12:50:34.306739+0000","last_clean":"2024-04-26T12:50:34.306739+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:50:34.306739+0000","last_undegraded":"2024-04-26T12:50:34.306739+0000","last_fullsized":"2024-04-26T12:50:34.306739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:33.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296572+0000","last_change":"2024-04-26T12:49:54.228710+0000","last_active":"2024-04-26T12:50:34.296572+0000","last_peered":"2024-04-26T12:50:34.296572+0000","last_clean":"2024-04-26T12:50:34.296572+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:50:34.296572+0000","last_undegraded":"2024-04-26T12:50:34.296572+0000","last_fullsized":"2024-04-26T12:50:34.296572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300941+0000","last_change":"2024-04-26T12:49:58.226208+0000","last_active":"2024-04-26T12:50:34.300941+0000","last_peered":"2024-04-26T12:50:34.300941+0000","last_clean":"2024-04-26T12:50:34.300941+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:50:34.300941+0000","last_undegraded":"2024-04-26T12:50:34.300941+0000","last_fullsized":"2024-04-26T12:50:34.300941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.427051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.336167+0000","last_change":"2024-04-26T12:50:00.262398+0000","last_active":"2024-04-26T12:53:08.336167+0000","last_peered":"2024-04-26T12:53:08.336167+0000","last_clean":"2024-04-26T12:53:08.336167+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:08.336167+0000","last_undegraded":"2024-04-26T12:53:08.336167+0000","last_fullsized":"2024-04-26T12:53:08.336167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:15.645393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323584+0000","last_change":"2024-04-26T12:50:02.286212+0000","last_active":"2024-04-26T12:50:34.323584+0000","last_peered":"2024-04-26T12:50:34.323584+0000","last_clean":"2024-04-26T12:50:34.323584+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:50:34.323584+0000","last_undegraded":"2024-04-26T12:50:34.323584+0000","last_fullsized":"2024-04-26T12:50:34.323584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.753285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.892986+0000","last_change":"2024-04-26T12:50:04.290606+0000","last_active":"2024-04-26T12:52:07.892986+0000","last_peered":"2024-04-26T12:52:07.892986+0000","last_clean":"2024-04-26T12:52:07.892986+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:52:07.892986+0000","last_undegraded":"2024-04-26T12:52:07.892986+0000","last_fullsized":"2024-04-26T12:52:07.892986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:57.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.925248+0000","last_change":"2024-04-26T12:49:56.234671+0000","last_active":"2024-04-26T12:53:08.925248+0000","last_peered":"2024-04-26T12:53:08.925248+0000","last_clean":"2024-04-26T12:53:08.925248+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:08.925248+0000","last_undegraded":"2024-04-26T12:53:08.925248+0000","last_fullsized":"2024-04-26T12:53:08.925248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:53.299044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.285576+0000","last_change":"2024-04-26T12:49:54.227464+0000","last_active":"2024-04-26T12:51:23.285576+0000","last_peered":"2024-04-26T12:51:23.285576+0000","last_clean":"2024-04-26T12:51:23.285576+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:51:23.285576+0000","last_undegraded":"2024-04-26T12:51:23.285576+0000","last_fullsized":"2024-04-26T12:51:23.285576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299481+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:50:34.299481+0000","last_peered":"2024-04-26T12:50:34.299481+0000","last_clean":"2024-04-26T12:50:34.299481+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:50:34.299481+0000","last_undegraded":"2024-04-26T12:50:34.299481+0000","last_fullsized":"2024-04-26T12:50:34.299481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:02.796747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163300+0000","last_change":"2024-04-26T12:49:58.218010+0000","last_active":"2024-04-26T12:52:05.163300+0000","last_peered":"2024-04-26T12:52:05.163300+0000","last_clean":"2024-04-26T12:52:05.163300+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:52:05.163300+0000","last_undegraded":"2024-04-26T12:52:05.163300+0000","last_fullsized":"2024-04-26T12:52:05.163300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:41.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.206605+0000","last_change":"2024-04-26T12:50:00.240005+0000","last_active":"2024-04-26T12:52:06.206605+0000","last_peered":"2024-04-26T12:52:06.206605+0000","last_clean":"2024-04-26T12:52:06.206605+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:52:06.206605+0000","last_undegraded":"2024-04-26T12:52:06.206605+0000","last_fullsized":"2024-04-26T12:52:06.206605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:08.343846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296108+0000","last_change":"2024-04-26T12:50:02.267791+0000","last_active":"2024-04-26T12:50:34.296108+0000","last_peered":"2024-04-26T12:50:34.296108+0000","last_clean":"2024-04-26T12:50:34.296108+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:50:34.296108+0000","last_undegraded":"2024-04-26T12:50:34.296108+0000","last_fullsized":"2024-04-26T12:50:34.296108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:57.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.138878+0000","last_change":"2024-04-26T12:50:04.282702+0000","last_active":"2024-04-26T12:52:08.138878+0000","last_peered":"2024-04-26T12:52:08.138878+0000","last_clean":"2024-04-26T12:52:08.138878+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:52:08.138878+0000","last_undegraded":"2024-04-26T12:52:08.138878+0000","last_fullsized":"2024-04-26T12:52:08.138878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:46.989616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.441251+0000","last_change":"2024-04-26T12:49:56.231876+0000","last_active":"2024-04-26T12:53:09.441251+0000","last_peered":"2024-04-26T12:53:09.441251+0000","last_clean":"2024-04-26T12:53:09.441251+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:09.441251+0000","last_undegraded":"2024-04-26T12:53:09.441251+0000","last_fullsized":"2024-04-26T12:53:09.441251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:44.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300795+0000","last_change":"2024-04-26T12:49:54.242611+0000","last_active":"2024-04-26T12:50:34.300795+0000","last_peered":"2024-04-26T12:50:34.300795+0000","last_clean":"2024-04-26T12:50:34.300795+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:50:34.300795+0000","last_undegraded":"2024-04-26T12:50:34.300795+0000","last_fullsized":"2024-04-26T12:50:34.300795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:28.681707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316052+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:50:34.316052+0000","last_peered":"2024-04-26T12:50:34.316052+0000","last_clean":"2024-04-26T12:50:34.316052+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:50:34.316052+0000","last_undegraded":"2024-04-26T12:50:34.316052+0000","last_fullsized":"2024-04-26T12:50:34.316052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:52.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302424+0000","last_change":"2024-04-26T12:49:58.241694+0000","last_active":"2024-04-26T12:50:34.302424+0000","last_peered":"2024-04-26T12:50:34.302424+0000","last_clean":"2024-04-26T12:50:34.302424+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:50:34.302424+0000","last_undegraded":"2024-04-26T12:50:34.302424+0000","last_fullsized":"2024-04-26T12:50:34.302424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.960038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'16","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.959724+0000","last_change":"2024-04-26T12:50:00.249990+0000","last_active":"2024-04-26T12:52:07.959724+0000","last_peered":"2024-04-26T12:52:07.959724+0000","last_clean":"2024-04-26T12:52:07.959724+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:52:07.959724+0000","last_undegraded":"2024-04-26T12:52:07.959724+0000","last_fullsized":"2024-04-26T12:52:07.959724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:16.755935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":356,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.474553+0000","last_change":"2024-04-26T12:50:02.274253+0000","last_active":"2024-04-26T12:53:08.474553+0000","last_peered":"2024-04-26T12:53:08.474553+0000","last_clean":"2024-04-26T12:53:08.474553+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:08.474553+0000","last_undegraded":"2024-04-26T12:53:08.474553+0000","last_fullsized":"2024-04-26T12:53:08.474553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:53.359511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.321938+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:50:34.321938+0000","last_peered":"2024-04-26T12:50:34.321938+0000","last_clean":"2024-04-26T12:50:34.321938+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:50:34.321938+0000","last_undegraded":"2024-04-26T12:50:34.321938+0000","last_fullsized":"2024-04-26T12:50:34.321938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:03.311297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'9","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.438858+0000","last_change":"2024-04-26T12:49:56.226197+0000","last_active":"2024-04-26T12:53:09.438858+0000","last_peered":"2024-04-26T12:53:09.438858+0000","last_clean":"2024-04-26T12:53:09.438858+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:53:09.438858+0000","last_undegraded":"2024-04-26T12:53:09.438858+0000","last_fullsized":"2024-04-26T12:53:09.438858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:07.136832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326593+0000","last_change":"2024-04-26T12:49:54.253396+0000","last_active":"2024-04-26T12:50:34.326593+0000","last_peered":"2024-04-26T12:50:34.326593+0000","last_clean":"2024-04-26T12:50:34.326593+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:50:34.326593+0000","last_undegraded":"2024-04-26T12:50:34.326593+0000","last_fullsized":"2024-04-26T12:50:34.326593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:39.258567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301688+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:50:34.301688+0000","last_peered":"2024-04-26T12:50:34.301688+0000","last_clean":"2024-04-26T12:50:34.301688+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:50:34.301688+0000","last_undegraded":"2024-04-26T12:50:34.301688+0000","last_fullsized":"2024-04-26T12:50:34.301688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:30.732769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308987+0000","last_change":"2024-04-26T12:49:58.245857+0000","last_active":"2024-04-26T12:50:34.308987+0000","last_peered":"2024-04-26T12:50:34.308987+0000","last_clean":"2024-04-26T12:50:34.308987+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:50:34.308987+0000","last_undegraded":"2024-04-26T12:50:34.308987+0000","last_fullsized":"2024-04-26T12:50:34.308987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.985370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307845+0000","last_change":"2024-04-26T12:50:00.271933+0000","last_active":"2024-04-26T12:50:34.307845+0000","last_peered":"2024-04-26T12:50:34.307845+0000","last_clean":"2024-04-26T12:50:34.307845+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:50:34.307845+0000","last_undegraded":"2024-04-26T12:50:34.307845+0000","last_fullsized":"2024-04-26T12:50:34.307845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:27.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":430,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.587212+0000","last_change":"2024-04-26T12:50:02.273956+0000","last_active":"2024-04-26T12:53:09.587212+0000","last_peered":"2024-04-26T12:53:09.587212+0000","last_clean":"2024-04-26T12:53:09.587212+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:09.587212+0000","last_undegraded":"2024-04-26T12:53:09.587212+0000","last_fullsized":"2024-04-26T12:53:09.587212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:50.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309143+0000","last_change":"2024-04-26T12:50:04.301343+0000","last_active":"2024-04-26T12:50:34.309143+0000","last_peered":"2024-04-26T12:50:34.309143+0000","last_clean":"2024-04-26T12:50:34.309143+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:50:34.309143+0000","last_undegraded":"2024-04-26T12:50:34.309143+0000","last_fullsized":"2024-04-26T12:50:34.309143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:43.916865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.300311+0000","last_change":"2024-04-26T12:49:56.215393+0000","last_active":"2024-04-26T12:51:23.300311+0000","last_peered":"2024-04-26T12:51:23.300311+0000","last_clean":"2024-04-26T12:51:23.300311+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:51:23.300311+0000","last_undegraded":"2024-04-26T12:51:23.300311+0000","last_fullsized":"2024-04-26T12:51:23.300311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:23.402206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.215677+0000","last_change":"2024-04-26T12:49:54.239381+0000","last_active":"2024-04-26T12:52:08.215677+0000","last_peered":"2024-04-26T12:52:08.215677+0000","last_clean":"2024-04-26T12:52:08.215677+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:52:08.215677+0000","last_undegraded":"2024-04-26T12:52:08.215677+0000","last_fullsized":"2024-04-26T12:52:08.215677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323186+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:50:34.323186+0000","last_peered":"2024-04-26T12:50:34.323186+0000","last_clean":"2024-04-26T12:50:34.323186+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:50:34.323186+0000","last_undegraded":"2024-04-26T12:50:34.323186+0000","last_fullsized":"2024-04-26T12:50:34.323186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.190860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301969+0000","last_change":"2024-04-26T12:49:58.237558+0000","last_active":"2024-04-26T12:50:34.301969+0000","last_peered":"2024-04-26T12:50:34.301969+0000","last_clean":"2024-04-26T12:50:34.301969+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:50:34.301969+0000","last_undegraded":"2024-04-26T12:50:34.301969+0000","last_fullsized":"2024-04-26T12:50:34.301969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:55.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'85","reported_seq":157,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.183596+0000","last_change":"2024-04-26T12:50:00.262654+0000","last_active":"2024-04-26T12:52:06.183596+0000","last_peered":"2024-04-26T12:52:06.183596+0000","last_clean":"2024-04-26T12:52:06.183596+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:52:06.183596+0000","last_undegraded":"2024-04-26T12:52:06.183596+0000","last_fullsized":"2024-04-26T12:52:06.183596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.678581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299226+0000","last_change":"2024-04-26T12:50:02.277001+0000","last_active":"2024-04-26T12:50:34.299226+0000","last_peered":"2024-04-26T12:50:34.299226+0000","last_clean":"2024-04-26T12:50:34.299226+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:50:34.299226+0000","last_undegraded":"2024-04-26T12:50:34.299226+0000","last_fullsized":"2024-04-26T12:50:34.299226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:28.423042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303169+0000","last_change":"2024-04-26T12:50:04.283865+0000","last_active":"2024-04-26T12:50:34.303169+0000","last_peered":"2024-04-26T12:50:34.303169+0000","last_clean":"2024-04-26T12:50:34.303169+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:50:34.303169+0000","last_undegraded":"2024-04-26T12:50:34.303169+0000","last_fullsized":"2024-04-26T12:50:34.303169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:55.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303220+0000","last_change":"2024-04-26T12:50:04.289462+0000","last_active":"2024-04-26T12:50:34.303220+0000","last_peered":"2024-04-26T12:50:34.303220+0000","last_clean":"2024-04-26T12:50:34.303220+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:50:34.303220+0000","last_undegraded":"2024-04-26T12:50:34.303220+0000","last_fullsized":"2024-04-26T12:50:34.303220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:03.677092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945866+0000","last_change":"2024-04-26T12:49:56.224657+0000","last_active":"2024-04-26T12:50:39.945866+0000","last_peered":"2024-04-26T12:50:39.945866+0000","last_clean":"2024-04-26T12:50:39.945866+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:50:39.945866+0000","last_undegraded":"2024-04-26T12:50:39.945866+0000","last_fullsized":"2024-04-26T12:50:39.945866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:09.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315720+0000","last_change":"2024-04-26T12:49:54.259672+0000","last_active":"2024-04-26T12:50:34.315720+0000","last_peered":"2024-04-26T12:50:34.315720+0000","last_clean":"2024-04-26T12:50:34.315720+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:50:34.315720+0000","last_undegraded":"2024-04-26T12:50:34.315720+0000","last_fullsized":"2024-04-26T12:50:34.315720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:37.170988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315130+0000","last_change":"2024-04-26T12:49:58.226855+0000","last_active":"2024-04-26T12:50:34.315130+0000","last_peered":"2024-04-26T12:50:34.315130+0000","last_clean":"2024-04-26T12:50:34.315130+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:50:34.315130+0000","last_undegraded":"2024-04-26T12:50:34.315130+0000","last_fullsized":"2024-04-26T12:50:34.315130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:54.671649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.193653+0000","last_change":"2024-04-26T12:50:00.266320+0000","last_active":"2024-04-26T12:52:06.193653+0000","last_peered":"2024-04-26T12:52:06.193653+0000","last_clean":"2024-04-26T12:52:06.193653+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:52:06.193653+0000","last_undegraded":"2024-04-26T12:52:06.193653+0000","last_fullsized":"2024-04-26T12:52:06.193653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:27.322235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301745+0000","last_change":"2024-04-26T12:50:02.282972+0000","last_active":"2024-04-26T12:50:34.301745+0000","last_peered":"2024-04-26T12:50:34.301745+0000","last_clean":"2024-04-26T12:50:34.301745+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:50:34.301745+0000","last_undegraded":"2024-04-26T12:50:34.301745+0000","last_fullsized":"2024-04-26T12:50:34.301745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:31.666992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.783785+0000","last_change":"2024-04-26T12:50:04.286573+0000","last_active":"2024-04-26T12:52:05.783785+0000","last_peered":"2024-04-26T12:52:05.783785+0000","last_clean":"2024-04-26T12:52:05.783785+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:52:05.783785+0000","last_undegraded":"2024-04-26T12:52:05.783785+0000","last_fullsized":"2024-04-26T12:52:05.783785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:44.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420386+0000","last_change":"2024-04-26T12:50:34.331364+0000","last_active":"2024-04-26T12:53:09.420386+0000","last_peered":"2024-04-26T12:53:09.420386+0000","last_clean":"2024-04-26T12:53:09.420386+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:53:09.420386+0000","last_undegraded":"2024-04-26T12:53:09.420386+0000","last_fullsized":"2024-04-26T12:53:09.420386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:32.541941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299076+0000","last_change":"2024-04-26T12:49:54.242795+0000","last_active":"2024-04-26T12:50:34.299076+0000","last_peered":"2024-04-26T12:50:34.299076+0000","last_clean":"2024-04-26T12:50:34.299076+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:50:34.299076+0000","last_undegraded":"2024-04-26T12:50:34.299076+0000","last_fullsized":"2024-04-26T12:50:34.299076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.327731+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:50:34.327731+0000","last_peered":"2024-04-26T12:50:34.327731+0000","last_clean":"2024-04-26T12:50:34.327731+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:50:34.327731+0000","last_undegraded":"2024-04-26T12:50:34.327731+0000","last_fullsized":"2024-04-26T12:50:34.327731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.316527+0000","last_change":"2024-04-26T12:50:00.232187+0000","last_active":"2024-04-26T12:53:08.316527+0000","last_peered":"2024-04-26T12:53:08.316527+0000","last_clean":"2024-04-26T12:53:08.316527+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:08.316527+0000","last_undegraded":"2024-04-26T12:53:08.316527+0000","last_fullsized":"2024-04-26T12:53:08.316527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:53.956543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295434+0000","last_change":"2024-04-26T12:50:02.285124+0000","last_active":"2024-04-26T12:50:34.295434+0000","last_peered":"2024-04-26T12:50:34.295434+0000","last_clean":"2024-04-26T12:50:34.295434+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:50:34.295434+0000","last_undegraded":"2024-04-26T12:50:34.295434+0000","last_fullsized":"2024-04-26T12:50:34.295434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.429582+0000","last_change":"2024-04-26T12:50:04.281861+0000","last_active":"2024-04-26T12:53:08.429582+0000","last_peered":"2024-04-26T12:53:08.429582+0000","last_clean":"2024-04-26T12:53:08.429582+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:08.429582+0000","last_undegraded":"2024-04-26T12:53:08.429582+0000","last_fullsized":"2024-04-26T12:53:08.429582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:06.429465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'15","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.947547+0000","last_change":"2024-04-26T12:49:56.221075+0000","last_active":"2024-04-26T12:53:08.947547+0000","last_peered":"2024-04-26T12:53:08.947547+0000","last_clean":"2024-04-26T12:53:08.947547+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:08.947547+0000","last_undegraded":"2024-04-26T12:53:08.947547+0000","last_fullsized":"2024-04-26T12:53:08.947547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:49.834778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304429+0000","last_change":"2024-04-26T12:49:54.248072+0000","last_active":"2024-04-26T12:50:34.304429+0000","last_peered":"2024-04-26T12:50:34.304429+0000","last_clean":"2024-04-26T12:50:34.304429+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:50:34.304429+0000","last_undegraded":"2024-04-26T12:50:34.304429+0000","last_fullsized":"2024-04-26T12:50:34.304429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.294648+0000","last_change":"2024-04-26T12:49:58.227451+0000","last_active":"2024-04-26T12:50:34.294648+0000","last_peered":"2024-04-26T12:50:34.294648+0000","last_clean":"2024-04-26T12:50:34.294648+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:50:34.294648+0000","last_undegraded":"2024-04-26T12:50:34.294648+0000","last_fullsized":"2024-04-26T12:50:34.294648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:46.024249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.399673+0000","last_change":"2024-04-26T12:50:00.233555+0000","last_active":"2024-04-26T12:53:08.399673+0000","last_peered":"2024-04-26T12:53:08.399673+0000","last_clean":"2024-04-26T12:53:08.399673+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:08.399673+0000","last_undegraded":"2024-04-26T12:53:08.399673+0000","last_fullsized":"2024-04-26T12:53:08.399673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:46.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310963+0000","last_change":"2024-04-26T12:50:02.272652+0000","last_active":"2024-04-26T12:50:34.310963+0000","last_peered":"2024-04-26T12:50:34.310963+0000","last_clean":"2024-04-26T12:50:34.310963+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:50:34.310963+0000","last_undegraded":"2024-04-26T12:50:34.310963+0000","last_fullsized":"2024-04-26T12:50:34.310963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:01.660724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.007347+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:51:23.007347+0000","last_peered":"2024-04-26T12:51:23.007347+0000","last_clean":"2024-04-26T12:51:23.007347+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:51:23.007347+0000","last_undegraded":"2024-04-26T12:51:23.007347+0000","last_fullsized":"2024-04-26T12:51:23.007347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:09.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.931477+0000","last_change":"2024-04-26T12:49:56.230150+0000","last_active":"2024-04-26T12:53:08.931477+0000","last_peered":"2024-04-26T12:53:08.931477+0000","last_clean":"2024-04-26T12:53:08.931477+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:08.931477+0000","last_undegraded":"2024-04-26T12:53:08.931477+0000","last_fullsized":"2024-04-26T12:53:08.931477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:24.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318667+0000","last_change":"2024-04-26T12:49:54.238487+0000","last_active":"2024-04-26T12:50:34.318667+0000","last_peered":"2024-04-26T12:50:34.318667+0000","last_clean":"2024-04-26T12:50:34.318667+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:50:34.318667+0000","last_undegraded":"2024-04-26T12:50:34.318667+0000","last_fullsized":"2024-04-26T12:50:34.318667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302190+0000","last_change":"2024-04-26T12:49:58.244563+0000","last_active":"2024-04-26T12:50:34.302190+0000","last_peered":"2024-04-26T12:50:34.302190+0000","last_clean":"2024-04-26T12:50:34.302190+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:50:34.302190+0000","last_undegraded":"2024-04-26T12:50:34.302190+0000","last_fullsized":"2024-04-26T12:50:34.302190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:44.871146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.170865+0000","last_change":"2024-04-26T12:50:00.240164+0000","last_active":"2024-04-26T12:52:06.170865+0000","last_peered":"2024-04-26T12:52:06.170865+0000","last_clean":"2024-04-26T12:52:06.170865+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:52:06.170865+0000","last_undegraded":"2024-04-26T12:52:06.170865+0000","last_fullsized":"2024-04-26T12:52:06.170865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:31.464728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295743+0000","last_change":"2024-04-26T12:50:02.264233+0000","last_active":"2024-04-26T12:50:34.295743+0000","last_peered":"2024-04-26T12:50:34.295743+0000","last_clean":"2024-04-26T12:50:34.295743+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:50:34.295743+0000","last_undegraded":"2024-04-26T12:50:34.295743+0000","last_fullsized":"2024-04-26T12:50:34.295743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:01.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420751+0000","last_change":"2024-04-26T12:49:56.232004+0000","last_active":"2024-04-26T12:53:09.420751+0000","last_peered":"2024-04-26T12:53:09.420751+0000","last_clean":"2024-04-26T12:53:09.420751+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:09.420751+0000","last_undegraded":"2024-04-26T12:53:09.420751+0000","last_fullsized":"2024-04-26T12:53:09.420751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:47.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300624+0000","last_change":"2024-04-26T12:49:54.241633+0000","last_active":"2024-04-26T12:50:34.300624+0000","last_peered":"2024-04-26T12:50:34.300624+0000","last_clean":"2024-04-26T12:50:34.300624+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:50:34.300624+0000","last_undegraded":"2024-04-26T12:50:34.300624+0000","last_fullsized":"2024-04-26T12:50:34.300624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:03.751774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'4","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.728988+0000","last_change":"2024-04-26T12:49:58.224668+0000","last_active":"2024-04-26T12:52:07.728988+0000","last_peered":"2024-04-26T12:52:07.728988+0000","last_clean":"2024-04-26T12:52:07.728988+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:52:07.728988+0000","last_undegraded":"2024-04-26T12:52:07.728988+0000","last_fullsized":"2024-04-26T12:52:07.728988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:46.613363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'54","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.202377+0000","last_change":"2024-04-26T12:50:00.242408+0000","last_active":"2024-04-26T12:52:06.202377+0000","last_peered":"2024-04-26T12:52:06.202377+0000","last_clean":"2024-04-26T12:52:06.202377+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:52:06.202377+0000","last_undegraded":"2024-04-26T12:52:06.202377+0000","last_fullsized":"2024-04-26T12:52:06.202377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:41.899361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295358+0000","last_change":"2024-04-26T12:50:02.272171+0000","last_active":"2024-04-26T12:50:34.295358+0000","last_peered":"2024-04-26T12:50:34.295358+0000","last_clean":"2024-04-26T12:50:34.295358+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:50:34.295358+0000","last_undegraded":"2024-04-26T12:50:34.295358+0000","last_fullsized":"2024-04-26T12:50:34.295358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:30.101175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.128428+0000","last_change":"2024-04-26T12:50:04.281931+0000","last_active":"2024-04-26T12:52:08.128428+0000","last_peered":"2024-04-26T12:52:08.128428+0000","last_clean":"2024-04-26T12:52:08.128428+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:52:08.128428+0000","last_undegraded":"2024-04-26T12:52:08.128428+0000","last_fullsized":"2024-04-26T12:52:08.128428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:16.500952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:40.677407+0000","last_change":"2024-04-26T12:49:56.224826+0000","last_active":"2024-04-26T12:50:40.677407+0000","last_peered":"2024-04-26T12:50:40.677407+0000","last_clean":"2024-04-26T12:50:40.677407+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:50:40.677407+0000","last_undegraded":"2024-04-26T12:50:40.677407+0000","last_fullsized":"2024-04-26T12:50:40.677407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:46.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305246+0000","last_change":"2024-04-26T12:49:54.243620+0000","last_active":"2024-04-26T12:50:34.305246+0000","last_peered":"2024-04-26T12:50:34.305246+0000","last_clean":"2024-04-26T12:50:34.305246+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:50:34.305246+0000","last_undegraded":"2024-04-26T12:50:34.305246+0000","last_fullsized":"2024-04-26T12:50:34.305246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303655+0000","last_change":"2024-04-26T12:49:58.220247+0000","last_active":"2024-04-26T12:50:34.303655+0000","last_peered":"2024-04-26T12:50:34.303655+0000","last_clean":"2024-04-26T12:50:34.303655+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:50:34.303655+0000","last_undegraded":"2024-04-26T12:50:34.303655+0000","last_fullsized":"2024-04-26T12:50:34.303655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:55.363024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.172034+0000","last_change":"2024-04-26T12:50:00.270194+0000","last_active":"2024-04-26T12:52:06.172034+0000","last_peered":"2024-04-26T12:52:06.172034+0000","last_clean":"2024-04-26T12:52:06.172034+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:52:06.172034+0000","last_undegraded":"2024-04-26T12:52:06.172034+0000","last_fullsized":"2024-04-26T12:52:06.172034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:34.153884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308720+0000","last_change":"2024-04-26T12:50:02.286102+0000","last_active":"2024-04-26T12:50:34.308720+0000","last_peered":"2024-04-26T12:50:34.308720+0000","last_clean":"2024-04-26T12:50:34.308720+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:50:34.308720+0000","last_undegraded":"2024-04-26T12:50:34.308720+0000","last_fullsized":"2024-04-26T12:50:34.308720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:48.894931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301117+0000","last_change":"2024-04-26T12:50:04.302095+0000","last_active":"2024-04-26T12:50:34.301117+0000","last_peered":"2024-04-26T12:50:34.301117+0000","last_clean":"2024-04-26T12:50:34.301117+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:50:34.301117+0000","last_undegraded":"2024-04-26T12:50:34.301117+0000","last_fullsized":"2024-04-26T12:50:34.301117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:22.017086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067641+0000","last_change":"2024-04-26T12:49:56.232608+0000","last_active":"2024-04-26T12:53:09.067641+0000","last_peered":"2024-04-26T12:53:09.067641+0000","last_clean":"2024-04-26T12:53:09.067641+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:09.067641+0000","last_undegraded":"2024-04-26T12:53:09.067641+0000","last_fullsized":"2024-04-26T12:53:09.067641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:33.707470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.311238+0000","last_change":"2024-04-26T12:49:54.229682+0000","last_active":"2024-04-26T12:50:34.311238+0000","last_peered":"2024-04-26T12:50:34.311238+0000","last_clean":"2024-04-26T12:50:34.311238+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:50:34.311238+0000","last_undegraded":"2024-04-26T12:50:34.311238+0000","last_fullsized":"2024-04-26T12:50:34.311238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295742+0000","last_change":"2024-04-26T12:49:58.218998+0000","last_active":"2024-04-26T12:50:34.295742+0000","last_peered":"2024-04-26T12:50:34.295742+0000","last_clean":"2024-04-26T12:50:34.295742+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:50:34.295742+0000","last_undegraded":"2024-04-26T12:50:34.295742+0000","last_fullsized":"2024-04-26T12:50:34.295742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:57.143731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.762812+0000","last_change":"2024-04-26T12:50:00.239798+0000","last_active":"2024-04-26T12:52:05.762812+0000","last_peered":"2024-04-26T12:52:05.762812+0000","last_clean":"2024-04-26T12:52:05.762812+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:52:05.762812+0000","last_undegraded":"2024-04-26T12:52:05.762812+0000","last_fullsized":"2024-04-26T12:52:05.762812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:35.710193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301139+0000","last_change":"2024-04-26T12:50:02.273673+0000","last_active":"2024-04-26T12:50:34.301139+0000","last_peered":"2024-04-26T12:50:34.301139+0000","last_clean":"2024-04-26T12:50:34.301139+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:50:34.301139+0000","last_undegraded":"2024-04-26T12:50:34.301139+0000","last_fullsized":"2024-04-26T12:50:34.301139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:50.707635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.274746+0000","last_change":"2024-04-26T12:50:04.302374+0000","last_active":"2024-04-26T12:52:08.274746+0000","last_peered":"2024-04-26T12:52:08.274746+0000","last_clean":"2024-04-26T12:52:08.274746+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:52:08.274746+0000","last_undegraded":"2024-04-26T12:52:08.274746+0000","last_fullsized":"2024-04-26T12:52:08.274746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:28.339845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303315+0000","last_change":"2024-04-26T12:49:56.219301+0000","last_active":"2024-04-26T12:50:34.303315+0000","last_peered":"2024-04-26T12:50:34.303315+0000","last_clean":"2024-04-26T12:50:34.303315+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:50:34.303315+0000","last_undegraded":"2024-04-26T12:50:34.303315+0000","last_fullsized":"2024-04-26T12:50:34.303315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:09.581494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308258+0000","last_change":"2024-04-26T12:49:54.253819+0000","last_active":"2024-04-26T12:50:34.308258+0000","last_peered":"2024-04-26T12:50:34.308258+0000","last_clean":"2024-04-26T12:50:34.308258+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:50:34.308258+0000","last_undegraded":"2024-04-26T12:50:34.308258+0000","last_fullsized":"2024-04-26T12:50:34.308258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:40.717814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319765+0000","last_change":"2024-04-26T12:49:58.227003+0000","last_active":"2024-04-26T12:50:34.319765+0000","last_peered":"2024-04-26T12:50:34.319765+0000","last_clean":"2024-04-26T12:50:34.319765+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:50:34.319765+0000","last_undegraded":"2024-04-26T12:50:34.319765+0000","last_fullsized":"2024-04-26T12:50:34.319765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:18.551779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322080+0000","last_change":"2024-04-26T12:50:00.272784+0000","last_active":"2024-04-26T12:50:34.322080+0000","last_peered":"2024-04-26T12:50:34.322080+0000","last_clean":"2024-04-26T12:50:34.322080+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:50:34.322080+0000","last_undegraded":"2024-04-26T12:50:34.322080+0000","last_fullsized":"2024-04-26T12:50:34.322080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":418,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.433170+0000","last_change":"2024-04-26T12:50:02.294579+0000","last_active":"2024-04-26T12:53:09.433170+0000","last_peered":"2024-04-26T12:53:09.433170+0000","last_clean":"2024-04-26T12:53:09.433170+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:09.433170+0000","last_undegraded":"2024-04-26T12:53:09.433170+0000","last_fullsized":"2024-04-26T12:53:09.433170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:13.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299552+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:50:34.299552+0000","last_peered":"2024-04-26T12:50:34.299552+0000","last_clean":"2024-04-26T12:50:34.299552+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:50:34.299552+0000","last_undegraded":"2024-04-26T12:50:34.299552+0000","last_fullsized":"2024-04-26T12:50:34.299552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:52.067129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'23","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.283786+0000","last_change":"2024-04-26T12:49:56.213304+0000","last_active":"2024-04-26T12:53:09.283786+0000","last_peered":"2024-04-26T12:53:09.283786+0000","last_clean":"2024-04-26T12:53:09.283786+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:09.283786+0000","last_undegraded":"2024-04-26T12:53:09.283786+0000","last_fullsized":"2024-04-26T12:53:09.283786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:27.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315379+0000","last_change":"2024-04-26T12:49:54.247955+0000","last_active":"2024-04-26T12:50:34.315379+0000","last_peered":"2024-04-26T12:50:34.315379+0000","last_clean":"2024-04-26T12:50:34.315379+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:50:34.315379+0000","last_undegraded":"2024-04-26T12:50:34.315379+0000","last_fullsized":"2024-04-26T12:50:34.315379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313932+0000","last_change":"2024-04-26T12:49:58.227232+0000","last_active":"2024-04-26T12:50:34.313932+0000","last_peered":"2024-04-26T12:50:34.313932+0000","last_clean":"2024-04-26T12:50:34.313932+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:50:34.313932+0000","last_undegraded":"2024-04-26T12:50:34.313932+0000","last_fullsized":"2024-04-26T12:50:34.313932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:55.045703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.157449+0000","last_change":"2024-04-26T12:50:00.233705+0000","last_active":"2024-04-26T12:52:06.157449+0000","last_peered":"2024-04-26T12:52:06.157449+0000","last_clean":"2024-04-26T12:52:06.157449+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:52:06.157449+0000","last_undegraded":"2024-04-26T12:52:06.157449+0000","last_fullsized":"2024-04-26T12:52:06.157449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:28.085543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297060+0000","last_change":"2024-04-26T12:50:02.271715+0000","last_active":"2024-04-26T12:50:34.297060+0000","last_peered":"2024-04-26T12:50:34.297060+0000","last_clean":"2024-04-26T12:50:34.297060+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:50:34.297060+0000","last_undegraded":"2024-04-26T12:50:34.297060+0000","last_fullsized":"2024-04-26T12:50:34.297060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:04.365884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319372+0000","last_change":"2024-04-26T12:50:04.283754+0000","last_active":"2024-04-26T12:50:34.319372+0000","last_peered":"2024-04-26T12:50:34.319372+0000","last_clean":"2024-04-26T12:50:34.319372+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:50:34.319372+0000","last_undegraded":"2024-04-26T12:50:34.319372+0000","last_fullsized":"2024-04-26T12:50:34.319372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:32.583019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295908+0000","last_change":"2024-04-26T12:49:56.216716+0000","last_active":"2024-04-26T12:50:34.295908+0000","last_peered":"2024-04-26T12:50:34.295908+0000","last_clean":"2024-04-26T12:50:34.295908+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:50:34.295908+0000","last_undegraded":"2024-04-26T12:50:34.295908+0000","last_fullsized":"2024-04-26T12:50:34.295908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:46.747501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316296+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:50:34.316296+0000","last_peered":"2024-04-26T12:50:34.316296+0000","last_clean":"2024-04-26T12:50:34.316296+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:50:34.316296+0000","last_undegraded":"2024-04-26T12:50:34.316296+0000","last_fullsized":"2024-04-26T12:50:34.316296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:12.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298228+0000","last_change":"2024-04-26T12:49:58.219225+0000","last_active":"2024-04-26T12:50:34.298228+0000","last_peered":"2024-04-26T12:50:34.298228+0000","last_clean":"2024-04-26T12:50:34.298228+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:50:34.298228+0000","last_undegraded":"2024-04-26T12:50:34.298228+0000","last_fullsized":"2024-04-26T12:50:34.298228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:14.134748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.158832+0000","last_change":"2024-04-26T12:50:00.239861+0000","last_active":"2024-04-26T12:52:06.158832+0000","last_peered":"2024-04-26T12:52:06.158832+0000","last_clean":"2024-04-26T12:52:06.158832+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:52:06.158832+0000","last_undegraded":"2024-04-26T12:52:06.158832+0000","last_fullsized":"2024-04-26T12:52:06.158832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:31.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301391+0000","last_change":"2024-04-26T12:50:02.287940+0000","last_active":"2024-04-26T12:50:34.301391+0000","last_peered":"2024-04-26T12:50:34.301391+0000","last_clean":"2024-04-26T12:50:34.301391+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:50:34.301391+0000","last_undegraded":"2024-04-26T12:50:34.301391+0000","last_fullsized":"2024-04-26T12:50:34.301391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:02.592328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315974+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:50:34.315974+0000","last_peered":"2024-04-26T12:50:34.315974+0000","last_clean":"2024-04-26T12:50:34.315974+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:50:34.315974+0000","last_undegraded":"2024-04-26T12:50:34.315974+0000","last_fullsized":"2024-04-26T12:50:34.315974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:25.596341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420535+0000","last_change":"2024-04-26T12:49:56.223405+0000","last_active":"2024-04-26T12:53:09.420535+0000","last_peered":"2024-04-26T12:53:09.420535+0000","last_clean":"2024-04-26T12:53:09.420535+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:53:09.420535+0000","last_undegraded":"2024-04-26T12:53:09.420535+0000","last_fullsized":"2024-04-26T12:53:09.420535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:55.440404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303556+0000","last_change":"2024-04-26T12:49:54.239137+0000","last_active":"2024-04-26T12:50:34.303556+0000","last_peered":"2024-04-26T12:50:34.303556+0000","last_clean":"2024-04-26T12:50:34.303556+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:50:34.303556+0000","last_undegraded":"2024-04-26T12:50:34.303556+0000","last_fullsized":"2024-04-26T12:50:34.303556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:18.714967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304001+0000","last_change":"2024-04-26T12:49:58.241371+0000","last_active":"2024-04-26T12:50:34.304001+0000","last_peered":"2024-04-26T12:50:34.304001+0000","last_clean":"2024-04-26T12:50:34.304001+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:50:34.304001+0000","last_undegraded":"2024-04-26T12:50:34.304001+0000","last_fullsized":"2024-04-26T12:50:34.304001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:35.312565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'27","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.291600+0000","last_change":"2024-04-26T12:50:00.270650+0000","last_active":"2024-04-26T12:52:08.291600+0000","last_peered":"2024-04-26T12:52:08.291600+0000","last_clean":"2024-04-26T12:52:08.291600+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:52:08.291600+0000","last_undegraded":"2024-04-26T12:52:08.291600+0000","last_fullsized":"2024-04-26T12:52:08.291600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:56.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306598+0000","last_change":"2024-04-26T12:50:02.288529+0000","last_active":"2024-04-26T12:50:34.306598+0000","last_peered":"2024-04-26T12:50:34.306598+0000","last_clean":"2024-04-26T12:50:34.306598+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:50:34.306598+0000","last_undegraded":"2024-04-26T12:50:34.306598+0000","last_fullsized":"2024-04-26T12:50:34.306598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:56.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.279169+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:08.279169+0000","last_peered":"2024-04-26T12:52:08.279169+0000","last_clean":"2024-04-26T12:52:08.279169+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:08.279169+0000","last_undegraded":"2024-04-26T12:52:08.279169+0000","last_fullsized":"2024-04-26T12:52:08.279169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:19.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.013381+0000","last_change":"2024-04-26T12:49:56.215521+0000","last_active":"2024-04-26T12:51:23.013381+0000","last_peered":"2024-04-26T12:51:23.013381+0000","last_clean":"2024-04-26T12:51:23.013381+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:51:23.013381+0000","last_undegraded":"2024-04-26T12:51:23.013381+0000","last_fullsized":"2024-04-26T12:51:23.013381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:02.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.788018+0000","last_change":"2024-04-26T12:49:54.245556+0000","last_active":"2024-04-26T12:53:08.788018+0000","last_peered":"2024-04-26T12:53:08.788018+0000","last_clean":"2024-04-26T12:53:08.788018+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:53:08.788018+0000","last_undegraded":"2024-04-26T12:53:08.788018+0000","last_fullsized":"2024-04-26T12:53:08.788018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:04.471472+0000","last_change":"2024-04-26T12:49:58.241812+0000","last_active":"2024-04-26T12:52:04.471472+0000","last_peered":"2024-04-26T12:52:04.471472+0000","last_clean":"2024-04-26T12:52:04.471472+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:52:04.471472+0000","last_undegraded":"2024-04-26T12:52:04.471472+0000","last_fullsized":"2024-04-26T12:52:04.471472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:49.780417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'32","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.318263+0000","last_change":"2024-04-26T12:50:00.271893+0000","last_active":"2024-04-26T12:53:08.318263+0000","last_peered":"2024-04-26T12:53:08.318263+0000","last_clean":"2024-04-26T12:53:08.318263+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:08.318263+0000","last_undegraded":"2024-04-26T12:53:08.318263+0000","last_fullsized":"2024-04-26T12:53:08.318263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:36.554225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299396+0000","last_change":"2024-04-26T12:50:02.271711+0000","last_active":"2024-04-26T12:50:34.299396+0000","last_peered":"2024-04-26T12:50:34.299396+0000","last_clean":"2024-04-26T12:50:34.299396+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:50:34.299396+0000","last_undegraded":"2024-04-26T12:50:34.299396+0000","last_fullsized":"2024-04-26T12:50:34.299396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:58.972643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.217037+0000","last_change":"2024-04-26T12:50:04.302279+0000","last_active":"2024-04-26T12:52:06.217037+0000","last_peered":"2024-04-26T12:52:06.217037+0000","last_clean":"2024-04-26T12:52:06.217037+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:52:06.217037+0000","last_undegraded":"2024-04-26T12:52:06.217037+0000","last_fullsized":"2024-04-26T12:52:06.217037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:45.287306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.350011+0000","last_change":"2024-04-26T12:49:56.234400+0000","last_active":"2024-04-26T12:53:09.350011+0000","last_peered":"2024-04-26T12:53:09.350011+0000","last_clean":"2024-04-26T12:53:09.350011+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:09.350011+0000","last_undegraded":"2024-04-26T12:53:09.350011+0000","last_fullsized":"2024-04-26T12:53:09.350011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:24.034799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.066998+0000","last_change":"2024-04-26T12:49:54.248434+0000","last_active":"2024-04-26T12:52:08.066998+0000","last_peered":"2024-04-26T12:52:08.066998+0000","last_clean":"2024-04-26T12:52:08.066998+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:52:08.066998+0000","last_undegraded":"2024-04-26T12:52:08.066998+0000","last_fullsized":"2024-04-26T12:52:08.066998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.419891+0000","last_change":"2024-04-26T12:49:56.215256+0000","last_active":"2024-04-26T12:53:09.419891+0000","last_peered":"2024-04-26T12:53:09.419891+0000","last_clean":"2024-04-26T12:53:09.419891+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:09.419891+0000","last_undegraded":"2024-04-26T12:53:09.419891+0000","last_fullsized":"2024-04-26T12:53:09.419891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:41.050135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297396+0000","last_change":"2024-04-26T12:49:54.242913+0000","last_active":"2024-04-26T12:50:34.297396+0000","last_peered":"2024-04-26T12:50:34.297396+0000","last_clean":"2024-04-26T12:50:34.297396+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:50:34.297396+0000","last_undegraded":"2024-04-26T12:50:34.297396+0000","last_fullsized":"2024-04-26T12:50:34.297396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:29.042508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265592+0000","last_change":"2024-04-26T12:49:56.225688+0000","last_active":"2024-04-26T12:53:09.265592+0000","last_peered":"2024-04-26T12:53:09.265592+0000","last_clean":"2024-04-26T12:53:09.265592+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:53:09.265592+0000","last_undegraded":"2024-04-26T12:53:09.265592+0000","last_fullsized":"2024-04-26T12:53:09.265592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:33.308436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963254+0000","last_change":"2024-04-26T12:49:54.236188+0000","last_active":"2024-04-26T12:52:02.963254+0000","last_peered":"2024-04-26T12:52:02.963254+0000","last_clean":"2024-04-26T12:52:02.963254+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:52:02.963254+0000","last_undegraded":"2024-04-26T12:52:02.963254+0000","last_fullsized":"2024-04-26T12:52:02.963254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:23.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.285259+0000","last_change":"2024-04-26T12:49:56.223112+0000","last_active":"2024-04-26T12:52:08.285259+0000","last_peered":"2024-04-26T12:52:08.285259+0000","last_clean":"2024-04-26T12:52:08.285259+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:52:08.285259+0000","last_undegraded":"2024-04-26T12:52:08.285259+0000","last_fullsized":"2024-04-26T12:52:08.285259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:24.739463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162110+0000","last_change":"2024-04-26T12:49:54.226434+0000","last_active":"2024-04-26T12:52:00.162110+0000","last_peered":"2024-04-26T12:52:00.162110+0000","last_clean":"2024-04-26T12:52:00.162110+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:52:00.162110+0000","last_undegraded":"2024-04-26T12:52:00.162110+0000","last_fullsized":"2024-04-26T12:52:00.162110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.586258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301648+0000","last_change":"2024-04-26T12:49:56.221387+0000","last_active":"2024-04-26T12:50:34.301648+0000","last_peered":"2024-04-26T12:50:34.301648+0000","last_clean":"2024-04-26T12:50:34.301648+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:50:34.301648+0000","last_undegraded":"2024-04-26T12:50:34.301648+0000","last_fullsized":"2024-04-26T12:50:34.301648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:33.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301072+0000","last_change":"2024-04-26T12:49:54.243199+0000","last_active":"2024-04-26T12:50:34.301072+0000","last_peered":"2024-04-26T12:50:34.301072+0000","last_clean":"2024-04-26T12:50:34.301072+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:50:34.301072+0000","last_undegraded":"2024-04-26T12:50:34.301072+0000","last_fullsized":"2024-04-26T12:50:34.301072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:36.903122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352717+0000","last_change":"2024-04-26T12:49:56.235320+0000","last_active":"2024-04-26T12:53:09.352717+0000","last_peered":"2024-04-26T12:53:09.352717+0000","last_clean":"2024-04-26T12:53:09.352717+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:09.352717+0000","last_undegraded":"2024-04-26T12:53:09.352717+0000","last_fullsized":"2024-04-26T12:53:09.352717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:12.130618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309160+0000","last_change":"2024-04-26T12:49:54.238503+0000","last_active":"2024-04-26T12:50:34.309160+0000","last_peered":"2024-04-26T12:50:34.309160+0000","last_clean":"2024-04-26T12:50:34.309160+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:50:34.309160+0000","last_undegraded":"2024-04-26T12:50:34.309160+0000","last_fullsized":"2024-04-26T12:50:34.309160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265292+0000","last_change":"2024-04-26T12:49:56.225647+0000","last_active":"2024-04-26T12:53:09.265292+0000","last_peered":"2024-04-26T12:53:09.265292+0000","last_clean":"2024-04-26T12:53:09.265292+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:53:09.265292+0000","last_undegraded":"2024-04-26T12:53:09.265292+0000","last_fullsized":"2024-04-26T12:53:09.265292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.813014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304680+0000","last_change":"2024-04-26T12:49:54.250162+0000","last_active":"2024-04-26T12:50:34.304680+0000","last_peered":"2024-04-26T12:50:34.304680+0000","last_clean":"2024-04-26T12:50:34.304680+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:50:34.304680+0000","last_undegraded":"2024-04-26T12:50:34.304680+0000","last_fullsized":"2024-04-26T12:50:34.304680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.958844+0000","last_change":"2024-04-26T12:49:56.231475+0000","last_active":"2024-04-26T12:52:02.958844+0000","last_peered":"2024-04-26T12:52:02.958844+0000","last_clean":"2024-04-26T12:52:02.958844+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:52:02.958844+0000","last_undegraded":"2024-04-26T12:52:02.958844+0000","last_fullsized":"2024-04-26T12:52:02.958844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439372+0000","last_change":"2024-04-26T12:49:54.229901+0000","last_active":"2024-04-26T12:50:38.439372+0000","last_peered":"2024-04-26T12:50:38.439372+0000","last_clean":"2024-04-26T12:50:38.439372+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:50:38.439372+0000","last_undegraded":"2024-04-26T12:50:38.439372+0000","last_fullsized":"2024-04-26T12:50:38.439372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:38.907969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.083486+0000","last_change":"2024-04-26T12:49:56.218286+0000","last_active":"2024-04-26T12:53:09.083486+0000","last_peered":"2024-04-26T12:53:09.083486+0000","last_clean":"2024-04-26T12:53:09.083486+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:09.083486+0000","last_undegraded":"2024-04-26T12:53:09.083486+0000","last_fullsized":"2024-04-26T12:53:09.083486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:17.751539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964028+0000","last_change":"2024-04-26T12:49:54.240647+0000","last_active":"2024-04-26T12:52:07.964028+0000","last_peered":"2024-04-26T12:52:07.964028+0000","last_clean":"2024-04-26T12:52:07.964028+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:52:07.964028+0000","last_undegraded":"2024-04-26T12:52:07.964028+0000","last_fullsized":"2024-04-26T12:52:07.964028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:55.293561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323510+0000","last_change":"2024-04-26T12:49:56.230003+0000","last_active":"2024-04-26T12:50:34.323510+0000","last_peered":"2024-04-26T12:50:34.323510+0000","last_clean":"2024-04-26T12:50:34.323510+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:50:34.323510+0000","last_undegraded":"2024-04-26T12:50:34.323510+0000","last_fullsized":"2024-04-26T12:50:34.323510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:12.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297885+0000","last_change":"2024-04-26T12:49:54.238656+0000","last_active":"2024-04-26T12:50:34.297885+0000","last_peered":"2024-04-26T12:50:34.297885+0000","last_clean":"2024-04-26T12:50:34.297885+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:50:34.297885+0000","last_undegraded":"2024-04-26T12:50:34.297885+0000","last_fullsized":"2024-04-26T12:50:34.297885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:36.879257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313256+0000","last_change":"2024-04-26T12:50:34.312404+0000","last_active":"2024-04-26T12:50:34.313256+0000","last_peered":"2024-04-26T12:50:34.313256+0000","last_clean":"2024-04-26T12:50:34.313256+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:50:34.313256+0000","last_undegraded":"2024-04-26T12:50:34.313256+0000","last_fullsized":"2024-04-26T12:50:34.313256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:47.220860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439966+0000","last_change":"2024-04-26T12:49:54.236940+0000","last_active":"2024-04-26T12:50:38.439966+0000","last_peered":"2024-04-26T12:50:38.439966+0000","last_clean":"2024-04-26T12:50:38.439966+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:50:38.439966+0000","last_undegraded":"2024-04-26T12:50:38.439966+0000","last_fullsized":"2024-04-26T12:50:38.439966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960904+0000","last_change":"2024-04-26T12:49:56.231000+0000","last_active":"2024-04-26T12:52:12.960904+0000","last_peered":"2024-04-26T12:52:12.960904+0000","last_clean":"2024-04-26T12:52:12.960904+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:52:12.960904+0000","last_undegraded":"2024-04-26T12:52:12.960904+0000","last_fullsized":"2024-04-26T12:52:12.960904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:23.072591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.252156+0000","last_change":"2024-04-26T12:49:54.233875+0000","last_active":"2024-04-26T12:53:09.252156+0000","last_peered":"2024-04-26T12:53:09.252156+0000","last_clean":"2024-04-26T12:53:09.252156+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:53:09.252156+0000","last_undegraded":"2024-04-26T12:53:09.252156+0000","last_fullsized":"2024-04-26T12:53:09.252156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352765+0000","last_change":"2024-04-26T12:49:56.234879+0000","last_active":"2024-04-26T12:53:09.352765+0000","last_peered":"2024-04-26T12:53:09.352765+0000","last_clean":"2024-04-26T12:53:09.352765+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:09.352765+0000","last_undegraded":"2024-04-26T12:53:09.352765+0000","last_fullsized":"2024-04-26T12:53:09.352765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:36.234142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316217+0000","last_change":"2024-04-26T12:49:54.252713+0000","last_active":"2024-04-26T12:50:34.316217+0000","last_peered":"2024-04-26T12:50:34.316217+0000","last_clean":"2024-04-26T12:50:34.316217+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:50:34.316217+0000","last_undegraded":"2024-04-26T12:50:34.316217+0000","last_fullsized":"2024-04-26T12:50:34.316217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:16.359098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.927242+0000","last_change":"2024-04-26T12:49:56.223432+0000","last_active":"2024-04-26T12:53:08.927242+0000","last_peered":"2024-04-26T12:53:08.927242+0000","last_clean":"2024-04-26T12:53:08.927242+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:08.927242+0000","last_undegraded":"2024-04-26T12:53:08.927242+0000","last_fullsized":"2024-04-26T12:53:08.927242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316540+0000","last_change":"2024-04-26T12:49:54.258313+0000","last_active":"2024-04-26T12:50:34.316540+0000","last_peered":"2024-04-26T12:50:34.316540+0000","last_clean":"2024-04-26T12:50:34.316540+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:50:34.316540+0000","last_undegraded":"2024-04-26T12:50:34.316540+0000","last_fullsized":"2024-04-26T12:50:34.316540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:25.040941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265442+0000","last_change":"2024-04-26T12:49:56.228594+0000","last_active":"2024-04-26T12:53:09.265442+0000","last_peered":"2024-04-26T12:53:09.265442+0000","last_clean":"2024-04-26T12:53:09.265442+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:53:09.265442+0000","last_undegraded":"2024-04-26T12:53:09.265442+0000","last_fullsized":"2024-04-26T12:53:09.265442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:49.872348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305357+0000","last_change":"2024-04-26T12:49:54.248935+0000","last_active":"2024-04-26T12:50:34.305357+0000","last_peered":"2024-04-26T12:50:34.305357+0000","last_clean":"2024-04-26T12:50:34.305357+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:50:34.305357+0000","last_undegraded":"2024-04-26T12:50:34.305357+0000","last_fullsized":"2024-04-26T12:50:34.305357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:16.074935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.268306+0000","last_change":"2024-04-26T12:49:56.231485+0000","last_active":"2024-04-26T12:52:08.268306+0000","last_peered":"2024-04-26T12:52:08.268306+0000","last_clean":"2024-04-26T12:52:08.268306+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:52:08.268306+0000","last_undegraded":"2024-04-26T12:52:08.268306+0000","last_fullsized":"2024-04-26T12:52:08.268306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966922+0000","last_change":"2024-04-26T12:49:54.258409+0000","last_active":"2024-04-26T12:52:17.966922+0000","last_peered":"2024-04-26T12:52:17.966922+0000","last_clean":"2024-04-26T12:52:17.966922+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:52:17.966922+0000","last_undegraded":"2024-04-26T12:52:17.966922+0000","last_fullsized":"2024-04-26T12:52:17.966922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:44.743239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301388+0000","last_change":"2024-04-26T12:49:54.241113+0000","last_active":"2024-04-26T12:50:34.301388+0000","last_peered":"2024-04-26T12:50:34.301388+0000","last_clean":"2024-04-26T12:50:34.301388+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:50:34.301388+0000","last_undegraded":"2024-04-26T12:50:34.301388+0000","last_fullsized":"2024-04-26T12:50:34.301388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.409242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352305+0000","last_change":"2024-04-26T12:49:56.227407+0000","last_active":"2024-04-26T12:53:09.352305+0000","last_peered":"2024-04-26T12:53:09.352305+0000","last_clean":"2024-04-26T12:53:09.352305+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:09.352305+0000","last_undegraded":"2024-04-26T12:53:09.352305+0000","last_fullsized":"2024-04-26T12:53:09.352305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:50.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.910309+0000","last_change":"2024-04-26T12:49:54.244752+0000","last_active":"2024-04-26T12:50:39.910309+0000","last_peered":"2024-04-26T12:50:39.910309+0000","last_clean":"2024-04-26T12:50:39.910309+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:50:39.910309+0000","last_undegraded":"2024-04-26T12:50:39.910309+0000","last_fullsized":"2024-04-26T12:50:39.910309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.113655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.011511+0000","last_change":"2024-04-26T12:49:56.232881+0000","last_active":"2024-04-26T12:51:23.011511+0000","last_peered":"2024-04-26T12:51:23.011511+0000","last_clean":"2024-04-26T12:51:23.011511+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:51:23.011511+0000","last_undegraded":"2024-04-26T12:51:23.011511+0000","last_fullsized":"2024-04-26T12:51:23.011511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:53.358894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46376,"kb_used_data":11040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325464,"statfs":{"total":96636764160,"available":96589275136,"internally_reserved":0,"allocated":11304960,"data_stored":10964681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48932,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322908,"statfs":{"total":96636764160,"available":96586657792,"internally_reserved":0,"allocated":13922304,"data_stored":13647204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42500,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329340,"statfs":{"total":96636764160,"available":96593244160,"internally_reserved":0,"allocated":7335936,"data_stored":7033851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":8956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":9170944,"data_stored":8865182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:53:16.740 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:53:16.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.890+0000 7fa2ae005640 1 Processor -- start 2024-04-26T12:53:16.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.890+0000 7fa2ae005640 1 -- start start 2024-04-26T12:53:16.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2a8098e10 0x7fa2a80991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:16.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a809ae10 con 0x7fa2a8099730 2024-04-26T12:53:16.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a809ab00 con 0x7fa2a8098e10 2024-04-26T12:53:16.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2a8098e10 0x7fa2a80991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:16.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa2a8099730 0x7fa2a8132a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55236/0 (socket says 172.21.15.29:55236) 2024-04-26T12:53:16.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a6ffd640 1 -- 172.21.15.29:0/207275301 learned_addr learned my addr 172.21.15.29:0/207275301 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:16.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a77fe640 1 -- 172.21.15.29:0/207275301 >> v1:172.21.15.29:6789/0 conn(0x7fa2a8099730 legacy=0x7fa2a8132a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a77fe640 1 -- 172.21.15.29:0/207275301 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a80a00c0 con 0x7fa2a8098e10 2024-04-26T12:53:16.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a77fe640 1 --2- 172.21.15.29:0/207275301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a80991f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa298009740 tx=0x7fa29801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275c91803f373aac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:16.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a67fc640 1 -- 172.21.15.29:0/207275301 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2980b1070 con 0x7fa2a8098e10 2024-04-26T12:53:16.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a67fc640 1 -- 172.21.15.29:0/207275301 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a809a160 con 0x7fa2a8098e10 2024-04-26T12:53:16.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2a67fc640 1 -- 172.21.15.29:0/207275301 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2980ac670 con 0x7fa2a8098e10 2024-04-26T12:53:16.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 -- 172.21.15.29:0/207275301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 msgr2=0x7fa2a80991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:16.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 --2- 172.21.15.29:0/207275301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a80991f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa298009740 tx=0x7fa29801c370 comp rx=0 tx=0).stop 2024-04-26T12:53:16.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 -- 172.21.15.29:0/207275301 shutdown_connections 2024-04-26T12:53:16.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 --2- 172.21.15.29:0/207275301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a80991f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:16.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.894+0000 7fa2ae005640 1 -- 172.21.15.29:0/207275301 >> 172.21.15.29:0/207275301 conn(0x7fa2a809ee00 msgr2=0x7fa2a809f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:16.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 -- 172.21.15.29:0/207275301 shutdown_connections 2024-04-26T12:53:16.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 -- 172.21.15.29:0/207275301 wait complete. 2024-04-26T12:53:16.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 Processor -- start 2024-04-26T12:53:16.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 -- start start 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a8092f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a8136d40 con 0x7fa2a8098e10 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a8092f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a8092f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59972/0 (socket says 172.21.15.29:59972) 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2a77fe640 1 -- 172.21.15.29:0/180317448 learned_addr learned my addr 172.21.15.29:0/180317448 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2a77fe640 1 -- 172.21.15.29:0/180317448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a8090cb0 con 0x7fa2a8098e10 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2a77fe640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a8092f00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa29801aa20 tx=0x7fa298019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa28ffff640 1 -- 172.21.15.29:0/180317448 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2980b9070 con 0x7fa2a8098e10 2024-04-26T12:53:16.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa28ffff640 1 -- 172.21.15.29:0/180317448 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2980acc80 con 0x7fa2a8098e10 2024-04-26T12:53:16.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa28ffff640 1 -- 172.21.15.29:0/180317448 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2980b1040 con 0x7fa2a8098e10 2024-04-26T12:53:16.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a8091590 con 0x7fa2a8098e10 2024-04-26T12:53:16.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a8093610 con 0x7fa2a8098e10 2024-04-26T12:53:16.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a8091cf0 con 0x7fa2a8098e10 2024-04-26T12:53:16.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa28ffff640 1 -- 172.21.15.29:0/180317448 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa2980bc070 con 0x7fa2a8098e10 2024-04-26T12:53:16.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa28ffff640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa294035db0 0x7fa294038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:16.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.898+0000 7fa28ffff640 1 -- 172.21.15.29:0/180317448 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa2980e2cf0 con 0x7fa2a8098e10 2024-04-26T12:53:16.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.902+0000 7fa2a6ffd640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa294035db0 0x7fa294038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:16.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.902+0000 7fa2a6ffd640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa294035db0 0x7fa294038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa29c001610 tx=0x7fa29c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:16.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:16.906+0000 7fa28ffff640 1 -- 172.21.15.29:0/180317448 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa2980a9070 con 0x7fa2a8098e10 2024-04-26T12:53:17.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.062+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2a809a160 con 0x7fa294035db0 2024-04-26T12:53:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.110+0000 7fa28ffff640 1 -- 172.21.15.29:0/180317448 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665708 (secure 0 0 0) 0x7fa2a809a160 con 0x7fa294035db0 2024-04-26T12:53:17.116 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:53:17.122 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:53:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa294035db0 msgr2=0x7fa294038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa294035db0 0x7fa294038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa29c001610 tx=0x7fa29c007ad0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 msgr2=0x7fa2a8092f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a8092f00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa29801aa20 tx=0x7fa298019110 comp rx=0 tx=0).stop 2024-04-26T12:53:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 shutdown_connections 2024-04-26T12:53:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa294035db0 0x7fa294038270 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 --2- 172.21.15.29:0/180317448 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8098e10 0x7fa2a8092f00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 >> 172.21.15.29:0/180317448 conn(0x7fa2a809ee00 msgr2=0x7fa2a8096490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 shutdown_connections 2024-04-26T12:53:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.114+0000 7fa2ae005640 1 -- 172.21.15.29:0/180317448 wait complete. 2024-04-26T12:53:17.132 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-26T12:53:15.234344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2106,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4477,"ondisk_log_size":4477,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173780,"kb_used_data":40756,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377313580,"statfs":{"total":386547056640,"available":386369105920,"internally_reserved":0,"allocated":41734144,"data_stored":40510918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":136177427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":465,"num_write":386,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006754"},"pg_stats":[{"pgid":"3.3f","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.960256+0000","last_change":"2024-04-26T12:49:54.242608+0000","last_active":"2024-04-26T12:52:02.960256+0000","last_peered":"2024-04-26T12:52:02.960256+0000","last_clean":"2024-04-26T12:52:02.960256+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:52:02.960256+0000","last_undegraded":"2024-04-26T12:52:02.960256+0000","last_fullsized":"2024-04-26T12:52:02.960256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.951421+0000","last_change":"2024-04-26T12:49:56.222755+0000","last_active":"2024-04-26T12:52:03.951421+0000","last_peered":"2024-04-26T12:52:03.951421+0000","last_clean":"2024-04-26T12:52:03.951421+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:52:03.951421+0000","last_undegraded":"2024-04-26T12:52:03.951421+0000","last_fullsized":"2024-04-26T12:52:03.951421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:40.027829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303872+0000","last_change":"2024-04-26T12:49:54.235378+0000","last_active":"2024-04-26T12:50:34.303872+0000","last_peered":"2024-04-26T12:50:34.303872+0000","last_clean":"2024-04-26T12:50:34.303872+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:50:34.303872+0000","last_undegraded":"2024-04-26T12:50:34.303872+0000","last_fullsized":"2024-04-26T12:50:34.303872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.979752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420744+0000","last_change":"2024-04-26T12:49:56.223502+0000","last_active":"2024-04-26T12:53:09.420744+0000","last_peered":"2024-04-26T12:53:09.420744+0000","last_clean":"2024-04-26T12:53:09.420744+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:53:09.420744+0000","last_undegraded":"2024-04-26T12:53:09.420744+0000","last_fullsized":"2024-04-26T12:53:09.420744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:55.385814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.443926+0000","last_change":"2024-04-26T12:49:54.259543+0000","last_active":"2024-04-26T12:50:38.443926+0000","last_peered":"2024-04-26T12:50:38.443926+0000","last_clean":"2024-04-26T12:50:38.443926+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:50:38.443926+0000","last_undegraded":"2024-04-26T12:50:38.443926+0000","last_fullsized":"2024-04-26T12:50:38.443926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:21.397944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439652+0000","last_change":"2024-04-26T12:49:56.230220+0000","last_active":"2024-04-26T12:53:09.439652+0000","last_peered":"2024-04-26T12:53:09.439652+0000","last_clean":"2024-04-26T12:53:09.439652+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:09.439652+0000","last_undegraded":"2024-04-26T12:53:09.439652+0000","last_fullsized":"2024-04-26T12:53:09.439652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:52.667520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.986056+0000","last_change":"2024-04-26T12:49:54.243452+0000","last_active":"2024-04-26T12:52:07.986056+0000","last_peered":"2024-04-26T12:52:07.986056+0000","last_clean":"2024-04-26T12:52:07.986056+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:52:07.986056+0000","last_undegraded":"2024-04-26T12:52:07.986056+0000","last_fullsized":"2024-04-26T12:52:07.986056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265864+0000","last_change":"2024-04-26T12:50:34.320557+0000","last_active":"2024-04-26T12:53:09.265864+0000","last_peered":"2024-04-26T12:53:09.265864+0000","last_clean":"2024-04-26T12:53:09.265864+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:53:09.265864+0000","last_undegraded":"2024-04-26T12:53:09.265864+0000","last_fullsized":"2024-04-26T12:53:09.265864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:36.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.171393+0000","last_change":"2024-04-26T12:49:54.237140+0000","last_active":"2024-04-26T12:52:08.171393+0000","last_peered":"2024-04-26T12:52:08.171393+0000","last_clean":"2024-04-26T12:52:08.171393+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:52:08.171393+0000","last_undegraded":"2024-04-26T12:52:08.171393+0000","last_fullsized":"2024-04-26T12:52:08.171393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:58.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945401+0000","last_change":"2024-04-26T12:49:56.231677+0000","last_active":"2024-04-26T12:50:39.945401+0000","last_peered":"2024-04-26T12:50:39.945401+0000","last_clean":"2024-04-26T12:50:39.945401+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:50:39.945401+0000","last_undegraded":"2024-04-26T12:50:39.945401+0000","last_fullsized":"2024-04-26T12:50:39.945401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:40.895169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296361+0000","last_change":"2024-04-26T12:49:54.242489+0000","last_active":"2024-04-26T12:50:34.296361+0000","last_peered":"2024-04-26T12:50:34.296361+0000","last_clean":"2024-04-26T12:50:34.296361+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:50:34.296361+0000","last_undegraded":"2024-04-26T12:50:34.296361+0000","last_fullsized":"2024-04-26T12:50:34.296361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.944960+0000","last_change":"2024-04-26T12:49:56.229364+0000","last_active":"2024-04-26T12:50:39.944960+0000","last_peered":"2024-04-26T12:50:39.944960+0000","last_clean":"2024-04-26T12:50:39.944960+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:50:39.944960+0000","last_undegraded":"2024-04-26T12:50:39.944960+0000","last_fullsized":"2024-04-26T12:50:39.944960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.707668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.932592+0000","last_change":"2024-04-26T12:49:54.238559+0000","last_active":"2024-04-26T12:52:03.932592+0000","last_peered":"2024-04-26T12:52:03.932592+0000","last_clean":"2024-04-26T12:52:03.932592+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:52:03.932592+0000","last_undegraded":"2024-04-26T12:52:03.932592+0000","last_fullsized":"2024-04-26T12:52:03.932592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:18.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.525120+0000","last_change":"2024-04-26T12:49:56.219293+0000","last_active":"2024-04-26T12:53:09.525120+0000","last_peered":"2024-04-26T12:53:09.525120+0000","last_clean":"2024-04-26T12:53:09.525120+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:09.525120+0000","last_undegraded":"2024-04-26T12:53:09.525120+0000","last_fullsized":"2024-04-26T12:53:09.525120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297946+0000","last_change":"2024-04-26T12:49:54.238122+0000","last_active":"2024-04-26T12:50:34.297946+0000","last_peered":"2024-04-26T12:50:34.297946+0000","last_clean":"2024-04-26T12:50:34.297946+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:50:34.297946+0000","last_undegraded":"2024-04-26T12:50:34.297946+0000","last_fullsized":"2024-04-26T12:50:34.297946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:44.405285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.935848+0000","last_change":"2024-04-26T12:49:56.214215+0000","last_active":"2024-04-26T12:52:03.935848+0000","last_peered":"2024-04-26T12:52:03.935848+0000","last_clean":"2024-04-26T12:52:03.935848+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:52:03.935848+0000","last_undegraded":"2024-04-26T12:52:03.935848+0000","last_fullsized":"2024-04-26T12:52:03.935848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.065457+0000","last_change":"2024-04-26T12:49:56.220575+0000","last_active":"2024-04-26T12:53:09.065457+0000","last_peered":"2024-04-26T12:53:09.065457+0000","last_clean":"2024-04-26T12:53:09.065457+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:53:09.065457+0000","last_undegraded":"2024-04-26T12:53:09.065457+0000","last_fullsized":"2024-04-26T12:53:09.065457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:18.310904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.927312+0000","last_change":"2024-04-26T12:49:54.245871+0000","last_active":"2024-04-26T12:50:39.927312+0000","last_peered":"2024-04-26T12:50:39.927312+0000","last_clean":"2024-04-26T12:50:39.927312+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:50:39.927312+0000","last_undegraded":"2024-04-26T12:50:39.927312+0000","last_fullsized":"2024-04-26T12:50:39.927312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265368+0000","last_change":"2024-04-26T12:49:56.220421+0000","last_active":"2024-04-26T12:53:09.265368+0000","last_peered":"2024-04-26T12:53:09.265368+0000","last_clean":"2024-04-26T12:53:09.265368+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:09.265368+0000","last_undegraded":"2024-04-26T12:53:09.265368+0000","last_fullsized":"2024-04-26T12:53:09.265368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'3","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964829+0000","last_change":"2024-04-26T12:49:54.250106+0000","last_active":"2024-04-26T12:52:22.964829+0000","last_peered":"2024-04-26T12:52:22.964829+0000","last_clean":"2024-04-26T12:52:22.964829+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:52:22.964829+0000","last_undegraded":"2024-04-26T12:52:22.964829+0000","last_fullsized":"2024-04-26T12:52:22.964829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.348707+0000","last_change":"2024-04-26T12:49:56.222834+0000","last_active":"2024-04-26T12:53:09.348707+0000","last_peered":"2024-04-26T12:53:09.348707+0000","last_clean":"2024-04-26T12:53:09.348707+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:09.348707+0000","last_undegraded":"2024-04-26T12:53:09.348707+0000","last_fullsized":"2024-04-26T12:53:09.348707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:55.139601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317543+0000","last_change":"2024-04-26T12:49:54.244413+0000","last_active":"2024-04-26T12:50:34.317543+0000","last_peered":"2024-04-26T12:50:34.317543+0000","last_clean":"2024-04-26T12:50:34.317543+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:50:34.317543+0000","last_undegraded":"2024-04-26T12:50:34.317543+0000","last_fullsized":"2024-04-26T12:50:34.317543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.920847+0000","last_change":"2024-04-26T12:49:56.221481+0000","last_active":"2024-04-26T12:53:08.920847+0000","last_peered":"2024-04-26T12:53:08.920847+0000","last_clean":"2024-04-26T12:53:08.920847+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:53:08.920847+0000","last_undegraded":"2024-04-26T12:53:08.920847+0000","last_fullsized":"2024-04-26T12:53:08.920847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:18.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.218924+0000","last_change":"2024-04-26T12:49:54.246419+0000","last_active":"2024-04-26T12:53:09.218924+0000","last_peered":"2024-04-26T12:53:09.218924+0000","last_clean":"2024-04-26T12:53:09.218924+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:09.218924+0000","last_undegraded":"2024-04-26T12:53:09.218924+0000","last_fullsized":"2024-04-26T12:53:09.218924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298569+0000","last_change":"2024-04-26T12:49:56.215781+0000","last_active":"2024-04-26T12:50:34.298569+0000","last_peered":"2024-04-26T12:50:34.298569+0000","last_clean":"2024-04-26T12:50:34.298569+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:50:34.298569+0000","last_undegraded":"2024-04-26T12:50:34.298569+0000","last_fullsized":"2024-04-26T12:50:34.298569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:05.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301528+0000","last_change":"2024-04-26T12:49:54.235967+0000","last_active":"2024-04-26T12:50:34.301528+0000","last_peered":"2024-04-26T12:50:34.301528+0000","last_clean":"2024-04-26T12:50:34.301528+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:50:34.301528+0000","last_undegraded":"2024-04-26T12:50:34.301528+0000","last_fullsized":"2024-04-26T12:50:34.301528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:38.031959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.349371+0000","last_change":"2024-04-26T12:49:56.230516+0000","last_active":"2024-04-26T12:53:09.349371+0000","last_peered":"2024-04-26T12:53:09.349371+0000","last_clean":"2024-04-26T12:53:09.349371+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:09.349371+0000","last_undegraded":"2024-04-26T12:53:09.349371+0000","last_fullsized":"2024-04-26T12:53:09.349371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:43.529519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307407+0000","last_change":"2024-04-26T12:49:54.231273+0000","last_active":"2024-04-26T12:50:34.307407+0000","last_peered":"2024-04-26T12:50:34.307407+0000","last_clean":"2024-04-26T12:50:34.307407+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:50:34.307407+0000","last_undegraded":"2024-04-26T12:50:34.307407+0000","last_fullsized":"2024-04-26T12:50:34.307407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:04.131902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.309725+0000","last_change":"2024-04-26T12:50:04.290015+0000","last_active":"2024-04-26T12:53:09.309725+0000","last_peered":"2024-04-26T12:53:09.309725+0000","last_clean":"2024-04-26T12:53:09.309725+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:53:09.309725+0000","last_undegraded":"2024-04-26T12:53:09.309725+0000","last_fullsized":"2024-04-26T12:53:09.309725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:43.725242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966748+0000","last_change":"2024-04-26T12:49:56.230418+0000","last_active":"2024-04-26T12:52:17.966748+0000","last_peered":"2024-04-26T12:52:17.966748+0000","last_clean":"2024-04-26T12:52:17.966748+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:52:17.966748+0000","last_undegraded":"2024-04-26T12:52:17.966748+0000","last_fullsized":"2024-04-26T12:52:17.966748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:45.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308000+0000","last_change":"2024-04-26T12:49:54.258161+0000","last_active":"2024-04-26T12:50:34.308000+0000","last_peered":"2024-04-26T12:50:34.308000+0000","last_clean":"2024-04-26T12:50:34.308000+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:50:34.308000+0000","last_undegraded":"2024-04-26T12:50:34.308000+0000","last_fullsized":"2024-04-26T12:50:34.308000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:00.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.757841+0000","last_change":"2024-04-26T12:49:58.245109+0000","last_active":"2024-04-26T12:52:07.757841+0000","last_peered":"2024-04-26T12:52:07.757841+0000","last_clean":"2024-04-26T12:52:07.757841+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:52:07.757841+0000","last_undegraded":"2024-04-26T12:52:07.757841+0000","last_fullsized":"2024-04-26T12:52:07.757841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:01.452307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.184804+0000","last_change":"2024-04-26T12:50:00.267183+0000","last_active":"2024-04-26T12:52:06.184804+0000","last_peered":"2024-04-26T12:52:06.184804+0000","last_clean":"2024-04-26T12:52:06.184804+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:52:06.184804+0000","last_undegraded":"2024-04-26T12:52:06.184804+0000","last_fullsized":"2024-04-26T12:52:06.184804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:20.694030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318971+0000","last_change":"2024-04-26T12:50:02.286913+0000","last_active":"2024-04-26T12:50:34.318971+0000","last_peered":"2024-04-26T12:50:34.318971+0000","last_clean":"2024-04-26T12:50:34.318971+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:50:34.318971+0000","last_undegraded":"2024-04-26T12:50:34.318971+0000","last_fullsized":"2024-04-26T12:50:34.318971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.009156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.021133+0000","last_change":"2024-04-26T12:50:04.289706+0000","last_active":"2024-04-26T12:51:23.021133+0000","last_peered":"2024-04-26T12:51:23.021133+0000","last_clean":"2024-04-26T12:51:23.021133+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:51:23.021133+0000","last_undegraded":"2024-04-26T12:51:23.021133+0000","last_fullsized":"2024-04-26T12:51:23.021133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420741+0000","last_change":"2024-04-26T12:49:56.230756+0000","last_active":"2024-04-26T12:53:09.420741+0000","last_peered":"2024-04-26T12:53:09.420741+0000","last_clean":"2024-04-26T12:53:09.420741+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:09.420741+0000","last_undegraded":"2024-04-26T12:53:09.420741+0000","last_fullsized":"2024-04-26T12:53:09.420741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:08.686460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295413+0000","last_change":"2024-04-26T12:49:54.239992+0000","last_active":"2024-04-26T12:50:34.295413+0000","last_peered":"2024-04-26T12:50:34.295413+0000","last_clean":"2024-04-26T12:50:34.295413+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:50:34.295413+0000","last_undegraded":"2024-04-26T12:50:34.295413+0000","last_fullsized":"2024-04-26T12:50:34.295413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298746+0000","last_change":"2024-04-26T12:49:58.222832+0000","last_active":"2024-04-26T12:50:34.298746+0000","last_peered":"2024-04-26T12:50:34.298746+0000","last_clean":"2024-04-26T12:50:34.298746+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:50:34.298746+0000","last_undegraded":"2024-04-26T12:50:34.298746+0000","last_fullsized":"2024-04-26T12:50:34.298746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:55.234724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317827+0000","last_change":"2024-04-26T12:50:00.237541+0000","last_active":"2024-04-26T12:50:34.317827+0000","last_peered":"2024-04-26T12:50:34.317827+0000","last_clean":"2024-04-26T12:50:34.317827+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:50:34.317827+0000","last_undegraded":"2024-04-26T12:50:34.317827+0000","last_fullsized":"2024-04-26T12:50:34.317827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:55.963923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317973+0000","last_change":"2024-04-26T12:50:02.279094+0000","last_active":"2024-04-26T12:50:34.317973+0000","last_peered":"2024-04-26T12:50:34.317973+0000","last_clean":"2024-04-26T12:50:34.317973+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:50:34.317973+0000","last_undegraded":"2024-04-26T12:50:34.317973+0000","last_fullsized":"2024-04-26T12:50:34.317973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:59.872989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297515+0000","last_change":"2024-04-26T12:50:04.281974+0000","last_active":"2024-04-26T12:50:34.297515+0000","last_peered":"2024-04-26T12:50:34.297515+0000","last_clean":"2024-04-26T12:50:34.297515+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:50:34.297515+0000","last_undegraded":"2024-04-26T12:50:34.297515+0000","last_fullsized":"2024-04-26T12:50:34.297515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:37.632879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301288+0000","last_change":"2024-04-26T12:49:56.230322+0000","last_active":"2024-04-26T12:51:23.301288+0000","last_peered":"2024-04-26T12:51:23.301288+0000","last_clean":"2024-04-26T12:51:23.301288+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:51:23.301288+0000","last_undegraded":"2024-04-26T12:51:23.301288+0000","last_fullsized":"2024-04-26T12:51:23.301288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:53.550517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302460+0000","last_change":"2024-04-26T12:49:54.238247+0000","last_active":"2024-04-26T12:50:34.302460+0000","last_peered":"2024-04-26T12:50:34.302460+0000","last_clean":"2024-04-26T12:50:34.302460+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:50:34.302460+0000","last_undegraded":"2024-04-26T12:50:34.302460+0000","last_fullsized":"2024-04-26T12:50:34.302460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:27.411968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304667+0000","last_change":"2024-04-26T12:49:58.227229+0000","last_active":"2024-04-26T12:50:34.304667+0000","last_peered":"2024-04-26T12:50:34.304667+0000","last_clean":"2024-04-26T12:50:34.304667+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:50:34.304667+0000","last_undegraded":"2024-04-26T12:50:34.304667+0000","last_fullsized":"2024-04-26T12:50:34.304667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.728074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299915+0000","last_change":"2024-04-26T12:50:00.265817+0000","last_active":"2024-04-26T12:50:34.299915+0000","last_peered":"2024-04-26T12:50:34.299915+0000","last_clean":"2024-04-26T12:50:34.299915+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:50:34.299915+0000","last_undegraded":"2024-04-26T12:50:34.299915+0000","last_fullsized":"2024-04-26T12:50:34.299915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":386,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.611107+0000","last_change":"2024-04-26T12:50:02.294244+0000","last_active":"2024-04-26T12:53:09.611107+0000","last_peered":"2024-04-26T12:53:09.611107+0000","last_clean":"2024-04-26T12:53:09.611107+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:09.611107+0000","last_undegraded":"2024-04-26T12:53:09.611107+0000","last_fullsized":"2024-04-26T12:53:09.611107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295111+0000","last_change":"2024-04-26T12:50:04.283093+0000","last_active":"2024-04-26T12:50:34.295111+0000","last_peered":"2024-04-26T12:50:34.295111+0000","last_clean":"2024-04-26T12:50:34.295111+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:50:34.295111+0000","last_undegraded":"2024-04-26T12:50:34.295111+0000","last_fullsized":"2024-04-26T12:50:34.295111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:54.841461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352362+0000","last_change":"2024-04-26T12:49:56.227048+0000","last_active":"2024-04-26T12:53:09.352362+0000","last_peered":"2024-04-26T12:53:09.352362+0000","last_clean":"2024-04-26T12:53:09.352362+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:09.352362+0000","last_undegraded":"2024-04-26T12:53:09.352362+0000","last_fullsized":"2024-04-26T12:53:09.352362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:09.070129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.905801+0000","last_change":"2024-04-26T12:49:54.236350+0000","last_active":"2024-04-26T12:50:39.905801+0000","last_peered":"2024-04-26T12:50:39.905801+0000","last_clean":"2024-04-26T12:50:39.905801+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:50:39.905801+0000","last_undegraded":"2024-04-26T12:50:39.905801+0000","last_fullsized":"2024-04-26T12:50:39.905801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.325536+0000","last_change":"2024-04-26T12:49:58.245623+0000","last_active":"2024-04-26T12:50:34.325536+0000","last_peered":"2024-04-26T12:50:34.325536+0000","last_clean":"2024-04-26T12:50:34.325536+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:50:34.325536+0000","last_undegraded":"2024-04-26T12:50:34.325536+0000","last_fullsized":"2024-04-26T12:50:34.325536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:58.925636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.176499+0000","last_change":"2024-04-26T12:50:00.265428+0000","last_active":"2024-04-26T12:52:06.176499+0000","last_peered":"2024-04-26T12:52:06.176499+0000","last_clean":"2024-04-26T12:52:06.176499+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:52:06.176499+0000","last_undegraded":"2024-04-26T12:52:06.176499+0000","last_fullsized":"2024-04-26T12:52:06.176499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:23.018038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.428698+0000","last_change":"2024-04-26T12:50:02.264756+0000","last_active":"2024-04-26T12:53:09.428698+0000","last_peered":"2024-04-26T12:53:09.428698+0000","last_clean":"2024-04-26T12:53:09.428698+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:09.428698+0000","last_undegraded":"2024-04-26T12:53:09.428698+0000","last_fullsized":"2024-04-26T12:53:09.428698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:39.304818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.930226+0000","last_change":"2024-04-26T12:49:56.225947+0000","last_active":"2024-04-26T12:53:08.930226+0000","last_peered":"2024-04-26T12:53:08.930226+0000","last_clean":"2024-04-26T12:53:08.930226+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:53:08.930226+0000","last_undegraded":"2024-04-26T12:53:08.930226+0000","last_fullsized":"2024-04-26T12:53:08.930226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:51.767496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.227207+0000","last_change":"2024-04-26T12:49:54.242591+0000","last_active":"2024-04-26T12:53:09.227207+0000","last_peered":"2024-04-26T12:53:09.227207+0000","last_clean":"2024-04-26T12:53:09.227207+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:53:09.227207+0000","last_undegraded":"2024-04-26T12:53:09.227207+0000","last_fullsized":"2024-04-26T12:53:09.227207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310114+0000","last_change":"2024-04-26T12:49:58.241965+0000","last_active":"2024-04-26T12:50:34.310114+0000","last_peered":"2024-04-26T12:50:34.310114+0000","last_clean":"2024-04-26T12:50:34.310114+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:50:34.310114+0000","last_undegraded":"2024-04-26T12:50:34.310114+0000","last_fullsized":"2024-04-26T12:50:34.310114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:10.690590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'40","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.192218+0000","last_change":"2024-04-26T12:50:00.235080+0000","last_active":"2024-04-26T12:52:06.192218+0000","last_peered":"2024-04-26T12:52:06.192218+0000","last_clean":"2024-04-26T12:52:06.192218+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:52:06.192218+0000","last_undegraded":"2024-04-26T12:52:06.192218+0000","last_fullsized":"2024-04-26T12:52:06.192218+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.158126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300728+0000","last_change":"2024-04-26T12:50:02.273873+0000","last_active":"2024-04-26T12:50:34.300728+0000","last_peered":"2024-04-26T12:50:34.300728+0000","last_clean":"2024-04-26T12:50:34.300728+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:50:34.300728+0000","last_undegraded":"2024-04-26T12:50:34.300728+0000","last_fullsized":"2024-04-26T12:50:34.300728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:53.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.326178+0000","last_change":"2024-04-26T12:50:04.291139+0000","last_active":"2024-04-26T12:53:09.326178+0000","last_peered":"2024-04-26T12:53:09.326178+0000","last_clean":"2024-04-26T12:53:09.326178+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:53:09.326178+0000","last_undegraded":"2024-04-26T12:53:09.326178+0000","last_fullsized":"2024-04-26T12:53:09.326178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:27.099715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302331+0000","last_change":"2024-04-26T12:49:56.227916+0000","last_active":"2024-04-26T12:51:23.302331+0000","last_peered":"2024-04-26T12:51:23.302331+0000","last_clean":"2024-04-26T12:51:23.302331+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:51:23.302331+0000","last_undegraded":"2024-04-26T12:51:23.302331+0000","last_fullsized":"2024-04-26T12:51:23.302331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:18.700267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.961996+0000","last_change":"2024-04-26T12:49:54.247789+0000","last_active":"2024-04-26T12:52:12.961996+0000","last_peered":"2024-04-26T12:52:12.961996+0000","last_clean":"2024-04-26T12:52:12.961996+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:52:12.961996+0000","last_undegraded":"2024-04-26T12:52:12.961996+0000","last_fullsized":"2024-04-26T12:52:12.961996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298328+0000","last_change":"2024-04-26T12:49:58.227616+0000","last_active":"2024-04-26T12:50:34.298328+0000","last_peered":"2024-04-26T12:50:34.298328+0000","last_clean":"2024-04-26T12:50:34.298328+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:50:34.298328+0000","last_undegraded":"2024-04-26T12:50:34.298328+0000","last_fullsized":"2024-04-26T12:50:34.298328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:46.747008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.160904+0000","last_change":"2024-04-26T12:50:00.253636+0000","last_active":"2024-04-26T12:52:06.160904+0000","last_peered":"2024-04-26T12:52:06.160904+0000","last_clean":"2024-04-26T12:52:06.160904+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:52:06.160904+0000","last_undegraded":"2024-04-26T12:52:06.160904+0000","last_fullsized":"2024-04-26T12:52:06.160904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:36.115587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298542+0000","last_change":"2024-04-26T12:50:02.278315+0000","last_active":"2024-04-26T12:50:34.298542+0000","last_peered":"2024-04-26T12:50:34.298542+0000","last_clean":"2024-04-26T12:50:34.298542+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:50:34.298542+0000","last_undegraded":"2024-04-26T12:50:34.298542+0000","last_fullsized":"2024-04-26T12:50:34.298542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:49.074190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:17.319401+0000","last_change":"2024-04-26T12:50:04.276914+0000","last_active":"2024-04-26T12:51:17.319401+0000","last_peered":"2024-04-26T12:51:17.319401+0000","last_clean":"2024-04-26T12:51:17.319401+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:51:17.319401+0000","last_undegraded":"2024-04-26T12:51:17.319401+0000","last_fullsized":"2024-04-26T12:51:17.319401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:42.273211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945853+0000","last_change":"2024-04-26T12:49:56.217097+0000","last_active":"2024-04-26T12:50:39.945853+0000","last_peered":"2024-04-26T12:50:39.945853+0000","last_clean":"2024-04-26T12:50:39.945853+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:50:39.945853+0000","last_undegraded":"2024-04-26T12:50:39.945853+0000","last_fullsized":"2024-04-26T12:50:39.945853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.297824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316635+0000","last_change":"2024-04-26T12:49:54.252650+0000","last_active":"2024-04-26T12:50:34.316635+0000","last_peered":"2024-04-26T12:50:34.316635+0000","last_clean":"2024-04-26T12:50:34.316635+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:50:34.316635+0000","last_undegraded":"2024-04-26T12:50:34.316635+0000","last_fullsized":"2024-04-26T12:50:34.316635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:16.696005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304364+0000","last_change":"2024-04-26T12:49:58.230763+0000","last_active":"2024-04-26T12:50:34.304364+0000","last_peered":"2024-04-26T12:50:34.304364+0000","last_clean":"2024-04-26T12:50:34.304364+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:50:34.304364+0000","last_undegraded":"2024-04-26T12:50:34.304364+0000","last_fullsized":"2024-04-26T12:50:34.304364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:45.346897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.194958+0000","last_change":"2024-04-26T12:50:00.268771+0000","last_active":"2024-04-26T12:52:06.194958+0000","last_peered":"2024-04-26T12:52:06.194958+0000","last_clean":"2024-04-26T12:52:06.194958+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:52:06.194958+0000","last_undegraded":"2024-04-26T12:52:06.194958+0000","last_fullsized":"2024-04-26T12:52:06.194958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:54.149076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":349,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.625390+0000","last_change":"2024-04-26T12:50:02.271777+0000","last_active":"2024-04-26T12:53:09.625390+0000","last_peered":"2024-04-26T12:53:09.625390+0000","last_clean":"2024-04-26T12:53:09.625390+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:09.625390+0000","last_undegraded":"2024-04-26T12:53:09.625390+0000","last_fullsized":"2024-04-26T12:53:09.625390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.220287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300846+0000","last_change":"2024-04-26T12:50:04.295468+0000","last_active":"2024-04-26T12:50:34.300846+0000","last_peered":"2024-04-26T12:50:34.300846+0000","last_clean":"2024-04-26T12:50:34.300846+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:50:34.300846+0000","last_undegraded":"2024-04-26T12:50:34.300846+0000","last_fullsized":"2024-04-26T12:50:34.300846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:16.734503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420472+0000","last_change":"2024-04-26T12:49:56.213567+0000","last_active":"2024-04-26T12:53:09.420472+0000","last_peered":"2024-04-26T12:53:09.420472+0000","last_clean":"2024-04-26T12:53:09.420472+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:09.420472+0000","last_undegraded":"2024-04-26T12:53:09.420472+0000","last_fullsized":"2024-04-26T12:53:09.420472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.363361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.408215+0000","last_change":"2024-04-26T12:49:54.259981+0000","last_active":"2024-04-26T12:53:09.408215+0000","last_peered":"2024-04-26T12:53:09.408215+0000","last_clean":"2024-04-26T12:53:09.408215+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:53:09.408215+0000","last_undegraded":"2024-04-26T12:53:09.408215+0000","last_fullsized":"2024-04-26T12:53:09.408215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:38.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:37.943080+0000","last_change":"2024-04-26T12:50:34.307424+0000","last_active":"2024-04-26T12:50:37.943080+0000","last_peered":"2024-04-26T12:50:37.943080+0000","last_clean":"2024-04-26T12:50:37.943080+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:50:37.943080+0000","last_undegraded":"2024-04-26T12:50:37.943080+0000","last_fullsized":"2024-04-26T12:50:37.943080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:48.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'55","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965106+0000","last_change":"2024-04-26T12:50:00.266463+0000","last_active":"2024-04-26T12:52:12.965106+0000","last_peered":"2024-04-26T12:52:12.965106+0000","last_clean":"2024-04-26T12:52:12.965106+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:52:12.965106+0000","last_undegraded":"2024-04-26T12:52:12.965106+0000","last_fullsized":"2024-04-26T12:52:12.965106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:23.507988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297422+0000","last_change":"2024-04-26T12:50:02.276572+0000","last_active":"2024-04-26T12:50:34.297422+0000","last_peered":"2024-04-26T12:50:34.297422+0000","last_clean":"2024-04-26T12:50:34.297422+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:50:34.297422+0000","last_undegraded":"2024-04-26T12:50:34.297422+0000","last_fullsized":"2024-04-26T12:50:34.297422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:09.557600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'20","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.585189+0000","last_change":"2024-04-26T12:50:04.303330+0000","last_active":"2024-04-26T12:53:09.585189+0000","last_peered":"2024-04-26T12:53:09.585189+0000","last_clean":"2024-04-26T12:53:09.585189+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:53:09.585189+0000","last_undegraded":"2024-04-26T12:53:09.585189+0000","last_fullsized":"2024-04-26T12:53:09.585189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:39.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302853+0000","last_change":"2024-04-26T12:49:56.234590+0000","last_active":"2024-04-26T12:51:23.302853+0000","last_peered":"2024-04-26T12:51:23.302853+0000","last_clean":"2024-04-26T12:51:23.302853+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:51:23.302853+0000","last_undegraded":"2024-04-26T12:51:23.302853+0000","last_fullsized":"2024-04-26T12:51:23.302853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:30.414057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300414+0000","last_change":"2024-04-26T12:49:54.239087+0000","last_active":"2024-04-26T12:50:34.300414+0000","last_peered":"2024-04-26T12:50:34.300414+0000","last_clean":"2024-04-26T12:50:34.300414+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:50:34.300414+0000","last_undegraded":"2024-04-26T12:50:34.300414+0000","last_fullsized":"2024-04-26T12:50:34.300414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299450+0000","last_change":"2024-04-26T12:49:58.226242+0000","last_active":"2024-04-26T12:50:34.299450+0000","last_peered":"2024-04-26T12:50:34.299450+0000","last_clean":"2024-04-26T12:50:34.299450+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:50:34.299450+0000","last_undegraded":"2024-04-26T12:50:34.299450+0000","last_fullsized":"2024-04-26T12:50:34.299450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:55.303173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.166823+0000","last_change":"2024-04-26T12:50:00.235211+0000","last_active":"2024-04-26T12:52:06.166823+0000","last_peered":"2024-04-26T12:52:06.166823+0000","last_clean":"2024-04-26T12:52:06.166823+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:52:06.166823+0000","last_undegraded":"2024-04-26T12:52:06.166823+0000","last_fullsized":"2024-04-26T12:52:06.166823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.091284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322784+0000","last_change":"2024-04-26T12:50:02.283252+0000","last_active":"2024-04-26T12:50:34.322784+0000","last_peered":"2024-04-26T12:50:34.322784+0000","last_clean":"2024-04-26T12:50:34.322784+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:50:34.322784+0000","last_undegraded":"2024-04-26T12:50:34.322784+0000","last_fullsized":"2024-04-26T12:50:34.322784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:56.381142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964007+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:52:07.964007+0000","last_peered":"2024-04-26T12:52:07.964007+0000","last_clean":"2024-04-26T12:52:07.964007+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:52:07.964007+0000","last_undegraded":"2024-04-26T12:52:07.964007+0000","last_fullsized":"2024-04-26T12:52:07.964007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:12.923913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352421+0000","last_change":"2024-04-26T12:49:56.229878+0000","last_active":"2024-04-26T12:53:09.352421+0000","last_peered":"2024-04-26T12:53:09.352421+0000","last_clean":"2024-04-26T12:53:09.352421+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:09.352421+0000","last_undegraded":"2024-04-26T12:53:09.352421+0000","last_fullsized":"2024-04-26T12:53:09.352421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:32.609926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308940+0000","last_change":"2024-04-26T12:49:54.231974+0000","last_active":"2024-04-26T12:50:34.308940+0000","last_peered":"2024-04-26T12:50:34.308940+0000","last_clean":"2024-04-26T12:50:34.308940+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:50:34.308940+0000","last_undegraded":"2024-04-26T12:50:34.308940+0000","last_fullsized":"2024-04-26T12:50:34.308940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:49.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299022+0000","last_change":"2024-04-26T12:49:58.230663+0000","last_active":"2024-04-26T12:50:34.299022+0000","last_peered":"2024-04-26T12:50:34.299022+0000","last_clean":"2024-04-26T12:50:34.299022+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:50:34.299022+0000","last_undegraded":"2024-04-26T12:50:34.299022+0000","last_fullsized":"2024-04-26T12:50:34.299022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:00.488394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.963417+0000","last_change":"2024-04-26T12:50:00.249967+0000","last_active":"2024-04-26T12:52:17.963417+0000","last_peered":"2024-04-26T12:52:17.963417+0000","last_clean":"2024-04-26T12:52:17.963417+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:52:17.963417+0000","last_undegraded":"2024-04-26T12:52:17.963417+0000","last_fullsized":"2024-04-26T12:52:17.963417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:37.320719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":404,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.597422+0000","last_change":"2024-04-26T12:50:02.276171+0000","last_active":"2024-04-26T12:53:09.597422+0000","last_peered":"2024-04-26T12:53:09.597422+0000","last_clean":"2024-04-26T12:53:09.597422+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:09.597422+0000","last_undegraded":"2024-04-26T12:53:09.597422+0000","last_fullsized":"2024-04-26T12:53:09.597422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:55.900264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.539446+0000","last_change":"2024-04-26T12:50:04.296504+0000","last_active":"2024-04-26T12:53:09.539446+0000","last_peered":"2024-04-26T12:53:09.539446+0000","last_clean":"2024-04-26T12:53:09.539446+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:53:09.539446+0000","last_undegraded":"2024-04-26T12:53:09.539446+0000","last_fullsized":"2024-04-26T12:53:09.539446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.592447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.287114+0000","last_change":"2024-04-26T12:49:56.221290+0000","last_active":"2024-04-26T12:52:08.287114+0000","last_peered":"2024-04-26T12:52:08.287114+0000","last_clean":"2024-04-26T12:52:08.287114+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:52:08.287114+0000","last_undegraded":"2024-04-26T12:52:08.287114+0000","last_fullsized":"2024-04-26T12:52:08.287114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:22.996331+0000","last_change":"2024-04-26T12:49:54.237237+0000","last_active":"2024-04-26T12:51:22.996331+0000","last_peered":"2024-04-26T12:51:22.996331+0000","last_clean":"2024-04-26T12:51:22.996331+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:51:22.996331+0000","last_undegraded":"2024-04-26T12:51:22.996331+0000","last_fullsized":"2024-04-26T12:51:22.996331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:54.152136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.757550+0000","last_change":"2024-04-26T12:49:58.226903+0000","last_active":"2024-04-26T12:52:07.757550+0000","last_peered":"2024-04-26T12:52:07.757550+0000","last_clean":"2024-04-26T12:52:07.757550+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:52:07.757550+0000","last_undegraded":"2024-04-26T12:52:07.757550+0000","last_fullsized":"2024-04-26T12:52:07.757550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:35.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316978+0000","last_change":"2024-04-26T12:50:00.268687+0000","last_active":"2024-04-26T12:50:34.316978+0000","last_peered":"2024-04-26T12:50:34.316978+0000","last_clean":"2024-04-26T12:50:34.316978+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:50:34.316978+0000","last_undegraded":"2024-04-26T12:50:34.316978+0000","last_fullsized":"2024-04-26T12:50:34.316978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:31.569888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":466,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.536293+0000","last_change":"2024-04-26T12:50:02.273006+0000","last_active":"2024-04-26T12:53:09.536293+0000","last_peered":"2024-04-26T12:53:09.536293+0000","last_clean":"2024-04-26T12:53:09.536293+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:09.536293+0000","last_undegraded":"2024-04-26T12:53:09.536293+0000","last_fullsized":"2024-04-26T12:53:09.536293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:51.983823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.914810+0000","last_change":"2024-04-26T12:50:04.274718+0000","last_active":"2024-04-26T12:52:07.914810+0000","last_peered":"2024-04-26T12:52:07.914810+0000","last_clean":"2024-04-26T12:52:07.914810+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:52:07.914810+0000","last_undegraded":"2024-04-26T12:52:07.914810+0000","last_fullsized":"2024-04-26T12:52:07.914810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:59.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067278+0000","last_change":"2024-04-26T12:49:56.234752+0000","last_active":"2024-04-26T12:53:09.067278+0000","last_peered":"2024-04-26T12:53:09.067278+0000","last_clean":"2024-04-26T12:53:09.067278+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:09.067278+0000","last_undegraded":"2024-04-26T12:53:09.067278+0000","last_fullsized":"2024-04-26T12:53:09.067278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:23.826434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301149+0000","last_change":"2024-04-26T12:49:54.243701+0000","last_active":"2024-04-26T12:50:34.301149+0000","last_peered":"2024-04-26T12:50:34.301149+0000","last_clean":"2024-04-26T12:50:34.301149+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:50:34.301149+0000","last_undegraded":"2024-04-26T12:50:34.301149+0000","last_fullsized":"2024-04-26T12:50:34.301149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:34.229879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322953+0000","last_change":"2024-04-26T12:49:58.244322+0000","last_active":"2024-04-26T12:50:34.322953+0000","last_peered":"2024-04-26T12:50:34.322953+0000","last_clean":"2024-04-26T12:50:34.322953+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:50:34.322953+0000","last_undegraded":"2024-04-26T12:50:34.322953+0000","last_fullsized":"2024-04-26T12:50:34.322953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:20.832753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'39","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.187089+0000","last_change":"2024-04-26T12:50:00.235679+0000","last_active":"2024-04-26T12:52:06.187089+0000","last_peered":"2024-04-26T12:52:06.187089+0000","last_clean":"2024-04-26T12:52:06.187089+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:52:06.187089+0000","last_undegraded":"2024-04-26T12:52:06.187089+0000","last_fullsized":"2024-04-26T12:52:06.187089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:26.195044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299317+0000","last_change":"2024-04-26T12:50:02.289768+0000","last_active":"2024-04-26T12:50:34.299317+0000","last_peered":"2024-04-26T12:50:34.299317+0000","last_clean":"2024-04-26T12:50:34.299317+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:50:34.299317+0000","last_undegraded":"2024-04-26T12:50:34.299317+0000","last_fullsized":"2024-04-26T12:50:34.299317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:01.413730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.492082+0000","last_change":"2024-04-26T12:50:04.271998+0000","last_active":"2024-04-26T12:53:09.492082+0000","last_peered":"2024-04-26T12:53:09.492082+0000","last_clean":"2024-04-26T12:53:09.492082+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:09.492082+0000","last_undegraded":"2024-04-26T12:53:09.492082+0000","last_fullsized":"2024-04-26T12:53:09.492082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:39.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.936230+0000","last_change":"2024-04-26T12:49:56.231794+0000","last_active":"2024-04-26T12:52:03.936230+0000","last_peered":"2024-04-26T12:52:03.936230+0000","last_clean":"2024-04-26T12:52:03.936230+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:52:03.936230+0000","last_undegraded":"2024-04-26T12:52:03.936230+0000","last_fullsized":"2024-04-26T12:52:03.936230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:53.041573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":202,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301216+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:50:34.301216+0000","last_peered":"2024-04-26T12:50:34.301216+0000","last_clean":"2024-04-26T12:50:34.301216+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:50:34.301216+0000","last_undegraded":"2024-04-26T12:50:34.301216+0000","last_fullsized":"2024-04-26T12:50:34.301216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:51.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307677+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:50:34.307677+0000","last_peered":"2024-04-26T12:50:34.307677+0000","last_clean":"2024-04-26T12:50:34.307677+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:50:34.307677+0000","last_undegraded":"2024-04-26T12:50:34.307677+0000","last_fullsized":"2024-04-26T12:50:34.307677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:44.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.874345+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:08.874345+0000","last_peered":"2024-04-26T12:53:08.874345+0000","last_clean":"2024-04-26T12:53:08.874345+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:08.874345+0000","last_undegraded":"2024-04-26T12:53:08.874345+0000","last_fullsized":"2024-04-26T12:53:08.874345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:07.492609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309753+0000","last_change":"2024-04-26T12:49:58.226523+0000","last_active":"2024-04-26T12:50:34.309753+0000","last_peered":"2024-04-26T12:50:34.309753+0000","last_clean":"2024-04-26T12:50:34.309753+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:50:34.309753+0000","last_undegraded":"2024-04-26T12:50:34.309753+0000","last_fullsized":"2024-04-26T12:50:34.309753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:34.614055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'77","reported_seq":146,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.205039+0000","last_change":"2024-04-26T12:50:00.264564+0000","last_active":"2024-04-26T12:52:06.205039+0000","last_peered":"2024-04-26T12:52:06.205039+0000","last_clean":"2024-04-26T12:52:06.205039+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:52:06.205039+0000","last_undegraded":"2024-04-26T12:52:06.205039+0000","last_fullsized":"2024-04-26T12:52:06.205039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:14.296275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301186+0000","last_change":"2024-04-26T12:50:02.283713+0000","last_active":"2024-04-26T12:50:34.301186+0000","last_peered":"2024-04-26T12:50:34.301186+0000","last_clean":"2024-04-26T12:50:34.301186+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:50:34.301186+0000","last_undegraded":"2024-04-26T12:50:34.301186+0000","last_fullsized":"2024-04-26T12:50:34.301186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:57.660351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.447691+0000","last_change":"2024-04-26T12:50:04.295222+0000","last_active":"2024-04-26T12:53:09.447691+0000","last_peered":"2024-04-26T12:53:09.447691+0000","last_clean":"2024-04-26T12:53:09.447691+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:53:09.447691+0000","last_undegraded":"2024-04-26T12:53:09.447691+0000","last_fullsized":"2024-04-26T12:53:09.447691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:45.205005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.950283+0000","last_change":"2024-04-26T12:49:56.229772+0000","last_active":"2024-04-26T12:52:03.950283+0000","last_peered":"2024-04-26T12:52:03.950283+0000","last_clean":"2024-04-26T12:52:03.950283+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:52:03.950283+0000","last_undegraded":"2024-04-26T12:52:03.950283+0000","last_fullsized":"2024-04-26T12:52:03.950283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:51.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300329+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:50:34.300329+0000","last_peered":"2024-04-26T12:50:34.300329+0000","last_clean":"2024-04-26T12:50:34.300329+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:50:34.300329+0000","last_undegraded":"2024-04-26T12:50:34.300329+0000","last_fullsized":"2024-04-26T12:50:34.300329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:26.774107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297560+0000","last_change":"2024-04-26T12:49:54.242621+0000","last_active":"2024-04-26T12:50:34.297560+0000","last_peered":"2024-04-26T12:50:34.297560+0000","last_clean":"2024-04-26T12:50:34.297560+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:50:34.297560+0000","last_undegraded":"2024-04-26T12:50:34.297560+0000","last_fullsized":"2024-04-26T12:50:34.297560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:13.443714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326393+0000","last_change":"2024-04-26T12:49:58.244054+0000","last_active":"2024-04-26T12:50:34.326393+0000","last_peered":"2024-04-26T12:50:34.326393+0000","last_clean":"2024-04-26T12:50:34.326393+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:50:34.326393+0000","last_undegraded":"2024-04-26T12:50:34.326393+0000","last_fullsized":"2024-04-26T12:50:34.326393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:25.847014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'273","reported_seq":477,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.475259+0000","last_change":"2024-04-26T12:50:00.249276+0000","last_active":"2024-04-26T12:53:08.475259+0000","last_peered":"2024-04-26T12:53:08.475259+0000","last_clean":"2024-04-26T12:53:08.475259+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:08.475259+0000","last_undegraded":"2024-04-26T12:53:08.475259+0000","last_fullsized":"2024-04-26T12:53:08.475259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:57.562801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.314485+0000","last_change":"2024-04-26T12:50:02.283171+0000","last_active":"2024-04-26T12:50:34.314485+0000","last_peered":"2024-04-26T12:50:34.314485+0000","last_clean":"2024-04-26T12:50:34.314485+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:50:34.314485+0000","last_undegraded":"2024-04-26T12:50:34.314485+0000","last_fullsized":"2024-04-26T12:50:34.314485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.718547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.017577+0000","last_change":"2024-04-26T12:50:04.282566+0000","last_active":"2024-04-26T12:51:23.017577+0000","last_peered":"2024-04-26T12:51:23.017577+0000","last_clean":"2024-04-26T12:51:23.017577+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:51:23.017577+0000","last_undegraded":"2024-04-26T12:51:23.017577+0000","last_fullsized":"2024-04-26T12:51:23.017577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:35.825570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420031+0000","last_change":"2024-04-26T12:49:56.225899+0000","last_active":"2024-04-26T12:53:09.420031+0000","last_peered":"2024-04-26T12:53:09.420031+0000","last_clean":"2024-04-26T12:53:09.420031+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:09.420031+0000","last_undegraded":"2024-04-26T12:53:09.420031+0000","last_fullsized":"2024-04-26T12:53:09.420031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:53.411007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295191+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:50:34.295191+0000","last_peered":"2024-04-26T12:50:34.295191+0000","last_clean":"2024-04-26T12:50:34.295191+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:50:34.295191+0000","last_undegraded":"2024-04-26T12:50:34.295191+0000","last_fullsized":"2024-04-26T12:50:34.295191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:41.462105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.243990+0000","last_change":"2024-04-26T12:49:54.236038+0000","last_active":"2024-04-26T12:53:09.243990+0000","last_peered":"2024-04-26T12:53:09.243990+0000","last_clean":"2024-04-26T12:53:09.243990+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:53:09.243990+0000","last_undegraded":"2024-04-26T12:53:09.243990+0000","last_fullsized":"2024-04-26T12:53:09.243990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:40.296155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.329321+0000","last_change":"2024-04-26T12:50:34.328152+0000","last_active":"2024-04-26T12:50:34.329321+0000","last_peered":"2024-04-26T12:50:34.329321+0000","last_clean":"2024-04-26T12:50:34.329321+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:50:34.329321+0000","last_undegraded":"2024-04-26T12:50:34.329321+0000","last_fullsized":"2024-04-26T12:50:34.329321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:37.685088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.474919+0000","last_change":"2024-04-26T12:50:00.249900+0000","last_active":"2024-04-26T12:53:08.474919+0000","last_peered":"2024-04-26T12:53:08.474919+0000","last_clean":"2024-04-26T12:53:08.474919+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:08.474919+0000","last_undegraded":"2024-04-26T12:53:08.474919+0000","last_fullsized":"2024-04-26T12:53:08.474919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:05.719952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300488+0000","last_change":"2024-04-26T12:50:02.279258+0000","last_active":"2024-04-26T12:50:34.300488+0000","last_peered":"2024-04-26T12:50:34.300488+0000","last_clean":"2024-04-26T12:50:34.300488+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:50:34.300488+0000","last_undegraded":"2024-04-26T12:50:34.300488+0000","last_fullsized":"2024-04-26T12:50:34.300488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:01.556723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.071153+0000","last_change":"2024-04-26T12:50:04.302141+0000","last_active":"2024-04-26T12:53:09.071153+0000","last_peered":"2024-04-26T12:53:09.071153+0000","last_clean":"2024-04-26T12:53:09.071153+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:53:09.071153+0000","last_undegraded":"2024-04-26T12:53:09.071153+0000","last_fullsized":"2024-04-26T12:53:09.071153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:27.014519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301204+0000","last_change":"2024-04-26T12:49:56.218654+0000","last_active":"2024-04-26T12:51:23.301204+0000","last_peered":"2024-04-26T12:51:23.301204+0000","last_clean":"2024-04-26T12:51:23.301204+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:51:23.301204+0000","last_undegraded":"2024-04-26T12:51:23.301204+0000","last_fullsized":"2024-04-26T12:51:23.301204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.466458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306739+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:50:34.306739+0000","last_peered":"2024-04-26T12:50:34.306739+0000","last_clean":"2024-04-26T12:50:34.306739+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:50:34.306739+0000","last_undegraded":"2024-04-26T12:50:34.306739+0000","last_fullsized":"2024-04-26T12:50:34.306739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:33.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296572+0000","last_change":"2024-04-26T12:49:54.228710+0000","last_active":"2024-04-26T12:50:34.296572+0000","last_peered":"2024-04-26T12:50:34.296572+0000","last_clean":"2024-04-26T12:50:34.296572+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:50:34.296572+0000","last_undegraded":"2024-04-26T12:50:34.296572+0000","last_fullsized":"2024-04-26T12:50:34.296572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300941+0000","last_change":"2024-04-26T12:49:58.226208+0000","last_active":"2024-04-26T12:50:34.300941+0000","last_peered":"2024-04-26T12:50:34.300941+0000","last_clean":"2024-04-26T12:50:34.300941+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:50:34.300941+0000","last_undegraded":"2024-04-26T12:50:34.300941+0000","last_fullsized":"2024-04-26T12:50:34.300941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.427051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.336167+0000","last_change":"2024-04-26T12:50:00.262398+0000","last_active":"2024-04-26T12:53:08.336167+0000","last_peered":"2024-04-26T12:53:08.336167+0000","last_clean":"2024-04-26T12:53:08.336167+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:08.336167+0000","last_undegraded":"2024-04-26T12:53:08.336167+0000","last_fullsized":"2024-04-26T12:53:08.336167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:15.645393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323584+0000","last_change":"2024-04-26T12:50:02.286212+0000","last_active":"2024-04-26T12:50:34.323584+0000","last_peered":"2024-04-26T12:50:34.323584+0000","last_clean":"2024-04-26T12:50:34.323584+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:50:34.323584+0000","last_undegraded":"2024-04-26T12:50:34.323584+0000","last_fullsized":"2024-04-26T12:50:34.323584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.753285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.892986+0000","last_change":"2024-04-26T12:50:04.290606+0000","last_active":"2024-04-26T12:52:07.892986+0000","last_peered":"2024-04-26T12:52:07.892986+0000","last_clean":"2024-04-26T12:52:07.892986+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:52:07.892986+0000","last_undegraded":"2024-04-26T12:52:07.892986+0000","last_fullsized":"2024-04-26T12:52:07.892986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:57.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.925248+0000","last_change":"2024-04-26T12:49:56.234671+0000","last_active":"2024-04-26T12:53:08.925248+0000","last_peered":"2024-04-26T12:53:08.925248+0000","last_clean":"2024-04-26T12:53:08.925248+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:08.925248+0000","last_undegraded":"2024-04-26T12:53:08.925248+0000","last_fullsized":"2024-04-26T12:53:08.925248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:53.299044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.285576+0000","last_change":"2024-04-26T12:49:54.227464+0000","last_active":"2024-04-26T12:51:23.285576+0000","last_peered":"2024-04-26T12:51:23.285576+0000","last_clean":"2024-04-26T12:51:23.285576+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:51:23.285576+0000","last_undegraded":"2024-04-26T12:51:23.285576+0000","last_fullsized":"2024-04-26T12:51:23.285576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299481+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:50:34.299481+0000","last_peered":"2024-04-26T12:50:34.299481+0000","last_clean":"2024-04-26T12:50:34.299481+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:50:34.299481+0000","last_undegraded":"2024-04-26T12:50:34.299481+0000","last_fullsized":"2024-04-26T12:50:34.299481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:02.796747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163300+0000","last_change":"2024-04-26T12:49:58.218010+0000","last_active":"2024-04-26T12:52:05.163300+0000","last_peered":"2024-04-26T12:52:05.163300+0000","last_clean":"2024-04-26T12:52:05.163300+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:52:05.163300+0000","last_undegraded":"2024-04-26T12:52:05.163300+0000","last_fullsized":"2024-04-26T12:52:05.163300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:41.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.206605+0000","last_change":"2024-04-26T12:50:00.240005+0000","last_active":"2024-04-26T12:52:06.206605+0000","last_peered":"2024-04-26T12:52:06.206605+0000","last_clean":"2024-04-26T12:52:06.206605+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:52:06.206605+0000","last_undegraded":"2024-04-26T12:52:06.206605+0000","last_fullsized":"2024-04-26T12:52:06.206605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:08.343846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296108+0000","last_change":"2024-04-26T12:50:02.267791+0000","last_active":"2024-04-26T12:50:34.296108+0000","last_peered":"2024-04-26T12:50:34.296108+0000","last_clean":"2024-04-26T12:50:34.296108+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:50:34.296108+0000","last_undegraded":"2024-04-26T12:50:34.296108+0000","last_fullsized":"2024-04-26T12:50:34.296108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:57.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.138878+0000","last_change":"2024-04-26T12:50:04.282702+0000","last_active":"2024-04-26T12:52:08.138878+0000","last_peered":"2024-04-26T12:52:08.138878+0000","last_clean":"2024-04-26T12:52:08.138878+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:52:08.138878+0000","last_undegraded":"2024-04-26T12:52:08.138878+0000","last_fullsized":"2024-04-26T12:52:08.138878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:46.989616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.441251+0000","last_change":"2024-04-26T12:49:56.231876+0000","last_active":"2024-04-26T12:53:09.441251+0000","last_peered":"2024-04-26T12:53:09.441251+0000","last_clean":"2024-04-26T12:53:09.441251+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:09.441251+0000","last_undegraded":"2024-04-26T12:53:09.441251+0000","last_fullsized":"2024-04-26T12:53:09.441251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:44.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300795+0000","last_change":"2024-04-26T12:49:54.242611+0000","last_active":"2024-04-26T12:50:34.300795+0000","last_peered":"2024-04-26T12:50:34.300795+0000","last_clean":"2024-04-26T12:50:34.300795+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:50:34.300795+0000","last_undegraded":"2024-04-26T12:50:34.300795+0000","last_fullsized":"2024-04-26T12:50:34.300795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:28.681707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316052+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:50:34.316052+0000","last_peered":"2024-04-26T12:50:34.316052+0000","last_clean":"2024-04-26T12:50:34.316052+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:50:34.316052+0000","last_undegraded":"2024-04-26T12:50:34.316052+0000","last_fullsized":"2024-04-26T12:50:34.316052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:52.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302424+0000","last_change":"2024-04-26T12:49:58.241694+0000","last_active":"2024-04-26T12:50:34.302424+0000","last_peered":"2024-04-26T12:50:34.302424+0000","last_clean":"2024-04-26T12:50:34.302424+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:50:34.302424+0000","last_undegraded":"2024-04-26T12:50:34.302424+0000","last_fullsized":"2024-04-26T12:50:34.302424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.960038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'16","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.959724+0000","last_change":"2024-04-26T12:50:00.249990+0000","last_active":"2024-04-26T12:52:07.959724+0000","last_peered":"2024-04-26T12:52:07.959724+0000","last_clean":"2024-04-26T12:52:07.959724+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:52:07.959724+0000","last_undegraded":"2024-04-26T12:52:07.959724+0000","last_fullsized":"2024-04-26T12:52:07.959724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:16.755935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":356,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.474553+0000","last_change":"2024-04-26T12:50:02.274253+0000","last_active":"2024-04-26T12:53:08.474553+0000","last_peered":"2024-04-26T12:53:08.474553+0000","last_clean":"2024-04-26T12:53:08.474553+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:08.474553+0000","last_undegraded":"2024-04-26T12:53:08.474553+0000","last_fullsized":"2024-04-26T12:53:08.474553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:53.359511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.321938+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:50:34.321938+0000","last_peered":"2024-04-26T12:50:34.321938+0000","last_clean":"2024-04-26T12:50:34.321938+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:50:34.321938+0000","last_undegraded":"2024-04-26T12:50:34.321938+0000","last_fullsized":"2024-04-26T12:50:34.321938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:03.311297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'9","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.438858+0000","last_change":"2024-04-26T12:49:56.226197+0000","last_active":"2024-04-26T12:53:09.438858+0000","last_peered":"2024-04-26T12:53:09.438858+0000","last_clean":"2024-04-26T12:53:09.438858+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:53:09.438858+0000","last_undegraded":"2024-04-26T12:53:09.438858+0000","last_fullsized":"2024-04-26T12:53:09.438858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:07.136832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326593+0000","last_change":"2024-04-26T12:49:54.253396+0000","last_active":"2024-04-26T12:50:34.326593+0000","last_peered":"2024-04-26T12:50:34.326593+0000","last_clean":"2024-04-26T12:50:34.326593+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:50:34.326593+0000","last_undegraded":"2024-04-26T12:50:34.326593+0000","last_fullsized":"2024-04-26T12:50:34.326593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:39.258567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301688+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:50:34.301688+0000","last_peered":"2024-04-26T12:50:34.301688+0000","last_clean":"2024-04-26T12:50:34.301688+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:50:34.301688+0000","last_undegraded":"2024-04-26T12:50:34.301688+0000","last_fullsized":"2024-04-26T12:50:34.301688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:30.732769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308987+0000","last_change":"2024-04-26T12:49:58.245857+0000","last_active":"2024-04-26T12:50:34.308987+0000","last_peered":"2024-04-26T12:50:34.308987+0000","last_clean":"2024-04-26T12:50:34.308987+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:50:34.308987+0000","last_undegraded":"2024-04-26T12:50:34.308987+0000","last_fullsized":"2024-04-26T12:50:34.308987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.985370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307845+0000","last_change":"2024-04-26T12:50:00.271933+0000","last_active":"2024-04-26T12:50:34.307845+0000","last_peered":"2024-04-26T12:50:34.307845+0000","last_clean":"2024-04-26T12:50:34.307845+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:50:34.307845+0000","last_undegraded":"2024-04-26T12:50:34.307845+0000","last_fullsized":"2024-04-26T12:50:34.307845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:27.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":430,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.587212+0000","last_change":"2024-04-26T12:50:02.273956+0000","last_active":"2024-04-26T12:53:09.587212+0000","last_peered":"2024-04-26T12:53:09.587212+0000","last_clean":"2024-04-26T12:53:09.587212+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:09.587212+0000","last_undegraded":"2024-04-26T12:53:09.587212+0000","last_fullsized":"2024-04-26T12:53:09.587212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:50.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309143+0000","last_change":"2024-04-26T12:50:04.301343+0000","last_active":"2024-04-26T12:50:34.309143+0000","last_peered":"2024-04-26T12:50:34.309143+0000","last_clean":"2024-04-26T12:50:34.309143+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:50:34.309143+0000","last_undegraded":"2024-04-26T12:50:34.309143+0000","last_fullsized":"2024-04-26T12:50:34.309143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:43.916865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.300311+0000","last_change":"2024-04-26T12:49:56.215393+0000","last_active":"2024-04-26T12:51:23.300311+0000","last_peered":"2024-04-26T12:51:23.300311+0000","last_clean":"2024-04-26T12:51:23.300311+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:51:23.300311+0000","last_undegraded":"2024-04-26T12:51:23.300311+0000","last_fullsized":"2024-04-26T12:51:23.300311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:23.402206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.215677+0000","last_change":"2024-04-26T12:49:54.239381+0000","last_active":"2024-04-26T12:52:08.215677+0000","last_peered":"2024-04-26T12:52:08.215677+0000","last_clean":"2024-04-26T12:52:08.215677+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:52:08.215677+0000","last_undegraded":"2024-04-26T12:52:08.215677+0000","last_fullsized":"2024-04-26T12:52:08.215677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323186+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:50:34.323186+0000","last_peered":"2024-04-26T12:50:34.323186+0000","last_clean":"2024-04-26T12:50:34.323186+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:50:34.323186+0000","last_undegraded":"2024-04-26T12:50:34.323186+0000","last_fullsized":"2024-04-26T12:50:34.323186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.190860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301969+0000","last_change":"2024-04-26T12:49:58.237558+0000","last_active":"2024-04-26T12:50:34.301969+0000","last_peered":"2024-04-26T12:50:34.301969+0000","last_clean":"2024-04-26T12:50:34.301969+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:50:34.301969+0000","last_undegraded":"2024-04-26T12:50:34.301969+0000","last_fullsized":"2024-04-26T12:50:34.301969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:55.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'85","reported_seq":157,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.183596+0000","last_change":"2024-04-26T12:50:00.262654+0000","last_active":"2024-04-26T12:52:06.183596+0000","last_peered":"2024-04-26T12:52:06.183596+0000","last_clean":"2024-04-26T12:52:06.183596+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:52:06.183596+0000","last_undegraded":"2024-04-26T12:52:06.183596+0000","last_fullsized":"2024-04-26T12:52:06.183596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.678581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299226+0000","last_change":"2024-04-26T12:50:02.277001+0000","last_active":"2024-04-26T12:50:34.299226+0000","last_peered":"2024-04-26T12:50:34.299226+0000","last_clean":"2024-04-26T12:50:34.299226+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:50:34.299226+0000","last_undegraded":"2024-04-26T12:50:34.299226+0000","last_fullsized":"2024-04-26T12:50:34.299226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:28.423042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303169+0000","last_change":"2024-04-26T12:50:04.283865+0000","last_active":"2024-04-26T12:50:34.303169+0000","last_peered":"2024-04-26T12:50:34.303169+0000","last_clean":"2024-04-26T12:50:34.303169+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:50:34.303169+0000","last_undegraded":"2024-04-26T12:50:34.303169+0000","last_fullsized":"2024-04-26T12:50:34.303169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:55.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303220+0000","last_change":"2024-04-26T12:50:04.289462+0000","last_active":"2024-04-26T12:50:34.303220+0000","last_peered":"2024-04-26T12:50:34.303220+0000","last_clean":"2024-04-26T12:50:34.303220+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:50:34.303220+0000","last_undegraded":"2024-04-26T12:50:34.303220+0000","last_fullsized":"2024-04-26T12:50:34.303220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:03.677092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945866+0000","last_change":"2024-04-26T12:49:56.224657+0000","last_active":"2024-04-26T12:50:39.945866+0000","last_peered":"2024-04-26T12:50:39.945866+0000","last_clean":"2024-04-26T12:50:39.945866+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:50:39.945866+0000","last_undegraded":"2024-04-26T12:50:39.945866+0000","last_fullsized":"2024-04-26T12:50:39.945866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:09.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315720+0000","last_change":"2024-04-26T12:49:54.259672+0000","last_active":"2024-04-26T12:50:34.315720+0000","last_peered":"2024-04-26T12:50:34.315720+0000","last_clean":"2024-04-26T12:50:34.315720+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:50:34.315720+0000","last_undegraded":"2024-04-26T12:50:34.315720+0000","last_fullsized":"2024-04-26T12:50:34.315720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:37.170988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315130+0000","last_change":"2024-04-26T12:49:58.226855+0000","last_active":"2024-04-26T12:50:34.315130+0000","last_peered":"2024-04-26T12:50:34.315130+0000","last_clean":"2024-04-26T12:50:34.315130+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:50:34.315130+0000","last_undegraded":"2024-04-26T12:50:34.315130+0000","last_fullsized":"2024-04-26T12:50:34.315130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:54.671649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.193653+0000","last_change":"2024-04-26T12:50:00.266320+0000","last_active":"2024-04-26T12:52:06.193653+0000","last_peered":"2024-04-26T12:52:06.193653+0000","last_clean":"2024-04-26T12:52:06.193653+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:52:06.193653+0000","last_undegraded":"2024-04-26T12:52:06.193653+0000","last_fullsized":"2024-04-26T12:52:06.193653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:27.322235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301745+0000","last_change":"2024-04-26T12:50:02.282972+0000","last_active":"2024-04-26T12:50:34.301745+0000","last_peered":"2024-04-26T12:50:34.301745+0000","last_clean":"2024-04-26T12:50:34.301745+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:50:34.301745+0000","last_undegraded":"2024-04-26T12:50:34.301745+0000","last_fullsized":"2024-04-26T12:50:34.301745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:31.666992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.783785+0000","last_change":"2024-04-26T12:50:04.286573+0000","last_active":"2024-04-26T12:52:05.783785+0000","last_peered":"2024-04-26T12:52:05.783785+0000","last_clean":"2024-04-26T12:52:05.783785+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:52:05.783785+0000","last_undegraded":"2024-04-26T12:52:05.783785+0000","last_fullsized":"2024-04-26T12:52:05.783785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:44.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420386+0000","last_change":"2024-04-26T12:50:34.331364+0000","last_active":"2024-04-26T12:53:09.420386+0000","last_peered":"2024-04-26T12:53:09.420386+0000","last_clean":"2024-04-26T12:53:09.420386+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:53:09.420386+0000","last_undegraded":"2024-04-26T12:53:09.420386+0000","last_fullsized":"2024-04-26T12:53:09.420386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:32.541941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299076+0000","last_change":"2024-04-26T12:49:54.242795+0000","last_active":"2024-04-26T12:50:34.299076+0000","last_peered":"2024-04-26T12:50:34.299076+0000","last_clean":"2024-04-26T12:50:34.299076+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:50:34.299076+0000","last_undegraded":"2024-04-26T12:50:34.299076+0000","last_fullsized":"2024-04-26T12:50:34.299076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.327731+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:50:34.327731+0000","last_peered":"2024-04-26T12:50:34.327731+0000","last_clean":"2024-04-26T12:50:34.327731+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:50:34.327731+0000","last_undegraded":"2024-04-26T12:50:34.327731+0000","last_fullsized":"2024-04-26T12:50:34.327731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.316527+0000","last_change":"2024-04-26T12:50:00.232187+0000","last_active":"2024-04-26T12:53:08.316527+0000","last_peered":"2024-04-26T12:53:08.316527+0000","last_clean":"2024-04-26T12:53:08.316527+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:08.316527+0000","last_undegraded":"2024-04-26T12:53:08.316527+0000","last_fullsized":"2024-04-26T12:53:08.316527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:53.956543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295434+0000","last_change":"2024-04-26T12:50:02.285124+0000","last_active":"2024-04-26T12:50:34.295434+0000","last_peered":"2024-04-26T12:50:34.295434+0000","last_clean":"2024-04-26T12:50:34.295434+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:50:34.295434+0000","last_undegraded":"2024-04-26T12:50:34.295434+0000","last_fullsized":"2024-04-26T12:50:34.295434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.429582+0000","last_change":"2024-04-26T12:50:04.281861+0000","last_active":"2024-04-26T12:53:08.429582+0000","last_peered":"2024-04-26T12:53:08.429582+0000","last_clean":"2024-04-26T12:53:08.429582+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:08.429582+0000","last_undegraded":"2024-04-26T12:53:08.429582+0000","last_fullsized":"2024-04-26T12:53:08.429582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:06.429465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'15","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.947547+0000","last_change":"2024-04-26T12:49:56.221075+0000","last_active":"2024-04-26T12:53:08.947547+0000","last_peered":"2024-04-26T12:53:08.947547+0000","last_clean":"2024-04-26T12:53:08.947547+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:08.947547+0000","last_undegraded":"2024-04-26T12:53:08.947547+0000","last_fullsized":"2024-04-26T12:53:08.947547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:49.834778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304429+0000","last_change":"2024-04-26T12:49:54.248072+0000","last_active":"2024-04-26T12:50:34.304429+0000","last_peered":"2024-04-26T12:50:34.304429+0000","last_clean":"2024-04-26T12:50:34.304429+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:50:34.304429+0000","last_undegraded":"2024-04-26T12:50:34.304429+0000","last_fullsized":"2024-04-26T12:50:34.304429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.294648+0000","last_change":"2024-04-26T12:49:58.227451+0000","last_active":"2024-04-26T12:50:34.294648+0000","last_peered":"2024-04-26T12:50:34.294648+0000","last_clean":"2024-04-26T12:50:34.294648+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:50:34.294648+0000","last_undegraded":"2024-04-26T12:50:34.294648+0000","last_fullsized":"2024-04-26T12:50:34.294648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:46.024249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.399673+0000","last_change":"2024-04-26T12:50:00.233555+0000","last_active":"2024-04-26T12:53:08.399673+0000","last_peered":"2024-04-26T12:53:08.399673+0000","last_clean":"2024-04-26T12:53:08.399673+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:08.399673+0000","last_undegraded":"2024-04-26T12:53:08.399673+0000","last_fullsized":"2024-04-26T12:53:08.399673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:46.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310963+0000","last_change":"2024-04-26T12:50:02.272652+0000","last_active":"2024-04-26T12:50:34.310963+0000","last_peered":"2024-04-26T12:50:34.310963+0000","last_clean":"2024-04-26T12:50:34.310963+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:50:34.310963+0000","last_undegraded":"2024-04-26T12:50:34.310963+0000","last_fullsized":"2024-04-26T12:50:34.310963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:01.660724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.007347+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:51:23.007347+0000","last_peered":"2024-04-26T12:51:23.007347+0000","last_clean":"2024-04-26T12:51:23.007347+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:51:23.007347+0000","last_undegraded":"2024-04-26T12:51:23.007347+0000","last_fullsized":"2024-04-26T12:51:23.007347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:09.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.931477+0000","last_change":"2024-04-26T12:49:56.230150+0000","last_active":"2024-04-26T12:53:08.931477+0000","last_peered":"2024-04-26T12:53:08.931477+0000","last_clean":"2024-04-26T12:53:08.931477+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:08.931477+0000","last_undegraded":"2024-04-26T12:53:08.931477+0000","last_fullsized":"2024-04-26T12:53:08.931477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:24.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318667+0000","last_change":"2024-04-26T12:49:54.238487+0000","last_active":"2024-04-26T12:50:34.318667+0000","last_peered":"2024-04-26T12:50:34.318667+0000","last_clean":"2024-04-26T12:50:34.318667+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:50:34.318667+0000","last_undegraded":"2024-04-26T12:50:34.318667+0000","last_fullsized":"2024-04-26T12:50:34.318667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302190+0000","last_change":"2024-04-26T12:49:58.244563+0000","last_active":"2024-04-26T12:50:34.302190+0000","last_peered":"2024-04-26T12:50:34.302190+0000","last_clean":"2024-04-26T12:50:34.302190+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:50:34.302190+0000","last_undegraded":"2024-04-26T12:50:34.302190+0000","last_fullsized":"2024-04-26T12:50:34.302190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:44.871146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.170865+0000","last_change":"2024-04-26T12:50:00.240164+0000","last_active":"2024-04-26T12:52:06.170865+0000","last_peered":"2024-04-26T12:52:06.170865+0000","last_clean":"2024-04-26T12:52:06.170865+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:52:06.170865+0000","last_undegraded":"2024-04-26T12:52:06.170865+0000","last_fullsized":"2024-04-26T12:52:06.170865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:31.464728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295743+0000","last_change":"2024-04-26T12:50:02.264233+0000","last_active":"2024-04-26T12:50:34.295743+0000","last_peered":"2024-04-26T12:50:34.295743+0000","last_clean":"2024-04-26T12:50:34.295743+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:50:34.295743+0000","last_undegraded":"2024-04-26T12:50:34.295743+0000","last_fullsized":"2024-04-26T12:50:34.295743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:01.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420751+0000","last_change":"2024-04-26T12:49:56.232004+0000","last_active":"2024-04-26T12:53:09.420751+0000","last_peered":"2024-04-26T12:53:09.420751+0000","last_clean":"2024-04-26T12:53:09.420751+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:09.420751+0000","last_undegraded":"2024-04-26T12:53:09.420751+0000","last_fullsized":"2024-04-26T12:53:09.420751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:47.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300624+0000","last_change":"2024-04-26T12:49:54.241633+0000","last_active":"2024-04-26T12:50:34.300624+0000","last_peered":"2024-04-26T12:50:34.300624+0000","last_clean":"2024-04-26T12:50:34.300624+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:50:34.300624+0000","last_undegraded":"2024-04-26T12:50:34.300624+0000","last_fullsized":"2024-04-26T12:50:34.300624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:03.751774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'4","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.728988+0000","last_change":"2024-04-26T12:49:58.224668+0000","last_active":"2024-04-26T12:52:07.728988+0000","last_peered":"2024-04-26T12:52:07.728988+0000","last_clean":"2024-04-26T12:52:07.728988+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:52:07.728988+0000","last_undegraded":"2024-04-26T12:52:07.728988+0000","last_fullsized":"2024-04-26T12:52:07.728988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:46.613363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'54","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.202377+0000","last_change":"2024-04-26T12:50:00.242408+0000","last_active":"2024-04-26T12:52:06.202377+0000","last_peered":"2024-04-26T12:52:06.202377+0000","last_clean":"2024-04-26T12:52:06.202377+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:52:06.202377+0000","last_undegraded":"2024-04-26T12:52:06.202377+0000","last_fullsized":"2024-04-26T12:52:06.202377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:41.899361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295358+0000","last_change":"2024-04-26T12:50:02.272171+0000","last_active":"2024-04-26T12:50:34.295358+0000","last_peered":"2024-04-26T12:50:34.295358+0000","last_clean":"2024-04-26T12:50:34.295358+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:50:34.295358+0000","last_undegraded":"2024-04-26T12:50:34.295358+0000","last_fullsized":"2024-04-26T12:50:34.295358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:30.101175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.128428+0000","last_change":"2024-04-26T12:50:04.281931+0000","last_active":"2024-04-26T12:52:08.128428+0000","last_peered":"2024-04-26T12:52:08.128428+0000","last_clean":"2024-04-26T12:52:08.128428+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:52:08.128428+0000","last_undegraded":"2024-04-26T12:52:08.128428+0000","last_fullsized":"2024-04-26T12:52:08.128428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:16.500952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:40.677407+0000","last_change":"2024-04-26T12:49:56.224826+0000","last_active":"2024-04-26T12:50:40.677407+0000","last_peered":"2024-04-26T12:50:40.677407+0000","last_clean":"2024-04-26T12:50:40.677407+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:50:40.677407+0000","last_undegraded":"2024-04-26T12:50:40.677407+0000","last_fullsized":"2024-04-26T12:50:40.677407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:46.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305246+0000","last_change":"2024-04-26T12:49:54.243620+0000","last_active":"2024-04-26T12:50:34.305246+0000","last_peered":"2024-04-26T12:50:34.305246+0000","last_clean":"2024-04-26T12:50:34.305246+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:50:34.305246+0000","last_undegraded":"2024-04-26T12:50:34.305246+0000","last_fullsized":"2024-04-26T12:50:34.305246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303655+0000","last_change":"2024-04-26T12:49:58.220247+0000","last_active":"2024-04-26T12:50:34.303655+0000","last_peered":"2024-04-26T12:50:34.303655+0000","last_clean":"2024-04-26T12:50:34.303655+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:50:34.303655+0000","last_undegraded":"2024-04-26T12:50:34.303655+0000","last_fullsized":"2024-04-26T12:50:34.303655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:55.363024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.172034+0000","last_change":"2024-04-26T12:50:00.270194+0000","last_active":"2024-04-26T12:52:06.172034+0000","last_peered":"2024-04-26T12:52:06.172034+0000","last_clean":"2024-04-26T12:52:06.172034+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:52:06.172034+0000","last_undegraded":"2024-04-26T12:52:06.172034+0000","last_fullsized":"2024-04-26T12:52:06.172034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:34.153884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308720+0000","last_change":"2024-04-26T12:50:02.286102+0000","last_active":"2024-04-26T12:50:34.308720+0000","last_peered":"2024-04-26T12:50:34.308720+0000","last_clean":"2024-04-26T12:50:34.308720+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:50:34.308720+0000","last_undegraded":"2024-04-26T12:50:34.308720+0000","last_fullsized":"2024-04-26T12:50:34.308720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:48.894931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301117+0000","last_change":"2024-04-26T12:50:04.302095+0000","last_active":"2024-04-26T12:50:34.301117+0000","last_peered":"2024-04-26T12:50:34.301117+0000","last_clean":"2024-04-26T12:50:34.301117+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:50:34.301117+0000","last_undegraded":"2024-04-26T12:50:34.301117+0000","last_fullsized":"2024-04-26T12:50:34.301117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:22.017086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067641+0000","last_change":"2024-04-26T12:49:56.232608+0000","last_active":"2024-04-26T12:53:09.067641+0000","last_peered":"2024-04-26T12:53:09.067641+0000","last_clean":"2024-04-26T12:53:09.067641+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:09.067641+0000","last_undegraded":"2024-04-26T12:53:09.067641+0000","last_fullsized":"2024-04-26T12:53:09.067641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:33.707470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.311238+0000","last_change":"2024-04-26T12:49:54.229682+0000","last_active":"2024-04-26T12:50:34.311238+0000","last_peered":"2024-04-26T12:50:34.311238+0000","last_clean":"2024-04-26T12:50:34.311238+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:50:34.311238+0000","last_undegraded":"2024-04-26T12:50:34.311238+0000","last_fullsized":"2024-04-26T12:50:34.311238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295742+0000","last_change":"2024-04-26T12:49:58.218998+0000","last_active":"2024-04-26T12:50:34.295742+0000","last_peered":"2024-04-26T12:50:34.295742+0000","last_clean":"2024-04-26T12:50:34.295742+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:50:34.295742+0000","last_undegraded":"2024-04-26T12:50:34.295742+0000","last_fullsized":"2024-04-26T12:50:34.295742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:57.143731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.762812+0000","last_change":"2024-04-26T12:50:00.239798+0000","last_active":"2024-04-26T12:52:05.762812+0000","last_peered":"2024-04-26T12:52:05.762812+0000","last_clean":"2024-04-26T12:52:05.762812+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:52:05.762812+0000","last_undegraded":"2024-04-26T12:52:05.762812+0000","last_fullsized":"2024-04-26T12:52:05.762812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:35.710193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301139+0000","last_change":"2024-04-26T12:50:02.273673+0000","last_active":"2024-04-26T12:50:34.301139+0000","last_peered":"2024-04-26T12:50:34.301139+0000","last_clean":"2024-04-26T12:50:34.301139+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:50:34.301139+0000","last_undegraded":"2024-04-26T12:50:34.301139+0000","last_fullsized":"2024-04-26T12:50:34.301139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:50.707635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.274746+0000","last_change":"2024-04-26T12:50:04.302374+0000","last_active":"2024-04-26T12:52:08.274746+0000","last_peered":"2024-04-26T12:52:08.274746+0000","last_clean":"2024-04-26T12:52:08.274746+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:52:08.274746+0000","last_undegraded":"2024-04-26T12:52:08.274746+0000","last_fullsized":"2024-04-26T12:52:08.274746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:28.339845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303315+0000","last_change":"2024-04-26T12:49:56.219301+0000","last_active":"2024-04-26T12:50:34.303315+0000","last_peered":"2024-04-26T12:50:34.303315+0000","last_clean":"2024-04-26T12:50:34.303315+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:50:34.303315+0000","last_undegraded":"2024-04-26T12:50:34.303315+0000","last_fullsized":"2024-04-26T12:50:34.303315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:09.581494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308258+0000","last_change":"2024-04-26T12:49:54.253819+0000","last_active":"2024-04-26T12:50:34.308258+0000","last_peered":"2024-04-26T12:50:34.308258+0000","last_clean":"2024-04-26T12:50:34.308258+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:50:34.308258+0000","last_undegraded":"2024-04-26T12:50:34.308258+0000","last_fullsized":"2024-04-26T12:50:34.308258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:40.717814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319765+0000","last_change":"2024-04-26T12:49:58.227003+0000","last_active":"2024-04-26T12:50:34.319765+0000","last_peered":"2024-04-26T12:50:34.319765+0000","last_clean":"2024-04-26T12:50:34.319765+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:50:34.319765+0000","last_undegraded":"2024-04-26T12:50:34.319765+0000","last_fullsized":"2024-04-26T12:50:34.319765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:18.551779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322080+0000","last_change":"2024-04-26T12:50:00.272784+0000","last_active":"2024-04-26T12:50:34.322080+0000","last_peered":"2024-04-26T12:50:34.322080+0000","last_clean":"2024-04-26T12:50:34.322080+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:50:34.322080+0000","last_undegraded":"2024-04-26T12:50:34.322080+0000","last_fullsized":"2024-04-26T12:50:34.322080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":418,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.433170+0000","last_change":"2024-04-26T12:50:02.294579+0000","last_active":"2024-04-26T12:53:09.433170+0000","last_peered":"2024-04-26T12:53:09.433170+0000","last_clean":"2024-04-26T12:53:09.433170+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:09.433170+0000","last_undegraded":"2024-04-26T12:53:09.433170+0000","last_fullsized":"2024-04-26T12:53:09.433170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:13.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299552+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:50:34.299552+0000","last_peered":"2024-04-26T12:50:34.299552+0000","last_clean":"2024-04-26T12:50:34.299552+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:50:34.299552+0000","last_undegraded":"2024-04-26T12:50:34.299552+0000","last_fullsized":"2024-04-26T12:50:34.299552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:52.067129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'23","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.283786+0000","last_change":"2024-04-26T12:49:56.213304+0000","last_active":"2024-04-26T12:53:09.283786+0000","last_peered":"2024-04-26T12:53:09.283786+0000","last_clean":"2024-04-26T12:53:09.283786+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:09.283786+0000","last_undegraded":"2024-04-26T12:53:09.283786+0000","last_fullsized":"2024-04-26T12:53:09.283786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:27.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315379+0000","last_change":"2024-04-26T12:49:54.247955+0000","last_active":"2024-04-26T12:50:34.315379+0000","last_peered":"2024-04-26T12:50:34.315379+0000","last_clean":"2024-04-26T12:50:34.315379+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:50:34.315379+0000","last_undegraded":"2024-04-26T12:50:34.315379+0000","last_fullsized":"2024-04-26T12:50:34.315379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313932+0000","last_change":"2024-04-26T12:49:58.227232+0000","last_active":"2024-04-26T12:50:34.313932+0000","last_peered":"2024-04-26T12:50:34.313932+0000","last_clean":"2024-04-26T12:50:34.313932+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:50:34.313932+0000","last_undegraded":"2024-04-26T12:50:34.313932+0000","last_fullsized":"2024-04-26T12:50:34.313932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:55.045703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.157449+0000","last_change":"2024-04-26T12:50:00.233705+0000","last_active":"2024-04-26T12:52:06.157449+0000","last_peered":"2024-04-26T12:52:06.157449+0000","last_clean":"2024-04-26T12:52:06.157449+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:52:06.157449+0000","last_undegraded":"2024-04-26T12:52:06.157449+0000","last_fullsized":"2024-04-26T12:52:06.157449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:28.085543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297060+0000","last_change":"2024-04-26T12:50:02.271715+0000","last_active":"2024-04-26T12:50:34.297060+0000","last_peered":"2024-04-26T12:50:34.297060+0000","last_clean":"2024-04-26T12:50:34.297060+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:50:34.297060+0000","last_undegraded":"2024-04-26T12:50:34.297060+0000","last_fullsized":"2024-04-26T12:50:34.297060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:04.365884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319372+0000","last_change":"2024-04-26T12:50:04.283754+0000","last_active":"2024-04-26T12:50:34.319372+0000","last_peered":"2024-04-26T12:50:34.319372+0000","last_clean":"2024-04-26T12:50:34.319372+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:50:34.319372+0000","last_undegraded":"2024-04-26T12:50:34.319372+0000","last_fullsized":"2024-04-26T12:50:34.319372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:32.583019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295908+0000","last_change":"2024-04-26T12:49:56.216716+0000","last_active":"2024-04-26T12:50:34.295908+0000","last_peered":"2024-04-26T12:50:34.295908+0000","last_clean":"2024-04-26T12:50:34.295908+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:50:34.295908+0000","last_undegraded":"2024-04-26T12:50:34.295908+0000","last_fullsized":"2024-04-26T12:50:34.295908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:46.747501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316296+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:50:34.316296+0000","last_peered":"2024-04-26T12:50:34.316296+0000","last_clean":"2024-04-26T12:50:34.316296+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:50:34.316296+0000","last_undegraded":"2024-04-26T12:50:34.316296+0000","last_fullsized":"2024-04-26T12:50:34.316296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:12.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298228+0000","last_change":"2024-04-26T12:49:58.219225+0000","last_active":"2024-04-26T12:50:34.298228+0000","last_peered":"2024-04-26T12:50:34.298228+0000","last_clean":"2024-04-26T12:50:34.298228+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:50:34.298228+0000","last_undegraded":"2024-04-26T12:50:34.298228+0000","last_fullsized":"2024-04-26T12:50:34.298228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:14.134748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.158832+0000","last_change":"2024-04-26T12:50:00.239861+0000","last_active":"2024-04-26T12:52:06.158832+0000","last_peered":"2024-04-26T12:52:06.158832+0000","last_clean":"2024-04-26T12:52:06.158832+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:52:06.158832+0000","last_undegraded":"2024-04-26T12:52:06.158832+0000","last_fullsized":"2024-04-26T12:52:06.158832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:31.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301391+0000","last_change":"2024-04-26T12:50:02.287940+0000","last_active":"2024-04-26T12:50:34.301391+0000","last_peered":"2024-04-26T12:50:34.301391+0000","last_clean":"2024-04-26T12:50:34.301391+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:50:34.301391+0000","last_undegraded":"2024-04-26T12:50:34.301391+0000","last_fullsized":"2024-04-26T12:50:34.301391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:02.592328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315974+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:50:34.315974+0000","last_peered":"2024-04-26T12:50:34.315974+0000","last_clean":"2024-04-26T12:50:34.315974+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:50:34.315974+0000","last_undegraded":"2024-04-26T12:50:34.315974+0000","last_fullsized":"2024-04-26T12:50:34.315974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:25.596341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420535+0000","last_change":"2024-04-26T12:49:56.223405+0000","last_active":"2024-04-26T12:53:09.420535+0000","last_peered":"2024-04-26T12:53:09.420535+0000","last_clean":"2024-04-26T12:53:09.420535+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:53:09.420535+0000","last_undegraded":"2024-04-26T12:53:09.420535+0000","last_fullsized":"2024-04-26T12:53:09.420535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:55.440404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303556+0000","last_change":"2024-04-26T12:49:54.239137+0000","last_active":"2024-04-26T12:50:34.303556+0000","last_peered":"2024-04-26T12:50:34.303556+0000","last_clean":"2024-04-26T12:50:34.303556+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:50:34.303556+0000","last_undegraded":"2024-04-26T12:50:34.303556+0000","last_fullsized":"2024-04-26T12:50:34.303556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:18.714967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304001+0000","last_change":"2024-04-26T12:49:58.241371+0000","last_active":"2024-04-26T12:50:34.304001+0000","last_peered":"2024-04-26T12:50:34.304001+0000","last_clean":"2024-04-26T12:50:34.304001+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:50:34.304001+0000","last_undegraded":"2024-04-26T12:50:34.304001+0000","last_fullsized":"2024-04-26T12:50:34.304001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:35.312565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'27","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.291600+0000","last_change":"2024-04-26T12:50:00.270650+0000","last_active":"2024-04-26T12:52:08.291600+0000","last_peered":"2024-04-26T12:52:08.291600+0000","last_clean":"2024-04-26T12:52:08.291600+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:52:08.291600+0000","last_undegraded":"2024-04-26T12:52:08.291600+0000","last_fullsized":"2024-04-26T12:52:08.291600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:56.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306598+0000","last_change":"2024-04-26T12:50:02.288529+0000","last_active":"2024-04-26T12:50:34.306598+0000","last_peered":"2024-04-26T12:50:34.306598+0000","last_clean":"2024-04-26T12:50:34.306598+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:50:34.306598+0000","last_undegraded":"2024-04-26T12:50:34.306598+0000","last_fullsized":"2024-04-26T12:50:34.306598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:56.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.279169+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:08.279169+0000","last_peered":"2024-04-26T12:52:08.279169+0000","last_clean":"2024-04-26T12:52:08.279169+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:08.279169+0000","last_undegraded":"2024-04-26T12:52:08.279169+0000","last_fullsized":"2024-04-26T12:52:08.279169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:19.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.013381+0000","last_change":"2024-04-26T12:49:56.215521+0000","last_active":"2024-04-26T12:51:23.013381+0000","last_peered":"2024-04-26T12:51:23.013381+0000","last_clean":"2024-04-26T12:51:23.013381+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:51:23.013381+0000","last_undegraded":"2024-04-26T12:51:23.013381+0000","last_fullsized":"2024-04-26T12:51:23.013381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:02.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.788018+0000","last_change":"2024-04-26T12:49:54.245556+0000","last_active":"2024-04-26T12:53:08.788018+0000","last_peered":"2024-04-26T12:53:08.788018+0000","last_clean":"2024-04-26T12:53:08.788018+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:53:08.788018+0000","last_undegraded":"2024-04-26T12:53:08.788018+0000","last_fullsized":"2024-04-26T12:53:08.788018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:04.471472+0000","last_change":"2024-04-26T12:49:58.241812+0000","last_active":"2024-04-26T12:52:04.471472+0000","last_peered":"2024-04-26T12:52:04.471472+0000","last_clean":"2024-04-26T12:52:04.471472+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:52:04.471472+0000","last_undegraded":"2024-04-26T12:52:04.471472+0000","last_fullsized":"2024-04-26T12:52:04.471472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:49.780417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'32","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.318263+0000","last_change":"2024-04-26T12:50:00.271893+0000","last_active":"2024-04-26T12:53:08.318263+0000","last_peered":"2024-04-26T12:53:08.318263+0000","last_clean":"2024-04-26T12:53:08.318263+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:08.318263+0000","last_undegraded":"2024-04-26T12:53:08.318263+0000","last_fullsized":"2024-04-26T12:53:08.318263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:36.554225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299396+0000","last_change":"2024-04-26T12:50:02.271711+0000","last_active":"2024-04-26T12:50:34.299396+0000","last_peered":"2024-04-26T12:50:34.299396+0000","last_clean":"2024-04-26T12:50:34.299396+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:50:34.299396+0000","last_undegraded":"2024-04-26T12:50:34.299396+0000","last_fullsized":"2024-04-26T12:50:34.299396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:58.972643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.217037+0000","last_change":"2024-04-26T12:50:04.302279+0000","last_active":"2024-04-26T12:52:06.217037+0000","last_peered":"2024-04-26T12:52:06.217037+0000","last_clean":"2024-04-26T12:52:06.217037+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:52:06.217037+0000","last_undegraded":"2024-04-26T12:52:06.217037+0000","last_fullsized":"2024-04-26T12:52:06.217037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:45.287306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.350011+0000","last_change":"2024-04-26T12:49:56.234400+0000","last_active":"2024-04-26T12:53:09.350011+0000","last_peered":"2024-04-26T12:53:09.350011+0000","last_clean":"2024-04-26T12:53:09.350011+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:09.350011+0000","last_undegraded":"2024-04-26T12:53:09.350011+0000","last_fullsized":"2024-04-26T12:53:09.350011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:24.034799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.066998+0000","last_change":"2024-04-26T12:49:54.248434+0000","last_active":"2024-04-26T12:52:08.066998+0000","last_peered":"2024-04-26T12:52:08.066998+0000","last_clean":"2024-04-26T12:52:08.066998+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:52:08.066998+0000","last_undegraded":"2024-04-26T12:52:08.066998+0000","last_fullsized":"2024-04-26T12:52:08.066998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.419891+0000","last_change":"2024-04-26T12:49:56.215256+0000","last_active":"2024-04-26T12:53:09.419891+0000","last_peered":"2024-04-26T12:53:09.419891+0000","last_clean":"2024-04-26T12:53:09.419891+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:09.419891+0000","last_undegraded":"2024-04-26T12:53:09.419891+0000","last_fullsized":"2024-04-26T12:53:09.419891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:41.050135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297396+0000","last_change":"2024-04-26T12:49:54.242913+0000","last_active":"2024-04-26T12:50:34.297396+0000","last_peered":"2024-04-26T12:50:34.297396+0000","last_clean":"2024-04-26T12:50:34.297396+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:50:34.297396+0000","last_undegraded":"2024-04-26T12:50:34.297396+0000","last_fullsized":"2024-04-26T12:50:34.297396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:29.042508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265592+0000","last_change":"2024-04-26T12:49:56.225688+0000","last_active":"2024-04-26T12:53:09.265592+0000","last_peered":"2024-04-26T12:53:09.265592+0000","last_clean":"2024-04-26T12:53:09.265592+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:53:09.265592+0000","last_undegraded":"2024-04-26T12:53:09.265592+0000","last_fullsized":"2024-04-26T12:53:09.265592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:33.308436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963254+0000","last_change":"2024-04-26T12:49:54.236188+0000","last_active":"2024-04-26T12:52:02.963254+0000","last_peered":"2024-04-26T12:52:02.963254+0000","last_clean":"2024-04-26T12:52:02.963254+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:52:02.963254+0000","last_undegraded":"2024-04-26T12:52:02.963254+0000","last_fullsized":"2024-04-26T12:52:02.963254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:23.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.285259+0000","last_change":"2024-04-26T12:49:56.223112+0000","last_active":"2024-04-26T12:52:08.285259+0000","last_peered":"2024-04-26T12:52:08.285259+0000","last_clean":"2024-04-26T12:52:08.285259+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:52:08.285259+0000","last_undegraded":"2024-04-26T12:52:08.285259+0000","last_fullsized":"2024-04-26T12:52:08.285259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:24.739463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162110+0000","last_change":"2024-04-26T12:49:54.226434+0000","last_active":"2024-04-26T12:52:00.162110+0000","last_peered":"2024-04-26T12:52:00.162110+0000","last_clean":"2024-04-26T12:52:00.162110+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:52:00.162110+0000","last_undegraded":"2024-04-26T12:52:00.162110+0000","last_fullsized":"2024-04-26T12:52:00.162110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.586258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301648+0000","last_change":"2024-04-26T12:49:56.221387+0000","last_active":"2024-04-26T12:50:34.301648+0000","last_peered":"2024-04-26T12:50:34.301648+0000","last_clean":"2024-04-26T12:50:34.301648+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:50:34.301648+0000","last_undegraded":"2024-04-26T12:50:34.301648+0000","last_fullsized":"2024-04-26T12:50:34.301648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:33.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301072+0000","last_change":"2024-04-26T12:49:54.243199+0000","last_active":"2024-04-26T12:50:34.301072+0000","last_peered":"2024-04-26T12:50:34.301072+0000","last_clean":"2024-04-26T12:50:34.301072+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:50:34.301072+0000","last_undegraded":"2024-04-26T12:50:34.301072+0000","last_fullsized":"2024-04-26T12:50:34.301072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:36.903122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352717+0000","last_change":"2024-04-26T12:49:56.235320+0000","last_active":"2024-04-26T12:53:09.352717+0000","last_peered":"2024-04-26T12:53:09.352717+0000","last_clean":"2024-04-26T12:53:09.352717+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:09.352717+0000","last_undegraded":"2024-04-26T12:53:09.352717+0000","last_fullsized":"2024-04-26T12:53:09.352717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:12.130618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309160+0000","last_change":"2024-04-26T12:49:54.238503+0000","last_active":"2024-04-26T12:50:34.309160+0000","last_peered":"2024-04-26T12:50:34.309160+0000","last_clean":"2024-04-26T12:50:34.309160+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:50:34.309160+0000","last_undegraded":"2024-04-26T12:50:34.309160+0000","last_fullsized":"2024-04-26T12:50:34.309160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265292+0000","last_change":"2024-04-26T12:49:56.225647+0000","last_active":"2024-04-26T12:53:09.265292+0000","last_peered":"2024-04-26T12:53:09.265292+0000","last_clean":"2024-04-26T12:53:09.265292+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:53:09.265292+0000","last_undegraded":"2024-04-26T12:53:09.265292+0000","last_fullsized":"2024-04-26T12:53:09.265292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.813014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304680+0000","last_change":"2024-04-26T12:49:54.250162+0000","last_active":"2024-04-26T12:50:34.304680+0000","last_peered":"2024-04-26T12:50:34.304680+0000","last_clean":"2024-04-26T12:50:34.304680+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:50:34.304680+0000","last_undegraded":"2024-04-26T12:50:34.304680+0000","last_fullsized":"2024-04-26T12:50:34.304680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.958844+0000","last_change":"2024-04-26T12:49:56.231475+0000","last_active":"2024-04-26T12:52:02.958844+0000","last_peered":"2024-04-26T12:52:02.958844+0000","last_clean":"2024-04-26T12:52:02.958844+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:52:02.958844+0000","last_undegraded":"2024-04-26T12:52:02.958844+0000","last_fullsized":"2024-04-26T12:52:02.958844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439372+0000","last_change":"2024-04-26T12:49:54.229901+0000","last_active":"2024-04-26T12:50:38.439372+0000","last_peered":"2024-04-26T12:50:38.439372+0000","last_clean":"2024-04-26T12:50:38.439372+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:50:38.439372+0000","last_undegraded":"2024-04-26T12:50:38.439372+0000","last_fullsized":"2024-04-26T12:50:38.439372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:38.907969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.083486+0000","last_change":"2024-04-26T12:49:56.218286+0000","last_active":"2024-04-26T12:53:09.083486+0000","last_peered":"2024-04-26T12:53:09.083486+0000","last_clean":"2024-04-26T12:53:09.083486+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:09.083486+0000","last_undegraded":"2024-04-26T12:53:09.083486+0000","last_fullsized":"2024-04-26T12:53:09.083486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:17.751539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964028+0000","last_change":"2024-04-26T12:49:54.240647+0000","last_active":"2024-04-26T12:52:07.964028+0000","last_peered":"2024-04-26T12:52:07.964028+0000","last_clean":"2024-04-26T12:52:07.964028+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:52:07.964028+0000","last_undegraded":"2024-04-26T12:52:07.964028+0000","last_fullsized":"2024-04-26T12:52:07.964028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:55.293561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323510+0000","last_change":"2024-04-26T12:49:56.230003+0000","last_active":"2024-04-26T12:50:34.323510+0000","last_peered":"2024-04-26T12:50:34.323510+0000","last_clean":"2024-04-26T12:50:34.323510+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:50:34.323510+0000","last_undegraded":"2024-04-26T12:50:34.323510+0000","last_fullsized":"2024-04-26T12:50:34.323510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:12.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297885+0000","last_change":"2024-04-26T12:49:54.238656+0000","last_active":"2024-04-26T12:50:34.297885+0000","last_peered":"2024-04-26T12:50:34.297885+0000","last_clean":"2024-04-26T12:50:34.297885+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:50:34.297885+0000","last_undegraded":"2024-04-26T12:50:34.297885+0000","last_fullsized":"2024-04-26T12:50:34.297885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:36.879257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313256+0000","last_change":"2024-04-26T12:50:34.312404+0000","last_active":"2024-04-26T12:50:34.313256+0000","last_peered":"2024-04-26T12:50:34.313256+0000","last_clean":"2024-04-26T12:50:34.313256+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:50:34.313256+0000","last_undegraded":"2024-04-26T12:50:34.313256+0000","last_fullsized":"2024-04-26T12:50:34.313256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:47.220860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439966+0000","last_change":"2024-04-26T12:49:54.236940+0000","last_active":"2024-04-26T12:50:38.439966+0000","last_peered":"2024-04-26T12:50:38.439966+0000","last_clean":"2024-04-26T12:50:38.439966+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:50:38.439966+0000","last_undegraded":"2024-04-26T12:50:38.439966+0000","last_fullsized":"2024-04-26T12:50:38.439966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960904+0000","last_change":"2024-04-26T12:49:56.231000+0000","last_active":"2024-04-26T12:52:12.960904+0000","last_peered":"2024-04-26T12:52:12.960904+0000","last_clean":"2024-04-26T12:52:12.960904+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:52:12.960904+0000","last_undegraded":"2024-04-26T12:52:12.960904+0000","last_fullsized":"2024-04-26T12:52:12.960904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:23.072591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.252156+0000","last_change":"2024-04-26T12:49:54.233875+0000","last_active":"2024-04-26T12:53:09.252156+0000","last_peered":"2024-04-26T12:53:09.252156+0000","last_clean":"2024-04-26T12:53:09.252156+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:53:09.252156+0000","last_undegraded":"2024-04-26T12:53:09.252156+0000","last_fullsized":"2024-04-26T12:53:09.252156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352765+0000","last_change":"2024-04-26T12:49:56.234879+0000","last_active":"2024-04-26T12:53:09.352765+0000","last_peered":"2024-04-26T12:53:09.352765+0000","last_clean":"2024-04-26T12:53:09.352765+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:09.352765+0000","last_undegraded":"2024-04-26T12:53:09.352765+0000","last_fullsized":"2024-04-26T12:53:09.352765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:36.234142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316217+0000","last_change":"2024-04-26T12:49:54.252713+0000","last_active":"2024-04-26T12:50:34.316217+0000","last_peered":"2024-04-26T12:50:34.316217+0000","last_clean":"2024-04-26T12:50:34.316217+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:50:34.316217+0000","last_undegraded":"2024-04-26T12:50:34.316217+0000","last_fullsized":"2024-04-26T12:50:34.316217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:16.359098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.927242+0000","last_change":"2024-04-26T12:49:56.223432+0000","last_active":"2024-04-26T12:53:08.927242+0000","last_peered":"2024-04-26T12:53:08.927242+0000","last_clean":"2024-04-26T12:53:08.927242+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:08.927242+0000","last_undegraded":"2024-04-26T12:53:08.927242+0000","last_fullsized":"2024-04-26T12:53:08.927242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316540+0000","last_change":"2024-04-26T12:49:54.258313+0000","last_active":"2024-04-26T12:50:34.316540+0000","last_peered":"2024-04-26T12:50:34.316540+0000","last_clean":"2024-04-26T12:50:34.316540+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:50:34.316540+0000","last_undegraded":"2024-04-26T12:50:34.316540+0000","last_fullsized":"2024-04-26T12:50:34.316540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:25.040941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265442+0000","last_change":"2024-04-26T12:49:56.228594+0000","last_active":"2024-04-26T12:53:09.265442+0000","last_peered":"2024-04-26T12:53:09.265442+0000","last_clean":"2024-04-26T12:53:09.265442+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:53:09.265442+0000","last_undegraded":"2024-04-26T12:53:09.265442+0000","last_fullsized":"2024-04-26T12:53:09.265442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:49.872348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305357+0000","last_change":"2024-04-26T12:49:54.248935+0000","last_active":"2024-04-26T12:50:34.305357+0000","last_peered":"2024-04-26T12:50:34.305357+0000","last_clean":"2024-04-26T12:50:34.305357+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:50:34.305357+0000","last_undegraded":"2024-04-26T12:50:34.305357+0000","last_fullsized":"2024-04-26T12:50:34.305357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:16.074935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.268306+0000","last_change":"2024-04-26T12:49:56.231485+0000","last_active":"2024-04-26T12:52:08.268306+0000","last_peered":"2024-04-26T12:52:08.268306+0000","last_clean":"2024-04-26T12:52:08.268306+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:52:08.268306+0000","last_undegraded":"2024-04-26T12:52:08.268306+0000","last_fullsized":"2024-04-26T12:52:08.268306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966922+0000","last_change":"2024-04-26T12:49:54.258409+0000","last_active":"2024-04-26T12:52:17.966922+0000","last_peered":"2024-04-26T12:52:17.966922+0000","last_clean":"2024-04-26T12:52:17.966922+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:52:17.966922+0000","last_undegraded":"2024-04-26T12:52:17.966922+0000","last_fullsized":"2024-04-26T12:52:17.966922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:44.743239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301388+0000","last_change":"2024-04-26T12:49:54.241113+0000","last_active":"2024-04-26T12:50:34.301388+0000","last_peered":"2024-04-26T12:50:34.301388+0000","last_clean":"2024-04-26T12:50:34.301388+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:50:34.301388+0000","last_undegraded":"2024-04-26T12:50:34.301388+0000","last_fullsized":"2024-04-26T12:50:34.301388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.409242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352305+0000","last_change":"2024-04-26T12:49:56.227407+0000","last_active":"2024-04-26T12:53:09.352305+0000","last_peered":"2024-04-26T12:53:09.352305+0000","last_clean":"2024-04-26T12:53:09.352305+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:09.352305+0000","last_undegraded":"2024-04-26T12:53:09.352305+0000","last_fullsized":"2024-04-26T12:53:09.352305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:50.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.910309+0000","last_change":"2024-04-26T12:49:54.244752+0000","last_active":"2024-04-26T12:50:39.910309+0000","last_peered":"2024-04-26T12:50:39.910309+0000","last_clean":"2024-04-26T12:50:39.910309+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:50:39.910309+0000","last_undegraded":"2024-04-26T12:50:39.910309+0000","last_fullsized":"2024-04-26T12:50:39.910309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.113655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.011511+0000","last_change":"2024-04-26T12:49:56.232881+0000","last_active":"2024-04-26T12:51:23.011511+0000","last_peered":"2024-04-26T12:51:23.011511+0000","last_clean":"2024-04-26T12:51:23.011511+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:51:23.011511+0000","last_undegraded":"2024-04-26T12:51:23.011511+0000","last_fullsized":"2024-04-26T12:51:23.011511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:53.358894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46376,"kb_used_data":11040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325464,"statfs":{"total":96636764160,"available":96589275136,"internally_reserved":0,"allocated":11304960,"data_stored":10964681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48932,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322908,"statfs":{"total":96636764160,"available":96586657792,"internally_reserved":0,"allocated":13922304,"data_stored":13647204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42500,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329340,"statfs":{"total":96636764160,"available":96593244160,"internally_reserved":0,"allocated":7335936,"data_stored":7033851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":8956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":9170944,"data_stored":8865182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:53:17.141 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:53:17.141 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:53:17.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.298+0000 7fb47c210640 1 Processor -- start 2024-04-26T12:53:17.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.298+0000 7fb47c210640 1 -- start start 2024-04-26T12:53:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.298+0000 7fb47c210640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4740939f0 0x7fb474093dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.298+0000 7fb47c210640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb47409d410 con 0x7fb474094cb0 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.298+0000 7fb47c210640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb474093360 con 0x7fb4740939f0 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb4797ab640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb474094cb0 0x7fb47412c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50238/0 (socket says 172.21.15.29:50238) 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb479fac640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4740939f0 0x7fb474093dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb4797ab640 1 -- 172.21.15.29:0/993174484 learned_addr learned my addr 172.21.15.29:0/993174484 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb479fac640 1 -- 172.21.15.29:0/993174484 >> v1:172.21.15.29:6789/0 conn(0x7fb474094cb0 legacy=0x7fb47412c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb479fac640 1 -- 172.21.15.29:0/993174484 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4740969b0 con 0x7fb4740939f0 2024-04-26T12:53:17.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb478faa640 1 -- 172.21.15.29:0/993174484 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984294145 0 0) 0x7fb47409d410 con 0x7fb474094cb0 2024-04-26T12:53:17.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb479fac640 1 --2- 172.21.15.29:0/993174484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474093dd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb470009d90 tx=0x7fb47001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c03058aa4b61991 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb478faa640 1 -- 172.21.15.29:0/993174484 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4700b2070 con 0x7fb4740939f0 2024-04-26T12:53:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb478faa640 1 -- 172.21.15.29:0/993174484 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4700a5740 con 0x7fb4740939f0 2024-04-26T12:53:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb478faa640 1 -- 172.21.15.29:0/993174484 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4700a5a40 con 0x7fb4740939f0 2024-04-26T12:53:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb47c210640 1 -- 172.21.15.29:0/993174484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 msgr2=0x7fb474093dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb47c210640 1 --2- 172.21.15.29:0/993174484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474093dd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb470009d90 tx=0x7fb47001c8c0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb47c210640 1 -- 172.21.15.29:0/993174484 shutdown_connections 2024-04-26T12:53:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb47c210640 1 --2- 172.21.15.29:0/993174484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474093dd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb47c210640 1 -- 172.21.15.29:0/993174484 >> 172.21.15.29:0/993174484 conn(0x7fb47409a3f0 msgr2=0x7fb47409a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb47c210640 1 -- 172.21.15.29:0/993174484 shutdown_connections 2024-04-26T12:53:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.302+0000 7fb47c210640 1 -- 172.21.15.29:0/993174484 wait complete. 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb47c210640 1 Processor -- start 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb47c210640 1 -- start start 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb47c210640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474091050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb47c210640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb474134e60 con 0x7fb4740939f0 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb479fac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474091050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb479fac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474091050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42730/0 (socket says 172.21.15.29:42730) 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb479fac640 1 -- 172.21.15.29:0/3103329642 learned_addr learned my addr 172.21.15.29:0/3103329642 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb479fac640 1 -- 172.21.15.29:0/3103329642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47408fa20 con 0x7fb4740939f0 2024-04-26T12:53:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb479fac640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474091050 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb4700b0040 tx=0x7fb470019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb46a7fc640 1 -- 172.21.15.29:0/3103329642 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4700bd070 con 0x7fb4740939f0 2024-04-26T12:53:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb46a7fc640 1 -- 172.21.15.29:0/3103329642 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb470003ad0 con 0x7fb4740939f0 2024-04-26T12:53:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb46a7fc640 1 -- 172.21.15.29:0/3103329642 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4700b2040 con 0x7fb4740939f0 2024-04-26T12:53:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb474091590 con 0x7fb4740939f0 2024-04-26T12:53:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb474091a50 con 0x7fb4740939f0 2024-04-26T12:53:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb46a7fc640 1 -- 172.21.15.29:0/3103329642 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb4700b8650 con 0x7fb4740939f0 2024-04-26T12:53:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb474073680 con 0x7fb4740939f0 2024-04-26T12:53:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb46a7fc640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb458035db0 0x7fb458038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb46a7fc640 1 -- 172.21.15.29:0/3103329642 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fb4700e3e90 con 0x7fb4740939f0 2024-04-26T12:53:17.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.306+0000 7fb4797ab640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb458035db0 0x7fb458038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:17.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.310+0000 7fb4797ab640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb458035db0 0x7fb458038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb464007fd0 tx=0x7fb464007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.310+0000 7fb46a7fc640 1 -- 172.21.15.29:0/3103329642 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb4700c6020 con 0x7fb4740939f0 2024-04-26T12:53:17.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.470+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb474062f80 con 0x7fb458035db0 2024-04-26T12:53:17.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.514+0000 7fb46a7fc640 1 -- 172.21.15.29:0/3103329642 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665708 (secure 0 0 0) 0x7fb474062f80 con 0x7fb458035db0 2024-04-26T12:53:17.520 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:53:17.528 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb458035db0 msgr2=0x7fb458038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb458035db0 0x7fb458038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb464007fd0 tx=0x7fb464007980 comp rx=0 tx=0).stop 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 msgr2=0x7fb474091050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474091050 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb4700b0040 tx=0x7fb470019660 comp rx=0 tx=0).stop 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 shutdown_connections 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fb458035db0 0x7fb458038270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 --2- 172.21.15.29:0/3103329642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4740939f0 0x7fb474091050 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 >> 172.21.15.29:0/3103329642 conn(0x7fb47409a3f0 msgr2=0x7fb4741312d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 shutdown_connections 2024-04-26T12:53:17.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.522+0000 7fb47c210640 1 -- 172.21.15.29:0/3103329642 wait complete. 2024-04-26T12:53:17.547 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-04-26T12:53:17.235243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2106,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4477,"ondisk_log_size":4477,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173780,"kb_used_data":40756,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377313580,"statfs":{"total":386547056640,"available":386369105920,"internally_reserved":0,"allocated":41734144,"data_stored":40510918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":136177427},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":465,"num_write":386,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006282"},"pg_stats":[{"pgid":"3.3f","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.960256+0000","last_change":"2024-04-26T12:49:54.242608+0000","last_active":"2024-04-26T12:52:02.960256+0000","last_peered":"2024-04-26T12:52:02.960256+0000","last_clean":"2024-04-26T12:52:02.960256+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:52:02.960256+0000","last_undegraded":"2024-04-26T12:52:02.960256+0000","last_fullsized":"2024-04-26T12:52:02.960256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.951421+0000","last_change":"2024-04-26T12:49:56.222755+0000","last_active":"2024-04-26T12:52:03.951421+0000","last_peered":"2024-04-26T12:52:03.951421+0000","last_clean":"2024-04-26T12:52:03.951421+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:52:03.951421+0000","last_undegraded":"2024-04-26T12:52:03.951421+0000","last_fullsized":"2024-04-26T12:52:03.951421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:40.027829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303872+0000","last_change":"2024-04-26T12:49:54.235378+0000","last_active":"2024-04-26T12:50:34.303872+0000","last_peered":"2024-04-26T12:50:34.303872+0000","last_clean":"2024-04-26T12:50:34.303872+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:50:34.303872+0000","last_undegraded":"2024-04-26T12:50:34.303872+0000","last_fullsized":"2024-04-26T12:50:34.303872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.979752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420744+0000","last_change":"2024-04-26T12:49:56.223502+0000","last_active":"2024-04-26T12:53:09.420744+0000","last_peered":"2024-04-26T12:53:09.420744+0000","last_clean":"2024-04-26T12:53:09.420744+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:53:09.420744+0000","last_undegraded":"2024-04-26T12:53:09.420744+0000","last_fullsized":"2024-04-26T12:53:09.420744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:55.385814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.443926+0000","last_change":"2024-04-26T12:49:54.259543+0000","last_active":"2024-04-26T12:50:38.443926+0000","last_peered":"2024-04-26T12:50:38.443926+0000","last_clean":"2024-04-26T12:50:38.443926+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:50:38.443926+0000","last_undegraded":"2024-04-26T12:50:38.443926+0000","last_fullsized":"2024-04-26T12:50:38.443926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:21.397944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439652+0000","last_change":"2024-04-26T12:49:56.230220+0000","last_active":"2024-04-26T12:53:09.439652+0000","last_peered":"2024-04-26T12:53:09.439652+0000","last_clean":"2024-04-26T12:53:09.439652+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:09.439652+0000","last_undegraded":"2024-04-26T12:53:09.439652+0000","last_fullsized":"2024-04-26T12:53:09.439652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:52.667520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.986056+0000","last_change":"2024-04-26T12:49:54.243452+0000","last_active":"2024-04-26T12:52:07.986056+0000","last_peered":"2024-04-26T12:52:07.986056+0000","last_clean":"2024-04-26T12:52:07.986056+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:52:07.986056+0000","last_undegraded":"2024-04-26T12:52:07.986056+0000","last_fullsized":"2024-04-26T12:52:07.986056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265864+0000","last_change":"2024-04-26T12:50:34.320557+0000","last_active":"2024-04-26T12:53:09.265864+0000","last_peered":"2024-04-26T12:53:09.265864+0000","last_clean":"2024-04-26T12:53:09.265864+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:53:09.265864+0000","last_undegraded":"2024-04-26T12:53:09.265864+0000","last_fullsized":"2024-04-26T12:53:09.265864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:36.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.171393+0000","last_change":"2024-04-26T12:49:54.237140+0000","last_active":"2024-04-26T12:52:08.171393+0000","last_peered":"2024-04-26T12:52:08.171393+0000","last_clean":"2024-04-26T12:52:08.171393+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:52:08.171393+0000","last_undegraded":"2024-04-26T12:52:08.171393+0000","last_fullsized":"2024-04-26T12:52:08.171393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:58.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945401+0000","last_change":"2024-04-26T12:49:56.231677+0000","last_active":"2024-04-26T12:50:39.945401+0000","last_peered":"2024-04-26T12:50:39.945401+0000","last_clean":"2024-04-26T12:50:39.945401+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:50:39.945401+0000","last_undegraded":"2024-04-26T12:50:39.945401+0000","last_fullsized":"2024-04-26T12:50:39.945401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:40.895169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296361+0000","last_change":"2024-04-26T12:49:54.242489+0000","last_active":"2024-04-26T12:50:34.296361+0000","last_peered":"2024-04-26T12:50:34.296361+0000","last_clean":"2024-04-26T12:50:34.296361+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:50:34.296361+0000","last_undegraded":"2024-04-26T12:50:34.296361+0000","last_fullsized":"2024-04-26T12:50:34.296361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.944960+0000","last_change":"2024-04-26T12:49:56.229364+0000","last_active":"2024-04-26T12:50:39.944960+0000","last_peered":"2024-04-26T12:50:39.944960+0000","last_clean":"2024-04-26T12:50:39.944960+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:50:39.944960+0000","last_undegraded":"2024-04-26T12:50:39.944960+0000","last_fullsized":"2024-04-26T12:50:39.944960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.707668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.932592+0000","last_change":"2024-04-26T12:49:54.238559+0000","last_active":"2024-04-26T12:52:03.932592+0000","last_peered":"2024-04-26T12:52:03.932592+0000","last_clean":"2024-04-26T12:52:03.932592+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:52:03.932592+0000","last_undegraded":"2024-04-26T12:52:03.932592+0000","last_fullsized":"2024-04-26T12:52:03.932592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:18.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.525120+0000","last_change":"2024-04-26T12:49:56.219293+0000","last_active":"2024-04-26T12:53:09.525120+0000","last_peered":"2024-04-26T12:53:09.525120+0000","last_clean":"2024-04-26T12:53:09.525120+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:09.525120+0000","last_undegraded":"2024-04-26T12:53:09.525120+0000","last_fullsized":"2024-04-26T12:53:09.525120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297946+0000","last_change":"2024-04-26T12:49:54.238122+0000","last_active":"2024-04-26T12:50:34.297946+0000","last_peered":"2024-04-26T12:50:34.297946+0000","last_clean":"2024-04-26T12:50:34.297946+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:50:34.297946+0000","last_undegraded":"2024-04-26T12:50:34.297946+0000","last_fullsized":"2024-04-26T12:50:34.297946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:44.405285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.935848+0000","last_change":"2024-04-26T12:49:56.214215+0000","last_active":"2024-04-26T12:52:03.935848+0000","last_peered":"2024-04-26T12:52:03.935848+0000","last_clean":"2024-04-26T12:52:03.935848+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:52:03.935848+0000","last_undegraded":"2024-04-26T12:52:03.935848+0000","last_fullsized":"2024-04-26T12:52:03.935848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.065457+0000","last_change":"2024-04-26T12:49:56.220575+0000","last_active":"2024-04-26T12:53:09.065457+0000","last_peered":"2024-04-26T12:53:09.065457+0000","last_clean":"2024-04-26T12:53:09.065457+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:53:09.065457+0000","last_undegraded":"2024-04-26T12:53:09.065457+0000","last_fullsized":"2024-04-26T12:53:09.065457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:18.310904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.927312+0000","last_change":"2024-04-26T12:49:54.245871+0000","last_active":"2024-04-26T12:50:39.927312+0000","last_peered":"2024-04-26T12:50:39.927312+0000","last_clean":"2024-04-26T12:50:39.927312+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:50:39.927312+0000","last_undegraded":"2024-04-26T12:50:39.927312+0000","last_fullsized":"2024-04-26T12:50:39.927312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265368+0000","last_change":"2024-04-26T12:49:56.220421+0000","last_active":"2024-04-26T12:53:09.265368+0000","last_peered":"2024-04-26T12:53:09.265368+0000","last_clean":"2024-04-26T12:53:09.265368+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:09.265368+0000","last_undegraded":"2024-04-26T12:53:09.265368+0000","last_fullsized":"2024-04-26T12:53:09.265368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'3","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964829+0000","last_change":"2024-04-26T12:49:54.250106+0000","last_active":"2024-04-26T12:52:22.964829+0000","last_peered":"2024-04-26T12:52:22.964829+0000","last_clean":"2024-04-26T12:52:22.964829+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:52:22.964829+0000","last_undegraded":"2024-04-26T12:52:22.964829+0000","last_fullsized":"2024-04-26T12:52:22.964829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.348707+0000","last_change":"2024-04-26T12:49:56.222834+0000","last_active":"2024-04-26T12:53:09.348707+0000","last_peered":"2024-04-26T12:53:09.348707+0000","last_clean":"2024-04-26T12:53:09.348707+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:09.348707+0000","last_undegraded":"2024-04-26T12:53:09.348707+0000","last_fullsized":"2024-04-26T12:53:09.348707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:55.139601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317543+0000","last_change":"2024-04-26T12:49:54.244413+0000","last_active":"2024-04-26T12:50:34.317543+0000","last_peered":"2024-04-26T12:50:34.317543+0000","last_clean":"2024-04-26T12:50:34.317543+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:50:34.317543+0000","last_undegraded":"2024-04-26T12:50:34.317543+0000","last_fullsized":"2024-04-26T12:50:34.317543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.920847+0000","last_change":"2024-04-26T12:49:56.221481+0000","last_active":"2024-04-26T12:53:08.920847+0000","last_peered":"2024-04-26T12:53:08.920847+0000","last_clean":"2024-04-26T12:53:08.920847+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:53:08.920847+0000","last_undegraded":"2024-04-26T12:53:08.920847+0000","last_fullsized":"2024-04-26T12:53:08.920847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:18.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.218924+0000","last_change":"2024-04-26T12:49:54.246419+0000","last_active":"2024-04-26T12:53:09.218924+0000","last_peered":"2024-04-26T12:53:09.218924+0000","last_clean":"2024-04-26T12:53:09.218924+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:09.218924+0000","last_undegraded":"2024-04-26T12:53:09.218924+0000","last_fullsized":"2024-04-26T12:53:09.218924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298569+0000","last_change":"2024-04-26T12:49:56.215781+0000","last_active":"2024-04-26T12:50:34.298569+0000","last_peered":"2024-04-26T12:50:34.298569+0000","last_clean":"2024-04-26T12:50:34.298569+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:50:34.298569+0000","last_undegraded":"2024-04-26T12:50:34.298569+0000","last_fullsized":"2024-04-26T12:50:34.298569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:05.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301528+0000","last_change":"2024-04-26T12:49:54.235967+0000","last_active":"2024-04-26T12:50:34.301528+0000","last_peered":"2024-04-26T12:50:34.301528+0000","last_clean":"2024-04-26T12:50:34.301528+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:50:34.301528+0000","last_undegraded":"2024-04-26T12:50:34.301528+0000","last_fullsized":"2024-04-26T12:50:34.301528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:38.031959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.349371+0000","last_change":"2024-04-26T12:49:56.230516+0000","last_active":"2024-04-26T12:53:09.349371+0000","last_peered":"2024-04-26T12:53:09.349371+0000","last_clean":"2024-04-26T12:53:09.349371+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:09.349371+0000","last_undegraded":"2024-04-26T12:53:09.349371+0000","last_fullsized":"2024-04-26T12:53:09.349371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:43.529519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307407+0000","last_change":"2024-04-26T12:49:54.231273+0000","last_active":"2024-04-26T12:50:34.307407+0000","last_peered":"2024-04-26T12:50:34.307407+0000","last_clean":"2024-04-26T12:50:34.307407+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:50:34.307407+0000","last_undegraded":"2024-04-26T12:50:34.307407+0000","last_fullsized":"2024-04-26T12:50:34.307407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:04.131902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.309725+0000","last_change":"2024-04-26T12:50:04.290015+0000","last_active":"2024-04-26T12:53:09.309725+0000","last_peered":"2024-04-26T12:53:09.309725+0000","last_clean":"2024-04-26T12:53:09.309725+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:53:09.309725+0000","last_undegraded":"2024-04-26T12:53:09.309725+0000","last_fullsized":"2024-04-26T12:53:09.309725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:43.725242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966748+0000","last_change":"2024-04-26T12:49:56.230418+0000","last_active":"2024-04-26T12:52:17.966748+0000","last_peered":"2024-04-26T12:52:17.966748+0000","last_clean":"2024-04-26T12:52:17.966748+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:52:17.966748+0000","last_undegraded":"2024-04-26T12:52:17.966748+0000","last_fullsized":"2024-04-26T12:52:17.966748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:45.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308000+0000","last_change":"2024-04-26T12:49:54.258161+0000","last_active":"2024-04-26T12:50:34.308000+0000","last_peered":"2024-04-26T12:50:34.308000+0000","last_clean":"2024-04-26T12:50:34.308000+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:50:34.308000+0000","last_undegraded":"2024-04-26T12:50:34.308000+0000","last_fullsized":"2024-04-26T12:50:34.308000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:00.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.757841+0000","last_change":"2024-04-26T12:49:58.245109+0000","last_active":"2024-04-26T12:52:07.757841+0000","last_peered":"2024-04-26T12:52:07.757841+0000","last_clean":"2024-04-26T12:52:07.757841+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:52:07.757841+0000","last_undegraded":"2024-04-26T12:52:07.757841+0000","last_fullsized":"2024-04-26T12:52:07.757841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:01.452307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.184804+0000","last_change":"2024-04-26T12:50:00.267183+0000","last_active":"2024-04-26T12:52:06.184804+0000","last_peered":"2024-04-26T12:52:06.184804+0000","last_clean":"2024-04-26T12:52:06.184804+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:52:06.184804+0000","last_undegraded":"2024-04-26T12:52:06.184804+0000","last_fullsized":"2024-04-26T12:52:06.184804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:20.694030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318971+0000","last_change":"2024-04-26T12:50:02.286913+0000","last_active":"2024-04-26T12:50:34.318971+0000","last_peered":"2024-04-26T12:50:34.318971+0000","last_clean":"2024-04-26T12:50:34.318971+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:50:34.318971+0000","last_undegraded":"2024-04-26T12:50:34.318971+0000","last_fullsized":"2024-04-26T12:50:34.318971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.009156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.021133+0000","last_change":"2024-04-26T12:50:04.289706+0000","last_active":"2024-04-26T12:51:23.021133+0000","last_peered":"2024-04-26T12:51:23.021133+0000","last_clean":"2024-04-26T12:51:23.021133+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:51:23.021133+0000","last_undegraded":"2024-04-26T12:51:23.021133+0000","last_fullsized":"2024-04-26T12:51:23.021133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420741+0000","last_change":"2024-04-26T12:49:56.230756+0000","last_active":"2024-04-26T12:53:09.420741+0000","last_peered":"2024-04-26T12:53:09.420741+0000","last_clean":"2024-04-26T12:53:09.420741+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:09.420741+0000","last_undegraded":"2024-04-26T12:53:09.420741+0000","last_fullsized":"2024-04-26T12:53:09.420741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:08.686460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295413+0000","last_change":"2024-04-26T12:49:54.239992+0000","last_active":"2024-04-26T12:50:34.295413+0000","last_peered":"2024-04-26T12:50:34.295413+0000","last_clean":"2024-04-26T12:50:34.295413+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:50:34.295413+0000","last_undegraded":"2024-04-26T12:50:34.295413+0000","last_fullsized":"2024-04-26T12:50:34.295413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298746+0000","last_change":"2024-04-26T12:49:58.222832+0000","last_active":"2024-04-26T12:50:34.298746+0000","last_peered":"2024-04-26T12:50:34.298746+0000","last_clean":"2024-04-26T12:50:34.298746+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:50:34.298746+0000","last_undegraded":"2024-04-26T12:50:34.298746+0000","last_fullsized":"2024-04-26T12:50:34.298746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:55.234724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317827+0000","last_change":"2024-04-26T12:50:00.237541+0000","last_active":"2024-04-26T12:50:34.317827+0000","last_peered":"2024-04-26T12:50:34.317827+0000","last_clean":"2024-04-26T12:50:34.317827+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:50:34.317827+0000","last_undegraded":"2024-04-26T12:50:34.317827+0000","last_fullsized":"2024-04-26T12:50:34.317827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:55.963923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317973+0000","last_change":"2024-04-26T12:50:02.279094+0000","last_active":"2024-04-26T12:50:34.317973+0000","last_peered":"2024-04-26T12:50:34.317973+0000","last_clean":"2024-04-26T12:50:34.317973+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:50:34.317973+0000","last_undegraded":"2024-04-26T12:50:34.317973+0000","last_fullsized":"2024-04-26T12:50:34.317973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:59.872989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297515+0000","last_change":"2024-04-26T12:50:04.281974+0000","last_active":"2024-04-26T12:50:34.297515+0000","last_peered":"2024-04-26T12:50:34.297515+0000","last_clean":"2024-04-26T12:50:34.297515+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:50:34.297515+0000","last_undegraded":"2024-04-26T12:50:34.297515+0000","last_fullsized":"2024-04-26T12:50:34.297515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:37.632879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301288+0000","last_change":"2024-04-26T12:49:56.230322+0000","last_active":"2024-04-26T12:51:23.301288+0000","last_peered":"2024-04-26T12:51:23.301288+0000","last_clean":"2024-04-26T12:51:23.301288+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:51:23.301288+0000","last_undegraded":"2024-04-26T12:51:23.301288+0000","last_fullsized":"2024-04-26T12:51:23.301288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:53.550517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302460+0000","last_change":"2024-04-26T12:49:54.238247+0000","last_active":"2024-04-26T12:50:34.302460+0000","last_peered":"2024-04-26T12:50:34.302460+0000","last_clean":"2024-04-26T12:50:34.302460+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:50:34.302460+0000","last_undegraded":"2024-04-26T12:50:34.302460+0000","last_fullsized":"2024-04-26T12:50:34.302460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:27.411968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304667+0000","last_change":"2024-04-26T12:49:58.227229+0000","last_active":"2024-04-26T12:50:34.304667+0000","last_peered":"2024-04-26T12:50:34.304667+0000","last_clean":"2024-04-26T12:50:34.304667+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:50:34.304667+0000","last_undegraded":"2024-04-26T12:50:34.304667+0000","last_fullsized":"2024-04-26T12:50:34.304667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.728074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299915+0000","last_change":"2024-04-26T12:50:00.265817+0000","last_active":"2024-04-26T12:50:34.299915+0000","last_peered":"2024-04-26T12:50:34.299915+0000","last_clean":"2024-04-26T12:50:34.299915+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:50:34.299915+0000","last_undegraded":"2024-04-26T12:50:34.299915+0000","last_fullsized":"2024-04-26T12:50:34.299915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":386,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.611107+0000","last_change":"2024-04-26T12:50:02.294244+0000","last_active":"2024-04-26T12:53:09.611107+0000","last_peered":"2024-04-26T12:53:09.611107+0000","last_clean":"2024-04-26T12:53:09.611107+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:09.611107+0000","last_undegraded":"2024-04-26T12:53:09.611107+0000","last_fullsized":"2024-04-26T12:53:09.611107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295111+0000","last_change":"2024-04-26T12:50:04.283093+0000","last_active":"2024-04-26T12:50:34.295111+0000","last_peered":"2024-04-26T12:50:34.295111+0000","last_clean":"2024-04-26T12:50:34.295111+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:50:34.295111+0000","last_undegraded":"2024-04-26T12:50:34.295111+0000","last_fullsized":"2024-04-26T12:50:34.295111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:54.841461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352362+0000","last_change":"2024-04-26T12:49:56.227048+0000","last_active":"2024-04-26T12:53:09.352362+0000","last_peered":"2024-04-26T12:53:09.352362+0000","last_clean":"2024-04-26T12:53:09.352362+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:09.352362+0000","last_undegraded":"2024-04-26T12:53:09.352362+0000","last_fullsized":"2024-04-26T12:53:09.352362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:09.070129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.905801+0000","last_change":"2024-04-26T12:49:54.236350+0000","last_active":"2024-04-26T12:50:39.905801+0000","last_peered":"2024-04-26T12:50:39.905801+0000","last_clean":"2024-04-26T12:50:39.905801+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:50:39.905801+0000","last_undegraded":"2024-04-26T12:50:39.905801+0000","last_fullsized":"2024-04-26T12:50:39.905801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.325536+0000","last_change":"2024-04-26T12:49:58.245623+0000","last_active":"2024-04-26T12:50:34.325536+0000","last_peered":"2024-04-26T12:50:34.325536+0000","last_clean":"2024-04-26T12:50:34.325536+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:50:34.325536+0000","last_undegraded":"2024-04-26T12:50:34.325536+0000","last_fullsized":"2024-04-26T12:50:34.325536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:58.925636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.176499+0000","last_change":"2024-04-26T12:50:00.265428+0000","last_active":"2024-04-26T12:52:06.176499+0000","last_peered":"2024-04-26T12:52:06.176499+0000","last_clean":"2024-04-26T12:52:06.176499+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:52:06.176499+0000","last_undegraded":"2024-04-26T12:52:06.176499+0000","last_fullsized":"2024-04-26T12:52:06.176499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:23.018038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.428698+0000","last_change":"2024-04-26T12:50:02.264756+0000","last_active":"2024-04-26T12:53:09.428698+0000","last_peered":"2024-04-26T12:53:09.428698+0000","last_clean":"2024-04-26T12:53:09.428698+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:09.428698+0000","last_undegraded":"2024-04-26T12:53:09.428698+0000","last_fullsized":"2024-04-26T12:53:09.428698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:39.304818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.930226+0000","last_change":"2024-04-26T12:49:56.225947+0000","last_active":"2024-04-26T12:53:08.930226+0000","last_peered":"2024-04-26T12:53:08.930226+0000","last_clean":"2024-04-26T12:53:08.930226+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:53:08.930226+0000","last_undegraded":"2024-04-26T12:53:08.930226+0000","last_fullsized":"2024-04-26T12:53:08.930226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:51.767496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.227207+0000","last_change":"2024-04-26T12:49:54.242591+0000","last_active":"2024-04-26T12:53:09.227207+0000","last_peered":"2024-04-26T12:53:09.227207+0000","last_clean":"2024-04-26T12:53:09.227207+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:53:09.227207+0000","last_undegraded":"2024-04-26T12:53:09.227207+0000","last_fullsized":"2024-04-26T12:53:09.227207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310114+0000","last_change":"2024-04-26T12:49:58.241965+0000","last_active":"2024-04-26T12:50:34.310114+0000","last_peered":"2024-04-26T12:50:34.310114+0000","last_clean":"2024-04-26T12:50:34.310114+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:50:34.310114+0000","last_undegraded":"2024-04-26T12:50:34.310114+0000","last_fullsized":"2024-04-26T12:50:34.310114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:10.690590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'40","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.192218+0000","last_change":"2024-04-26T12:50:00.235080+0000","last_active":"2024-04-26T12:52:06.192218+0000","last_peered":"2024-04-26T12:52:06.192218+0000","last_clean":"2024-04-26T12:52:06.192218+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:52:06.192218+0000","last_undegraded":"2024-04-26T12:52:06.192218+0000","last_fullsized":"2024-04-26T12:52:06.192218+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.158126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300728+0000","last_change":"2024-04-26T12:50:02.273873+0000","last_active":"2024-04-26T12:50:34.300728+0000","last_peered":"2024-04-26T12:50:34.300728+0000","last_clean":"2024-04-26T12:50:34.300728+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:50:34.300728+0000","last_undegraded":"2024-04-26T12:50:34.300728+0000","last_fullsized":"2024-04-26T12:50:34.300728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:53.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.326178+0000","last_change":"2024-04-26T12:50:04.291139+0000","last_active":"2024-04-26T12:53:09.326178+0000","last_peered":"2024-04-26T12:53:09.326178+0000","last_clean":"2024-04-26T12:53:09.326178+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:53:09.326178+0000","last_undegraded":"2024-04-26T12:53:09.326178+0000","last_fullsized":"2024-04-26T12:53:09.326178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:27.099715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302331+0000","last_change":"2024-04-26T12:49:56.227916+0000","last_active":"2024-04-26T12:51:23.302331+0000","last_peered":"2024-04-26T12:51:23.302331+0000","last_clean":"2024-04-26T12:51:23.302331+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:51:23.302331+0000","last_undegraded":"2024-04-26T12:51:23.302331+0000","last_fullsized":"2024-04-26T12:51:23.302331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:18.700267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.961996+0000","last_change":"2024-04-26T12:49:54.247789+0000","last_active":"2024-04-26T12:52:12.961996+0000","last_peered":"2024-04-26T12:52:12.961996+0000","last_clean":"2024-04-26T12:52:12.961996+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:52:12.961996+0000","last_undegraded":"2024-04-26T12:52:12.961996+0000","last_fullsized":"2024-04-26T12:52:12.961996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298328+0000","last_change":"2024-04-26T12:49:58.227616+0000","last_active":"2024-04-26T12:50:34.298328+0000","last_peered":"2024-04-26T12:50:34.298328+0000","last_clean":"2024-04-26T12:50:34.298328+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:50:34.298328+0000","last_undegraded":"2024-04-26T12:50:34.298328+0000","last_fullsized":"2024-04-26T12:50:34.298328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:46.747008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.160904+0000","last_change":"2024-04-26T12:50:00.253636+0000","last_active":"2024-04-26T12:52:06.160904+0000","last_peered":"2024-04-26T12:52:06.160904+0000","last_clean":"2024-04-26T12:52:06.160904+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:52:06.160904+0000","last_undegraded":"2024-04-26T12:52:06.160904+0000","last_fullsized":"2024-04-26T12:52:06.160904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:36.115587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298542+0000","last_change":"2024-04-26T12:50:02.278315+0000","last_active":"2024-04-26T12:50:34.298542+0000","last_peered":"2024-04-26T12:50:34.298542+0000","last_clean":"2024-04-26T12:50:34.298542+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:50:34.298542+0000","last_undegraded":"2024-04-26T12:50:34.298542+0000","last_fullsized":"2024-04-26T12:50:34.298542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:49.074190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:17.319401+0000","last_change":"2024-04-26T12:50:04.276914+0000","last_active":"2024-04-26T12:51:17.319401+0000","last_peered":"2024-04-26T12:51:17.319401+0000","last_clean":"2024-04-26T12:51:17.319401+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:51:17.319401+0000","last_undegraded":"2024-04-26T12:51:17.319401+0000","last_fullsized":"2024-04-26T12:51:17.319401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:42.273211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945853+0000","last_change":"2024-04-26T12:49:56.217097+0000","last_active":"2024-04-26T12:50:39.945853+0000","last_peered":"2024-04-26T12:50:39.945853+0000","last_clean":"2024-04-26T12:50:39.945853+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:50:39.945853+0000","last_undegraded":"2024-04-26T12:50:39.945853+0000","last_fullsized":"2024-04-26T12:50:39.945853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.297824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316635+0000","last_change":"2024-04-26T12:49:54.252650+0000","last_active":"2024-04-26T12:50:34.316635+0000","last_peered":"2024-04-26T12:50:34.316635+0000","last_clean":"2024-04-26T12:50:34.316635+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:50:34.316635+0000","last_undegraded":"2024-04-26T12:50:34.316635+0000","last_fullsized":"2024-04-26T12:50:34.316635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:16.696005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304364+0000","last_change":"2024-04-26T12:49:58.230763+0000","last_active":"2024-04-26T12:50:34.304364+0000","last_peered":"2024-04-26T12:50:34.304364+0000","last_clean":"2024-04-26T12:50:34.304364+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:50:34.304364+0000","last_undegraded":"2024-04-26T12:50:34.304364+0000","last_fullsized":"2024-04-26T12:50:34.304364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:45.346897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.194958+0000","last_change":"2024-04-26T12:50:00.268771+0000","last_active":"2024-04-26T12:52:06.194958+0000","last_peered":"2024-04-26T12:52:06.194958+0000","last_clean":"2024-04-26T12:52:06.194958+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:52:06.194958+0000","last_undegraded":"2024-04-26T12:52:06.194958+0000","last_fullsized":"2024-04-26T12:52:06.194958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:54.149076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":349,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.625390+0000","last_change":"2024-04-26T12:50:02.271777+0000","last_active":"2024-04-26T12:53:09.625390+0000","last_peered":"2024-04-26T12:53:09.625390+0000","last_clean":"2024-04-26T12:53:09.625390+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:09.625390+0000","last_undegraded":"2024-04-26T12:53:09.625390+0000","last_fullsized":"2024-04-26T12:53:09.625390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.220287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300846+0000","last_change":"2024-04-26T12:50:04.295468+0000","last_active":"2024-04-26T12:50:34.300846+0000","last_peered":"2024-04-26T12:50:34.300846+0000","last_clean":"2024-04-26T12:50:34.300846+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:50:34.300846+0000","last_undegraded":"2024-04-26T12:50:34.300846+0000","last_fullsized":"2024-04-26T12:50:34.300846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:16.734503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420472+0000","last_change":"2024-04-26T12:49:56.213567+0000","last_active":"2024-04-26T12:53:09.420472+0000","last_peered":"2024-04-26T12:53:09.420472+0000","last_clean":"2024-04-26T12:53:09.420472+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:09.420472+0000","last_undegraded":"2024-04-26T12:53:09.420472+0000","last_fullsized":"2024-04-26T12:53:09.420472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.363361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.408215+0000","last_change":"2024-04-26T12:49:54.259981+0000","last_active":"2024-04-26T12:53:09.408215+0000","last_peered":"2024-04-26T12:53:09.408215+0000","last_clean":"2024-04-26T12:53:09.408215+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:53:09.408215+0000","last_undegraded":"2024-04-26T12:53:09.408215+0000","last_fullsized":"2024-04-26T12:53:09.408215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:38.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:37.943080+0000","last_change":"2024-04-26T12:50:34.307424+0000","last_active":"2024-04-26T12:50:37.943080+0000","last_peered":"2024-04-26T12:50:37.943080+0000","last_clean":"2024-04-26T12:50:37.943080+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:50:37.943080+0000","last_undegraded":"2024-04-26T12:50:37.943080+0000","last_fullsized":"2024-04-26T12:50:37.943080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:48.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'55","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965106+0000","last_change":"2024-04-26T12:50:00.266463+0000","last_active":"2024-04-26T12:52:12.965106+0000","last_peered":"2024-04-26T12:52:12.965106+0000","last_clean":"2024-04-26T12:52:12.965106+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:52:12.965106+0000","last_undegraded":"2024-04-26T12:52:12.965106+0000","last_fullsized":"2024-04-26T12:52:12.965106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:23.507988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297422+0000","last_change":"2024-04-26T12:50:02.276572+0000","last_active":"2024-04-26T12:50:34.297422+0000","last_peered":"2024-04-26T12:50:34.297422+0000","last_clean":"2024-04-26T12:50:34.297422+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:50:34.297422+0000","last_undegraded":"2024-04-26T12:50:34.297422+0000","last_fullsized":"2024-04-26T12:50:34.297422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:09.557600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'20","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.585189+0000","last_change":"2024-04-26T12:50:04.303330+0000","last_active":"2024-04-26T12:53:09.585189+0000","last_peered":"2024-04-26T12:53:09.585189+0000","last_clean":"2024-04-26T12:53:09.585189+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:53:09.585189+0000","last_undegraded":"2024-04-26T12:53:09.585189+0000","last_fullsized":"2024-04-26T12:53:09.585189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:39.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302853+0000","last_change":"2024-04-26T12:49:56.234590+0000","last_active":"2024-04-26T12:51:23.302853+0000","last_peered":"2024-04-26T12:51:23.302853+0000","last_clean":"2024-04-26T12:51:23.302853+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:51:23.302853+0000","last_undegraded":"2024-04-26T12:51:23.302853+0000","last_fullsized":"2024-04-26T12:51:23.302853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:30.414057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300414+0000","last_change":"2024-04-26T12:49:54.239087+0000","last_active":"2024-04-26T12:50:34.300414+0000","last_peered":"2024-04-26T12:50:34.300414+0000","last_clean":"2024-04-26T12:50:34.300414+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:50:34.300414+0000","last_undegraded":"2024-04-26T12:50:34.300414+0000","last_fullsized":"2024-04-26T12:50:34.300414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299450+0000","last_change":"2024-04-26T12:49:58.226242+0000","last_active":"2024-04-26T12:50:34.299450+0000","last_peered":"2024-04-26T12:50:34.299450+0000","last_clean":"2024-04-26T12:50:34.299450+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:50:34.299450+0000","last_undegraded":"2024-04-26T12:50:34.299450+0000","last_fullsized":"2024-04-26T12:50:34.299450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:55.303173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.166823+0000","last_change":"2024-04-26T12:50:00.235211+0000","last_active":"2024-04-26T12:52:06.166823+0000","last_peered":"2024-04-26T12:52:06.166823+0000","last_clean":"2024-04-26T12:52:06.166823+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:52:06.166823+0000","last_undegraded":"2024-04-26T12:52:06.166823+0000","last_fullsized":"2024-04-26T12:52:06.166823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.091284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322784+0000","last_change":"2024-04-26T12:50:02.283252+0000","last_active":"2024-04-26T12:50:34.322784+0000","last_peered":"2024-04-26T12:50:34.322784+0000","last_clean":"2024-04-26T12:50:34.322784+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:50:34.322784+0000","last_undegraded":"2024-04-26T12:50:34.322784+0000","last_fullsized":"2024-04-26T12:50:34.322784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:56.381142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964007+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:52:07.964007+0000","last_peered":"2024-04-26T12:52:07.964007+0000","last_clean":"2024-04-26T12:52:07.964007+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:52:07.964007+0000","last_undegraded":"2024-04-26T12:52:07.964007+0000","last_fullsized":"2024-04-26T12:52:07.964007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:12.923913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352421+0000","last_change":"2024-04-26T12:49:56.229878+0000","last_active":"2024-04-26T12:53:09.352421+0000","last_peered":"2024-04-26T12:53:09.352421+0000","last_clean":"2024-04-26T12:53:09.352421+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:09.352421+0000","last_undegraded":"2024-04-26T12:53:09.352421+0000","last_fullsized":"2024-04-26T12:53:09.352421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:32.609926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308940+0000","last_change":"2024-04-26T12:49:54.231974+0000","last_active":"2024-04-26T12:50:34.308940+0000","last_peered":"2024-04-26T12:50:34.308940+0000","last_clean":"2024-04-26T12:50:34.308940+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:50:34.308940+0000","last_undegraded":"2024-04-26T12:50:34.308940+0000","last_fullsized":"2024-04-26T12:50:34.308940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:49.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299022+0000","last_change":"2024-04-26T12:49:58.230663+0000","last_active":"2024-04-26T12:50:34.299022+0000","last_peered":"2024-04-26T12:50:34.299022+0000","last_clean":"2024-04-26T12:50:34.299022+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:50:34.299022+0000","last_undegraded":"2024-04-26T12:50:34.299022+0000","last_fullsized":"2024-04-26T12:50:34.299022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:00.488394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.963417+0000","last_change":"2024-04-26T12:50:00.249967+0000","last_active":"2024-04-26T12:52:17.963417+0000","last_peered":"2024-04-26T12:52:17.963417+0000","last_clean":"2024-04-26T12:52:17.963417+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:52:17.963417+0000","last_undegraded":"2024-04-26T12:52:17.963417+0000","last_fullsized":"2024-04-26T12:52:17.963417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:37.320719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":404,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.597422+0000","last_change":"2024-04-26T12:50:02.276171+0000","last_active":"2024-04-26T12:53:09.597422+0000","last_peered":"2024-04-26T12:53:09.597422+0000","last_clean":"2024-04-26T12:53:09.597422+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:09.597422+0000","last_undegraded":"2024-04-26T12:53:09.597422+0000","last_fullsized":"2024-04-26T12:53:09.597422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:55.900264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.539446+0000","last_change":"2024-04-26T12:50:04.296504+0000","last_active":"2024-04-26T12:53:09.539446+0000","last_peered":"2024-04-26T12:53:09.539446+0000","last_clean":"2024-04-26T12:53:09.539446+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:53:09.539446+0000","last_undegraded":"2024-04-26T12:53:09.539446+0000","last_fullsized":"2024-04-26T12:53:09.539446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.592447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.287114+0000","last_change":"2024-04-26T12:49:56.221290+0000","last_active":"2024-04-26T12:52:08.287114+0000","last_peered":"2024-04-26T12:52:08.287114+0000","last_clean":"2024-04-26T12:52:08.287114+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:52:08.287114+0000","last_undegraded":"2024-04-26T12:52:08.287114+0000","last_fullsized":"2024-04-26T12:52:08.287114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:22.996331+0000","last_change":"2024-04-26T12:49:54.237237+0000","last_active":"2024-04-26T12:51:22.996331+0000","last_peered":"2024-04-26T12:51:22.996331+0000","last_clean":"2024-04-26T12:51:22.996331+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:51:22.996331+0000","last_undegraded":"2024-04-26T12:51:22.996331+0000","last_fullsized":"2024-04-26T12:51:22.996331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:54.152136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.757550+0000","last_change":"2024-04-26T12:49:58.226903+0000","last_active":"2024-04-26T12:52:07.757550+0000","last_peered":"2024-04-26T12:52:07.757550+0000","last_clean":"2024-04-26T12:52:07.757550+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:52:07.757550+0000","last_undegraded":"2024-04-26T12:52:07.757550+0000","last_fullsized":"2024-04-26T12:52:07.757550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:35.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316978+0000","last_change":"2024-04-26T12:50:00.268687+0000","last_active":"2024-04-26T12:50:34.316978+0000","last_peered":"2024-04-26T12:50:34.316978+0000","last_clean":"2024-04-26T12:50:34.316978+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:50:34.316978+0000","last_undegraded":"2024-04-26T12:50:34.316978+0000","last_fullsized":"2024-04-26T12:50:34.316978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:31.569888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":466,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.536293+0000","last_change":"2024-04-26T12:50:02.273006+0000","last_active":"2024-04-26T12:53:09.536293+0000","last_peered":"2024-04-26T12:53:09.536293+0000","last_clean":"2024-04-26T12:53:09.536293+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:09.536293+0000","last_undegraded":"2024-04-26T12:53:09.536293+0000","last_fullsized":"2024-04-26T12:53:09.536293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:51.983823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.914810+0000","last_change":"2024-04-26T12:50:04.274718+0000","last_active":"2024-04-26T12:52:07.914810+0000","last_peered":"2024-04-26T12:52:07.914810+0000","last_clean":"2024-04-26T12:52:07.914810+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:52:07.914810+0000","last_undegraded":"2024-04-26T12:52:07.914810+0000","last_fullsized":"2024-04-26T12:52:07.914810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:59.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067278+0000","last_change":"2024-04-26T12:49:56.234752+0000","last_active":"2024-04-26T12:53:09.067278+0000","last_peered":"2024-04-26T12:53:09.067278+0000","last_clean":"2024-04-26T12:53:09.067278+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:09.067278+0000","last_undegraded":"2024-04-26T12:53:09.067278+0000","last_fullsized":"2024-04-26T12:53:09.067278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:23.826434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301149+0000","last_change":"2024-04-26T12:49:54.243701+0000","last_active":"2024-04-26T12:50:34.301149+0000","last_peered":"2024-04-26T12:50:34.301149+0000","last_clean":"2024-04-26T12:50:34.301149+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:50:34.301149+0000","last_undegraded":"2024-04-26T12:50:34.301149+0000","last_fullsized":"2024-04-26T12:50:34.301149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:34.229879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322953+0000","last_change":"2024-04-26T12:49:58.244322+0000","last_active":"2024-04-26T12:50:34.322953+0000","last_peered":"2024-04-26T12:50:34.322953+0000","last_clean":"2024-04-26T12:50:34.322953+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:50:34.322953+0000","last_undegraded":"2024-04-26T12:50:34.322953+0000","last_fullsized":"2024-04-26T12:50:34.322953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:20.832753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'39","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.187089+0000","last_change":"2024-04-26T12:50:00.235679+0000","last_active":"2024-04-26T12:52:06.187089+0000","last_peered":"2024-04-26T12:52:06.187089+0000","last_clean":"2024-04-26T12:52:06.187089+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:52:06.187089+0000","last_undegraded":"2024-04-26T12:52:06.187089+0000","last_fullsized":"2024-04-26T12:52:06.187089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:26.195044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299317+0000","last_change":"2024-04-26T12:50:02.289768+0000","last_active":"2024-04-26T12:50:34.299317+0000","last_peered":"2024-04-26T12:50:34.299317+0000","last_clean":"2024-04-26T12:50:34.299317+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:50:34.299317+0000","last_undegraded":"2024-04-26T12:50:34.299317+0000","last_fullsized":"2024-04-26T12:50:34.299317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:01.413730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.492082+0000","last_change":"2024-04-26T12:50:04.271998+0000","last_active":"2024-04-26T12:53:09.492082+0000","last_peered":"2024-04-26T12:53:09.492082+0000","last_clean":"2024-04-26T12:53:09.492082+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:09.492082+0000","last_undegraded":"2024-04-26T12:53:09.492082+0000","last_fullsized":"2024-04-26T12:53:09.492082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:39.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.936230+0000","last_change":"2024-04-26T12:49:56.231794+0000","last_active":"2024-04-26T12:52:03.936230+0000","last_peered":"2024-04-26T12:52:03.936230+0000","last_clean":"2024-04-26T12:52:03.936230+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:52:03.936230+0000","last_undegraded":"2024-04-26T12:52:03.936230+0000","last_fullsized":"2024-04-26T12:52:03.936230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:53.041573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":202,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301216+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:50:34.301216+0000","last_peered":"2024-04-26T12:50:34.301216+0000","last_clean":"2024-04-26T12:50:34.301216+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:50:34.301216+0000","last_undegraded":"2024-04-26T12:50:34.301216+0000","last_fullsized":"2024-04-26T12:50:34.301216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:51.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307677+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:50:34.307677+0000","last_peered":"2024-04-26T12:50:34.307677+0000","last_clean":"2024-04-26T12:50:34.307677+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:50:34.307677+0000","last_undegraded":"2024-04-26T12:50:34.307677+0000","last_fullsized":"2024-04-26T12:50:34.307677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:44.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.874345+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:08.874345+0000","last_peered":"2024-04-26T12:53:08.874345+0000","last_clean":"2024-04-26T12:53:08.874345+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:08.874345+0000","last_undegraded":"2024-04-26T12:53:08.874345+0000","last_fullsized":"2024-04-26T12:53:08.874345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:07.492609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309753+0000","last_change":"2024-04-26T12:49:58.226523+0000","last_active":"2024-04-26T12:50:34.309753+0000","last_peered":"2024-04-26T12:50:34.309753+0000","last_clean":"2024-04-26T12:50:34.309753+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:50:34.309753+0000","last_undegraded":"2024-04-26T12:50:34.309753+0000","last_fullsized":"2024-04-26T12:50:34.309753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:34.614055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'77","reported_seq":146,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.205039+0000","last_change":"2024-04-26T12:50:00.264564+0000","last_active":"2024-04-26T12:52:06.205039+0000","last_peered":"2024-04-26T12:52:06.205039+0000","last_clean":"2024-04-26T12:52:06.205039+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:52:06.205039+0000","last_undegraded":"2024-04-26T12:52:06.205039+0000","last_fullsized":"2024-04-26T12:52:06.205039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:14.296275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301186+0000","last_change":"2024-04-26T12:50:02.283713+0000","last_active":"2024-04-26T12:50:34.301186+0000","last_peered":"2024-04-26T12:50:34.301186+0000","last_clean":"2024-04-26T12:50:34.301186+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:50:34.301186+0000","last_undegraded":"2024-04-26T12:50:34.301186+0000","last_fullsized":"2024-04-26T12:50:34.301186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:57.660351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.447691+0000","last_change":"2024-04-26T12:50:04.295222+0000","last_active":"2024-04-26T12:53:09.447691+0000","last_peered":"2024-04-26T12:53:09.447691+0000","last_clean":"2024-04-26T12:53:09.447691+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:53:09.447691+0000","last_undegraded":"2024-04-26T12:53:09.447691+0000","last_fullsized":"2024-04-26T12:53:09.447691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:45.205005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.950283+0000","last_change":"2024-04-26T12:49:56.229772+0000","last_active":"2024-04-26T12:52:03.950283+0000","last_peered":"2024-04-26T12:52:03.950283+0000","last_clean":"2024-04-26T12:52:03.950283+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:52:03.950283+0000","last_undegraded":"2024-04-26T12:52:03.950283+0000","last_fullsized":"2024-04-26T12:52:03.950283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:51.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300329+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:50:34.300329+0000","last_peered":"2024-04-26T12:50:34.300329+0000","last_clean":"2024-04-26T12:50:34.300329+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:50:34.300329+0000","last_undegraded":"2024-04-26T12:50:34.300329+0000","last_fullsized":"2024-04-26T12:50:34.300329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:26.774107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297560+0000","last_change":"2024-04-26T12:49:54.242621+0000","last_active":"2024-04-26T12:50:34.297560+0000","last_peered":"2024-04-26T12:50:34.297560+0000","last_clean":"2024-04-26T12:50:34.297560+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:50:34.297560+0000","last_undegraded":"2024-04-26T12:50:34.297560+0000","last_fullsized":"2024-04-26T12:50:34.297560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:13.443714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326393+0000","last_change":"2024-04-26T12:49:58.244054+0000","last_active":"2024-04-26T12:50:34.326393+0000","last_peered":"2024-04-26T12:50:34.326393+0000","last_clean":"2024-04-26T12:50:34.326393+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:50:34.326393+0000","last_undegraded":"2024-04-26T12:50:34.326393+0000","last_fullsized":"2024-04-26T12:50:34.326393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:25.847014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'273","reported_seq":477,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.475259+0000","last_change":"2024-04-26T12:50:00.249276+0000","last_active":"2024-04-26T12:53:08.475259+0000","last_peered":"2024-04-26T12:53:08.475259+0000","last_clean":"2024-04-26T12:53:08.475259+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:08.475259+0000","last_undegraded":"2024-04-26T12:53:08.475259+0000","last_fullsized":"2024-04-26T12:53:08.475259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:57.562801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.314485+0000","last_change":"2024-04-26T12:50:02.283171+0000","last_active":"2024-04-26T12:50:34.314485+0000","last_peered":"2024-04-26T12:50:34.314485+0000","last_clean":"2024-04-26T12:50:34.314485+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:50:34.314485+0000","last_undegraded":"2024-04-26T12:50:34.314485+0000","last_fullsized":"2024-04-26T12:50:34.314485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.718547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.017577+0000","last_change":"2024-04-26T12:50:04.282566+0000","last_active":"2024-04-26T12:51:23.017577+0000","last_peered":"2024-04-26T12:51:23.017577+0000","last_clean":"2024-04-26T12:51:23.017577+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:51:23.017577+0000","last_undegraded":"2024-04-26T12:51:23.017577+0000","last_fullsized":"2024-04-26T12:51:23.017577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:35.825570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420031+0000","last_change":"2024-04-26T12:49:56.225899+0000","last_active":"2024-04-26T12:53:09.420031+0000","last_peered":"2024-04-26T12:53:09.420031+0000","last_clean":"2024-04-26T12:53:09.420031+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:09.420031+0000","last_undegraded":"2024-04-26T12:53:09.420031+0000","last_fullsized":"2024-04-26T12:53:09.420031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:53.411007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295191+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:50:34.295191+0000","last_peered":"2024-04-26T12:50:34.295191+0000","last_clean":"2024-04-26T12:50:34.295191+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:50:34.295191+0000","last_undegraded":"2024-04-26T12:50:34.295191+0000","last_fullsized":"2024-04-26T12:50:34.295191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:41.462105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.243990+0000","last_change":"2024-04-26T12:49:54.236038+0000","last_active":"2024-04-26T12:53:09.243990+0000","last_peered":"2024-04-26T12:53:09.243990+0000","last_clean":"2024-04-26T12:53:09.243990+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:53:09.243990+0000","last_undegraded":"2024-04-26T12:53:09.243990+0000","last_fullsized":"2024-04-26T12:53:09.243990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:40.296155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.329321+0000","last_change":"2024-04-26T12:50:34.328152+0000","last_active":"2024-04-26T12:50:34.329321+0000","last_peered":"2024-04-26T12:50:34.329321+0000","last_clean":"2024-04-26T12:50:34.329321+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:50:34.329321+0000","last_undegraded":"2024-04-26T12:50:34.329321+0000","last_fullsized":"2024-04-26T12:50:34.329321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:37.685088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.474919+0000","last_change":"2024-04-26T12:50:00.249900+0000","last_active":"2024-04-26T12:53:08.474919+0000","last_peered":"2024-04-26T12:53:08.474919+0000","last_clean":"2024-04-26T12:53:08.474919+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:08.474919+0000","last_undegraded":"2024-04-26T12:53:08.474919+0000","last_fullsized":"2024-04-26T12:53:08.474919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:05.719952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300488+0000","last_change":"2024-04-26T12:50:02.279258+0000","last_active":"2024-04-26T12:50:34.300488+0000","last_peered":"2024-04-26T12:50:34.300488+0000","last_clean":"2024-04-26T12:50:34.300488+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:50:34.300488+0000","last_undegraded":"2024-04-26T12:50:34.300488+0000","last_fullsized":"2024-04-26T12:50:34.300488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:01.556723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.071153+0000","last_change":"2024-04-26T12:50:04.302141+0000","last_active":"2024-04-26T12:53:09.071153+0000","last_peered":"2024-04-26T12:53:09.071153+0000","last_clean":"2024-04-26T12:53:09.071153+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:53:09.071153+0000","last_undegraded":"2024-04-26T12:53:09.071153+0000","last_fullsized":"2024-04-26T12:53:09.071153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:27.014519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301204+0000","last_change":"2024-04-26T12:49:56.218654+0000","last_active":"2024-04-26T12:51:23.301204+0000","last_peered":"2024-04-26T12:51:23.301204+0000","last_clean":"2024-04-26T12:51:23.301204+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:51:23.301204+0000","last_undegraded":"2024-04-26T12:51:23.301204+0000","last_fullsized":"2024-04-26T12:51:23.301204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.466458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306739+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:50:34.306739+0000","last_peered":"2024-04-26T12:50:34.306739+0000","last_clean":"2024-04-26T12:50:34.306739+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:50:34.306739+0000","last_undegraded":"2024-04-26T12:50:34.306739+0000","last_fullsized":"2024-04-26T12:50:34.306739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:33.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296572+0000","last_change":"2024-04-26T12:49:54.228710+0000","last_active":"2024-04-26T12:50:34.296572+0000","last_peered":"2024-04-26T12:50:34.296572+0000","last_clean":"2024-04-26T12:50:34.296572+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:50:34.296572+0000","last_undegraded":"2024-04-26T12:50:34.296572+0000","last_fullsized":"2024-04-26T12:50:34.296572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300941+0000","last_change":"2024-04-26T12:49:58.226208+0000","last_active":"2024-04-26T12:50:34.300941+0000","last_peered":"2024-04-26T12:50:34.300941+0000","last_clean":"2024-04-26T12:50:34.300941+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:50:34.300941+0000","last_undegraded":"2024-04-26T12:50:34.300941+0000","last_fullsized":"2024-04-26T12:50:34.300941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.427051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.336167+0000","last_change":"2024-04-26T12:50:00.262398+0000","last_active":"2024-04-26T12:53:08.336167+0000","last_peered":"2024-04-26T12:53:08.336167+0000","last_clean":"2024-04-26T12:53:08.336167+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:08.336167+0000","last_undegraded":"2024-04-26T12:53:08.336167+0000","last_fullsized":"2024-04-26T12:53:08.336167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:15.645393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323584+0000","last_change":"2024-04-26T12:50:02.286212+0000","last_active":"2024-04-26T12:50:34.323584+0000","last_peered":"2024-04-26T12:50:34.323584+0000","last_clean":"2024-04-26T12:50:34.323584+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:50:34.323584+0000","last_undegraded":"2024-04-26T12:50:34.323584+0000","last_fullsized":"2024-04-26T12:50:34.323584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.753285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.892986+0000","last_change":"2024-04-26T12:50:04.290606+0000","last_active":"2024-04-26T12:52:07.892986+0000","last_peered":"2024-04-26T12:52:07.892986+0000","last_clean":"2024-04-26T12:52:07.892986+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:52:07.892986+0000","last_undegraded":"2024-04-26T12:52:07.892986+0000","last_fullsized":"2024-04-26T12:52:07.892986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:57.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.925248+0000","last_change":"2024-04-26T12:49:56.234671+0000","last_active":"2024-04-26T12:53:08.925248+0000","last_peered":"2024-04-26T12:53:08.925248+0000","last_clean":"2024-04-26T12:53:08.925248+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:08.925248+0000","last_undegraded":"2024-04-26T12:53:08.925248+0000","last_fullsized":"2024-04-26T12:53:08.925248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:53.299044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.285576+0000","last_change":"2024-04-26T12:49:54.227464+0000","last_active":"2024-04-26T12:51:23.285576+0000","last_peered":"2024-04-26T12:51:23.285576+0000","last_clean":"2024-04-26T12:51:23.285576+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:51:23.285576+0000","last_undegraded":"2024-04-26T12:51:23.285576+0000","last_fullsized":"2024-04-26T12:51:23.285576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299481+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:50:34.299481+0000","last_peered":"2024-04-26T12:50:34.299481+0000","last_clean":"2024-04-26T12:50:34.299481+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:50:34.299481+0000","last_undegraded":"2024-04-26T12:50:34.299481+0000","last_fullsized":"2024-04-26T12:50:34.299481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:02.796747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163300+0000","last_change":"2024-04-26T12:49:58.218010+0000","last_active":"2024-04-26T12:52:05.163300+0000","last_peered":"2024-04-26T12:52:05.163300+0000","last_clean":"2024-04-26T12:52:05.163300+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:52:05.163300+0000","last_undegraded":"2024-04-26T12:52:05.163300+0000","last_fullsized":"2024-04-26T12:52:05.163300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:41.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.206605+0000","last_change":"2024-04-26T12:50:00.240005+0000","last_active":"2024-04-26T12:52:06.206605+0000","last_peered":"2024-04-26T12:52:06.206605+0000","last_clean":"2024-04-26T12:52:06.206605+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:52:06.206605+0000","last_undegraded":"2024-04-26T12:52:06.206605+0000","last_fullsized":"2024-04-26T12:52:06.206605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:08.343846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296108+0000","last_change":"2024-04-26T12:50:02.267791+0000","last_active":"2024-04-26T12:50:34.296108+0000","last_peered":"2024-04-26T12:50:34.296108+0000","last_clean":"2024-04-26T12:50:34.296108+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:50:34.296108+0000","last_undegraded":"2024-04-26T12:50:34.296108+0000","last_fullsized":"2024-04-26T12:50:34.296108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:57.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.138878+0000","last_change":"2024-04-26T12:50:04.282702+0000","last_active":"2024-04-26T12:52:08.138878+0000","last_peered":"2024-04-26T12:52:08.138878+0000","last_clean":"2024-04-26T12:52:08.138878+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:52:08.138878+0000","last_undegraded":"2024-04-26T12:52:08.138878+0000","last_fullsized":"2024-04-26T12:52:08.138878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:46.989616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.441251+0000","last_change":"2024-04-26T12:49:56.231876+0000","last_active":"2024-04-26T12:53:09.441251+0000","last_peered":"2024-04-26T12:53:09.441251+0000","last_clean":"2024-04-26T12:53:09.441251+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:09.441251+0000","last_undegraded":"2024-04-26T12:53:09.441251+0000","last_fullsized":"2024-04-26T12:53:09.441251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:44.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300795+0000","last_change":"2024-04-26T12:49:54.242611+0000","last_active":"2024-04-26T12:50:34.300795+0000","last_peered":"2024-04-26T12:50:34.300795+0000","last_clean":"2024-04-26T12:50:34.300795+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:50:34.300795+0000","last_undegraded":"2024-04-26T12:50:34.300795+0000","last_fullsized":"2024-04-26T12:50:34.300795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:28.681707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316052+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:50:34.316052+0000","last_peered":"2024-04-26T12:50:34.316052+0000","last_clean":"2024-04-26T12:50:34.316052+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:50:34.316052+0000","last_undegraded":"2024-04-26T12:50:34.316052+0000","last_fullsized":"2024-04-26T12:50:34.316052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:52.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302424+0000","last_change":"2024-04-26T12:49:58.241694+0000","last_active":"2024-04-26T12:50:34.302424+0000","last_peered":"2024-04-26T12:50:34.302424+0000","last_clean":"2024-04-26T12:50:34.302424+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:50:34.302424+0000","last_undegraded":"2024-04-26T12:50:34.302424+0000","last_fullsized":"2024-04-26T12:50:34.302424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.960038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'16","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.959724+0000","last_change":"2024-04-26T12:50:00.249990+0000","last_active":"2024-04-26T12:52:07.959724+0000","last_peered":"2024-04-26T12:52:07.959724+0000","last_clean":"2024-04-26T12:52:07.959724+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:52:07.959724+0000","last_undegraded":"2024-04-26T12:52:07.959724+0000","last_fullsized":"2024-04-26T12:52:07.959724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:16.755935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":356,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.474553+0000","last_change":"2024-04-26T12:50:02.274253+0000","last_active":"2024-04-26T12:53:08.474553+0000","last_peered":"2024-04-26T12:53:08.474553+0000","last_clean":"2024-04-26T12:53:08.474553+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:08.474553+0000","last_undegraded":"2024-04-26T12:53:08.474553+0000","last_fullsized":"2024-04-26T12:53:08.474553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:53.359511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.321938+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:50:34.321938+0000","last_peered":"2024-04-26T12:50:34.321938+0000","last_clean":"2024-04-26T12:50:34.321938+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:50:34.321938+0000","last_undegraded":"2024-04-26T12:50:34.321938+0000","last_fullsized":"2024-04-26T12:50:34.321938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:03.311297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'9","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.438858+0000","last_change":"2024-04-26T12:49:56.226197+0000","last_active":"2024-04-26T12:53:09.438858+0000","last_peered":"2024-04-26T12:53:09.438858+0000","last_clean":"2024-04-26T12:53:09.438858+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:53:09.438858+0000","last_undegraded":"2024-04-26T12:53:09.438858+0000","last_fullsized":"2024-04-26T12:53:09.438858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:07.136832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326593+0000","last_change":"2024-04-26T12:49:54.253396+0000","last_active":"2024-04-26T12:50:34.326593+0000","last_peered":"2024-04-26T12:50:34.326593+0000","last_clean":"2024-04-26T12:50:34.326593+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:50:34.326593+0000","last_undegraded":"2024-04-26T12:50:34.326593+0000","last_fullsized":"2024-04-26T12:50:34.326593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:39.258567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301688+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:50:34.301688+0000","last_peered":"2024-04-26T12:50:34.301688+0000","last_clean":"2024-04-26T12:50:34.301688+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:50:34.301688+0000","last_undegraded":"2024-04-26T12:50:34.301688+0000","last_fullsized":"2024-04-26T12:50:34.301688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:30.732769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308987+0000","last_change":"2024-04-26T12:49:58.245857+0000","last_active":"2024-04-26T12:50:34.308987+0000","last_peered":"2024-04-26T12:50:34.308987+0000","last_clean":"2024-04-26T12:50:34.308987+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:50:34.308987+0000","last_undegraded":"2024-04-26T12:50:34.308987+0000","last_fullsized":"2024-04-26T12:50:34.308987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.985370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307845+0000","last_change":"2024-04-26T12:50:00.271933+0000","last_active":"2024-04-26T12:50:34.307845+0000","last_peered":"2024-04-26T12:50:34.307845+0000","last_clean":"2024-04-26T12:50:34.307845+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:50:34.307845+0000","last_undegraded":"2024-04-26T12:50:34.307845+0000","last_fullsized":"2024-04-26T12:50:34.307845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:27.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":430,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.587212+0000","last_change":"2024-04-26T12:50:02.273956+0000","last_active":"2024-04-26T12:53:09.587212+0000","last_peered":"2024-04-26T12:53:09.587212+0000","last_clean":"2024-04-26T12:53:09.587212+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:09.587212+0000","last_undegraded":"2024-04-26T12:53:09.587212+0000","last_fullsized":"2024-04-26T12:53:09.587212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:50.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309143+0000","last_change":"2024-04-26T12:50:04.301343+0000","last_active":"2024-04-26T12:50:34.309143+0000","last_peered":"2024-04-26T12:50:34.309143+0000","last_clean":"2024-04-26T12:50:34.309143+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:50:34.309143+0000","last_undegraded":"2024-04-26T12:50:34.309143+0000","last_fullsized":"2024-04-26T12:50:34.309143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:43.916865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.300311+0000","last_change":"2024-04-26T12:49:56.215393+0000","last_active":"2024-04-26T12:51:23.300311+0000","last_peered":"2024-04-26T12:51:23.300311+0000","last_clean":"2024-04-26T12:51:23.300311+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:51:23.300311+0000","last_undegraded":"2024-04-26T12:51:23.300311+0000","last_fullsized":"2024-04-26T12:51:23.300311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:23.402206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.215677+0000","last_change":"2024-04-26T12:49:54.239381+0000","last_active":"2024-04-26T12:52:08.215677+0000","last_peered":"2024-04-26T12:52:08.215677+0000","last_clean":"2024-04-26T12:52:08.215677+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:52:08.215677+0000","last_undegraded":"2024-04-26T12:52:08.215677+0000","last_fullsized":"2024-04-26T12:52:08.215677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323186+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:50:34.323186+0000","last_peered":"2024-04-26T12:50:34.323186+0000","last_clean":"2024-04-26T12:50:34.323186+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:50:34.323186+0000","last_undegraded":"2024-04-26T12:50:34.323186+0000","last_fullsized":"2024-04-26T12:50:34.323186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.190860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301969+0000","last_change":"2024-04-26T12:49:58.237558+0000","last_active":"2024-04-26T12:50:34.301969+0000","last_peered":"2024-04-26T12:50:34.301969+0000","last_clean":"2024-04-26T12:50:34.301969+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:50:34.301969+0000","last_undegraded":"2024-04-26T12:50:34.301969+0000","last_fullsized":"2024-04-26T12:50:34.301969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:55.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'85","reported_seq":157,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.183596+0000","last_change":"2024-04-26T12:50:00.262654+0000","last_active":"2024-04-26T12:52:06.183596+0000","last_peered":"2024-04-26T12:52:06.183596+0000","last_clean":"2024-04-26T12:52:06.183596+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:52:06.183596+0000","last_undegraded":"2024-04-26T12:52:06.183596+0000","last_fullsized":"2024-04-26T12:52:06.183596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.678581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299226+0000","last_change":"2024-04-26T12:50:02.277001+0000","last_active":"2024-04-26T12:50:34.299226+0000","last_peered":"2024-04-26T12:50:34.299226+0000","last_clean":"2024-04-26T12:50:34.299226+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:50:34.299226+0000","last_undegraded":"2024-04-26T12:50:34.299226+0000","last_fullsized":"2024-04-26T12:50:34.299226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:28.423042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303169+0000","last_change":"2024-04-26T12:50:04.283865+0000","last_active":"2024-04-26T12:50:34.303169+0000","last_peered":"2024-04-26T12:50:34.303169+0000","last_clean":"2024-04-26T12:50:34.303169+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:50:34.303169+0000","last_undegraded":"2024-04-26T12:50:34.303169+0000","last_fullsized":"2024-04-26T12:50:34.303169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:55.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303220+0000","last_change":"2024-04-26T12:50:04.289462+0000","last_active":"2024-04-26T12:50:34.303220+0000","last_peered":"2024-04-26T12:50:34.303220+0000","last_clean":"2024-04-26T12:50:34.303220+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:50:34.303220+0000","last_undegraded":"2024-04-26T12:50:34.303220+0000","last_fullsized":"2024-04-26T12:50:34.303220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:03.677092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945866+0000","last_change":"2024-04-26T12:49:56.224657+0000","last_active":"2024-04-26T12:50:39.945866+0000","last_peered":"2024-04-26T12:50:39.945866+0000","last_clean":"2024-04-26T12:50:39.945866+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:50:39.945866+0000","last_undegraded":"2024-04-26T12:50:39.945866+0000","last_fullsized":"2024-04-26T12:50:39.945866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:09.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315720+0000","last_change":"2024-04-26T12:49:54.259672+0000","last_active":"2024-04-26T12:50:34.315720+0000","last_peered":"2024-04-26T12:50:34.315720+0000","last_clean":"2024-04-26T12:50:34.315720+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:50:34.315720+0000","last_undegraded":"2024-04-26T12:50:34.315720+0000","last_fullsized":"2024-04-26T12:50:34.315720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:37.170988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315130+0000","last_change":"2024-04-26T12:49:58.226855+0000","last_active":"2024-04-26T12:50:34.315130+0000","last_peered":"2024-04-26T12:50:34.315130+0000","last_clean":"2024-04-26T12:50:34.315130+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:50:34.315130+0000","last_undegraded":"2024-04-26T12:50:34.315130+0000","last_fullsized":"2024-04-26T12:50:34.315130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:54.671649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.193653+0000","last_change":"2024-04-26T12:50:00.266320+0000","last_active":"2024-04-26T12:52:06.193653+0000","last_peered":"2024-04-26T12:52:06.193653+0000","last_clean":"2024-04-26T12:52:06.193653+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:52:06.193653+0000","last_undegraded":"2024-04-26T12:52:06.193653+0000","last_fullsized":"2024-04-26T12:52:06.193653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:27.322235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301745+0000","last_change":"2024-04-26T12:50:02.282972+0000","last_active":"2024-04-26T12:50:34.301745+0000","last_peered":"2024-04-26T12:50:34.301745+0000","last_clean":"2024-04-26T12:50:34.301745+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:50:34.301745+0000","last_undegraded":"2024-04-26T12:50:34.301745+0000","last_fullsized":"2024-04-26T12:50:34.301745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:31.666992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.783785+0000","last_change":"2024-04-26T12:50:04.286573+0000","last_active":"2024-04-26T12:52:05.783785+0000","last_peered":"2024-04-26T12:52:05.783785+0000","last_clean":"2024-04-26T12:52:05.783785+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:52:05.783785+0000","last_undegraded":"2024-04-26T12:52:05.783785+0000","last_fullsized":"2024-04-26T12:52:05.783785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:44.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420386+0000","last_change":"2024-04-26T12:50:34.331364+0000","last_active":"2024-04-26T12:53:09.420386+0000","last_peered":"2024-04-26T12:53:09.420386+0000","last_clean":"2024-04-26T12:53:09.420386+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:53:09.420386+0000","last_undegraded":"2024-04-26T12:53:09.420386+0000","last_fullsized":"2024-04-26T12:53:09.420386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:32.541941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299076+0000","last_change":"2024-04-26T12:49:54.242795+0000","last_active":"2024-04-26T12:50:34.299076+0000","last_peered":"2024-04-26T12:50:34.299076+0000","last_clean":"2024-04-26T12:50:34.299076+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:50:34.299076+0000","last_undegraded":"2024-04-26T12:50:34.299076+0000","last_fullsized":"2024-04-26T12:50:34.299076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.327731+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:50:34.327731+0000","last_peered":"2024-04-26T12:50:34.327731+0000","last_clean":"2024-04-26T12:50:34.327731+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:50:34.327731+0000","last_undegraded":"2024-04-26T12:50:34.327731+0000","last_fullsized":"2024-04-26T12:50:34.327731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.316527+0000","last_change":"2024-04-26T12:50:00.232187+0000","last_active":"2024-04-26T12:53:08.316527+0000","last_peered":"2024-04-26T12:53:08.316527+0000","last_clean":"2024-04-26T12:53:08.316527+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:08.316527+0000","last_undegraded":"2024-04-26T12:53:08.316527+0000","last_fullsized":"2024-04-26T12:53:08.316527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:53.956543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295434+0000","last_change":"2024-04-26T12:50:02.285124+0000","last_active":"2024-04-26T12:50:34.295434+0000","last_peered":"2024-04-26T12:50:34.295434+0000","last_clean":"2024-04-26T12:50:34.295434+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:50:34.295434+0000","last_undegraded":"2024-04-26T12:50:34.295434+0000","last_fullsized":"2024-04-26T12:50:34.295434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.429582+0000","last_change":"2024-04-26T12:50:04.281861+0000","last_active":"2024-04-26T12:53:08.429582+0000","last_peered":"2024-04-26T12:53:08.429582+0000","last_clean":"2024-04-26T12:53:08.429582+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:08.429582+0000","last_undegraded":"2024-04-26T12:53:08.429582+0000","last_fullsized":"2024-04-26T12:53:08.429582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:06.429465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'15","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.947547+0000","last_change":"2024-04-26T12:49:56.221075+0000","last_active":"2024-04-26T12:53:08.947547+0000","last_peered":"2024-04-26T12:53:08.947547+0000","last_clean":"2024-04-26T12:53:08.947547+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:08.947547+0000","last_undegraded":"2024-04-26T12:53:08.947547+0000","last_fullsized":"2024-04-26T12:53:08.947547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:49.834778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304429+0000","last_change":"2024-04-26T12:49:54.248072+0000","last_active":"2024-04-26T12:50:34.304429+0000","last_peered":"2024-04-26T12:50:34.304429+0000","last_clean":"2024-04-26T12:50:34.304429+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:50:34.304429+0000","last_undegraded":"2024-04-26T12:50:34.304429+0000","last_fullsized":"2024-04-26T12:50:34.304429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.294648+0000","last_change":"2024-04-26T12:49:58.227451+0000","last_active":"2024-04-26T12:50:34.294648+0000","last_peered":"2024-04-26T12:50:34.294648+0000","last_clean":"2024-04-26T12:50:34.294648+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:50:34.294648+0000","last_undegraded":"2024-04-26T12:50:34.294648+0000","last_fullsized":"2024-04-26T12:50:34.294648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:46.024249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.399673+0000","last_change":"2024-04-26T12:50:00.233555+0000","last_active":"2024-04-26T12:53:08.399673+0000","last_peered":"2024-04-26T12:53:08.399673+0000","last_clean":"2024-04-26T12:53:08.399673+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:08.399673+0000","last_undegraded":"2024-04-26T12:53:08.399673+0000","last_fullsized":"2024-04-26T12:53:08.399673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:46.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310963+0000","last_change":"2024-04-26T12:50:02.272652+0000","last_active":"2024-04-26T12:50:34.310963+0000","last_peered":"2024-04-26T12:50:34.310963+0000","last_clean":"2024-04-26T12:50:34.310963+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:50:34.310963+0000","last_undegraded":"2024-04-26T12:50:34.310963+0000","last_fullsized":"2024-04-26T12:50:34.310963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:01.660724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.007347+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:51:23.007347+0000","last_peered":"2024-04-26T12:51:23.007347+0000","last_clean":"2024-04-26T12:51:23.007347+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:51:23.007347+0000","last_undegraded":"2024-04-26T12:51:23.007347+0000","last_fullsized":"2024-04-26T12:51:23.007347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:09.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.931477+0000","last_change":"2024-04-26T12:49:56.230150+0000","last_active":"2024-04-26T12:53:08.931477+0000","last_peered":"2024-04-26T12:53:08.931477+0000","last_clean":"2024-04-26T12:53:08.931477+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:08.931477+0000","last_undegraded":"2024-04-26T12:53:08.931477+0000","last_fullsized":"2024-04-26T12:53:08.931477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:24.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318667+0000","last_change":"2024-04-26T12:49:54.238487+0000","last_active":"2024-04-26T12:50:34.318667+0000","last_peered":"2024-04-26T12:50:34.318667+0000","last_clean":"2024-04-26T12:50:34.318667+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:50:34.318667+0000","last_undegraded":"2024-04-26T12:50:34.318667+0000","last_fullsized":"2024-04-26T12:50:34.318667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302190+0000","last_change":"2024-04-26T12:49:58.244563+0000","last_active":"2024-04-26T12:50:34.302190+0000","last_peered":"2024-04-26T12:50:34.302190+0000","last_clean":"2024-04-26T12:50:34.302190+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:50:34.302190+0000","last_undegraded":"2024-04-26T12:50:34.302190+0000","last_fullsized":"2024-04-26T12:50:34.302190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:44.871146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.170865+0000","last_change":"2024-04-26T12:50:00.240164+0000","last_active":"2024-04-26T12:52:06.170865+0000","last_peered":"2024-04-26T12:52:06.170865+0000","last_clean":"2024-04-26T12:52:06.170865+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:52:06.170865+0000","last_undegraded":"2024-04-26T12:52:06.170865+0000","last_fullsized":"2024-04-26T12:52:06.170865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:31.464728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295743+0000","last_change":"2024-04-26T12:50:02.264233+0000","last_active":"2024-04-26T12:50:34.295743+0000","last_peered":"2024-04-26T12:50:34.295743+0000","last_clean":"2024-04-26T12:50:34.295743+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:50:34.295743+0000","last_undegraded":"2024-04-26T12:50:34.295743+0000","last_fullsized":"2024-04-26T12:50:34.295743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:01.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420751+0000","last_change":"2024-04-26T12:49:56.232004+0000","last_active":"2024-04-26T12:53:09.420751+0000","last_peered":"2024-04-26T12:53:09.420751+0000","last_clean":"2024-04-26T12:53:09.420751+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:09.420751+0000","last_undegraded":"2024-04-26T12:53:09.420751+0000","last_fullsized":"2024-04-26T12:53:09.420751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:47.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300624+0000","last_change":"2024-04-26T12:49:54.241633+0000","last_active":"2024-04-26T12:50:34.300624+0000","last_peered":"2024-04-26T12:50:34.300624+0000","last_clean":"2024-04-26T12:50:34.300624+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:50:34.300624+0000","last_undegraded":"2024-04-26T12:50:34.300624+0000","last_fullsized":"2024-04-26T12:50:34.300624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:03.751774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'4","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.728988+0000","last_change":"2024-04-26T12:49:58.224668+0000","last_active":"2024-04-26T12:52:07.728988+0000","last_peered":"2024-04-26T12:52:07.728988+0000","last_clean":"2024-04-26T12:52:07.728988+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:52:07.728988+0000","last_undegraded":"2024-04-26T12:52:07.728988+0000","last_fullsized":"2024-04-26T12:52:07.728988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:46.613363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'54","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.202377+0000","last_change":"2024-04-26T12:50:00.242408+0000","last_active":"2024-04-26T12:52:06.202377+0000","last_peered":"2024-04-26T12:52:06.202377+0000","last_clean":"2024-04-26T12:52:06.202377+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:52:06.202377+0000","last_undegraded":"2024-04-26T12:52:06.202377+0000","last_fullsized":"2024-04-26T12:52:06.202377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:41.899361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295358+0000","last_change":"2024-04-26T12:50:02.272171+0000","last_active":"2024-04-26T12:50:34.295358+0000","last_peered":"2024-04-26T12:50:34.295358+0000","last_clean":"2024-04-26T12:50:34.295358+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:50:34.295358+0000","last_undegraded":"2024-04-26T12:50:34.295358+0000","last_fullsized":"2024-04-26T12:50:34.295358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:30.101175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.128428+0000","last_change":"2024-04-26T12:50:04.281931+0000","last_active":"2024-04-26T12:52:08.128428+0000","last_peered":"2024-04-26T12:52:08.128428+0000","last_clean":"2024-04-26T12:52:08.128428+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:52:08.128428+0000","last_undegraded":"2024-04-26T12:52:08.128428+0000","last_fullsized":"2024-04-26T12:52:08.128428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:16.500952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:40.677407+0000","last_change":"2024-04-26T12:49:56.224826+0000","last_active":"2024-04-26T12:50:40.677407+0000","last_peered":"2024-04-26T12:50:40.677407+0000","last_clean":"2024-04-26T12:50:40.677407+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:50:40.677407+0000","last_undegraded":"2024-04-26T12:50:40.677407+0000","last_fullsized":"2024-04-26T12:50:40.677407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:46.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305246+0000","last_change":"2024-04-26T12:49:54.243620+0000","last_active":"2024-04-26T12:50:34.305246+0000","last_peered":"2024-04-26T12:50:34.305246+0000","last_clean":"2024-04-26T12:50:34.305246+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:50:34.305246+0000","last_undegraded":"2024-04-26T12:50:34.305246+0000","last_fullsized":"2024-04-26T12:50:34.305246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303655+0000","last_change":"2024-04-26T12:49:58.220247+0000","last_active":"2024-04-26T12:50:34.303655+0000","last_peered":"2024-04-26T12:50:34.303655+0000","last_clean":"2024-04-26T12:50:34.303655+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:50:34.303655+0000","last_undegraded":"2024-04-26T12:50:34.303655+0000","last_fullsized":"2024-04-26T12:50:34.303655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:55.363024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.172034+0000","last_change":"2024-04-26T12:50:00.270194+0000","last_active":"2024-04-26T12:52:06.172034+0000","last_peered":"2024-04-26T12:52:06.172034+0000","last_clean":"2024-04-26T12:52:06.172034+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:52:06.172034+0000","last_undegraded":"2024-04-26T12:52:06.172034+0000","last_fullsized":"2024-04-26T12:52:06.172034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:34.153884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308720+0000","last_change":"2024-04-26T12:50:02.286102+0000","last_active":"2024-04-26T12:50:34.308720+0000","last_peered":"2024-04-26T12:50:34.308720+0000","last_clean":"2024-04-26T12:50:34.308720+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:50:34.308720+0000","last_undegraded":"2024-04-26T12:50:34.308720+0000","last_fullsized":"2024-04-26T12:50:34.308720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:48.894931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301117+0000","last_change":"2024-04-26T12:50:04.302095+0000","last_active":"2024-04-26T12:50:34.301117+0000","last_peered":"2024-04-26T12:50:34.301117+0000","last_clean":"2024-04-26T12:50:34.301117+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:50:34.301117+0000","last_undegraded":"2024-04-26T12:50:34.301117+0000","last_fullsized":"2024-04-26T12:50:34.301117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:22.017086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067641+0000","last_change":"2024-04-26T12:49:56.232608+0000","last_active":"2024-04-26T12:53:09.067641+0000","last_peered":"2024-04-26T12:53:09.067641+0000","last_clean":"2024-04-26T12:53:09.067641+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:09.067641+0000","last_undegraded":"2024-04-26T12:53:09.067641+0000","last_fullsized":"2024-04-26T12:53:09.067641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:33.707470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.311238+0000","last_change":"2024-04-26T12:49:54.229682+0000","last_active":"2024-04-26T12:50:34.311238+0000","last_peered":"2024-04-26T12:50:34.311238+0000","last_clean":"2024-04-26T12:50:34.311238+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:50:34.311238+0000","last_undegraded":"2024-04-26T12:50:34.311238+0000","last_fullsized":"2024-04-26T12:50:34.311238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295742+0000","last_change":"2024-04-26T12:49:58.218998+0000","last_active":"2024-04-26T12:50:34.295742+0000","last_peered":"2024-04-26T12:50:34.295742+0000","last_clean":"2024-04-26T12:50:34.295742+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:50:34.295742+0000","last_undegraded":"2024-04-26T12:50:34.295742+0000","last_fullsized":"2024-04-26T12:50:34.295742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:57.143731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.762812+0000","last_change":"2024-04-26T12:50:00.239798+0000","last_active":"2024-04-26T12:52:05.762812+0000","last_peered":"2024-04-26T12:52:05.762812+0000","last_clean":"2024-04-26T12:52:05.762812+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:52:05.762812+0000","last_undegraded":"2024-04-26T12:52:05.762812+0000","last_fullsized":"2024-04-26T12:52:05.762812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:35.710193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301139+0000","last_change":"2024-04-26T12:50:02.273673+0000","last_active":"2024-04-26T12:50:34.301139+0000","last_peered":"2024-04-26T12:50:34.301139+0000","last_clean":"2024-04-26T12:50:34.301139+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:50:34.301139+0000","last_undegraded":"2024-04-26T12:50:34.301139+0000","last_fullsized":"2024-04-26T12:50:34.301139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:50.707635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.274746+0000","last_change":"2024-04-26T12:50:04.302374+0000","last_active":"2024-04-26T12:52:08.274746+0000","last_peered":"2024-04-26T12:52:08.274746+0000","last_clean":"2024-04-26T12:52:08.274746+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:52:08.274746+0000","last_undegraded":"2024-04-26T12:52:08.274746+0000","last_fullsized":"2024-04-26T12:52:08.274746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:28.339845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303315+0000","last_change":"2024-04-26T12:49:56.219301+0000","last_active":"2024-04-26T12:50:34.303315+0000","last_peered":"2024-04-26T12:50:34.303315+0000","last_clean":"2024-04-26T12:50:34.303315+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:50:34.303315+0000","last_undegraded":"2024-04-26T12:50:34.303315+0000","last_fullsized":"2024-04-26T12:50:34.303315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:09.581494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308258+0000","last_change":"2024-04-26T12:49:54.253819+0000","last_active":"2024-04-26T12:50:34.308258+0000","last_peered":"2024-04-26T12:50:34.308258+0000","last_clean":"2024-04-26T12:50:34.308258+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:50:34.308258+0000","last_undegraded":"2024-04-26T12:50:34.308258+0000","last_fullsized":"2024-04-26T12:50:34.308258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:40.717814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319765+0000","last_change":"2024-04-26T12:49:58.227003+0000","last_active":"2024-04-26T12:50:34.319765+0000","last_peered":"2024-04-26T12:50:34.319765+0000","last_clean":"2024-04-26T12:50:34.319765+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:50:34.319765+0000","last_undegraded":"2024-04-26T12:50:34.319765+0000","last_fullsized":"2024-04-26T12:50:34.319765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:18.551779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322080+0000","last_change":"2024-04-26T12:50:00.272784+0000","last_active":"2024-04-26T12:50:34.322080+0000","last_peered":"2024-04-26T12:50:34.322080+0000","last_clean":"2024-04-26T12:50:34.322080+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:50:34.322080+0000","last_undegraded":"2024-04-26T12:50:34.322080+0000","last_fullsized":"2024-04-26T12:50:34.322080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":418,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.433170+0000","last_change":"2024-04-26T12:50:02.294579+0000","last_active":"2024-04-26T12:53:09.433170+0000","last_peered":"2024-04-26T12:53:09.433170+0000","last_clean":"2024-04-26T12:53:09.433170+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:09.433170+0000","last_undegraded":"2024-04-26T12:53:09.433170+0000","last_fullsized":"2024-04-26T12:53:09.433170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:13.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299552+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:50:34.299552+0000","last_peered":"2024-04-26T12:50:34.299552+0000","last_clean":"2024-04-26T12:50:34.299552+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:50:34.299552+0000","last_undegraded":"2024-04-26T12:50:34.299552+0000","last_fullsized":"2024-04-26T12:50:34.299552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:52.067129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'23","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.283786+0000","last_change":"2024-04-26T12:49:56.213304+0000","last_active":"2024-04-26T12:53:09.283786+0000","last_peered":"2024-04-26T12:53:09.283786+0000","last_clean":"2024-04-26T12:53:09.283786+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:09.283786+0000","last_undegraded":"2024-04-26T12:53:09.283786+0000","last_fullsized":"2024-04-26T12:53:09.283786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:27.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315379+0000","last_change":"2024-04-26T12:49:54.247955+0000","last_active":"2024-04-26T12:50:34.315379+0000","last_peered":"2024-04-26T12:50:34.315379+0000","last_clean":"2024-04-26T12:50:34.315379+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:50:34.315379+0000","last_undegraded":"2024-04-26T12:50:34.315379+0000","last_fullsized":"2024-04-26T12:50:34.315379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313932+0000","last_change":"2024-04-26T12:49:58.227232+0000","last_active":"2024-04-26T12:50:34.313932+0000","last_peered":"2024-04-26T12:50:34.313932+0000","last_clean":"2024-04-26T12:50:34.313932+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:50:34.313932+0000","last_undegraded":"2024-04-26T12:50:34.313932+0000","last_fullsized":"2024-04-26T12:50:34.313932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:55.045703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.157449+0000","last_change":"2024-04-26T12:50:00.233705+0000","last_active":"2024-04-26T12:52:06.157449+0000","last_peered":"2024-04-26T12:52:06.157449+0000","last_clean":"2024-04-26T12:52:06.157449+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:52:06.157449+0000","last_undegraded":"2024-04-26T12:52:06.157449+0000","last_fullsized":"2024-04-26T12:52:06.157449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:28.085543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297060+0000","last_change":"2024-04-26T12:50:02.271715+0000","last_active":"2024-04-26T12:50:34.297060+0000","last_peered":"2024-04-26T12:50:34.297060+0000","last_clean":"2024-04-26T12:50:34.297060+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:50:34.297060+0000","last_undegraded":"2024-04-26T12:50:34.297060+0000","last_fullsized":"2024-04-26T12:50:34.297060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:04.365884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319372+0000","last_change":"2024-04-26T12:50:04.283754+0000","last_active":"2024-04-26T12:50:34.319372+0000","last_peered":"2024-04-26T12:50:34.319372+0000","last_clean":"2024-04-26T12:50:34.319372+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:50:34.319372+0000","last_undegraded":"2024-04-26T12:50:34.319372+0000","last_fullsized":"2024-04-26T12:50:34.319372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:32.583019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295908+0000","last_change":"2024-04-26T12:49:56.216716+0000","last_active":"2024-04-26T12:50:34.295908+0000","last_peered":"2024-04-26T12:50:34.295908+0000","last_clean":"2024-04-26T12:50:34.295908+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:50:34.295908+0000","last_undegraded":"2024-04-26T12:50:34.295908+0000","last_fullsized":"2024-04-26T12:50:34.295908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:46.747501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316296+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:50:34.316296+0000","last_peered":"2024-04-26T12:50:34.316296+0000","last_clean":"2024-04-26T12:50:34.316296+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:50:34.316296+0000","last_undegraded":"2024-04-26T12:50:34.316296+0000","last_fullsized":"2024-04-26T12:50:34.316296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:12.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298228+0000","last_change":"2024-04-26T12:49:58.219225+0000","last_active":"2024-04-26T12:50:34.298228+0000","last_peered":"2024-04-26T12:50:34.298228+0000","last_clean":"2024-04-26T12:50:34.298228+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:50:34.298228+0000","last_undegraded":"2024-04-26T12:50:34.298228+0000","last_fullsized":"2024-04-26T12:50:34.298228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:14.134748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.158832+0000","last_change":"2024-04-26T12:50:00.239861+0000","last_active":"2024-04-26T12:52:06.158832+0000","last_peered":"2024-04-26T12:52:06.158832+0000","last_clean":"2024-04-26T12:52:06.158832+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:52:06.158832+0000","last_undegraded":"2024-04-26T12:52:06.158832+0000","last_fullsized":"2024-04-26T12:52:06.158832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:31.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301391+0000","last_change":"2024-04-26T12:50:02.287940+0000","last_active":"2024-04-26T12:50:34.301391+0000","last_peered":"2024-04-26T12:50:34.301391+0000","last_clean":"2024-04-26T12:50:34.301391+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:50:34.301391+0000","last_undegraded":"2024-04-26T12:50:34.301391+0000","last_fullsized":"2024-04-26T12:50:34.301391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:02.592328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315974+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:50:34.315974+0000","last_peered":"2024-04-26T12:50:34.315974+0000","last_clean":"2024-04-26T12:50:34.315974+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:50:34.315974+0000","last_undegraded":"2024-04-26T12:50:34.315974+0000","last_fullsized":"2024-04-26T12:50:34.315974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:25.596341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420535+0000","last_change":"2024-04-26T12:49:56.223405+0000","last_active":"2024-04-26T12:53:09.420535+0000","last_peered":"2024-04-26T12:53:09.420535+0000","last_clean":"2024-04-26T12:53:09.420535+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:53:09.420535+0000","last_undegraded":"2024-04-26T12:53:09.420535+0000","last_fullsized":"2024-04-26T12:53:09.420535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:55.440404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303556+0000","last_change":"2024-04-26T12:49:54.239137+0000","last_active":"2024-04-26T12:50:34.303556+0000","last_peered":"2024-04-26T12:50:34.303556+0000","last_clean":"2024-04-26T12:50:34.303556+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:50:34.303556+0000","last_undegraded":"2024-04-26T12:50:34.303556+0000","last_fullsized":"2024-04-26T12:50:34.303556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:18.714967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304001+0000","last_change":"2024-04-26T12:49:58.241371+0000","last_active":"2024-04-26T12:50:34.304001+0000","last_peered":"2024-04-26T12:50:34.304001+0000","last_clean":"2024-04-26T12:50:34.304001+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:50:34.304001+0000","last_undegraded":"2024-04-26T12:50:34.304001+0000","last_fullsized":"2024-04-26T12:50:34.304001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:35.312565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'27","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.291600+0000","last_change":"2024-04-26T12:50:00.270650+0000","last_active":"2024-04-26T12:52:08.291600+0000","last_peered":"2024-04-26T12:52:08.291600+0000","last_clean":"2024-04-26T12:52:08.291600+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:52:08.291600+0000","last_undegraded":"2024-04-26T12:52:08.291600+0000","last_fullsized":"2024-04-26T12:52:08.291600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:56.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306598+0000","last_change":"2024-04-26T12:50:02.288529+0000","last_active":"2024-04-26T12:50:34.306598+0000","last_peered":"2024-04-26T12:50:34.306598+0000","last_clean":"2024-04-26T12:50:34.306598+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:50:34.306598+0000","last_undegraded":"2024-04-26T12:50:34.306598+0000","last_fullsized":"2024-04-26T12:50:34.306598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:56.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.279169+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:08.279169+0000","last_peered":"2024-04-26T12:52:08.279169+0000","last_clean":"2024-04-26T12:52:08.279169+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:08.279169+0000","last_undegraded":"2024-04-26T12:52:08.279169+0000","last_fullsized":"2024-04-26T12:52:08.279169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:19.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.013381+0000","last_change":"2024-04-26T12:49:56.215521+0000","last_active":"2024-04-26T12:51:23.013381+0000","last_peered":"2024-04-26T12:51:23.013381+0000","last_clean":"2024-04-26T12:51:23.013381+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:51:23.013381+0000","last_undegraded":"2024-04-26T12:51:23.013381+0000","last_fullsized":"2024-04-26T12:51:23.013381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:02.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.788018+0000","last_change":"2024-04-26T12:49:54.245556+0000","last_active":"2024-04-26T12:53:08.788018+0000","last_peered":"2024-04-26T12:53:08.788018+0000","last_clean":"2024-04-26T12:53:08.788018+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:53:08.788018+0000","last_undegraded":"2024-04-26T12:53:08.788018+0000","last_fullsized":"2024-04-26T12:53:08.788018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:04.471472+0000","last_change":"2024-04-26T12:49:58.241812+0000","last_active":"2024-04-26T12:52:04.471472+0000","last_peered":"2024-04-26T12:52:04.471472+0000","last_clean":"2024-04-26T12:52:04.471472+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:52:04.471472+0000","last_undegraded":"2024-04-26T12:52:04.471472+0000","last_fullsized":"2024-04-26T12:52:04.471472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:49.780417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'32","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.318263+0000","last_change":"2024-04-26T12:50:00.271893+0000","last_active":"2024-04-26T12:53:08.318263+0000","last_peered":"2024-04-26T12:53:08.318263+0000","last_clean":"2024-04-26T12:53:08.318263+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:08.318263+0000","last_undegraded":"2024-04-26T12:53:08.318263+0000","last_fullsized":"2024-04-26T12:53:08.318263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:36.554225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299396+0000","last_change":"2024-04-26T12:50:02.271711+0000","last_active":"2024-04-26T12:50:34.299396+0000","last_peered":"2024-04-26T12:50:34.299396+0000","last_clean":"2024-04-26T12:50:34.299396+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:50:34.299396+0000","last_undegraded":"2024-04-26T12:50:34.299396+0000","last_fullsized":"2024-04-26T12:50:34.299396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:58.972643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.217037+0000","last_change":"2024-04-26T12:50:04.302279+0000","last_active":"2024-04-26T12:52:06.217037+0000","last_peered":"2024-04-26T12:52:06.217037+0000","last_clean":"2024-04-26T12:52:06.217037+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:52:06.217037+0000","last_undegraded":"2024-04-26T12:52:06.217037+0000","last_fullsized":"2024-04-26T12:52:06.217037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:45.287306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.350011+0000","last_change":"2024-04-26T12:49:56.234400+0000","last_active":"2024-04-26T12:53:09.350011+0000","last_peered":"2024-04-26T12:53:09.350011+0000","last_clean":"2024-04-26T12:53:09.350011+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:09.350011+0000","last_undegraded":"2024-04-26T12:53:09.350011+0000","last_fullsized":"2024-04-26T12:53:09.350011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:24.034799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.066998+0000","last_change":"2024-04-26T12:49:54.248434+0000","last_active":"2024-04-26T12:52:08.066998+0000","last_peered":"2024-04-26T12:52:08.066998+0000","last_clean":"2024-04-26T12:52:08.066998+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:52:08.066998+0000","last_undegraded":"2024-04-26T12:52:08.066998+0000","last_fullsized":"2024-04-26T12:52:08.066998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.419891+0000","last_change":"2024-04-26T12:49:56.215256+0000","last_active":"2024-04-26T12:53:09.419891+0000","last_peered":"2024-04-26T12:53:09.419891+0000","last_clean":"2024-04-26T12:53:09.419891+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:09.419891+0000","last_undegraded":"2024-04-26T12:53:09.419891+0000","last_fullsized":"2024-04-26T12:53:09.419891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:41.050135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297396+0000","last_change":"2024-04-26T12:49:54.242913+0000","last_active":"2024-04-26T12:50:34.297396+0000","last_peered":"2024-04-26T12:50:34.297396+0000","last_clean":"2024-04-26T12:50:34.297396+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:50:34.297396+0000","last_undegraded":"2024-04-26T12:50:34.297396+0000","last_fullsized":"2024-04-26T12:50:34.297396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:29.042508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265592+0000","last_change":"2024-04-26T12:49:56.225688+0000","last_active":"2024-04-26T12:53:09.265592+0000","last_peered":"2024-04-26T12:53:09.265592+0000","last_clean":"2024-04-26T12:53:09.265592+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:53:09.265592+0000","last_undegraded":"2024-04-26T12:53:09.265592+0000","last_fullsized":"2024-04-26T12:53:09.265592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:33.308436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963254+0000","last_change":"2024-04-26T12:49:54.236188+0000","last_active":"2024-04-26T12:52:02.963254+0000","last_peered":"2024-04-26T12:52:02.963254+0000","last_clean":"2024-04-26T12:52:02.963254+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:52:02.963254+0000","last_undegraded":"2024-04-26T12:52:02.963254+0000","last_fullsized":"2024-04-26T12:52:02.963254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:23.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.285259+0000","last_change":"2024-04-26T12:49:56.223112+0000","last_active":"2024-04-26T12:52:08.285259+0000","last_peered":"2024-04-26T12:52:08.285259+0000","last_clean":"2024-04-26T12:52:08.285259+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:52:08.285259+0000","last_undegraded":"2024-04-26T12:52:08.285259+0000","last_fullsized":"2024-04-26T12:52:08.285259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:24.739463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162110+0000","last_change":"2024-04-26T12:49:54.226434+0000","last_active":"2024-04-26T12:52:00.162110+0000","last_peered":"2024-04-26T12:52:00.162110+0000","last_clean":"2024-04-26T12:52:00.162110+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:52:00.162110+0000","last_undegraded":"2024-04-26T12:52:00.162110+0000","last_fullsized":"2024-04-26T12:52:00.162110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.586258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301648+0000","last_change":"2024-04-26T12:49:56.221387+0000","last_active":"2024-04-26T12:50:34.301648+0000","last_peered":"2024-04-26T12:50:34.301648+0000","last_clean":"2024-04-26T12:50:34.301648+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:50:34.301648+0000","last_undegraded":"2024-04-26T12:50:34.301648+0000","last_fullsized":"2024-04-26T12:50:34.301648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:33.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301072+0000","last_change":"2024-04-26T12:49:54.243199+0000","last_active":"2024-04-26T12:50:34.301072+0000","last_peered":"2024-04-26T12:50:34.301072+0000","last_clean":"2024-04-26T12:50:34.301072+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:50:34.301072+0000","last_undegraded":"2024-04-26T12:50:34.301072+0000","last_fullsized":"2024-04-26T12:50:34.301072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:36.903122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352717+0000","last_change":"2024-04-26T12:49:56.235320+0000","last_active":"2024-04-26T12:53:09.352717+0000","last_peered":"2024-04-26T12:53:09.352717+0000","last_clean":"2024-04-26T12:53:09.352717+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:09.352717+0000","last_undegraded":"2024-04-26T12:53:09.352717+0000","last_fullsized":"2024-04-26T12:53:09.352717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:12.130618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309160+0000","last_change":"2024-04-26T12:49:54.238503+0000","last_active":"2024-04-26T12:50:34.309160+0000","last_peered":"2024-04-26T12:50:34.309160+0000","last_clean":"2024-04-26T12:50:34.309160+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:50:34.309160+0000","last_undegraded":"2024-04-26T12:50:34.309160+0000","last_fullsized":"2024-04-26T12:50:34.309160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265292+0000","last_change":"2024-04-26T12:49:56.225647+0000","last_active":"2024-04-26T12:53:09.265292+0000","last_peered":"2024-04-26T12:53:09.265292+0000","last_clean":"2024-04-26T12:53:09.265292+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:53:09.265292+0000","last_undegraded":"2024-04-26T12:53:09.265292+0000","last_fullsized":"2024-04-26T12:53:09.265292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.813014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304680+0000","last_change":"2024-04-26T12:49:54.250162+0000","last_active":"2024-04-26T12:50:34.304680+0000","last_peered":"2024-04-26T12:50:34.304680+0000","last_clean":"2024-04-26T12:50:34.304680+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:50:34.304680+0000","last_undegraded":"2024-04-26T12:50:34.304680+0000","last_fullsized":"2024-04-26T12:50:34.304680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.958844+0000","last_change":"2024-04-26T12:49:56.231475+0000","last_active":"2024-04-26T12:52:02.958844+0000","last_peered":"2024-04-26T12:52:02.958844+0000","last_clean":"2024-04-26T12:52:02.958844+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:52:02.958844+0000","last_undegraded":"2024-04-26T12:52:02.958844+0000","last_fullsized":"2024-04-26T12:52:02.958844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439372+0000","last_change":"2024-04-26T12:49:54.229901+0000","last_active":"2024-04-26T12:50:38.439372+0000","last_peered":"2024-04-26T12:50:38.439372+0000","last_clean":"2024-04-26T12:50:38.439372+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:50:38.439372+0000","last_undegraded":"2024-04-26T12:50:38.439372+0000","last_fullsized":"2024-04-26T12:50:38.439372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:38.907969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.083486+0000","last_change":"2024-04-26T12:49:56.218286+0000","last_active":"2024-04-26T12:53:09.083486+0000","last_peered":"2024-04-26T12:53:09.083486+0000","last_clean":"2024-04-26T12:53:09.083486+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:09.083486+0000","last_undegraded":"2024-04-26T12:53:09.083486+0000","last_fullsized":"2024-04-26T12:53:09.083486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:17.751539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964028+0000","last_change":"2024-04-26T12:49:54.240647+0000","last_active":"2024-04-26T12:52:07.964028+0000","last_peered":"2024-04-26T12:52:07.964028+0000","last_clean":"2024-04-26T12:52:07.964028+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:52:07.964028+0000","last_undegraded":"2024-04-26T12:52:07.964028+0000","last_fullsized":"2024-04-26T12:52:07.964028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:55.293561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323510+0000","last_change":"2024-04-26T12:49:56.230003+0000","last_active":"2024-04-26T12:50:34.323510+0000","last_peered":"2024-04-26T12:50:34.323510+0000","last_clean":"2024-04-26T12:50:34.323510+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:50:34.323510+0000","last_undegraded":"2024-04-26T12:50:34.323510+0000","last_fullsized":"2024-04-26T12:50:34.323510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:12.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297885+0000","last_change":"2024-04-26T12:49:54.238656+0000","last_active":"2024-04-26T12:50:34.297885+0000","last_peered":"2024-04-26T12:50:34.297885+0000","last_clean":"2024-04-26T12:50:34.297885+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:50:34.297885+0000","last_undegraded":"2024-04-26T12:50:34.297885+0000","last_fullsized":"2024-04-26T12:50:34.297885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:36.879257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313256+0000","last_change":"2024-04-26T12:50:34.312404+0000","last_active":"2024-04-26T12:50:34.313256+0000","last_peered":"2024-04-26T12:50:34.313256+0000","last_clean":"2024-04-26T12:50:34.313256+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:50:34.313256+0000","last_undegraded":"2024-04-26T12:50:34.313256+0000","last_fullsized":"2024-04-26T12:50:34.313256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:47.220860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439966+0000","last_change":"2024-04-26T12:49:54.236940+0000","last_active":"2024-04-26T12:50:38.439966+0000","last_peered":"2024-04-26T12:50:38.439966+0000","last_clean":"2024-04-26T12:50:38.439966+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:50:38.439966+0000","last_undegraded":"2024-04-26T12:50:38.439966+0000","last_fullsized":"2024-04-26T12:50:38.439966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960904+0000","last_change":"2024-04-26T12:49:56.231000+0000","last_active":"2024-04-26T12:52:12.960904+0000","last_peered":"2024-04-26T12:52:12.960904+0000","last_clean":"2024-04-26T12:52:12.960904+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:52:12.960904+0000","last_undegraded":"2024-04-26T12:52:12.960904+0000","last_fullsized":"2024-04-26T12:52:12.960904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:23.072591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.252156+0000","last_change":"2024-04-26T12:49:54.233875+0000","last_active":"2024-04-26T12:53:09.252156+0000","last_peered":"2024-04-26T12:53:09.252156+0000","last_clean":"2024-04-26T12:53:09.252156+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:53:09.252156+0000","last_undegraded":"2024-04-26T12:53:09.252156+0000","last_fullsized":"2024-04-26T12:53:09.252156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352765+0000","last_change":"2024-04-26T12:49:56.234879+0000","last_active":"2024-04-26T12:53:09.352765+0000","last_peered":"2024-04-26T12:53:09.352765+0000","last_clean":"2024-04-26T12:53:09.352765+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:09.352765+0000","last_undegraded":"2024-04-26T12:53:09.352765+0000","last_fullsized":"2024-04-26T12:53:09.352765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:36.234142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316217+0000","last_change":"2024-04-26T12:49:54.252713+0000","last_active":"2024-04-26T12:50:34.316217+0000","last_peered":"2024-04-26T12:50:34.316217+0000","last_clean":"2024-04-26T12:50:34.316217+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:50:34.316217+0000","last_undegraded":"2024-04-26T12:50:34.316217+0000","last_fullsized":"2024-04-26T12:50:34.316217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:16.359098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.927242+0000","last_change":"2024-04-26T12:49:56.223432+0000","last_active":"2024-04-26T12:53:08.927242+0000","last_peered":"2024-04-26T12:53:08.927242+0000","last_clean":"2024-04-26T12:53:08.927242+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:08.927242+0000","last_undegraded":"2024-04-26T12:53:08.927242+0000","last_fullsized":"2024-04-26T12:53:08.927242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316540+0000","last_change":"2024-04-26T12:49:54.258313+0000","last_active":"2024-04-26T12:50:34.316540+0000","last_peered":"2024-04-26T12:50:34.316540+0000","last_clean":"2024-04-26T12:50:34.316540+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:50:34.316540+0000","last_undegraded":"2024-04-26T12:50:34.316540+0000","last_fullsized":"2024-04-26T12:50:34.316540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:25.040941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265442+0000","last_change":"2024-04-26T12:49:56.228594+0000","last_active":"2024-04-26T12:53:09.265442+0000","last_peered":"2024-04-26T12:53:09.265442+0000","last_clean":"2024-04-26T12:53:09.265442+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:53:09.265442+0000","last_undegraded":"2024-04-26T12:53:09.265442+0000","last_fullsized":"2024-04-26T12:53:09.265442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:49.872348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305357+0000","last_change":"2024-04-26T12:49:54.248935+0000","last_active":"2024-04-26T12:50:34.305357+0000","last_peered":"2024-04-26T12:50:34.305357+0000","last_clean":"2024-04-26T12:50:34.305357+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:50:34.305357+0000","last_undegraded":"2024-04-26T12:50:34.305357+0000","last_fullsized":"2024-04-26T12:50:34.305357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:16.074935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.268306+0000","last_change":"2024-04-26T12:49:56.231485+0000","last_active":"2024-04-26T12:52:08.268306+0000","last_peered":"2024-04-26T12:52:08.268306+0000","last_clean":"2024-04-26T12:52:08.268306+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:52:08.268306+0000","last_undegraded":"2024-04-26T12:52:08.268306+0000","last_fullsized":"2024-04-26T12:52:08.268306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966922+0000","last_change":"2024-04-26T12:49:54.258409+0000","last_active":"2024-04-26T12:52:17.966922+0000","last_peered":"2024-04-26T12:52:17.966922+0000","last_clean":"2024-04-26T12:52:17.966922+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:52:17.966922+0000","last_undegraded":"2024-04-26T12:52:17.966922+0000","last_fullsized":"2024-04-26T12:52:17.966922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:44.743239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301388+0000","last_change":"2024-04-26T12:49:54.241113+0000","last_active":"2024-04-26T12:50:34.301388+0000","last_peered":"2024-04-26T12:50:34.301388+0000","last_clean":"2024-04-26T12:50:34.301388+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:50:34.301388+0000","last_undegraded":"2024-04-26T12:50:34.301388+0000","last_fullsized":"2024-04-26T12:50:34.301388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.409242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352305+0000","last_change":"2024-04-26T12:49:56.227407+0000","last_active":"2024-04-26T12:53:09.352305+0000","last_peered":"2024-04-26T12:53:09.352305+0000","last_clean":"2024-04-26T12:53:09.352305+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:09.352305+0000","last_undegraded":"2024-04-26T12:53:09.352305+0000","last_fullsized":"2024-04-26T12:53:09.352305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:50.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.910309+0000","last_change":"2024-04-26T12:49:54.244752+0000","last_active":"2024-04-26T12:50:39.910309+0000","last_peered":"2024-04-26T12:50:39.910309+0000","last_clean":"2024-04-26T12:50:39.910309+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:50:39.910309+0000","last_undegraded":"2024-04-26T12:50:39.910309+0000","last_fullsized":"2024-04-26T12:50:39.910309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.113655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.011511+0000","last_change":"2024-04-26T12:49:56.232881+0000","last_active":"2024-04-26T12:51:23.011511+0000","last_peered":"2024-04-26T12:51:23.011511+0000","last_clean":"2024-04-26T12:51:23.011511+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:51:23.011511+0000","last_undegraded":"2024-04-26T12:51:23.011511+0000","last_fullsized":"2024-04-26T12:51:23.011511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:53.358894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46376,"kb_used_data":11040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325464,"statfs":{"total":96636764160,"available":96589275136,"internally_reserved":0,"allocated":11304960,"data_stored":10964681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48932,"kb_used_data":13596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322908,"statfs":{"total":96636764160,"available":96586657792,"internally_reserved":0,"allocated":13922304,"data_stored":13647204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42500,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329340,"statfs":{"total":96636764160,"available":96593244160,"internally_reserved":0,"allocated":7335936,"data_stored":7033851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":8956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":9170944,"data_stored":8865182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:53:17.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f774a499640 1 Processor -- start 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f774a499640 1 -- start start 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f774a499640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f774412b470 0x7f774412b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f774a499640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7744092b10 con 0x7f774412e430 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f774a499640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7744092790 con 0x7f774412b470 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f7743fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f774412b470 0x7f774412b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f77437fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f774412e430 0x7f774412e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50246/0 (socket says 172.21.15.29:50246) 2024-04-26T12:53:17.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f77437fe640 1 -- 172.21.15.29:0/2341753860 learned_addr learned my addr 172.21.15.29:0/2341753860 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:17.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f7743fff640 1 -- 172.21.15.29:0/2341753860 >> v1:172.21.15.29:6789/0 conn(0x7f774412e430 legacy=0x7f774412e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f7743fff640 1 -- 172.21.15.29:0/2341753860 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774412bd90 con 0x7f774412b470 2024-04-26T12:53:17.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f7743fff640 1 --2- 172.21.15.29:0/2341753860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f774412b850 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7734009740 tx=0x7f773401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc04bf2e0739d00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:17.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f7742ffd640 1 -- 172.21.15.29:0/2341753860 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77340b0070 con 0x7f774412b470 2024-04-26T12:53:17.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f7742ffd640 1 -- 172.21.15.29:0/2341753860 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77340ab530 con 0x7f774412b470 2024-04-26T12:53:17.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.718+0000 7f7742ffd640 1 -- 172.21.15.29:0/2341753860 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77340ab830 con 0x7f774412b470 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2341753860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 msgr2=0x7f774412b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 --2- 172.21.15.29:0/2341753860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f774412b850 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7734009740 tx=0x7f773401c370 comp rx=0 tx=0).stop 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2341753860 shutdown_connections 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 --2- 172.21.15.29:0/2341753860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f774412b850 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2341753860 >> 172.21.15.29:0/2341753860 conn(0x7f77440a0c70 msgr2=0x7f77440a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2341753860 shutdown_connections 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2341753860 wait complete. 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 Processor -- start 2024-04-26T12:53:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- start start 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f7744071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7744137160 con 0x7f774412b470 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7743fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f7744071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7743fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f7744071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42758/0 (socket says 172.21.15.29:42758) 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7743fff640 1 -- 172.21.15.29:0/2953975622 learned_addr learned my addr 172.21.15.29:0/2953975622 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7743fff640 1 -- 172.21.15.29:0/2953975622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7744128240 con 0x7f774412b470 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7743fff640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f7744071740 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f77340ae040 tx=0x7f773401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7740ff9640 1 -- 172.21.15.29:0/2953975622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77340b0050 con 0x7f774412b470 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7740ff9640 1 -- 172.21.15.29:0/2953975622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77340b1040 con 0x7f774412b470 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7740ff9640 1 -- 172.21.15.29:0/2953975622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77340b5780 con 0x7f774412b470 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774412f780 con 0x7f774412b470 2024-04-26T12:53:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7744071c80 con 0x7f774412b470 2024-04-26T12:53:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7740ff9640 1 -- 172.21.15.29:0/2953975622 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f77340be030 con 0x7f774412b470 2024-04-26T12:53:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7744062f80 con 0x7f774412b470 2024-04-26T12:53:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7740ff9640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7724035db0 0x7f7724038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.722+0000 7f7740ff9640 1 -- 172.21.15.29:0/2953975622 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f77340bc070 con 0x7f774412b470 2024-04-26T12:53:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.726+0000 7f77437fe640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7724035db0 0x7f7724038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.726+0000 7f77437fe640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7724035db0 0x7f7724038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f772c001610 tx=0x7f772c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:17.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.730+0000 7f7740ff9640 1 -- 172.21.15.29:0/2953975622 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f77340c5060 con 0x7f774412b470 2024-04-26T12:53:17.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.894+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77440733c0 con 0x7f774412b470 2024-04-26T12:53:17.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f7740ff9640 1 -- 172.21.15.29:0/2953975622 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+20880 (secure 0 0 0) 0x7f7734015ff0 con 0x7f774412b470 2024-04-26T12:53:17.898 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:53:17.898 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":35,"fsid":"e9a80640-28c1-4a64-ae98-6666131f9984","created":"2024-04-26T12:49:27.360185+0000","modified":"2024-04-26T12:50:34.286811+0000","last_up_change":"2024-04-26T12:49:37.667209+0000","last_in_change":"2024-04-26T12:49:28.549061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:49:39.220591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:49:43.178365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T12:49:52.235849+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T12:49:54.587912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T12:49:56.480584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T12:49:58.396202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T12:50:00.315712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T12:50:02.447711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a486baa1-57d4-44e0-81e1-6c67d01653d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6801","nonce":1895601642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6803","nonce":1895601642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6807","nonce":1895601642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1895601642},{"type":"v1","addr":"172.21.15.29:6805","nonce":1895601642}]},"public_addr":"172.21.15.29:6801/1895601642","cluster_addr":"172.21.15.29:6803/1895601642","heartbeat_back_addr":"172.21.15.29:6807/1895601642","heartbeat_front_addr":"172.21.15.29:6805/1895601642","state":["exists","up"]},{"osd":1,"uuid":"58ac9945-efae-4b1c-bb23-e53958170e53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6817","nonce":1811201389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6819","nonce":1811201389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6823","nonce":1811201389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1811201389},{"type":"v1","addr":"172.21.15.72:6821","nonce":1811201389}]},"public_addr":"172.21.15.72:6817/1811201389","cluster_addr":"172.21.15.72:6819/1811201389","heartbeat_back_addr":"172.21.15.72:6823/1811201389","heartbeat_front_addr":"172.21.15.72:6821/1811201389","state":["exists","up"]},{"osd":2,"uuid":"152b72f4-b41a-429c-9f88-79befe0eae01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6801","nonce":1931234624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6803","nonce":1931234624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6807","nonce":1931234624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1931234624},{"type":"v1","addr":"172.21.15.72:6805","nonce":1931234624}]},"public_addr":"172.21.15.72:6801/1931234624","cluster_addr":"172.21.15.72:6803/1931234624","heartbeat_back_addr":"172.21.15.72:6807/1931234624","heartbeat_front_addr":"172.21.15.72:6805/1931234624","state":["exists","up"]},{"osd":3,"uuid":"ba649e3f-0dcb-4dbb-a39a-c7557b884273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6809","nonce":671626845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6811","nonce":671626845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6815","nonce":671626845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":671626845},{"type":"v1","addr":"172.21.15.72:6813","nonce":671626845}]},"public_addr":"172.21.15.72:6809/671626845","cluster_addr":"172.21.15.72:6811/671626845","heartbeat_back_addr":"172.21.15.72:6815/671626845","heartbeat_front_addr":"172.21.15.72:6813/671626845","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:33.883530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.050590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.032083+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:49:34.030129+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.2d","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:53:17.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7724035db0 msgr2=0x7f7724038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7724035db0 0x7f7724038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f772c001610 tx=0x7f772c007ad0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 msgr2=0x7f7744071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f7744071740 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f77340ae040 tx=0x7f773401abb0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 shutdown_connections 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7724035db0 0x7f7724038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 --2- 172.21.15.29:0/2953975622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f774412b470 0x7f7744071740 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 >> 172.21.15.29:0/2953975622 conn(0x7f77440a0c70 msgr2=0x7f774408e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 shutdown_connections 2024-04-26T12:53:17.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:17.898+0000 7f774a499640 1 -- 172.21.15.29:0/2953975622 wait complete. 2024-04-26T12:53:18.917 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:53:18.917 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:53:19.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f6995cb3640 1 Processor -- start 2024-04-26T12:53:19.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f6995cb3640 1 -- start start 2024-04-26T12:53:19.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f6995cb3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f699012c230 0x7f699012c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f6995cb3640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6990070460 con 0x7f699012cd70 2024-04-26T12:53:19.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f6995cb3640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f699012c610 con 0x7f699012c230 2024-04-26T12:53:19.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f698f7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f699012c230 0x7f699012c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f698effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f699012cd70 0x7f6990128d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50250/0 (socket says 172.21.15.29:50250) 2024-04-26T12:53:19.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f698effd640 1 -- 172.21.15.29:0/11323052 learned_addr learned my addr 172.21.15.29:0/11323052 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:19.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f698f7fe640 1 -- 172.21.15.29:0/11323052 >> v1:172.21.15.29:6789/0 conn(0x7f699012cd70 legacy=0x7f6990128d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f698e7fc640 1 -- 172.21.15.29:0/11323052 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266515283 0 0) 0x7f6990070460 con 0x7f699012cd70 2024-04-26T12:53:19.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.058+0000 7f698f7fe640 1 -- 172.21.15.29:0/11323052 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699008e850 con 0x7f699012c230 2024-04-26T12:53:19.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698f7fe640 1 --2- 172.21.15.29:0/11323052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f699012c830 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6980009740 tx=0x7f698001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da86650ff0acf8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698e7fc640 1 -- 172.21.15.29:0/11323052 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69800b0070 con 0x7f699012c230 2024-04-26T12:53:19.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698e7fc640 1 -- 172.21.15.29:0/11323052 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69800ab530 con 0x7f699012c230 2024-04-26T12:53:19.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698e7fc640 1 -- 172.21.15.29:0/11323052 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69800ab830 con 0x7f699012c230 2024-04-26T12:53:19.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 -- 172.21.15.29:0/11323052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 msgr2=0x7f699012c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 --2- 172.21.15.29:0/11323052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f699012c830 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6980009740 tx=0x7f698001c400 comp rx=0 tx=0).stop 2024-04-26T12:53:19.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 -- 172.21.15.29:0/11323052 shutdown_connections 2024-04-26T12:53:19.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 --2- 172.21.15.29:0/11323052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f699012c830 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 -- 172.21.15.29:0/11323052 >> 172.21.15.29:0/11323052 conn(0x7f699009b440 msgr2=0x7f699009b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 -- 172.21.15.29:0/11323052 shutdown_connections 2024-04-26T12:53:19.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 -- 172.21.15.29:0/11323052 wait complete. 2024-04-26T12:53:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 Processor -- start 2024-04-26T12:53:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 -- start start 2024-04-26T12:53:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f69901c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f6995cb3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f699008e430 con 0x7f699012c230 2024-04-26T12:53:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f69901c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f69901c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42764/0 (socket says 172.21.15.29:42764) 2024-04-26T12:53:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698f7fe640 1 -- 172.21.15.29:0/3289562549 learned_addr learned my addr 172.21.15.29:0/3289562549 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:19.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.062+0000 7f698f7fe640 1 -- 172.21.15.29:0/3289562549 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6990131a10 con 0x7f699012c230 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f698f7fe640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f69901c61e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f698001a030 tx=0x7f698001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69800bb070 con 0x7f699012c230 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699008bed0 con 0x7f699012c230 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6980004020 con 0x7f699012c230 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699006de10 con 0x7f699012c230 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69800b0040 con 0x7f699012c230 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6990062f80 con 0x7f699012c230 2024-04-26T12:53:19.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69800041d0 con 0x7f699012c230 2024-04-26T12:53:19.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f697c035d60 0x7f697c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f69800e3d20 con 0x7f699012c230 2024-04-26T12:53:19.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f697c042060 0x7f697c044500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6980006800 con 0x7f697c042060 2024-04-26T12:53:19.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f69800e6450 con 0x7f699012c230 2024-04-26T12:53:19.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f698ffff640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f697c042060 0x7f697c044500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f698effd640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f697c035d60 0x7f697c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f698ffff640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f697c042060 0x7f697c044500 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== osd.0 v2:172.21.15.29:6800/1895601642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6980006800 con 0x7f697c042060 2024-04-26T12:53:19.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.066+0000 7f698effd640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f697c035d60 0x7f697c038220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6984007fd0 tx=0x7f6984007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.078+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 --> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f699008de70 con 0x7f697c042060 2024-04-26T12:53:19.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6977fff640 1 -- 172.21.15.29:0/3289562549 <== osd.0 v2:172.21.15.29:6800/1895601642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f699008de70 con 0x7f697c042060 2024-04-26T12:53:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T12:53:19.082 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:53:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f697c042060 msgr2=0x7f697c044500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f697c042060 0x7f697c044500 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f697c035d60 msgr2=0x7f697c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f697c035d60 0x7f697c038220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6984007fd0 tx=0x7f6984007980 comp rx=0 tx=0).stop 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 msgr2=0x7f69901c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f69901c61e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f698001a030 tx=0x7f698001ac40 comp rx=0 tx=0).stop 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 shutdown_connections 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:6800/1895601642,v1:172.21.15.29:6801/1895601642] conn(0x7f697c042060 0x7f697c044500 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f697c035d60 0x7f697c038220 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 --2- 172.21.15.29:0/3289562549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f699012c230 0x7f69901c61e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 >> 172.21.15.29:0/3289562549 conn(0x7f699009b440 msgr2=0x7f6990127a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 shutdown_connections 2024-04-26T12:53:19.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.082+0000 7f6995cb3640 1 -- 172.21.15.29:0/3289562549 wait complete. 2024-04-26T12:53:19.098 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:53:19.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff1988aa640 1 Processor -- start 2024-04-26T12:53:19.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff1988aa640 1 -- start start 2024-04-26T12:53:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff1988aa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff194072b40 0x7ff1941313c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff1988aa640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff194070d60 con 0x7ff194070f60 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff1988aa640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff194113cd0 con 0x7ff194072b40 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff19259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff194070f60 0x7ff194071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50260/0 (socket says 172.21.15.29:50260) 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff19259c640 1 -- 172.21.15.29:0/2378979389 learned_addr learned my addr 172.21.15.29:0/2378979389 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff191d9b640 1 --2- 172.21.15.29:0/2378979389 >> v2:172.21.15.29:3300/0 conn(0x7ff194072b40 0x7ff1941313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff19159a640 1 -- 172.21.15.29:0/2378979389 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767971310 0 0) 0x7ff194070d60 con 0x7ff194070f60 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff19159a640 1 -- 172.21.15.29:0/2378979389 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff17c003530 con 0x7ff194070f60 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff191d9b640 1 -- 172.21.15.29:0/2378979389 >> v1:172.21.15.29:6789/0 conn(0x7ff194070f60 legacy=0x7ff194071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.210+0000 7ff191d9b640 1 -- 172.21.15.29:0/2378979389 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19406d080 con 0x7ff194072b40 2024-04-26T12:53:19.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff191d9b640 1 --2- 172.21.15.29:0/2378979389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194072b40 0x7ff1941313c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff184009740 tx=0x7ff18401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464670d55c1aeb40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff19159a640 1 -- 172.21.15.29:0/2378979389 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840b0070 con 0x7ff194072b40 2024-04-26T12:53:19.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff19159a640 1 -- 172.21.15.29:0/2378979389 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1840ab530 con 0x7ff194072b40 2024-04-26T12:53:19.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff19159a640 1 -- 172.21.15.29:0/2378979389 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840ab810 con 0x7ff194072b40 2024-04-26T12:53:19.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 -- 172.21.15.29:0/2378979389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194072b40 msgr2=0x7ff1941313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 --2- 172.21.15.29:0/2378979389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194072b40 0x7ff1941313c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff184009740 tx=0x7ff18401c370 comp rx=0 tx=0).stop 2024-04-26T12:53:19.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 -- 172.21.15.29:0/2378979389 shutdown_connections 2024-04-26T12:53:19.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 --2- 172.21.15.29:0/2378979389 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194072b40 0x7ff1941313c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 -- 172.21.15.29:0/2378979389 >> 172.21.15.29:0/2378979389 conn(0x7ff19409a310 msgr2=0x7ff19409a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 -- 172.21.15.29:0/2378979389 shutdown_connections 2024-04-26T12:53:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 -- 172.21.15.29:0/2378979389 wait complete. 2024-04-26T12:53:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 Processor -- start 2024-04-26T12:53:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.214+0000 7ff1988aa640 1 -- start start 2024-04-26T12:53:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff1988aa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194070f60 0x7ff19412f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff1988aa640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff1941344b0 con 0x7ff194070f60 2024-04-26T12:53:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff19259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194070f60 0x7ff19412f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff19259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194070f60 0x7ff19412f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42792/0 (socket says 172.21.15.29:42792) 2024-04-26T12:53:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff19259c640 1 -- 172.21.15.29:0/729540069 learned_addr learned my addr 172.21.15.29:0/729540069 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:19.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff19259c640 1 -- 172.21.15.29:0/729540069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff194130f40 con 0x7ff194070f60 2024-04-26T12:53:19.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff19259c640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194070f60 0x7ff19412f260 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c3d0 tx=0x7ff18800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff182ffd640 1 -- 172.21.15.29:0/729540069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff188017070 con 0x7ff194070f60 2024-04-26T12:53:19.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff182ffd640 1 -- 172.21.15.29:0/729540069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff188005ce0 con 0x7ff194070f60 2024-04-26T12:53:19.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1941141e0 con 0x7ff194070f60 2024-04-26T12:53:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff182ffd640 1 -- 172.21.15.29:0/729540069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1880070d0 con 0x7ff194070f60 2024-04-26T12:53:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff194114a30 con 0x7ff194070f60 2024-04-26T12:53:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff182ffd640 1 -- 172.21.15.29:0/729540069 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff18801a070 con 0x7ff194070f60 2024-04-26T12:53:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff194114cc0 con 0x7ff194070f60 2024-04-26T12:53:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff182ffd640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff174035db0 0x7ff174038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff182ffd640 1 -- 172.21.15.29:0/729540069 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7ff188048660 con 0x7ff194070f60 2024-04-26T12:53:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff191d9b640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff174035db0 0x7ff174038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.218+0000 7ff191d9b640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff174035db0 0x7ff174038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff1840ad000 tx=0x7ff1840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.222+0000 7ff182ffd640 1 -- 172.21.15.29:0/729540069 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff188019e10 con 0x7ff194070f60 2024-04-26T12:53:19.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.386+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff194062f80 con 0x7ff174035db0 2024-04-26T12:53:19.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.386+0000 7ff182ffd640 1 -- 172.21.15.29:0/729540069 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff194062f80 con 0x7ff174035db0 2024-04-26T12:53:19.387 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff174035db0 msgr2=0x7ff174038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff174035db0 0x7ff174038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff1840ad000 tx=0x7ff1840a6000 comp rx=0 tx=0).stop 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194070f60 msgr2=0x7ff19412f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194070f60 0x7ff19412f260 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c3d0 tx=0x7ff18800c890 comp rx=0 tx=0).stop 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 shutdown_connections 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7ff174035db0 0x7ff174038270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 --2- 172.21.15.29:0/729540069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff194070f60 0x7ff19412f260 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 >> 172.21.15.29:0/729540069 conn(0x7ff19409a310 msgr2=0x7ff19412bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 shutdown_connections 2024-04-26T12:53:19.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.390+0000 7ff1988aa640 1 -- 172.21.15.29:0/729540069 wait complete. 2024-04-26T12:53:19.407 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:53:19.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:53:19.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7adc8c7640 1 Processor -- start 2024-04-26T12:53:19.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7adc8c7640 1 -- start start 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7adc8c7640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ad812dbd0 0x7f7ad812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7adc8c7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad808e5d0 con 0x7f7ad808dae0 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7adc8c7640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad806e780 con 0x7f7ad812dbd0 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7acdd9b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ad812dbd0 0x7f7ad812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7ad659c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7ad808dae0 0x7f7ad808dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50274/0 (socket says 172.21.15.29:50274) 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.534+0000 7f7ad659c640 1 -- 172.21.15.29:0/3830989254 learned_addr learned my addr 172.21.15.29:0/3830989254 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7acdd9b640 1 -- 172.21.15.29:0/3830989254 >> v1:172.21.15.29:6789/0 conn(0x7f7ad808dae0 legacy=0x7f7ad808dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7acdd9b640 1 -- 172.21.15.29:0/3830989254 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad806d9e0 con 0x7f7ad812dbd0 2024-04-26T12:53:19.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7acdd9b640 1 --2- 172.21.15.29:0/3830989254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad812dbd0 0x7f7ad812ffc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000a8e0 tx=0x7f7ac001d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29f8b2da65937a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7ad5d9b640 1 -- 172.21.15.29:0/3830989254 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ac000b040 con 0x7f7ad812dbd0 2024-04-26T12:53:19.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7ad5d9b640 1 -- 172.21.15.29:0/3830989254 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac00b1530 con 0x7f7ad812dbd0 2024-04-26T12:53:19.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7ad5d9b640 1 -- 172.21.15.29:0/3830989254 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ac00b1830 con 0x7f7ad812dbd0 2024-04-26T12:53:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7adc8c7640 1 -- 172.21.15.29:0/3830989254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad812dbd0 msgr2=0x7f7ad812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/3830989254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad812dbd0 0x7f7ad812ffc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000a8e0 tx=0x7f7ac001d740 comp rx=0 tx=0).stop 2024-04-26T12:53:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7adc8c7640 1 -- 172.21.15.29:0/3830989254 shutdown_connections 2024-04-26T12:53:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/3830989254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad812dbd0 0x7f7ad812ffc0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7adc8c7640 1 -- 172.21.15.29:0/3830989254 >> 172.21.15.29:0/3830989254 conn(0x7f7ad809b440 msgr2=0x7f7ad809b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7adc8c7640 1 -- 172.21.15.29:0/3830989254 shutdown_connections 2024-04-26T12:53:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.538+0000 7f7adc8c7640 1 -- 172.21.15.29:0/3830989254 wait complete. 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7adc8c7640 1 Processor -- start 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7adc8c7640 1 -- start start 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7adc8c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad808dae0 0x7f7ad8097140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7adc8c7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad81330b0 con 0x7f7ad808dae0 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad808dae0 0x7f7ad8097140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad808dae0 0x7f7ad8097140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42814/0 (socket says 172.21.15.29:42814) 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7ad659c640 1 -- 172.21.15.29:0/1180122610 learned_addr learned my addr 172.21.15.29:0/1180122610 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7ad659c640 1 -- 172.21.15.29:0/1180122610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad8121870 con 0x7f7ad808dae0 2024-04-26T12:53:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7ad659c640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad808dae0 0x7f7ad8097140 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c380 tx=0x7f7ac800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ac8017070 con 0x7f7ad808dae0 2024-04-26T12:53:19.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac8005c20 con 0x7f7ad808dae0 2024-04-26T12:53:19.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad8099a30 con 0x7f7ad808dae0 2024-04-26T12:53:19.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ac80070d0 con 0x7f7ad808dae0 2024-04-26T12:53:19.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad8097850 con 0x7f7ad808dae0 2024-04-26T12:53:19.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ad8098da0 con 0x7f7ad808dae0 2024-04-26T12:53:19.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7ac801a070 con 0x7f7ad808dae0 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7ab8035db0 0x7f7ab8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f7ac8048410 con 0x7f7ad808dae0 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f7ab8042130 0x7f7ab80445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ab8044ca0 con 0x7f7ab8042130 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7ac804f050 con 0x7f7ad808dae0 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7acdd9b640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7ab8035db0 0x7f7ab8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.542+0000 7f7ad6d9d640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f7ab8042130 0x7f7ab80445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.546+0000 7f7ad6d9d640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f7ab8042130 0x7f7ab80445d0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.546+0000 7f7acdd9b640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7ab8035db0 0x7f7ab8038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00b0000 tx=0x7f7ac00a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.546+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== osd.1 v2:172.21.15.72:6816/1811201389 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ab8044ca0 con 0x7f7ab8042130 2024-04-26T12:53:19.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.558+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 --> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ad8062f80 con 0x7f7ab8042130 2024-04-26T12:53:19.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7acf7fe640 1 -- 172.21.15.29:0/1180122610 <== osd.1 v2:172.21.15.72:6816/1811201389 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ad8062f80 con 0x7f7ab8042130 2024-04-26T12:53:19.562 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T12:53:19.562 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:53:19.562 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T12:53:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f7ab8042130 msgr2=0x7f7ab80445d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f7ab8042130 0x7f7ab80445d0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7ab8035db0 msgr2=0x7f7ab8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7ab8035db0 0x7f7ab8038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00b0000 tx=0x7f7ac00a8000 comp rx=0 tx=0).stop 2024-04-26T12:53:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad808dae0 msgr2=0x7f7ad8097140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad808dae0 0x7f7ad8097140 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c380 tx=0x7f7ac800c840 comp rx=0 tx=0).stop 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 shutdown_connections 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6816/1811201389,v1:172.21.15.72:6817/1811201389] conn(0x7f7ab8042130 0x7f7ab80445d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f7ab8035db0 0x7f7ab8038270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 --2- 172.21.15.29:0/1180122610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad808dae0 0x7f7ad8097140 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 >> 172.21.15.29:0/1180122610 conn(0x7f7ad809b440 msgr2=0x7f7ad808ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 shutdown_connections 2024-04-26T12:53:19.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.562+0000 7f7adc8c7640 1 -- 172.21.15.29:0/1180122610 wait complete. 2024-04-26T12:53:19.579 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:53:19.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f223128c640 1 Processor -- start 2024-04-26T12:53:19.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f223128c640 1 -- start start 2024-04-26T12:53:19.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f223128c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f222c099900 0x7f222c133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f223128c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f222c09ae10 con 0x7f222c098e10 2024-04-26T12:53:19.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f223128c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f222c09ab00 con 0x7f222c099900 2024-04-26T12:53:19.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f222a7fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f222c099900 0x7f222c133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f222affd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f222c098e10 0x7f222c0991f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50280/0 (socket says 172.21.15.29:50280) 2024-04-26T12:53:19.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f222affd640 1 -- 172.21.15.29:0/1410336099 learned_addr learned my addr 172.21.15.29:0/1410336099 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:19.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f222a7fc640 1 -- 172.21.15.29:0/1410336099 >> v1:172.21.15.29:6789/0 conn(0x7f222c098e10 legacy=0x7f222c0991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f222a7fc640 1 -- 172.21.15.29:0/1410336099 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c0a00c0 con 0x7f222c099900 2024-04-26T12:53:19.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.694+0000 7f222a7fc640 1 --2- 172.21.15.29:0/1410336099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c099900 0x7f222c133a80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2220009740 tx=0x7f222001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d8f78aa163c69f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f2229ffb640 1 -- 172.21.15.29:0/1410336099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22200b0070 con 0x7f222c099900 2024-04-26T12:53:19.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f2229ffb640 1 -- 172.21.15.29:0/1410336099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22200ab530 con 0x7f222c099900 2024-04-26T12:53:19.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f2229ffb640 1 -- 172.21.15.29:0/1410336099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22200ab830 con 0x7f222c099900 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/1410336099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c099900 msgr2=0x7f222c133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 --2- 172.21.15.29:0/1410336099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c099900 0x7f222c133a80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2220009740 tx=0x7f222001c370 comp rx=0 tx=0).stop 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/1410336099 shutdown_connections 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 --2- 172.21.15.29:0/1410336099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c099900 0x7f222c133a80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/1410336099 >> 172.21.15.29:0/1410336099 conn(0x7f222c09ee00 msgr2=0x7f222c09f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/1410336099 shutdown_connections 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/1410336099 wait complete. 2024-04-26T12:53:19.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 Processor -- start 2024-04-26T12:53:19.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- start start 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c098e10 0x7f222c1325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f222c136b70 con 0x7f222c098e10 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f222affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c098e10 0x7f222c1325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f222affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c098e10 0x7f222c1325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42840/0 (socket says 172.21.15.29:42840) 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f222affd640 1 -- 172.21.15.29:0/4197362773 learned_addr learned my addr 172.21.15.29:0/4197362773 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f222affd640 1 -- 172.21.15.29:0/4197362773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c092d40 con 0x7f222c098e10 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f222affd640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c098e10 0x7f222c1325c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f221c00c480 tx=0x7f221c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f22137fe640 1 -- 172.21.15.29:0/4197362773 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c017070 con 0x7f222c098e10 2024-04-26T12:53:19.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f22137fe640 1 -- 172.21.15.29:0/4197362773 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c005c20 con 0x7f222c098e10 2024-04-26T12:53:19.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222c093e70 con 0x7f222c098e10 2024-04-26T12:53:19.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f22137fe640 1 -- 172.21.15.29:0/4197362773 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c007070 con 0x7f222c098e10 2024-04-26T12:53:19.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f222c132cd0 con 0x7f222c098e10 2024-04-26T12:53:19.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f22137fe640 1 -- 172.21.15.29:0/4197362773 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f221c01a070 con 0x7f222c098e10 2024-04-26T12:53:19.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.698+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f222c093a10 con 0x7f222c098e10 2024-04-26T12:53:19.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.702+0000 7f22137fe640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2218035db0 0x7f2218038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:19.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.702+0000 7f22137fe640 1 -- 172.21.15.29:0/4197362773 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f221c0483c0 con 0x7f222c098e10 2024-04-26T12:53:19.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.702+0000 7f222a7fc640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2218035db0 0x7f2218038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:19.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.702+0000 7f222a7fc640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2218035db0 0x7f2218038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f22200ad000 tx=0x7f22200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:19.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.706+0000 7f22137fe640 1 -- 172.21.15.29:0/4197362773 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f222c093a10 con 0x7f222c098e10 2024-04-26T12:53:19.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.866+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f222c062f80 con 0x7f2218035db0 2024-04-26T12:53:19.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.866+0000 7f22137fe640 1 -- 172.21.15.29:0/4197362773 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f222c062f80 con 0x7f2218035db0 2024-04-26T12:53:19.868 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:53:19.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2218035db0 msgr2=0x7f2218038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2218035db0 0x7f2218038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f22200ad000 tx=0x7f22200a6000 comp rx=0 tx=0).stop 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c098e10 msgr2=0x7f222c1325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c098e10 0x7f222c1325c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f221c00c480 tx=0x7f221c00c940 comp rx=0 tx=0).stop 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 shutdown_connections 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f2218035db0 0x7f2218038270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 --2- 172.21.15.29:0/4197362773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c098e10 0x7f222c1325c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 >> 172.21.15.29:0/4197362773 conn(0x7f222c09ee00 msgr2=0x7f222c096280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 shutdown_connections 2024-04-26T12:53:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:19.870+0000 7f223128c640 1 -- 172.21.15.29:0/4197362773 wait complete. 2024-04-26T12:53:19.887 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:53:19.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:53:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc35dfe640 1 Processor -- start 2024-04-26T12:53:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc35dfe640 1 -- start start 2024-04-26T12:53:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc35dfe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc3012cf40 0x7efc30131550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc35dfe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc30070460 con 0x7efc3012c230 2024-04-26T12:53:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc35dfe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7efc3012c610 con 0x7efc3012cf40 2024-04-26T12:53:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc2effd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc3012cf40 0x7efc30131550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc2f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efc3012c230 0x7efc3012c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50286/0 (socket says 172.21.15.29:50286) 2024-04-26T12:53:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc2f7fe640 1 -- 172.21.15.29:0/3475329232 learned_addr learned my addr 172.21.15.29:0/3475329232 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc2effd640 1 -- 172.21.15.29:0/3475329232 >> v1:172.21.15.29:6789/0 conn(0x7efc3012c230 legacy=0x7efc3012c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc2effd640 1 -- 172.21.15.29:0/3475329232 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3008e850 con 0x7efc3012cf40 2024-04-26T12:53:20.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.010+0000 7efc2e7fc640 1 -- 172.21.15.29:0/3475329232 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445726368 0 0) 0x7efc30070460 con 0x7efc3012c230 2024-04-26T12:53:20.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2effd640 1 --2- 172.21.15.29:0/3475329232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012cf40 0x7efc30131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efc24009770 tx=0x7efc2401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d4454306d1188f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2e7fc640 1 -- 172.21.15.29:0/3475329232 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc240b0070 con 0x7efc3012cf40 2024-04-26T12:53:20.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2e7fc640 1 -- 172.21.15.29:0/3475329232 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc240ab530 con 0x7efc3012cf40 2024-04-26T12:53:20.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2e7fc640 1 -- 172.21.15.29:0/3475329232 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc240ab830 con 0x7efc3012cf40 2024-04-26T12:53:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- 172.21.15.29:0/3475329232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012cf40 msgr2=0x7efc30131550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 --2- 172.21.15.29:0/3475329232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012cf40 0x7efc30131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efc24009770 tx=0x7efc2401c400 comp rx=0 tx=0).stop 2024-04-26T12:53:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- 172.21.15.29:0/3475329232 shutdown_connections 2024-04-26T12:53:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 --2- 172.21.15.29:0/3475329232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012cf40 0x7efc30131550 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- 172.21.15.29:0/3475329232 >> 172.21.15.29:0/3475329232 conn(0x7efc3009b440 msgr2=0x7efc3009b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- 172.21.15.29:0/3475329232 shutdown_connections 2024-04-26T12:53:20.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- 172.21.15.29:0/3475329232 wait complete. 2024-04-26T12:53:20.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 Processor -- start 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- start start 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012c230 0x7efc3012fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efc3006fc20 con 0x7efc3012c230 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012c230 0x7efc3012fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012c230 0x7efc3012fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42848/0 (socket says 172.21.15.29:42848) 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2f7fe640 1 -- 172.21.15.29:0/121882780 learned_addr learned my addr 172.21.15.29:0/121882780 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2f7fe640 1 -- 172.21.15.29:0/121882780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3012e710 con 0x7efc3012c230 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc2f7fe640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012c230 0x7efc3012fb00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c420 tx=0x7efc2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc20018070 con 0x7efc3012c230 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3012e3f0 con 0x7efc3012c230 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc200074d0 con 0x7efc3012c230 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc20004960 con 0x7efc3012c230 2024-04-26T12:53:20.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.014+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3012f7f0 con 0x7efc3012c230 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc30062f80 con 0x7efc3012c230 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efc2001b070 con 0x7efc3012c230 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc17fff640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc1c035d60 0x7efc1c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7efc20048550 con 0x7efc3012c230 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc17fff640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efc1c042060 0x7efc1c044500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc1c044bd0 con 0x7efc1c042060 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efc2004f050 con 0x7efc3012c230 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc2effd640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc1c035d60 0x7efc1c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc2ffff640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efc1c042060 0x7efc1c044500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc2ffff640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efc1c042060 0x7efc1c044500 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.018+0000 7efc2effd640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc1c035d60 0x7efc1c038220 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efc240ad000 tx=0x7efc24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.022+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== osd.2 v2:172.21.15.72:6800/1931234624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc1c044bd0 con 0x7efc1c042060 2024-04-26T12:53:20.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 --> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efc30099810 con 0x7efc1c042060 2024-04-26T12:53:20.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc17fff640 1 -- 172.21.15.29:0/121882780 <== osd.2 v2:172.21.15.72:6800/1931234624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efc30099810 con 0x7efc1c042060 2024-04-26T12:53:20.036 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T12:53:20.036 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:53:20.036 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efc1c042060 msgr2=0x7efc1c044500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efc1c042060 0x7efc1c044500 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc1c035d60 msgr2=0x7efc1c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc1c035d60 0x7efc1c038220 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efc240ad000 tx=0x7efc24008040 comp rx=0 tx=0).stop 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012c230 msgr2=0x7efc3012fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012c230 0x7efc3012fb00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c420 tx=0x7efc2000c8e0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 shutdown_connections 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6800/1931234624,v1:172.21.15.72:6801/1931234624] conn(0x7efc1c042060 0x7efc1c044500 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7efc1c035d60 0x7efc1c038220 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 --2- 172.21.15.29:0/121882780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc3012c230 0x7efc3012fb00 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 >> 172.21.15.29:0/121882780 conn(0x7efc3009b440 msgr2=0x7efc30070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 shutdown_connections 2024-04-26T12:53:20.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.034+0000 7efc35dfe640 1 -- 172.21.15.29:0/121882780 wait complete. 2024-04-26T12:53:20.052 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:53:20.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1bc6ce640 1 Processor -- start 2024-04-26T12:53:20.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1bc6ce640 1 -- start start 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1bc6ce640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1b412b470 0x7fa1b412b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1bc6ce640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b4092b10 con 0x7fa1b412e430 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1bc6ce640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b4092790 con 0x7fa1b412b470 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1ba46a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1b412b470 0x7fa1b412b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1b9c69640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa1b412e430 0x7fa1b412e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50292/0 (socket says 172.21.15.29:50292) 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1b9c69640 1 -- 172.21.15.29:0/4167866858 learned_addr learned my addr 172.21.15.29:0/4167866858 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1ba46a640 1 -- 172.21.15.29:0/4167866858 >> v1:172.21.15.29:6789/0 conn(0x7fa1b412e430 legacy=0x7fa1b412e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.166+0000 7fa1ba46a640 1 -- 172.21.15.29:0/4167866858 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b412bd90 con 0x7fa1b412b470 2024-04-26T12:53:20.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1ba46a640 1 --2- 172.21.15.29:0/4167866858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b412b850 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009740 tx=0x7fa1b001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58a5e7348572f4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1b9468640 1 -- 172.21.15.29:0/4167866858 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b00b0070 con 0x7fa1b412b470 2024-04-26T12:53:20.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1b9468640 1 -- 172.21.15.29:0/4167866858 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b00ab530 con 0x7fa1b412b470 2024-04-26T12:53:20.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1b9468640 1 -- 172.21.15.29:0/4167866858 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b00ab830 con 0x7fa1b412b470 2024-04-26T12:53:20.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/4167866858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 msgr2=0x7fa1b412b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 --2- 172.21.15.29:0/4167866858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b412b850 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009740 tx=0x7fa1b001c370 comp rx=0 tx=0).stop 2024-04-26T12:53:20.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/4167866858 shutdown_connections 2024-04-26T12:53:20.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 --2- 172.21.15.29:0/4167866858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b412b850 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/4167866858 >> 172.21.15.29:0/4167866858 conn(0x7fa1b40a0c70 msgr2=0x7fa1b40a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/4167866858 shutdown_connections 2024-04-26T12:53:20.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/4167866858 wait complete. 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 Processor -- start 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- start start 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b4071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4137160 con 0x7fa1b412b470 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1ba46a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b4071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1ba46a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b4071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42872/0 (socket says 172.21.15.29:42872) 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1ba46a640 1 -- 172.21.15.29:0/1800181498 learned_addr learned my addr 172.21.15.29:0/1800181498 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1ba46a640 1 -- 172.21.15.29:0/1800181498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b4130520 con 0x7fa1b412b470 2024-04-26T12:53:20.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1ba46a640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b4071510 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00ae040 tx=0x7fa1b001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1aaffd640 1 -- 172.21.15.29:0/1800181498 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b00b0050 con 0x7fa1b412b470 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1aaffd640 1 -- 172.21.15.29:0/1800181498 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b00b1040 con 0x7fa1b412b470 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.170+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b412f910 con 0x7fa1b412b470 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1aaffd640 1 -- 172.21.15.29:0/1800181498 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b00b5780 con 0x7fa1b412b470 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b412fff0 con 0x7fa1b412b470 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b4072d10 con 0x7fa1b412b470 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1aaffd640 1 -- 172.21.15.29:0/1800181498 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa1b00be030 con 0x7fa1b412b470 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1aaffd640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa198035d60 0x7fa198038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1aaffd640 1 -- 172.21.15.29:0/1800181498 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa1b00bc070 con 0x7fa1b412b470 2024-04-26T12:53:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1b9c69640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa198035d60 0x7fa198038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.174+0000 7fa1b9c69640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa198035d60 0x7fa198038220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4001610 tx=0x7fa1a4007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.178+0000 7fa1aaffd640 1 -- 172.21.15.29:0/1800181498 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa1b00c5060 con 0x7fa1b412b470 2024-04-26T12:53:20.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.338+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa1b4062f80 con 0x7fa198035d60 2024-04-26T12:53:20.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1aaffd640 1 -- 172.21.15.29:0/1800181498 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa1b4062f80 con 0x7fa198035d60 2024-04-26T12:53:20.342 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:53:20.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa198035d60 msgr2=0x7fa198038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa198035d60 0x7fa198038220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4001610 tx=0x7fa1a4007ad0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 msgr2=0x7fa1b4071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b4071510 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00ae040 tx=0x7fa1b001abb0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 shutdown_connections 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa198035d60 0x7fa198038220 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 --2- 172.21.15.29:0/1800181498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1b412b470 0x7fa1b4071510 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 >> 172.21.15.29:0/1800181498 conn(0x7fa1b40a0c70 msgr2=0x7fa1b408e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 shutdown_connections 2024-04-26T12:53:20.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.342+0000 7fa1bc6ce640 1 -- 172.21.15.29:0/1800181498 wait complete. 2024-04-26T12:53:20.359 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T12:53:20.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:53:20.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68d5cd5640 1 Processor -- start 2024-04-26T12:53:20.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68d5cd5640 1 -- start start 2024-04-26T12:53:20.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68d5cd5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f68d012c230 0x7f68d012c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68d5cd5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68d0070460 con 0x7f68d012cd70 2024-04-26T12:53:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68d5cd5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f68d012c610 con 0x7f68d012c230 2024-04-26T12:53:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68cf7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f68d012c230 0x7f68d012c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68ceffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f68d012cd70 0x7f68d0128d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50294/0 (socket says 172.21.15.29:50294) 2024-04-26T12:53:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68ceffd640 1 -- 172.21.15.29:0/3409406650 learned_addr learned my addr 172.21.15.29:0/3409406650 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68cf7fe640 1 -- 172.21.15.29:0/3409406650 >> v1:172.21.15.29:6789/0 conn(0x7f68d012cd70 legacy=0x7f68d0128d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.478+0000 7f68cf7fe640 1 -- 172.21.15.29:0/3409406650 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d008e850 con 0x7f68d012c230 2024-04-26T12:53:20.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68cf7fe640 1 --2- 172.21.15.29:0/3409406650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d012c830 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009740 tx=0x7f68c801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586c0623d65f93b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68ce7fc640 1 -- 172.21.15.29:0/3409406650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c80b0070 con 0x7f68d012c230 2024-04-26T12:53:20.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68ce7fc640 1 -- 172.21.15.29:0/3409406650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c80ab530 con 0x7f68d012c230 2024-04-26T12:53:20.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68ce7fc640 1 -- 172.21.15.29:0/3409406650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c80ab830 con 0x7f68d012c230 2024-04-26T12:53:20.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 -- 172.21.15.29:0/3409406650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 msgr2=0x7f68d012c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/3409406650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d012c830 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009740 tx=0x7f68c801c400 comp rx=0 tx=0).stop 2024-04-26T12:53:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 -- 172.21.15.29:0/3409406650 shutdown_connections 2024-04-26T12:53:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/3409406650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d012c830 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 -- 172.21.15.29:0/3409406650 >> 172.21.15.29:0/3409406650 conn(0x7f68d009b440 msgr2=0x7f68d009b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 -- 172.21.15.29:0/3409406650 shutdown_connections 2024-04-26T12:53:20.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 -- 172.21.15.29:0/3409406650 wait complete. 2024-04-26T12:53:20.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 Processor -- start 2024-04-26T12:53:20.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.482+0000 7f68d5cd5640 1 -- start start 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68d5cd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d008c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68d5cd5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f68d008e430 con 0x7f68d012c230 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68cf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d008c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68cf7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d008c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42886/0 (socket says 172.21.15.29:42886) 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68cf7fe640 1 -- 172.21.15.29:0/2003729064 learned_addr learned my addr 172.21.15.29:0/2003729064 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68cf7fe640 1 -- 172.21.15.29:0/2003729064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d01319d0 con 0x7f68d012c230 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68cf7fe640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d008c440 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f68c80ae040 tx=0x7f68c801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c80b0050 con 0x7f68d012c230 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c80b1040 con 0x7f68d012c230 2024-04-26T12:53:20.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c80aab80 con 0x7f68d012c230 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d006dce0 con 0x7f68d012c230 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d008de40 con 0x7f68d012c230 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68d0062f80 con 0x7f68d012c230 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f68c80be030 con 0x7f68d012c230 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f68b0035db0 0x7f68b0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f68c80bc070 con 0x7f68d012c230 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7f68b0042190 0x7f68b0044630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68c8001d40 con 0x7f68b0042190 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f68c80ea050 con 0x7f68d012c230 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68ceffd640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f68b0035db0 0x7f68b0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68cffff640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7f68b0042190 0x7f68b0044630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.486+0000 7f68cffff640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7f68b0042190 0x7f68b0044630 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.490+0000 7f68ceffd640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f68b0035db0 0x7f68b0038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f68b8002090 tx=0x7f68b8001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.490+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== osd.3 v2:172.21.15.72:6808/671626845 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68c8001d40 con 0x7f68b0042190 2024-04-26T12:53:20.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.502+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 --> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68d008d560 con 0x7f68b0042190 2024-04-26T12:53:20.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.502+0000 7f68c7fff640 1 -- 172.21.15.29:0/2003729064 <== osd.3 v2:172.21.15.72:6808/671626845 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f68d008d560 con 0x7f68b0042190 2024-04-26T12:53:20.506 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T12:53:20.506 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:53:20.506 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T12:53:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7f68b0042190 msgr2=0x7f68b0044630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7f68b0042190 0x7f68b0044630 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f68b0035db0 msgr2=0x7f68b0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f68b0035db0 0x7f68b0038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f68b8002090 tx=0x7f68b8001680 comp rx=0 tx=0).stop 2024-04-26T12:53:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 msgr2=0x7f68d008c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d008c440 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f68c80ae040 tx=0x7f68c801ac40 comp rx=0 tx=0).stop 2024-04-26T12:53:20.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 shutdown_connections 2024-04-26T12:53:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6808/671626845,v1:172.21.15.72:6809/671626845] conn(0x7f68b0042190 0x7f68b0044630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f68b0035db0 0x7f68b0038270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 --2- 172.21.15.29:0/2003729064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68d012c230 0x7f68d008c440 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 >> 172.21.15.29:0/2003729064 conn(0x7f68d009b440 msgr2=0x7f68d012a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 shutdown_connections 2024-04-26T12:53:20.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.506+0000 7f68d5cd5640 1 -- 172.21.15.29:0/2003729064 wait complete. 2024-04-26T12:53:20.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T12:53:20.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb3c86640 1 Processor -- start 2024-04-26T12:53:20.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb3c86640 1 -- start start 2024-04-26T12:53:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb3c86640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5fac094cb0 0x7f5fac131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb3c86640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fac09d410 con 0x7f5fac0939f0 2024-04-26T12:53:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb3c86640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5fac093360 con 0x7f5fac094cb0 2024-04-26T12:53:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb1221640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5fac094cb0 0x7f5fac131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb1a22640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5fac0939f0 0x7f5fac093dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50302/0 (socket says 172.21.15.29:50302) 2024-04-26T12:53:20.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb1a22640 1 -- 172.21.15.29:0/138980160 learned_addr learned my addr 172.21.15.29:0/138980160 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:20.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb0a20640 1 -- 172.21.15.29:0/138980160 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315442007 0 0) 0x7f5fac09d410 con 0x7f5fac0939f0 2024-04-26T12:53:20.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb0a20640 1 -- 172.21.15.29:0/138980160 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f98003530 con 0x7f5fac0939f0 2024-04-26T12:53:20.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb1221640 1 -- 172.21.15.29:0/138980160 >> v1:172.21.15.29:6789/0 conn(0x7f5fac0939f0 legacy=0x7f5fac093dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb1221640 1 -- 172.21.15.29:0/138980160 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac0969b0 con 0x7f5fac094cb0 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb1221640 1 --2- 172.21.15.29:0/138980160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac094cb0 0x7f5fac131ab0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009740 tx=0x7f5f9c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c923c81b756dcc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.642+0000 7f5fb0a20640 1 -- 172.21.15.29:0/138980160 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9c0b0070 con 0x7f5fac094cb0 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb0a20640 1 -- 172.21.15.29:0/138980160 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c0ab530 con 0x7f5fac094cb0 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb0a20640 1 -- 172.21.15.29:0/138980160 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9c0ab810 con 0x7f5fac094cb0 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/138980160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac094cb0 msgr2=0x7f5fac131ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 --2- 172.21.15.29:0/138980160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac094cb0 0x7f5fac131ab0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009740 tx=0x7f5f9c01c370 comp rx=0 tx=0).stop 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/138980160 shutdown_connections 2024-04-26T12:53:20.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 --2- 172.21.15.29:0/138980160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac094cb0 0x7f5fac131ab0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/138980160 >> 172.21.15.29:0/138980160 conn(0x7f5fac09a3f0 msgr2=0x7f5fac09a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/138980160 shutdown_connections 2024-04-26T12:53:20.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/138980160 wait complete. 2024-04-26T12:53:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 Processor -- start 2024-04-26T12:53:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- start start 2024-04-26T12:53:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac0939f0 0x7f5fac12ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac134ba0 con 0x7f5fac0939f0 2024-04-26T12:53:20.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb1a22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac0939f0 0x7f5fac12ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb1a22640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac0939f0 0x7f5fac12ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42904/0 (socket says 172.21.15.29:42904) 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb1a22640 1 -- 172.21.15.29:0/2088056728 learned_addr learned my addr 172.21.15.29:0/2088056728 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb1a22640 1 -- 172.21.15.29:0/2088056728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac08ced0 con 0x7f5fac0939f0 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb1a22640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac0939f0 0x7f5fac12ec60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c450 tx=0x7f5fa800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fa27fc640 1 -- 172.21.15.29:0/2088056728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa8017070 con 0x7f5fac0939f0 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fa27fc640 1 -- 172.21.15.29:0/2088056728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa8005c20 con 0x7f5fac0939f0 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fac0920a0 con 0x7f5fac0939f0 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fa27fc640 1 -- 172.21.15.29:0/2088056728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa8007070 con 0x7f5fac0939f0 2024-04-26T12:53:20.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fac08da10 con 0x7f5fac0939f0 2024-04-26T12:53:20.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fa27fc640 1 -- 172.21.15.29:0/2088056728 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5fa801a070 con 0x7f5fac0939f0 2024-04-26T12:53:20.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fac062f80 con 0x7f5fac0939f0 2024-04-26T12:53:20.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fa27fc640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5f90035db0 0x7f5f90038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.646+0000 7f5fa27fc640 1 -- 172.21.15.29:0/2088056728 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f5fa8048410 con 0x7f5fac0939f0 2024-04-26T12:53:20.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.650+0000 7f5fb1221640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5f90035db0 0x7f5f90038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.650+0000 7f5fb1221640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5f90035db0 0x7f5f90038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009740 tx=0x7f5f9c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.654+0000 7f5fa27fc640 1 -- 172.21.15.29:0/2088056728 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5fa8012400 con 0x7f5fac0939f0 2024-04-26T12:53:20.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.814+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5fac0738b0 con 0x7f5f90035db0 2024-04-26T12:53:20.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.814+0000 7f5fa27fc640 1 -- 172.21.15.29:0/2088056728 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5fac0738b0 con 0x7f5f90035db0 2024-04-26T12:53:20.817 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5f90035db0 msgr2=0x7f5f90038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5f90035db0 0x7f5f90038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009740 tx=0x7f5f9c0a6000 comp rx=0 tx=0).stop 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac0939f0 msgr2=0x7f5fac12ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac0939f0 0x7f5fac12ec60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c450 tx=0x7f5fa800c910 comp rx=0 tx=0).stop 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 shutdown_connections 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5f90035db0 0x7f5f90038270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 --2- 172.21.15.29:0/2088056728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5fac0939f0 0x7f5fac12ec60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 >> 172.21.15.29:0/2088056728 conn(0x7f5fac09a3f0 msgr2=0x7f5fac06f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 shutdown_connections 2024-04-26T12:53:20.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.818+0000 7f5fb3c86640 1 -- 172.21.15.29:0/2088056728 wait complete. 2024-04-26T12:53:20.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:53:20.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.962+0000 7f655f26c640 1 Processor -- start 2024-04-26T12:53:20.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.962+0000 7f655f26c640 1 -- start start 2024-04-26T12:53:20.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.962+0000 7f655f26c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f655812cdd0 0x7f6558131880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.962+0000 7f655f26c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6558096210 con 0x7f655812c2e0 2024-04-26T12:53:20.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.962+0000 7f655f26c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f655806b9d0 con 0x7f655812cdd0 2024-04-26T12:53:20.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655c807640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f655812cdd0 0x7f6558131880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655d008640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f655812c2e0 0x7f655812c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50312/0 (socket says 172.21.15.29:50312) 2024-04-26T12:53:20.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655d008640 1 -- 172.21.15.29:0/3714354301 learned_addr learned my addr 172.21.15.29:0/3714354301 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:20.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655c807640 1 -- 172.21.15.29:0/3714354301 >> v1:172.21.15.29:6789/0 conn(0x7f655812c2e0 legacy=0x7f655812c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655c807640 1 -- 172.21.15.29:0/3714354301 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6558096960 con 0x7f655812cdd0 2024-04-26T12:53:20.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655c807640 1 --2- 172.21.15.29:0/3714354301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812cdd0 0x7f6558131880 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6554009740 tx=0x7f655401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7eb17d4f72ab302 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f654ffff640 1 -- 172.21.15.29:0/3714354301 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65540b0070 con 0x7f655812cdd0 2024-04-26T12:53:20.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f654ffff640 1 -- 172.21.15.29:0/3714354301 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65540ab530 con 0x7f655812cdd0 2024-04-26T12:53:20.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f654ffff640 1 -- 172.21.15.29:0/3714354301 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65540ab830 con 0x7f655812cdd0 2024-04-26T12:53:20.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655f26c640 1 -- 172.21.15.29:0/3714354301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812cdd0 msgr2=0x7f6558131880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:20.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655f26c640 1 --2- 172.21.15.29:0/3714354301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812cdd0 0x7f6558131880 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6554009740 tx=0x7f655401c370 comp rx=0 tx=0).stop 2024-04-26T12:53:20.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655f26c640 1 -- 172.21.15.29:0/3714354301 shutdown_connections 2024-04-26T12:53:20.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655f26c640 1 --2- 172.21.15.29:0/3714354301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812cdd0 0x7f6558131880 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:20.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655f26c640 1 -- 172.21.15.29:0/3714354301 >> 172.21.15.29:0/3714354301 conn(0x7f655809d040 msgr2=0x7f655809d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:20.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655f26c640 1 -- 172.21.15.29:0/3714354301 shutdown_connections 2024-04-26T12:53:20.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.966+0000 7f655f26c640 1 -- 172.21.15.29:0/3714354301 wait complete. 2024-04-26T12:53:20.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655f26c640 1 Processor -- start 2024-04-26T12:53:20.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655f26c640 1 -- start start 2024-04-26T12:53:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655f26c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812c2e0 0x7f65581230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655f26c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f65581347f0 con 0x7f655812c2e0 2024-04-26T12:53:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655d008640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812c2e0 0x7f65581230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655d008640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812c2e0 0x7f65581230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42924/0 (socket says 172.21.15.29:42924) 2024-04-26T12:53:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655d008640 1 -- 172.21.15.29:0/2189429586 learned_addr learned my addr 172.21.15.29:0/2189429586 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:20.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655d008640 1 -- 172.21.15.29:0/2189429586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655809a660 con 0x7f655812c2e0 2024-04-26T12:53:20.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655d008640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812c2e0 0x7f65581230d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f654800c480 tx=0x7f654800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f654dffb640 1 -- 172.21.15.29:0/2189429586 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6548017070 con 0x7f655812c2e0 2024-04-26T12:53:20.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f654dffb640 1 -- 172.21.15.29:0/2189429586 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6548005c20 con 0x7f655812c2e0 2024-04-26T12:53:20.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6558131570 con 0x7f655812c2e0 2024-04-26T12:53:20.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f654dffb640 1 -- 172.21.15.29:0/2189429586 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6548007070 con 0x7f655812c2e0 2024-04-26T12:53:20.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6558125400 con 0x7f655812c2e0 2024-04-26T12:53:20.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6558062f80 con 0x7f655812c2e0 2024-04-26T12:53:20.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f654dffb640 1 -- 172.21.15.29:0/2189429586 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f654801a070 con 0x7f655812c2e0 2024-04-26T12:53:20.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f654dffb640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f653c035db0 0x7f653c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:20.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.970+0000 7f654dffb640 1 -- 172.21.15.29:0/2189429586 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f6548048500 con 0x7f655812c2e0 2024-04-26T12:53:20.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.974+0000 7f655c807640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f653c035db0 0x7f653c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:20.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.974+0000 7f655c807640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f653c035db0 0x7f653c038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f65540ad000 tx=0x7f65540a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:20.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:20.978+0000 7f654dffb640 1 -- 172.21.15.29:0/2189429586 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6548007210 con 0x7f655812c2e0 2024-04-26T12:53:21.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.134+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6558095aa0 con 0x7f653c035db0 2024-04-26T12:53:21.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.178+0000 7f654dffb640 1 -- 172.21.15.29:0/2189429586 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665590 (secure 0 0 0) 0x7f65540ab500 con 0x7f653c035db0 2024-04-26T12:53:21.185 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:53:21.192 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f653c035db0 msgr2=0x7f653c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f653c035db0 0x7f653c038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f65540ad000 tx=0x7f65540a6000 comp rx=0 tx=0).stop 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812c2e0 msgr2=0x7f65581230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812c2e0 0x7f65581230d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f654800c480 tx=0x7f654800c940 comp rx=0 tx=0).stop 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 shutdown_connections 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f653c035db0 0x7f653c038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 --2- 172.21.15.29:0/2189429586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655812c2e0 0x7f65581230d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 >> 172.21.15.29:0/2189429586 conn(0x7f655809d040 msgr2=0x7f6558072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:21.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 shutdown_connections 2024-04-26T12:53:21.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:21.186+0000 7f655f26c640 1 -- 172.21.15.29:0/2189429586 wait complete. 2024-04-26T12:53:21.205 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-04-26T12:53:19.235825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4799687,"num_objects":221,"num_object_clones":0,"num_object_copies":443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":5061,"num_read_kb":4643,"num_write":2164,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4576,"ondisk_log_size":4576,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152796,"kb_used_data":11444,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377334564,"statfs":{"total":386547056640,"available":386390593536,"internally_reserved":0,"allocated":11718656,"data_stored":10500202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":144697107},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4198585,"num_objects":3,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":679,"num_read_kb":639,"num_write":444,"num_write_kb":29373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005981"},"pg_stats":[{"pgid":"3.3f","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.749126+0000","last_change":"2024-04-26T12:49:54.242608+0000","last_active":"2024-04-26T12:53:08.749126+0000","last_peered":"2024-04-26T12:53:08.749126+0000","last_clean":"2024-04-26T12:53:08.749126+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:53:08.749126+0000","last_undegraded":"2024-04-26T12:53:08.749126+0000","last_fullsized":"2024-04-26T12:53:08.749126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.951421+0000","last_change":"2024-04-26T12:49:56.222755+0000","last_active":"2024-04-26T12:52:03.951421+0000","last_peered":"2024-04-26T12:52:03.951421+0000","last_clean":"2024-04-26T12:52:03.951421+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:52:03.951421+0000","last_undegraded":"2024-04-26T12:52:03.951421+0000","last_fullsized":"2024-04-26T12:52:03.951421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:40.027829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303872+0000","last_change":"2024-04-26T12:49:54.235378+0000","last_active":"2024-04-26T12:50:34.303872+0000","last_peered":"2024-04-26T12:50:34.303872+0000","last_clean":"2024-04-26T12:50:34.303872+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:50:34.303872+0000","last_undegraded":"2024-04-26T12:50:34.303872+0000","last_fullsized":"2024-04-26T12:50:34.303872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.979752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420744+0000","last_change":"2024-04-26T12:49:56.223502+0000","last_active":"2024-04-26T12:53:09.420744+0000","last_peered":"2024-04-26T12:53:09.420744+0000","last_clean":"2024-04-26T12:53:09.420744+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:53:09.420744+0000","last_undegraded":"2024-04-26T12:53:09.420744+0000","last_fullsized":"2024-04-26T12:53:09.420744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:55.385814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.443926+0000","last_change":"2024-04-26T12:49:54.259543+0000","last_active":"2024-04-26T12:50:38.443926+0000","last_peered":"2024-04-26T12:50:38.443926+0000","last_clean":"2024-04-26T12:50:38.443926+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:50:38.443926+0000","last_undegraded":"2024-04-26T12:50:38.443926+0000","last_fullsized":"2024-04-26T12:50:38.443926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:21.397944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439652+0000","last_change":"2024-04-26T12:49:56.230220+0000","last_active":"2024-04-26T12:53:09.439652+0000","last_peered":"2024-04-26T12:53:09.439652+0000","last_clean":"2024-04-26T12:53:09.439652+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:09.439652+0000","last_undegraded":"2024-04-26T12:53:09.439652+0000","last_fullsized":"2024-04-26T12:53:09.439652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:52.667520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.986056+0000","last_change":"2024-04-26T12:49:54.243452+0000","last_active":"2024-04-26T12:52:07.986056+0000","last_peered":"2024-04-26T12:52:07.986056+0000","last_clean":"2024-04-26T12:52:07.986056+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:52:07.986056+0000","last_undegraded":"2024-04-26T12:52:07.986056+0000","last_fullsized":"2024-04-26T12:52:07.986056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265864+0000","last_change":"2024-04-26T12:50:34.320557+0000","last_active":"2024-04-26T12:53:09.265864+0000","last_peered":"2024-04-26T12:53:09.265864+0000","last_clean":"2024-04-26T12:53:09.265864+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:53:09.265864+0000","last_undegraded":"2024-04-26T12:53:09.265864+0000","last_fullsized":"2024-04-26T12:53:09.265864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:36.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.171393+0000","last_change":"2024-04-26T12:49:54.237140+0000","last_active":"2024-04-26T12:52:08.171393+0000","last_peered":"2024-04-26T12:52:08.171393+0000","last_clean":"2024-04-26T12:52:08.171393+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:52:08.171393+0000","last_undegraded":"2024-04-26T12:52:08.171393+0000","last_fullsized":"2024-04-26T12:52:08.171393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:58.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945401+0000","last_change":"2024-04-26T12:49:56.231677+0000","last_active":"2024-04-26T12:50:39.945401+0000","last_peered":"2024-04-26T12:50:39.945401+0000","last_clean":"2024-04-26T12:50:39.945401+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:50:39.945401+0000","last_undegraded":"2024-04-26T12:50:39.945401+0000","last_fullsized":"2024-04-26T12:50:39.945401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:40.895169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296361+0000","last_change":"2024-04-26T12:49:54.242489+0000","last_active":"2024-04-26T12:50:34.296361+0000","last_peered":"2024-04-26T12:50:34.296361+0000","last_clean":"2024-04-26T12:50:34.296361+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:50:34.296361+0000","last_undegraded":"2024-04-26T12:50:34.296361+0000","last_fullsized":"2024-04-26T12:50:34.296361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.944960+0000","last_change":"2024-04-26T12:49:56.229364+0000","last_active":"2024-04-26T12:50:39.944960+0000","last_peered":"2024-04-26T12:50:39.944960+0000","last_clean":"2024-04-26T12:50:39.944960+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:50:39.944960+0000","last_undegraded":"2024-04-26T12:50:39.944960+0000","last_fullsized":"2024-04-26T12:50:39.944960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.707668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.932592+0000","last_change":"2024-04-26T12:49:54.238559+0000","last_active":"2024-04-26T12:52:03.932592+0000","last_peered":"2024-04-26T12:52:03.932592+0000","last_clean":"2024-04-26T12:52:03.932592+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:52:03.932592+0000","last_undegraded":"2024-04-26T12:52:03.932592+0000","last_fullsized":"2024-04-26T12:52:03.932592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:18.653954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'6","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.525120+0000","last_change":"2024-04-26T12:49:56.219293+0000","last_active":"2024-04-26T12:53:09.525120+0000","last_peered":"2024-04-26T12:53:09.525120+0000","last_clean":"2024-04-26T12:53:09.525120+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:09.525120+0000","last_undegraded":"2024-04-26T12:53:09.525120+0000","last_fullsized":"2024-04-26T12:53:09.525120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297946+0000","last_change":"2024-04-26T12:49:54.238122+0000","last_active":"2024-04-26T12:50:34.297946+0000","last_peered":"2024-04-26T12:50:34.297946+0000","last_clean":"2024-04-26T12:50:34.297946+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:50:34.297946+0000","last_undegraded":"2024-04-26T12:50:34.297946+0000","last_fullsized":"2024-04-26T12:50:34.297946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:44.405285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.935848+0000","last_change":"2024-04-26T12:49:56.214215+0000","last_active":"2024-04-26T12:52:03.935848+0000","last_peered":"2024-04-26T12:52:03.935848+0000","last_clean":"2024-04-26T12:52:03.935848+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:52:03.935848+0000","last_undegraded":"2024-04-26T12:52:03.935848+0000","last_fullsized":"2024-04-26T12:52:03.935848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.065457+0000","last_change":"2024-04-26T12:49:56.220575+0000","last_active":"2024-04-26T12:53:09.065457+0000","last_peered":"2024-04-26T12:53:09.065457+0000","last_clean":"2024-04-26T12:53:09.065457+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:53:09.065457+0000","last_undegraded":"2024-04-26T12:53:09.065457+0000","last_fullsized":"2024-04-26T12:53:09.065457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:18.310904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.927312+0000","last_change":"2024-04-26T12:49:54.245871+0000","last_active":"2024-04-26T12:50:39.927312+0000","last_peered":"2024-04-26T12:50:39.927312+0000","last_clean":"2024-04-26T12:50:39.927312+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:50:39.927312+0000","last_undegraded":"2024-04-26T12:50:39.927312+0000","last_fullsized":"2024-04-26T12:50:39.927312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265368+0000","last_change":"2024-04-26T12:49:56.220421+0000","last_active":"2024-04-26T12:53:09.265368+0000","last_peered":"2024-04-26T12:53:09.265368+0000","last_clean":"2024-04-26T12:53:09.265368+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:09.265368+0000","last_undegraded":"2024-04-26T12:53:09.265368+0000","last_fullsized":"2024-04-26T12:53:09.265368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:39.175250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.631488+0000","last_change":"2024-04-26T12:49:54.250106+0000","last_active":"2024-04-26T12:53:08.631488+0000","last_peered":"2024-04-26T12:53:08.631488+0000","last_clean":"2024-04-26T12:53:08.631488+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:53:08.631488+0000","last_undegraded":"2024-04-26T12:53:08.631488+0000","last_fullsized":"2024-04-26T12:53:08.631488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.348707+0000","last_change":"2024-04-26T12:49:56.222834+0000","last_active":"2024-04-26T12:53:09.348707+0000","last_peered":"2024-04-26T12:53:09.348707+0000","last_clean":"2024-04-26T12:53:09.348707+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:09.348707+0000","last_undegraded":"2024-04-26T12:53:09.348707+0000","last_fullsized":"2024-04-26T12:53:09.348707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:55.139601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317543+0000","last_change":"2024-04-26T12:49:54.244413+0000","last_active":"2024-04-26T12:50:34.317543+0000","last_peered":"2024-04-26T12:50:34.317543+0000","last_clean":"2024-04-26T12:50:34.317543+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:50:34.317543+0000","last_undegraded":"2024-04-26T12:50:34.317543+0000","last_fullsized":"2024-04-26T12:50:34.317543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.920847+0000","last_change":"2024-04-26T12:49:56.221481+0000","last_active":"2024-04-26T12:53:08.920847+0000","last_peered":"2024-04-26T12:53:08.920847+0000","last_clean":"2024-04-26T12:53:08.920847+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:53:08.920847+0000","last_undegraded":"2024-04-26T12:53:08.920847+0000","last_fullsized":"2024-04-26T12:53:08.920847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:18.233516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.218924+0000","last_change":"2024-04-26T12:49:54.246419+0000","last_active":"2024-04-26T12:53:09.218924+0000","last_peered":"2024-04-26T12:53:09.218924+0000","last_clean":"2024-04-26T12:53:09.218924+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:09.218924+0000","last_undegraded":"2024-04-26T12:53:09.218924+0000","last_fullsized":"2024-04-26T12:53:09.218924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:51.954948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298569+0000","last_change":"2024-04-26T12:49:56.215781+0000","last_active":"2024-04-26T12:50:34.298569+0000","last_peered":"2024-04-26T12:50:34.298569+0000","last_clean":"2024-04-26T12:50:34.298569+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:50:34.298569+0000","last_undegraded":"2024-04-26T12:50:34.298569+0000","last_fullsized":"2024-04-26T12:50:34.298569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:05.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301528+0000","last_change":"2024-04-26T12:49:54.235967+0000","last_active":"2024-04-26T12:50:34.301528+0000","last_peered":"2024-04-26T12:50:34.301528+0000","last_clean":"2024-04-26T12:50:34.301528+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:50:34.301528+0000","last_undegraded":"2024-04-26T12:50:34.301528+0000","last_fullsized":"2024-04-26T12:50:34.301528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:38.031959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.349371+0000","last_change":"2024-04-26T12:49:56.230516+0000","last_active":"2024-04-26T12:53:09.349371+0000","last_peered":"2024-04-26T12:53:09.349371+0000","last_clean":"2024-04-26T12:53:09.349371+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:09.349371+0000","last_undegraded":"2024-04-26T12:53:09.349371+0000","last_fullsized":"2024-04-26T12:53:09.349371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:43.529519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307407+0000","last_change":"2024-04-26T12:49:54.231273+0000","last_active":"2024-04-26T12:50:34.307407+0000","last_peered":"2024-04-26T12:50:34.307407+0000","last_clean":"2024-04-26T12:50:34.307407+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:50:34.307407+0000","last_undegraded":"2024-04-26T12:50:34.307407+0000","last_fullsized":"2024-04-26T12:50:34.307407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:04.131902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.309725+0000","last_change":"2024-04-26T12:50:04.290015+0000","last_active":"2024-04-26T12:53:09.309725+0000","last_peered":"2024-04-26T12:53:09.309725+0000","last_clean":"2024-04-26T12:53:09.309725+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:53:09.309725+0000","last_undegraded":"2024-04-26T12:53:09.309725+0000","last_fullsized":"2024-04-26T12:53:09.309725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:43.725242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966748+0000","last_change":"2024-04-26T12:49:56.230418+0000","last_active":"2024-04-26T12:52:17.966748+0000","last_peered":"2024-04-26T12:52:17.966748+0000","last_clean":"2024-04-26T12:52:17.966748+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:52:17.966748+0000","last_undegraded":"2024-04-26T12:52:17.966748+0000","last_fullsized":"2024-04-26T12:52:17.966748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:45.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308000+0000","last_change":"2024-04-26T12:49:54.258161+0000","last_active":"2024-04-26T12:50:34.308000+0000","last_peered":"2024-04-26T12:50:34.308000+0000","last_clean":"2024-04-26T12:50:34.308000+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:50:34.308000+0000","last_undegraded":"2024-04-26T12:50:34.308000+0000","last_fullsized":"2024-04-26T12:50:34.308000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:00.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'1","reported_seq":220,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:15.967884+0000","last_change":"2024-04-26T12:49:58.245109+0000","last_active":"2024-04-26T12:53:15.967884+0000","last_peered":"2024-04-26T12:53:15.967884+0000","last_clean":"2024-04-26T12:53:15.967884+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:53:15.967884+0000","last_undegraded":"2024-04-26T12:53:15.967884+0000","last_fullsized":"2024-04-26T12:53:15.967884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:01.452307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'34","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.125128+0000","last_change":"2024-04-26T12:50:00.267183+0000","last_active":"2024-04-26T12:53:16.125128+0000","last_peered":"2024-04-26T12:53:16.125128+0000","last_clean":"2024-04-26T12:53:16.125128+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:53:16.125128+0000","last_undegraded":"2024-04-26T12:53:16.125128+0000","last_fullsized":"2024-04-26T12:53:16.125128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:20.694030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318971+0000","last_change":"2024-04-26T12:50:02.286913+0000","last_active":"2024-04-26T12:50:34.318971+0000","last_peered":"2024-04-26T12:50:34.318971+0000","last_clean":"2024-04-26T12:50:34.318971+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:50:34.318971+0000","last_undegraded":"2024-04-26T12:50:34.318971+0000","last_fullsized":"2024-04-26T12:50:34.318971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:27.009156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.021133+0000","last_change":"2024-04-26T12:50:04.289706+0000","last_active":"2024-04-26T12:51:23.021133+0000","last_peered":"2024-04-26T12:51:23.021133+0000","last_clean":"2024-04-26T12:51:23.021133+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:51:23.021133+0000","last_undegraded":"2024-04-26T12:51:23.021133+0000","last_fullsized":"2024-04-26T12:51:23.021133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420741+0000","last_change":"2024-04-26T12:49:56.230756+0000","last_active":"2024-04-26T12:53:09.420741+0000","last_peered":"2024-04-26T12:53:09.420741+0000","last_clean":"2024-04-26T12:53:09.420741+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:09.420741+0000","last_undegraded":"2024-04-26T12:53:09.420741+0000","last_fullsized":"2024-04-26T12:53:09.420741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:08.686460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295413+0000","last_change":"2024-04-26T12:49:54.239992+0000","last_active":"2024-04-26T12:50:34.295413+0000","last_peered":"2024-04-26T12:50:34.295413+0000","last_clean":"2024-04-26T12:50:34.295413+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:50:34.295413+0000","last_undegraded":"2024-04-26T12:50:34.295413+0000","last_fullsized":"2024-04-26T12:50:34.295413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:54.057289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298746+0000","last_change":"2024-04-26T12:49:58.222832+0000","last_active":"2024-04-26T12:50:34.298746+0000","last_peered":"2024-04-26T12:50:34.298746+0000","last_clean":"2024-04-26T12:50:34.298746+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:50:34.298746+0000","last_undegraded":"2024-04-26T12:50:34.298746+0000","last_fullsized":"2024-04-26T12:50:34.298746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:55.234724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317827+0000","last_change":"2024-04-26T12:50:00.237541+0000","last_active":"2024-04-26T12:50:34.317827+0000","last_peered":"2024-04-26T12:50:34.317827+0000","last_clean":"2024-04-26T12:50:34.317827+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:50:34.317827+0000","last_undegraded":"2024-04-26T12:50:34.317827+0000","last_fullsized":"2024-04-26T12:50:34.317827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:55.963923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.317973+0000","last_change":"2024-04-26T12:50:02.279094+0000","last_active":"2024-04-26T12:50:34.317973+0000","last_peered":"2024-04-26T12:50:34.317973+0000","last_clean":"2024-04-26T12:50:34.317973+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:50:34.317973+0000","last_undegraded":"2024-04-26T12:50:34.317973+0000","last_fullsized":"2024-04-26T12:50:34.317973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:59.872989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297515+0000","last_change":"2024-04-26T12:50:04.281974+0000","last_active":"2024-04-26T12:50:34.297515+0000","last_peered":"2024-04-26T12:50:34.297515+0000","last_clean":"2024-04-26T12:50:34.297515+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:50:34.297515+0000","last_undegraded":"2024-04-26T12:50:34.297515+0000","last_fullsized":"2024-04-26T12:50:34.297515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:37.632879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301288+0000","last_change":"2024-04-26T12:49:56.230322+0000","last_active":"2024-04-26T12:51:23.301288+0000","last_peered":"2024-04-26T12:51:23.301288+0000","last_clean":"2024-04-26T12:51:23.301288+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:51:23.301288+0000","last_undegraded":"2024-04-26T12:51:23.301288+0000","last_fullsized":"2024-04-26T12:51:23.301288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:53.550517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302460+0000","last_change":"2024-04-26T12:49:54.238247+0000","last_active":"2024-04-26T12:50:34.302460+0000","last_peered":"2024-04-26T12:50:34.302460+0000","last_clean":"2024-04-26T12:50:34.302460+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:50:34.302460+0000","last_undegraded":"2024-04-26T12:50:34.302460+0000","last_fullsized":"2024-04-26T12:50:34.302460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:27.411968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304667+0000","last_change":"2024-04-26T12:49:58.227229+0000","last_active":"2024-04-26T12:50:34.304667+0000","last_peered":"2024-04-26T12:50:34.304667+0000","last_clean":"2024-04-26T12:50:34.304667+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:50:34.304667+0000","last_undegraded":"2024-04-26T12:50:34.304667+0000","last_fullsized":"2024-04-26T12:50:34.304667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:36.728074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299915+0000","last_change":"2024-04-26T12:50:00.265817+0000","last_active":"2024-04-26T12:50:34.299915+0000","last_peered":"2024-04-26T12:50:34.299915+0000","last_clean":"2024-04-26T12:50:34.299915+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:50:34.299915+0000","last_undegraded":"2024-04-26T12:50:34.299915+0000","last_fullsized":"2024-04-26T12:50:34.299915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.529574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":389,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.008605+0000","last_change":"2024-04-26T12:50:02.294244+0000","last_active":"2024-04-26T12:53:16.008605+0000","last_peered":"2024-04-26T12:53:16.008605+0000","last_clean":"2024-04-26T12:53:16.008605+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:16.008605+0000","last_undegraded":"2024-04-26T12:53:16.008605+0000","last_fullsized":"2024-04-26T12:53:16.008605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295111+0000","last_change":"2024-04-26T12:50:04.283093+0000","last_active":"2024-04-26T12:50:34.295111+0000","last_peered":"2024-04-26T12:50:34.295111+0000","last_clean":"2024-04-26T12:50:34.295111+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:50:34.295111+0000","last_undegraded":"2024-04-26T12:50:34.295111+0000","last_fullsized":"2024-04-26T12:50:34.295111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:54.841461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352362+0000","last_change":"2024-04-26T12:49:56.227048+0000","last_active":"2024-04-26T12:53:09.352362+0000","last_peered":"2024-04-26T12:53:09.352362+0000","last_clean":"2024-04-26T12:53:09.352362+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:09.352362+0000","last_undegraded":"2024-04-26T12:53:09.352362+0000","last_fullsized":"2024-04-26T12:53:09.352362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:09.070129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.905801+0000","last_change":"2024-04-26T12:49:54.236350+0000","last_active":"2024-04-26T12:50:39.905801+0000","last_peered":"2024-04-26T12:50:39.905801+0000","last_clean":"2024-04-26T12:50:39.905801+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:50:39.905801+0000","last_undegraded":"2024-04-26T12:50:39.905801+0000","last_fullsized":"2024-04-26T12:50:39.905801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.325536+0000","last_change":"2024-04-26T12:49:58.245623+0000","last_active":"2024-04-26T12:50:34.325536+0000","last_peered":"2024-04-26T12:50:34.325536+0000","last_clean":"2024-04-26T12:50:34.325536+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:50:34.325536+0000","last_undegraded":"2024-04-26T12:50:34.325536+0000","last_fullsized":"2024-04-26T12:50:34.325536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:58.925636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'33","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.099024+0000","last_change":"2024-04-26T12:50:00.265428+0000","last_active":"2024-04-26T12:53:16.099024+0000","last_peered":"2024-04-26T12:53:16.099024+0000","last_clean":"2024-04-26T12:53:16.099024+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:53:16.099024+0000","last_undegraded":"2024-04-26T12:53:16.099024+0000","last_fullsized":"2024-04-26T12:53:16.099024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:23.018038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.428698+0000","last_change":"2024-04-26T12:50:02.264756+0000","last_active":"2024-04-26T12:53:09.428698+0000","last_peered":"2024-04-26T12:53:09.428698+0000","last_clean":"2024-04-26T12:53:09.428698+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:09.428698+0000","last_undegraded":"2024-04-26T12:53:09.428698+0000","last_fullsized":"2024-04-26T12:53:09.428698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:39.304818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.930226+0000","last_change":"2024-04-26T12:49:56.225947+0000","last_active":"2024-04-26T12:53:08.930226+0000","last_peered":"2024-04-26T12:53:08.930226+0000","last_clean":"2024-04-26T12:53:08.930226+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:53:08.930226+0000","last_undegraded":"2024-04-26T12:53:08.930226+0000","last_fullsized":"2024-04-26T12:53:08.930226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:51.767496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.227207+0000","last_change":"2024-04-26T12:49:54.242591+0000","last_active":"2024-04-26T12:53:09.227207+0000","last_peered":"2024-04-26T12:53:09.227207+0000","last_clean":"2024-04-26T12:53:09.227207+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:53:09.227207+0000","last_undegraded":"2024-04-26T12:53:09.227207+0000","last_fullsized":"2024-04-26T12:53:09.227207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310114+0000","last_change":"2024-04-26T12:49:58.241965+0000","last_active":"2024-04-26T12:50:34.310114+0000","last_peered":"2024-04-26T12:50:34.310114+0000","last_clean":"2024-04-26T12:50:34.310114+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:50:34.310114+0000","last_undegraded":"2024-04-26T12:50:34.310114+0000","last_fullsized":"2024-04-26T12:50:34.310114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:10.690590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'43","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.147542+0000","last_change":"2024-04-26T12:50:00.235080+0000","last_active":"2024-04-26T12:53:16.147542+0000","last_peered":"2024-04-26T12:53:16.147542+0000","last_clean":"2024-04-26T12:53:16.147542+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:53:16.147542+0000","last_undegraded":"2024-04-26T12:53:16.147542+0000","last_fullsized":"2024-04-26T12:53:16.147542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.158126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300728+0000","last_change":"2024-04-26T12:50:02.273873+0000","last_active":"2024-04-26T12:50:34.300728+0000","last_peered":"2024-04-26T12:50:34.300728+0000","last_clean":"2024-04-26T12:50:34.300728+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:50:34.300728+0000","last_undegraded":"2024-04-26T12:50:34.300728+0000","last_fullsized":"2024-04-26T12:50:34.300728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:53.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.326178+0000","last_change":"2024-04-26T12:50:04.291139+0000","last_active":"2024-04-26T12:53:09.326178+0000","last_peered":"2024-04-26T12:53:09.326178+0000","last_clean":"2024-04-26T12:53:09.326178+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:53:09.326178+0000","last_undegraded":"2024-04-26T12:53:09.326178+0000","last_fullsized":"2024-04-26T12:53:09.326178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:27.099715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302331+0000","last_change":"2024-04-26T12:49:56.227916+0000","last_active":"2024-04-26T12:51:23.302331+0000","last_peered":"2024-04-26T12:51:23.302331+0000","last_clean":"2024-04-26T12:51:23.302331+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:51:23.302331+0000","last_undegraded":"2024-04-26T12:51:23.302331+0000","last_fullsized":"2024-04-26T12:51:23.302331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:18.700267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.736262+0000","last_change":"2024-04-26T12:49:54.247789+0000","last_active":"2024-04-26T12:53:08.736262+0000","last_peered":"2024-04-26T12:53:08.736262+0000","last_clean":"2024-04-26T12:53:08.736262+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:53:08.736262+0000","last_undegraded":"2024-04-26T12:53:08.736262+0000","last_fullsized":"2024-04-26T12:53:08.736262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.314878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298328+0000","last_change":"2024-04-26T12:49:58.227616+0000","last_active":"2024-04-26T12:50:34.298328+0000","last_peered":"2024-04-26T12:50:34.298328+0000","last_clean":"2024-04-26T12:50:34.298328+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:50:34.298328+0000","last_undegraded":"2024-04-26T12:50:34.298328+0000","last_fullsized":"2024-04-26T12:50:34.298328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:46.747008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'33","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.227454+0000","last_change":"2024-04-26T12:50:00.253636+0000","last_active":"2024-04-26T12:53:16.227454+0000","last_peered":"2024-04-26T12:53:16.227454+0000","last_clean":"2024-04-26T12:53:16.227454+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:53:16.227454+0000","last_undegraded":"2024-04-26T12:53:16.227454+0000","last_fullsized":"2024-04-26T12:53:16.227454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:36.115587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298542+0000","last_change":"2024-04-26T12:50:02.278315+0000","last_active":"2024-04-26T12:50:34.298542+0000","last_peered":"2024-04-26T12:50:34.298542+0000","last_clean":"2024-04-26T12:50:34.298542+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:50:34.298542+0000","last_undegraded":"2024-04-26T12:50:34.298542+0000","last_fullsized":"2024-04-26T12:50:34.298542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:49.074190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:17.319401+0000","last_change":"2024-04-26T12:50:04.276914+0000","last_active":"2024-04-26T12:51:17.319401+0000","last_peered":"2024-04-26T12:51:17.319401+0000","last_clean":"2024-04-26T12:51:17.319401+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:51:17.319401+0000","last_undegraded":"2024-04-26T12:51:17.319401+0000","last_fullsized":"2024-04-26T12:51:17.319401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:42.273211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945853+0000","last_change":"2024-04-26T12:49:56.217097+0000","last_active":"2024-04-26T12:50:39.945853+0000","last_peered":"2024-04-26T12:50:39.945853+0000","last_clean":"2024-04-26T12:50:39.945853+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:50:39.945853+0000","last_undegraded":"2024-04-26T12:50:39.945853+0000","last_fullsized":"2024-04-26T12:50:39.945853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.297824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316635+0000","last_change":"2024-04-26T12:49:54.252650+0000","last_active":"2024-04-26T12:50:34.316635+0000","last_peered":"2024-04-26T12:50:34.316635+0000","last_clean":"2024-04-26T12:50:34.316635+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:50:34.316635+0000","last_undegraded":"2024-04-26T12:50:34.316635+0000","last_fullsized":"2024-04-26T12:50:34.316635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:16.696005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304364+0000","last_change":"2024-04-26T12:49:58.230763+0000","last_active":"2024-04-26T12:50:34.304364+0000","last_peered":"2024-04-26T12:50:34.304364+0000","last_clean":"2024-04-26T12:50:34.304364+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:50:34.304364+0000","last_undegraded":"2024-04-26T12:50:34.304364+0000","last_fullsized":"2024-04-26T12:50:34.304364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:45.346897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'39","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.156748+0000","last_change":"2024-04-26T12:50:00.268771+0000","last_active":"2024-04-26T12:53:16.156748+0000","last_peered":"2024-04-26T12:53:16.156748+0000","last_clean":"2024-04-26T12:53:16.156748+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:53:16.156748+0000","last_undegraded":"2024-04-26T12:53:16.156748+0000","last_fullsized":"2024-04-26T12:53:16.156748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:54.149076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":349,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.625390+0000","last_change":"2024-04-26T12:50:02.271777+0000","last_active":"2024-04-26T12:53:09.625390+0000","last_peered":"2024-04-26T12:53:09.625390+0000","last_clean":"2024-04-26T12:53:09.625390+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:09.625390+0000","last_undegraded":"2024-04-26T12:53:09.625390+0000","last_fullsized":"2024-04-26T12:53:09.625390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:02.220287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300846+0000","last_change":"2024-04-26T12:50:04.295468+0000","last_active":"2024-04-26T12:50:34.300846+0000","last_peered":"2024-04-26T12:50:34.300846+0000","last_clean":"2024-04-26T12:50:34.300846+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:50:34.300846+0000","last_undegraded":"2024-04-26T12:50:34.300846+0000","last_fullsized":"2024-04-26T12:50:34.300846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:16.734503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420472+0000","last_change":"2024-04-26T12:49:56.213567+0000","last_active":"2024-04-26T12:53:09.420472+0000","last_peered":"2024-04-26T12:53:09.420472+0000","last_clean":"2024-04-26T12:53:09.420472+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:09.420472+0000","last_undegraded":"2024-04-26T12:53:09.420472+0000","last_fullsized":"2024-04-26T12:53:09.420472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.363361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.408215+0000","last_change":"2024-04-26T12:49:54.259981+0000","last_active":"2024-04-26T12:53:09.408215+0000","last_peered":"2024-04-26T12:53:09.408215+0000","last_clean":"2024-04-26T12:53:09.408215+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:53:09.408215+0000","last_undegraded":"2024-04-26T12:53:09.408215+0000","last_fullsized":"2024-04-26T12:53:09.408215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:38.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:37.943080+0000","last_change":"2024-04-26T12:50:34.307424+0000","last_active":"2024-04-26T12:50:37.943080+0000","last_peered":"2024-04-26T12:50:37.943080+0000","last_clean":"2024-04-26T12:50:37.943080+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:50:37.943080+0000","last_undegraded":"2024-04-26T12:50:37.943080+0000","last_fullsized":"2024-04-26T12:50:37.943080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:48.963727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'62","reported_seq":126,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.266537+0000","last_change":"2024-04-26T12:50:00.266463+0000","last_active":"2024-04-26T12:53:16.266537+0000","last_peered":"2024-04-26T12:53:16.266537+0000","last_clean":"2024-04-26T12:53:16.266537+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:53:16.266537+0000","last_undegraded":"2024-04-26T12:53:16.266537+0000","last_fullsized":"2024-04-26T12:53:16.266537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:23.507988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297422+0000","last_change":"2024-04-26T12:50:02.276572+0000","last_active":"2024-04-26T12:50:34.297422+0000","last_peered":"2024-04-26T12:50:34.297422+0000","last_clean":"2024-04-26T12:50:34.297422+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:50:34.297422+0000","last_undegraded":"2024-04-26T12:50:34.297422+0000","last_fullsized":"2024-04-26T12:50:34.297422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:09.557600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'20","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.585189+0000","last_change":"2024-04-26T12:50:04.303330+0000","last_active":"2024-04-26T12:53:09.585189+0000","last_peered":"2024-04-26T12:53:09.585189+0000","last_clean":"2024-04-26T12:53:09.585189+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:53:09.585189+0000","last_undegraded":"2024-04-26T12:53:09.585189+0000","last_fullsized":"2024-04-26T12:53:09.585189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:39.932976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.302853+0000","last_change":"2024-04-26T12:49:56.234590+0000","last_active":"2024-04-26T12:51:23.302853+0000","last_peered":"2024-04-26T12:51:23.302853+0000","last_clean":"2024-04-26T12:51:23.302853+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:51:23.302853+0000","last_undegraded":"2024-04-26T12:51:23.302853+0000","last_fullsized":"2024-04-26T12:51:23.302853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:30.414057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300414+0000","last_change":"2024-04-26T12:49:54.239087+0000","last_active":"2024-04-26T12:50:34.300414+0000","last_peered":"2024-04-26T12:50:34.300414+0000","last_clean":"2024-04-26T12:50:34.300414+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:50:34.300414+0000","last_undegraded":"2024-04-26T12:50:34.300414+0000","last_fullsized":"2024-04-26T12:50:34.300414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299450+0000","last_change":"2024-04-26T12:49:58.226242+0000","last_active":"2024-04-26T12:50:34.299450+0000","last_peered":"2024-04-26T12:50:34.299450+0000","last_clean":"2024-04-26T12:50:34.299450+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:50:34.299450+0000","last_undegraded":"2024-04-26T12:50:34.299450+0000","last_fullsized":"2024-04-26T12:50:34.299450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:55.303173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'35","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.273270+0000","last_change":"2024-04-26T12:50:00.235211+0000","last_active":"2024-04-26T12:53:16.273270+0000","last_peered":"2024-04-26T12:53:16.273270+0000","last_clean":"2024-04-26T12:53:16.273270+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:53:16.273270+0000","last_undegraded":"2024-04-26T12:53:16.273270+0000","last_fullsized":"2024-04-26T12:53:16.273270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.091284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322784+0000","last_change":"2024-04-26T12:50:02.283252+0000","last_active":"2024-04-26T12:50:34.322784+0000","last_peered":"2024-04-26T12:50:34.322784+0000","last_clean":"2024-04-26T12:50:34.322784+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:50:34.322784+0000","last_undegraded":"2024-04-26T12:50:34.322784+0000","last_fullsized":"2024-04-26T12:50:34.322784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:56.381142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964007+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:52:07.964007+0000","last_peered":"2024-04-26T12:52:07.964007+0000","last_clean":"2024-04-26T12:52:07.964007+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:52:07.964007+0000","last_undegraded":"2024-04-26T12:52:07.964007+0000","last_fullsized":"2024-04-26T12:52:07.964007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:12.923913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352421+0000","last_change":"2024-04-26T12:49:56.229878+0000","last_active":"2024-04-26T12:53:09.352421+0000","last_peered":"2024-04-26T12:53:09.352421+0000","last_clean":"2024-04-26T12:53:09.352421+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:09.352421+0000","last_undegraded":"2024-04-26T12:53:09.352421+0000","last_fullsized":"2024-04-26T12:53:09.352421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:32.609926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308940+0000","last_change":"2024-04-26T12:49:54.231974+0000","last_active":"2024-04-26T12:50:34.308940+0000","last_peered":"2024-04-26T12:50:34.308940+0000","last_clean":"2024-04-26T12:50:34.308940+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:50:34.308940+0000","last_undegraded":"2024-04-26T12:50:34.308940+0000","last_fullsized":"2024-04-26T12:50:34.308940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:49.172103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299022+0000","last_change":"2024-04-26T12:49:58.230663+0000","last_active":"2024-04-26T12:50:34.299022+0000","last_peered":"2024-04-26T12:50:34.299022+0000","last_clean":"2024-04-26T12:50:34.299022+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:50:34.299022+0000","last_undegraded":"2024-04-26T12:50:34.299022+0000","last_fullsized":"2024-04-26T12:50:34.299022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:00.488394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'40","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.205605+0000","last_change":"2024-04-26T12:50:00.249967+0000","last_active":"2024-04-26T12:53:16.205605+0000","last_peered":"2024-04-26T12:53:16.205605+0000","last_clean":"2024-04-26T12:53:16.205605+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:53:16.205605+0000","last_undegraded":"2024-04-26T12:53:16.205605+0000","last_fullsized":"2024-04-26T12:53:16.205605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:37.320719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":407,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.009404+0000","last_change":"2024-04-26T12:50:02.276171+0000","last_active":"2024-04-26T12:53:16.009404+0000","last_peered":"2024-04-26T12:53:16.009404+0000","last_clean":"2024-04-26T12:53:16.009404+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:16.009404+0000","last_undegraded":"2024-04-26T12:53:16.009404+0000","last_fullsized":"2024-04-26T12:53:16.009404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:55.900264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.539446+0000","last_change":"2024-04-26T12:50:04.296504+0000","last_active":"2024-04-26T12:53:09.539446+0000","last_peered":"2024-04-26T12:53:09.539446+0000","last_clean":"2024-04-26T12:53:09.539446+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:53:09.539446+0000","last_undegraded":"2024-04-26T12:53:09.539446+0000","last_fullsized":"2024-04-26T12:53:09.539446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:36.592447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.287114+0000","last_change":"2024-04-26T12:49:56.221290+0000","last_active":"2024-04-26T12:52:08.287114+0000","last_peered":"2024-04-26T12:52:08.287114+0000","last_clean":"2024-04-26T12:52:08.287114+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:52:08.287114+0000","last_undegraded":"2024-04-26T12:52:08.287114+0000","last_fullsized":"2024-04-26T12:52:08.287114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:22.996331+0000","last_change":"2024-04-26T12:49:54.237237+0000","last_active":"2024-04-26T12:51:22.996331+0000","last_peered":"2024-04-26T12:51:22.996331+0000","last_clean":"2024-04-26T12:51:22.996331+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:51:22.996331+0000","last_undegraded":"2024-04-26T12:51:22.996331+0000","last_fullsized":"2024-04-26T12:51:22.996331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:54.152136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:15.980272+0000","last_change":"2024-04-26T12:49:58.226903+0000","last_active":"2024-04-26T12:53:15.980272+0000","last_peered":"2024-04-26T12:53:15.980272+0000","last_clean":"2024-04-26T12:53:15.980272+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:53:15.980272+0000","last_undegraded":"2024-04-26T12:53:15.980272+0000","last_fullsized":"2024-04-26T12:53:15.980272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:35.711600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316978+0000","last_change":"2024-04-26T12:50:00.268687+0000","last_active":"2024-04-26T12:50:34.316978+0000","last_peered":"2024-04-26T12:50:34.316978+0000","last_clean":"2024-04-26T12:50:34.316978+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:50:34.316978+0000","last_undegraded":"2024-04-26T12:50:34.316978+0000","last_fullsized":"2024-04-26T12:50:34.316978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:31.569888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":469,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.011891+0000","last_change":"2024-04-26T12:50:02.273006+0000","last_active":"2024-04-26T12:53:16.011891+0000","last_peered":"2024-04-26T12:53:16.011891+0000","last_clean":"2024-04-26T12:53:16.011891+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:16.011891+0000","last_undegraded":"2024-04-26T12:53:16.011891+0000","last_fullsized":"2024-04-26T12:53:16.011891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:51.983823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.914810+0000","last_change":"2024-04-26T12:50:04.274718+0000","last_active":"2024-04-26T12:52:07.914810+0000","last_peered":"2024-04-26T12:52:07.914810+0000","last_clean":"2024-04-26T12:52:07.914810+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:52:07.914810+0000","last_undegraded":"2024-04-26T12:52:07.914810+0000","last_fullsized":"2024-04-26T12:52:07.914810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:59.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067278+0000","last_change":"2024-04-26T12:49:56.234752+0000","last_active":"2024-04-26T12:53:09.067278+0000","last_peered":"2024-04-26T12:53:09.067278+0000","last_clean":"2024-04-26T12:53:09.067278+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:09.067278+0000","last_undegraded":"2024-04-26T12:53:09.067278+0000","last_fullsized":"2024-04-26T12:53:09.067278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:23.826434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301149+0000","last_change":"2024-04-26T12:49:54.243701+0000","last_active":"2024-04-26T12:50:34.301149+0000","last_peered":"2024-04-26T12:50:34.301149+0000","last_clean":"2024-04-26T12:50:34.301149+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:50:34.301149+0000","last_undegraded":"2024-04-26T12:50:34.301149+0000","last_fullsized":"2024-04-26T12:50:34.301149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:34.229879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322953+0000","last_change":"2024-04-26T12:49:58.244322+0000","last_active":"2024-04-26T12:50:34.322953+0000","last_peered":"2024-04-26T12:50:34.322953+0000","last_clean":"2024-04-26T12:50:34.322953+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:50:34.322953+0000","last_undegraded":"2024-04-26T12:50:34.322953+0000","last_fullsized":"2024-04-26T12:50:34.322953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:20.832753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'42","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.130138+0000","last_change":"2024-04-26T12:50:00.235679+0000","last_active":"2024-04-26T12:53:16.130138+0000","last_peered":"2024-04-26T12:53:16.130138+0000","last_clean":"2024-04-26T12:53:16.130138+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:53:16.130138+0000","last_undegraded":"2024-04-26T12:53:16.130138+0000","last_fullsized":"2024-04-26T12:53:16.130138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:26.195044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299317+0000","last_change":"2024-04-26T12:50:02.289768+0000","last_active":"2024-04-26T12:50:34.299317+0000","last_peered":"2024-04-26T12:50:34.299317+0000","last_clean":"2024-04-26T12:50:34.299317+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:50:34.299317+0000","last_undegraded":"2024-04-26T12:50:34.299317+0000","last_fullsized":"2024-04-26T12:50:34.299317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:01.413730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.492082+0000","last_change":"2024-04-26T12:50:04.271998+0000","last_active":"2024-04-26T12:53:09.492082+0000","last_peered":"2024-04-26T12:53:09.492082+0000","last_clean":"2024-04-26T12:53:09.492082+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:09.492082+0000","last_undegraded":"2024-04-26T12:53:09.492082+0000","last_fullsized":"2024-04-26T12:53:09.492082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:39.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.936230+0000","last_change":"2024-04-26T12:49:56.231794+0000","last_active":"2024-04-26T12:52:03.936230+0000","last_peered":"2024-04-26T12:52:03.936230+0000","last_clean":"2024-04-26T12:52:03.936230+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:52:03.936230+0000","last_undegraded":"2024-04-26T12:52:03.936230+0000","last_fullsized":"2024-04-26T12:52:03.936230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:53.041573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":202,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301216+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:50:34.301216+0000","last_peered":"2024-04-26T12:50:34.301216+0000","last_clean":"2024-04-26T12:50:34.301216+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:50:34.301216+0000","last_undegraded":"2024-04-26T12:50:34.301216+0000","last_fullsized":"2024-04-26T12:50:34.301216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:51.098345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307677+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:50:34.307677+0000","last_peered":"2024-04-26T12:50:34.307677+0000","last_clean":"2024-04-26T12:50:34.307677+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:50:34.307677+0000","last_undegraded":"2024-04-26T12:50:34.307677+0000","last_fullsized":"2024-04-26T12:50:34.307677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:44.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.874345+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:08.874345+0000","last_peered":"2024-04-26T12:53:08.874345+0000","last_clean":"2024-04-26T12:53:08.874345+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:08.874345+0000","last_undegraded":"2024-04-26T12:53:08.874345+0000","last_fullsized":"2024-04-26T12:53:08.874345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:07.492609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309753+0000","last_change":"2024-04-26T12:49:58.226523+0000","last_active":"2024-04-26T12:50:34.309753+0000","last_peered":"2024-04-26T12:50:34.309753+0000","last_clean":"2024-04-26T12:50:34.309753+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:50:34.309753+0000","last_undegraded":"2024-04-26T12:50:34.309753+0000","last_fullsized":"2024-04-26T12:50:34.309753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:34.614055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'86","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.191546+0000","last_change":"2024-04-26T12:50:00.264564+0000","last_active":"2024-04-26T12:53:16.191546+0000","last_peered":"2024-04-26T12:53:16.191546+0000","last_clean":"2024-04-26T12:53:16.191546+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:53:16.191546+0000","last_undegraded":"2024-04-26T12:53:16.191546+0000","last_fullsized":"2024-04-26T12:53:16.191546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:14.296275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301186+0000","last_change":"2024-04-26T12:50:02.283713+0000","last_active":"2024-04-26T12:50:34.301186+0000","last_peered":"2024-04-26T12:50:34.301186+0000","last_clean":"2024-04-26T12:50:34.301186+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:50:34.301186+0000","last_undegraded":"2024-04-26T12:50:34.301186+0000","last_fullsized":"2024-04-26T12:50:34.301186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:57.660351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.447691+0000","last_change":"2024-04-26T12:50:04.295222+0000","last_active":"2024-04-26T12:53:09.447691+0000","last_peered":"2024-04-26T12:53:09.447691+0000","last_clean":"2024-04-26T12:53:09.447691+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:53:09.447691+0000","last_undegraded":"2024-04-26T12:53:09.447691+0000","last_fullsized":"2024-04-26T12:53:09.447691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:45.205005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.950283+0000","last_change":"2024-04-26T12:49:56.229772+0000","last_active":"2024-04-26T12:52:03.950283+0000","last_peered":"2024-04-26T12:52:03.950283+0000","last_clean":"2024-04-26T12:52:03.950283+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:52:03.950283+0000","last_undegraded":"2024-04-26T12:52:03.950283+0000","last_fullsized":"2024-04-26T12:52:03.950283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:51.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300329+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:50:34.300329+0000","last_peered":"2024-04-26T12:50:34.300329+0000","last_clean":"2024-04-26T12:50:34.300329+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:50:34.300329+0000","last_undegraded":"2024-04-26T12:50:34.300329+0000","last_fullsized":"2024-04-26T12:50:34.300329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:26.774107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297560+0000","last_change":"2024-04-26T12:49:54.242621+0000","last_active":"2024-04-26T12:50:34.297560+0000","last_peered":"2024-04-26T12:50:34.297560+0000","last_clean":"2024-04-26T12:50:34.297560+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:50:34.297560+0000","last_undegraded":"2024-04-26T12:50:34.297560+0000","last_fullsized":"2024-04-26T12:50:34.297560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:13.443714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326393+0000","last_change":"2024-04-26T12:49:58.244054+0000","last_active":"2024-04-26T12:50:34.326393+0000","last_peered":"2024-04-26T12:50:34.326393+0000","last_clean":"2024-04-26T12:50:34.326393+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:50:34.326393+0000","last_undegraded":"2024-04-26T12:50:34.326393+0000","last_fullsized":"2024-04-26T12:50:34.326393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:25.847014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'284","reported_seq":501,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.238329+0000","last_change":"2024-04-26T12:50:00.249276+0000","last_active":"2024-04-26T12:53:16.238329+0000","last_peered":"2024-04-26T12:53:16.238329+0000","last_clean":"2024-04-26T12:53:16.238329+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:16.238329+0000","last_undegraded":"2024-04-26T12:53:16.238329+0000","last_fullsized":"2024-04-26T12:53:16.238329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:57.562801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.314485+0000","last_change":"2024-04-26T12:50:02.283171+0000","last_active":"2024-04-26T12:50:34.314485+0000","last_peered":"2024-04-26T12:50:34.314485+0000","last_clean":"2024-04-26T12:50:34.314485+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:50:34.314485+0000","last_undegraded":"2024-04-26T12:50:34.314485+0000","last_fullsized":"2024-04-26T12:50:34.314485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.718547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.017577+0000","last_change":"2024-04-26T12:50:04.282566+0000","last_active":"2024-04-26T12:51:23.017577+0000","last_peered":"2024-04-26T12:51:23.017577+0000","last_clean":"2024-04-26T12:51:23.017577+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:51:23.017577+0000","last_undegraded":"2024-04-26T12:51:23.017577+0000","last_fullsized":"2024-04-26T12:51:23.017577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:35.825570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420031+0000","last_change":"2024-04-26T12:49:56.225899+0000","last_active":"2024-04-26T12:53:09.420031+0000","last_peered":"2024-04-26T12:53:09.420031+0000","last_clean":"2024-04-26T12:53:09.420031+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:09.420031+0000","last_undegraded":"2024-04-26T12:53:09.420031+0000","last_fullsized":"2024-04-26T12:53:09.420031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:53.411007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295191+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:50:34.295191+0000","last_peered":"2024-04-26T12:50:34.295191+0000","last_clean":"2024-04-26T12:50:34.295191+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:50:34.295191+0000","last_undegraded":"2024-04-26T12:50:34.295191+0000","last_fullsized":"2024-04-26T12:50:34.295191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:41.462105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.243990+0000","last_change":"2024-04-26T12:49:54.236038+0000","last_active":"2024-04-26T12:53:09.243990+0000","last_peered":"2024-04-26T12:53:09.243990+0000","last_clean":"2024-04-26T12:53:09.243990+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:53:09.243990+0000","last_undegraded":"2024-04-26T12:53:09.243990+0000","last_fullsized":"2024-04-26T12:53:09.243990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:40.296155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.329321+0000","last_change":"2024-04-26T12:50:34.328152+0000","last_active":"2024-04-26T12:50:34.329321+0000","last_peered":"2024-04-26T12:50:34.329321+0000","last_clean":"2024-04-26T12:50:34.329321+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:50:34.329321+0000","last_undegraded":"2024-04-26T12:50:34.329321+0000","last_fullsized":"2024-04-26T12:50:34.329321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:37.685088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.474919+0000","last_change":"2024-04-26T12:50:00.249900+0000","last_active":"2024-04-26T12:53:08.474919+0000","last_peered":"2024-04-26T12:53:08.474919+0000","last_clean":"2024-04-26T12:53:08.474919+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:08.474919+0000","last_undegraded":"2024-04-26T12:53:08.474919+0000","last_fullsized":"2024-04-26T12:53:08.474919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:05.719952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300488+0000","last_change":"2024-04-26T12:50:02.279258+0000","last_active":"2024-04-26T12:50:34.300488+0000","last_peered":"2024-04-26T12:50:34.300488+0000","last_clean":"2024-04-26T12:50:34.300488+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:50:34.300488+0000","last_undegraded":"2024-04-26T12:50:34.300488+0000","last_fullsized":"2024-04-26T12:50:34.300488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:01.556723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.071153+0000","last_change":"2024-04-26T12:50:04.302141+0000","last_active":"2024-04-26T12:53:09.071153+0000","last_peered":"2024-04-26T12:53:09.071153+0000","last_clean":"2024-04-26T12:53:09.071153+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:53:09.071153+0000","last_undegraded":"2024-04-26T12:53:09.071153+0000","last_fullsized":"2024-04-26T12:53:09.071153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:27.014519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.301204+0000","last_change":"2024-04-26T12:49:56.218654+0000","last_active":"2024-04-26T12:51:23.301204+0000","last_peered":"2024-04-26T12:51:23.301204+0000","last_clean":"2024-04-26T12:51:23.301204+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:51:23.301204+0000","last_undegraded":"2024-04-26T12:51:23.301204+0000","last_fullsized":"2024-04-26T12:51:23.301204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.466458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306739+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:50:34.306739+0000","last_peered":"2024-04-26T12:50:34.306739+0000","last_clean":"2024-04-26T12:50:34.306739+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:50:34.306739+0000","last_undegraded":"2024-04-26T12:50:34.306739+0000","last_fullsized":"2024-04-26T12:50:34.306739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:33.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296572+0000","last_change":"2024-04-26T12:49:54.228710+0000","last_active":"2024-04-26T12:50:34.296572+0000","last_peered":"2024-04-26T12:50:34.296572+0000","last_clean":"2024-04-26T12:50:34.296572+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:50:34.296572+0000","last_undegraded":"2024-04-26T12:50:34.296572+0000","last_fullsized":"2024-04-26T12:50:34.296572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300941+0000","last_change":"2024-04-26T12:49:58.226208+0000","last_active":"2024-04-26T12:50:34.300941+0000","last_peered":"2024-04-26T12:50:34.300941+0000","last_clean":"2024-04-26T12:50:34.300941+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:50:34.300941+0000","last_undegraded":"2024-04-26T12:50:34.300941+0000","last_fullsized":"2024-04-26T12:50:34.300941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:41.427051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.336167+0000","last_change":"2024-04-26T12:50:00.262398+0000","last_active":"2024-04-26T12:53:08.336167+0000","last_peered":"2024-04-26T12:53:08.336167+0000","last_clean":"2024-04-26T12:53:08.336167+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:08.336167+0000","last_undegraded":"2024-04-26T12:53:08.336167+0000","last_fullsized":"2024-04-26T12:53:08.336167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:15.645393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323584+0000","last_change":"2024-04-26T12:50:02.286212+0000","last_active":"2024-04-26T12:50:34.323584+0000","last_peered":"2024-04-26T12:50:34.323584+0000","last_clean":"2024-04-26T12:50:34.323584+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:50:34.323584+0000","last_undegraded":"2024-04-26T12:50:34.323584+0000","last_fullsized":"2024-04-26T12:50:34.323584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.753285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.892986+0000","last_change":"2024-04-26T12:50:04.290606+0000","last_active":"2024-04-26T12:52:07.892986+0000","last_peered":"2024-04-26T12:52:07.892986+0000","last_clean":"2024-04-26T12:52:07.892986+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:52:07.892986+0000","last_undegraded":"2024-04-26T12:52:07.892986+0000","last_fullsized":"2024-04-26T12:52:07.892986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:57.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.925248+0000","last_change":"2024-04-26T12:49:56.234671+0000","last_active":"2024-04-26T12:53:08.925248+0000","last_peered":"2024-04-26T12:53:08.925248+0000","last_clean":"2024-04-26T12:53:08.925248+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:08.925248+0000","last_undegraded":"2024-04-26T12:53:08.925248+0000","last_fullsized":"2024-04-26T12:53:08.925248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:53.299044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.285576+0000","last_change":"2024-04-26T12:49:54.227464+0000","last_active":"2024-04-26T12:51:23.285576+0000","last_peered":"2024-04-26T12:51:23.285576+0000","last_clean":"2024-04-26T12:51:23.285576+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:51:23.285576+0000","last_undegraded":"2024-04-26T12:51:23.285576+0000","last_fullsized":"2024-04-26T12:51:23.285576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299481+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:50:34.299481+0000","last_peered":"2024-04-26T12:50:34.299481+0000","last_clean":"2024-04-26T12:50:34.299481+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:50:34.299481+0000","last_undegraded":"2024-04-26T12:50:34.299481+0000","last_fullsized":"2024-04-26T12:50:34.299481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:02.796747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163300+0000","last_change":"2024-04-26T12:49:58.218010+0000","last_active":"2024-04-26T12:52:05.163300+0000","last_peered":"2024-04-26T12:52:05.163300+0000","last_clean":"2024-04-26T12:52:05.163300+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:52:05.163300+0000","last_undegraded":"2024-04-26T12:52:05.163300+0000","last_fullsized":"2024-04-26T12:52:05.163300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:41.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.206605+0000","last_change":"2024-04-26T12:50:00.240005+0000","last_active":"2024-04-26T12:52:06.206605+0000","last_peered":"2024-04-26T12:52:06.206605+0000","last_clean":"2024-04-26T12:52:06.206605+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:52:06.206605+0000","last_undegraded":"2024-04-26T12:52:06.206605+0000","last_fullsized":"2024-04-26T12:52:06.206605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:08.343846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.296108+0000","last_change":"2024-04-26T12:50:02.267791+0000","last_active":"2024-04-26T12:50:34.296108+0000","last_peered":"2024-04-26T12:50:34.296108+0000","last_clean":"2024-04-26T12:50:34.296108+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:50:34.296108+0000","last_undegraded":"2024-04-26T12:50:34.296108+0000","last_fullsized":"2024-04-26T12:50:34.296108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:57.795411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.138878+0000","last_change":"2024-04-26T12:50:04.282702+0000","last_active":"2024-04-26T12:52:08.138878+0000","last_peered":"2024-04-26T12:52:08.138878+0000","last_clean":"2024-04-26T12:52:08.138878+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:52:08.138878+0000","last_undegraded":"2024-04-26T12:52:08.138878+0000","last_fullsized":"2024-04-26T12:52:08.138878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:46.989616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.441251+0000","last_change":"2024-04-26T12:49:56.231876+0000","last_active":"2024-04-26T12:53:09.441251+0000","last_peered":"2024-04-26T12:53:09.441251+0000","last_clean":"2024-04-26T12:53:09.441251+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:09.441251+0000","last_undegraded":"2024-04-26T12:53:09.441251+0000","last_fullsized":"2024-04-26T12:53:09.441251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:44.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300795+0000","last_change":"2024-04-26T12:49:54.242611+0000","last_active":"2024-04-26T12:50:34.300795+0000","last_peered":"2024-04-26T12:50:34.300795+0000","last_clean":"2024-04-26T12:50:34.300795+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:50:34.300795+0000","last_undegraded":"2024-04-26T12:50:34.300795+0000","last_fullsized":"2024-04-26T12:50:34.300795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:28.681707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316052+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:50:34.316052+0000","last_peered":"2024-04-26T12:50:34.316052+0000","last_clean":"2024-04-26T12:50:34.316052+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:50:34.316052+0000","last_undegraded":"2024-04-26T12:50:34.316052+0000","last_fullsized":"2024-04-26T12:50:34.316052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:52.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302424+0000","last_change":"2024-04-26T12:49:58.241694+0000","last_active":"2024-04-26T12:50:34.302424+0000","last_peered":"2024-04-26T12:50:34.302424+0000","last_clean":"2024-04-26T12:50:34.302424+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:50:34.302424+0000","last_undegraded":"2024-04-26T12:50:34.302424+0000","last_fullsized":"2024-04-26T12:50:34.302424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.960038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'16","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.959724+0000","last_change":"2024-04-26T12:50:00.249990+0000","last_active":"2024-04-26T12:52:07.959724+0000","last_peered":"2024-04-26T12:52:07.959724+0000","last_clean":"2024-04-26T12:52:07.959724+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:52:07.959724+0000","last_undegraded":"2024-04-26T12:52:07.959724+0000","last_fullsized":"2024-04-26T12:52:07.959724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:16.755935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":359,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.005714+0000","last_change":"2024-04-26T12:50:02.274253+0000","last_active":"2024-04-26T12:53:16.005714+0000","last_peered":"2024-04-26T12:53:16.005714+0000","last_clean":"2024-04-26T12:53:16.005714+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:16.005714+0000","last_undegraded":"2024-04-26T12:53:16.005714+0000","last_fullsized":"2024-04-26T12:53:16.005714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:53.359511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.321938+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:50:34.321938+0000","last_peered":"2024-04-26T12:50:34.321938+0000","last_clean":"2024-04-26T12:50:34.321938+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:50:34.321938+0000","last_undegraded":"2024-04-26T12:50:34.321938+0000","last_fullsized":"2024-04-26T12:50:34.321938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:03.311297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'9","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.438858+0000","last_change":"2024-04-26T12:49:56.226197+0000","last_active":"2024-04-26T12:53:09.438858+0000","last_peered":"2024-04-26T12:53:09.438858+0000","last_clean":"2024-04-26T12:53:09.438858+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:53:09.438858+0000","last_undegraded":"2024-04-26T12:53:09.438858+0000","last_fullsized":"2024-04-26T12:53:09.438858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:07.136832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.326593+0000","last_change":"2024-04-26T12:49:54.253396+0000","last_active":"2024-04-26T12:50:34.326593+0000","last_peered":"2024-04-26T12:50:34.326593+0000","last_clean":"2024-04-26T12:50:34.326593+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:50:34.326593+0000","last_undegraded":"2024-04-26T12:50:34.326593+0000","last_fullsized":"2024-04-26T12:50:34.326593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:39.258567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301688+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:50:34.301688+0000","last_peered":"2024-04-26T12:50:34.301688+0000","last_clean":"2024-04-26T12:50:34.301688+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:50:34.301688+0000","last_undegraded":"2024-04-26T12:50:34.301688+0000","last_fullsized":"2024-04-26T12:50:34.301688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:30.732769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308987+0000","last_change":"2024-04-26T12:49:58.245857+0000","last_active":"2024-04-26T12:50:34.308987+0000","last_peered":"2024-04-26T12:50:34.308987+0000","last_clean":"2024-04-26T12:50:34.308987+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:50:34.308987+0000","last_undegraded":"2024-04-26T12:50:34.308987+0000","last_fullsized":"2024-04-26T12:50:34.308987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.985370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.307845+0000","last_change":"2024-04-26T12:50:00.271933+0000","last_active":"2024-04-26T12:50:34.307845+0000","last_peered":"2024-04-26T12:50:34.307845+0000","last_clean":"2024-04-26T12:50:34.307845+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:50:34.307845+0000","last_undegraded":"2024-04-26T12:50:34.307845+0000","last_fullsized":"2024-04-26T12:50:34.307845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:27.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":430,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.587212+0000","last_change":"2024-04-26T12:50:02.273956+0000","last_active":"2024-04-26T12:53:09.587212+0000","last_peered":"2024-04-26T12:53:09.587212+0000","last_clean":"2024-04-26T12:53:09.587212+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:09.587212+0000","last_undegraded":"2024-04-26T12:53:09.587212+0000","last_fullsized":"2024-04-26T12:53:09.587212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:50.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309143+0000","last_change":"2024-04-26T12:50:04.301343+0000","last_active":"2024-04-26T12:50:34.309143+0000","last_peered":"2024-04-26T12:50:34.309143+0000","last_clean":"2024-04-26T12:50:34.309143+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:50:34.309143+0000","last_undegraded":"2024-04-26T12:50:34.309143+0000","last_fullsized":"2024-04-26T12:50:34.309143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:43.916865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.300311+0000","last_change":"2024-04-26T12:49:56.215393+0000","last_active":"2024-04-26T12:51:23.300311+0000","last_peered":"2024-04-26T12:51:23.300311+0000","last_clean":"2024-04-26T12:51:23.300311+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:51:23.300311+0000","last_undegraded":"2024-04-26T12:51:23.300311+0000","last_fullsized":"2024-04-26T12:51:23.300311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:23.402206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.215677+0000","last_change":"2024-04-26T12:49:54.239381+0000","last_active":"2024-04-26T12:52:08.215677+0000","last_peered":"2024-04-26T12:52:08.215677+0000","last_clean":"2024-04-26T12:52:08.215677+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:52:08.215677+0000","last_undegraded":"2024-04-26T12:52:08.215677+0000","last_fullsized":"2024-04-26T12:52:08.215677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.962867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323186+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:50:34.323186+0000","last_peered":"2024-04-26T12:50:34.323186+0000","last_clean":"2024-04-26T12:50:34.323186+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:50:34.323186+0000","last_undegraded":"2024-04-26T12:50:34.323186+0000","last_fullsized":"2024-04-26T12:50:34.323186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.190860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301969+0000","last_change":"2024-04-26T12:49:58.237558+0000","last_active":"2024-04-26T12:50:34.301969+0000","last_peered":"2024-04-26T12:50:34.301969+0000","last_clean":"2024-04-26T12:50:34.301969+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:50:34.301969+0000","last_undegraded":"2024-04-26T12:50:34.301969+0000","last_fullsized":"2024-04-26T12:50:34.301969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:55.849203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'94","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.243508+0000","last_change":"2024-04-26T12:50:00.262654+0000","last_active":"2024-04-26T12:53:16.243508+0000","last_peered":"2024-04-26T12:53:16.243508+0000","last_clean":"2024-04-26T12:53:16.243508+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:53:16.243508+0000","last_undegraded":"2024-04-26T12:53:16.243508+0000","last_fullsized":"2024-04-26T12:53:16.243508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.678581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299226+0000","last_change":"2024-04-26T12:50:02.277001+0000","last_active":"2024-04-26T12:50:34.299226+0000","last_peered":"2024-04-26T12:50:34.299226+0000","last_clean":"2024-04-26T12:50:34.299226+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:50:34.299226+0000","last_undegraded":"2024-04-26T12:50:34.299226+0000","last_fullsized":"2024-04-26T12:50:34.299226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:28.423042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303169+0000","last_change":"2024-04-26T12:50:04.283865+0000","last_active":"2024-04-26T12:50:34.303169+0000","last_peered":"2024-04-26T12:50:34.303169+0000","last_clean":"2024-04-26T12:50:34.303169+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:50:34.303169+0000","last_undegraded":"2024-04-26T12:50:34.303169+0000","last_fullsized":"2024-04-26T12:50:34.303169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:55.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303220+0000","last_change":"2024-04-26T12:50:04.289462+0000","last_active":"2024-04-26T12:50:34.303220+0000","last_peered":"2024-04-26T12:50:34.303220+0000","last_clean":"2024-04-26T12:50:34.303220+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:50:34.303220+0000","last_undegraded":"2024-04-26T12:50:34.303220+0000","last_fullsized":"2024-04-26T12:50:34.303220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:03.677092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.945866+0000","last_change":"2024-04-26T12:49:56.224657+0000","last_active":"2024-04-26T12:50:39.945866+0000","last_peered":"2024-04-26T12:50:39.945866+0000","last_clean":"2024-04-26T12:50:39.945866+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:50:39.945866+0000","last_undegraded":"2024-04-26T12:50:39.945866+0000","last_fullsized":"2024-04-26T12:50:39.945866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:09.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315720+0000","last_change":"2024-04-26T12:49:54.259672+0000","last_active":"2024-04-26T12:50:34.315720+0000","last_peered":"2024-04-26T12:50:34.315720+0000","last_clean":"2024-04-26T12:50:34.315720+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:50:34.315720+0000","last_undegraded":"2024-04-26T12:50:34.315720+0000","last_fullsized":"2024-04-26T12:50:34.315720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:37.170988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315130+0000","last_change":"2024-04-26T12:49:58.226855+0000","last_active":"2024-04-26T12:50:34.315130+0000","last_peered":"2024-04-26T12:50:34.315130+0000","last_clean":"2024-04-26T12:50:34.315130+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:50:34.315130+0000","last_undegraded":"2024-04-26T12:50:34.315130+0000","last_fullsized":"2024-04-26T12:50:34.315130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:54.671649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'35","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.152232+0000","last_change":"2024-04-26T12:50:00.266320+0000","last_active":"2024-04-26T12:53:16.152232+0000","last_peered":"2024-04-26T12:53:16.152232+0000","last_clean":"2024-04-26T12:53:16.152232+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:53:16.152232+0000","last_undegraded":"2024-04-26T12:53:16.152232+0000","last_fullsized":"2024-04-26T12:53:16.152232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:27.322235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301745+0000","last_change":"2024-04-26T12:50:02.282972+0000","last_active":"2024-04-26T12:50:34.301745+0000","last_peered":"2024-04-26T12:50:34.301745+0000","last_clean":"2024-04-26T12:50:34.301745+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:50:34.301745+0000","last_undegraded":"2024-04-26T12:50:34.301745+0000","last_fullsized":"2024-04-26T12:50:34.301745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:31.666992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.783785+0000","last_change":"2024-04-26T12:50:04.286573+0000","last_active":"2024-04-26T12:52:05.783785+0000","last_peered":"2024-04-26T12:52:05.783785+0000","last_clean":"2024-04-26T12:52:05.783785+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:52:05.783785+0000","last_undegraded":"2024-04-26T12:52:05.783785+0000","last_fullsized":"2024-04-26T12:52:05.783785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:44.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420386+0000","last_change":"2024-04-26T12:50:34.331364+0000","last_active":"2024-04-26T12:53:09.420386+0000","last_peered":"2024-04-26T12:53:09.420386+0000","last_clean":"2024-04-26T12:53:09.420386+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:53:09.420386+0000","last_undegraded":"2024-04-26T12:53:09.420386+0000","last_fullsized":"2024-04-26T12:53:09.420386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:32.541941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299076+0000","last_change":"2024-04-26T12:49:54.242795+0000","last_active":"2024-04-26T12:50:34.299076+0000","last_peered":"2024-04-26T12:50:34.299076+0000","last_clean":"2024-04-26T12:50:34.299076+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:50:34.299076+0000","last_undegraded":"2024-04-26T12:50:34.299076+0000","last_fullsized":"2024-04-26T12:50:34.299076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:35.543759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.327731+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:50:34.327731+0000","last_peered":"2024-04-26T12:50:34.327731+0000","last_clean":"2024-04-26T12:50:34.327731+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:50:34.327731+0000","last_undegraded":"2024-04-26T12:50:34.327731+0000","last_fullsized":"2024-04-26T12:50:34.327731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'5","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.316527+0000","last_change":"2024-04-26T12:50:00.232187+0000","last_active":"2024-04-26T12:53:08.316527+0000","last_peered":"2024-04-26T12:53:08.316527+0000","last_clean":"2024-04-26T12:53:08.316527+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:08.316527+0000","last_undegraded":"2024-04-26T12:53:08.316527+0000","last_fullsized":"2024-04-26T12:53:08.316527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:53.956543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295434+0000","last_change":"2024-04-26T12:50:02.285124+0000","last_active":"2024-04-26T12:50:34.295434+0000","last_peered":"2024-04-26T12:50:34.295434+0000","last_clean":"2024-04-26T12:50:34.295434+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:50:34.295434+0000","last_undegraded":"2024-04-26T12:50:34.295434+0000","last_fullsized":"2024-04-26T12:50:34.295434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.338819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.429582+0000","last_change":"2024-04-26T12:50:04.281861+0000","last_active":"2024-04-26T12:53:08.429582+0000","last_peered":"2024-04-26T12:53:08.429582+0000","last_clean":"2024-04-26T12:53:08.429582+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:08.429582+0000","last_undegraded":"2024-04-26T12:53:08.429582+0000","last_fullsized":"2024-04-26T12:53:08.429582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:06.429465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'15","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.947547+0000","last_change":"2024-04-26T12:49:56.221075+0000","last_active":"2024-04-26T12:53:08.947547+0000","last_peered":"2024-04-26T12:53:08.947547+0000","last_clean":"2024-04-26T12:53:08.947547+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:08.947547+0000","last_undegraded":"2024-04-26T12:53:08.947547+0000","last_fullsized":"2024-04-26T12:53:08.947547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:49.834778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304429+0000","last_change":"2024-04-26T12:49:54.248072+0000","last_active":"2024-04-26T12:50:34.304429+0000","last_peered":"2024-04-26T12:50:34.304429+0000","last_clean":"2024-04-26T12:50:34.304429+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:50:34.304429+0000","last_undegraded":"2024-04-26T12:50:34.304429+0000","last_fullsized":"2024-04-26T12:50:34.304429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.294648+0000","last_change":"2024-04-26T12:49:58.227451+0000","last_active":"2024-04-26T12:50:34.294648+0000","last_peered":"2024-04-26T12:50:34.294648+0000","last_clean":"2024-04-26T12:50:34.294648+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:50:34.294648+0000","last_undegraded":"2024-04-26T12:50:34.294648+0000","last_fullsized":"2024-04-26T12:50:34.294648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:46.024249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'40","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.399673+0000","last_change":"2024-04-26T12:50:00.233555+0000","last_active":"2024-04-26T12:53:08.399673+0000","last_peered":"2024-04-26T12:53:08.399673+0000","last_clean":"2024-04-26T12:53:08.399673+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:08.399673+0000","last_undegraded":"2024-04-26T12:53:08.399673+0000","last_fullsized":"2024-04-26T12:53:08.399673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:46.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.310963+0000","last_change":"2024-04-26T12:50:02.272652+0000","last_active":"2024-04-26T12:50:34.310963+0000","last_peered":"2024-04-26T12:50:34.310963+0000","last_clean":"2024-04-26T12:50:34.310963+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:50:34.310963+0000","last_undegraded":"2024-04-26T12:50:34.310963+0000","last_fullsized":"2024-04-26T12:50:34.310963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:01.660724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.007347+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:51:23.007347+0000","last_peered":"2024-04-26T12:51:23.007347+0000","last_clean":"2024-04-26T12:51:23.007347+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:51:23.007347+0000","last_undegraded":"2024-04-26T12:51:23.007347+0000","last_fullsized":"2024-04-26T12:51:23.007347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:09.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.931477+0000","last_change":"2024-04-26T12:49:56.230150+0000","last_active":"2024-04-26T12:53:08.931477+0000","last_peered":"2024-04-26T12:53:08.931477+0000","last_clean":"2024-04-26T12:53:08.931477+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:08.931477+0000","last_undegraded":"2024-04-26T12:53:08.931477+0000","last_fullsized":"2024-04-26T12:53:08.931477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:24.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.318667+0000","last_change":"2024-04-26T12:49:54.238487+0000","last_active":"2024-04-26T12:50:34.318667+0000","last_peered":"2024-04-26T12:50:34.318667+0000","last_clean":"2024-04-26T12:50:34.318667+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:50:34.318667+0000","last_undegraded":"2024-04-26T12:50:34.318667+0000","last_fullsized":"2024-04-26T12:50:34.318667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.302190+0000","last_change":"2024-04-26T12:49:58.244563+0000","last_active":"2024-04-26T12:50:34.302190+0000","last_peered":"2024-04-26T12:50:34.302190+0000","last_clean":"2024-04-26T12:50:34.302190+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:50:34.302190+0000","last_undegraded":"2024-04-26T12:50:34.302190+0000","last_fullsized":"2024-04-26T12:50:34.302190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:44.871146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'33","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.289867+0000","last_change":"2024-04-26T12:50:00.240164+0000","last_active":"2024-04-26T12:53:16.289867+0000","last_peered":"2024-04-26T12:53:16.289867+0000","last_clean":"2024-04-26T12:53:16.289867+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:53:16.289867+0000","last_undegraded":"2024-04-26T12:53:16.289867+0000","last_fullsized":"2024-04-26T12:53:16.289867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:31.464728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295743+0000","last_change":"2024-04-26T12:50:02.264233+0000","last_active":"2024-04-26T12:50:34.295743+0000","last_peered":"2024-04-26T12:50:34.295743+0000","last_clean":"2024-04-26T12:50:34.295743+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:50:34.295743+0000","last_undegraded":"2024-04-26T12:50:34.295743+0000","last_fullsized":"2024-04-26T12:50:34.295743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:01.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420751+0000","last_change":"2024-04-26T12:49:56.232004+0000","last_active":"2024-04-26T12:53:09.420751+0000","last_peered":"2024-04-26T12:53:09.420751+0000","last_clean":"2024-04-26T12:53:09.420751+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:09.420751+0000","last_undegraded":"2024-04-26T12:53:09.420751+0000","last_fullsized":"2024-04-26T12:53:09.420751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:47.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.300624+0000","last_change":"2024-04-26T12:49:54.241633+0000","last_active":"2024-04-26T12:50:34.300624+0000","last_peered":"2024-04-26T12:50:34.300624+0000","last_clean":"2024-04-26T12:50:34.300624+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:50:34.300624+0000","last_undegraded":"2024-04-26T12:50:34.300624+0000","last_fullsized":"2024-04-26T12:50:34.300624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:03.751774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'4","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.728988+0000","last_change":"2024-04-26T12:49:58.224668+0000","last_active":"2024-04-26T12:52:07.728988+0000","last_peered":"2024-04-26T12:52:07.728988+0000","last_clean":"2024-04-26T12:52:07.728988+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:52:07.728988+0000","last_undegraded":"2024-04-26T12:52:07.728988+0000","last_fullsized":"2024-04-26T12:52:07.728988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:46.613363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'54","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.202377+0000","last_change":"2024-04-26T12:50:00.242408+0000","last_active":"2024-04-26T12:52:06.202377+0000","last_peered":"2024-04-26T12:52:06.202377+0000","last_clean":"2024-04-26T12:52:06.202377+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:52:06.202377+0000","last_undegraded":"2024-04-26T12:52:06.202377+0000","last_fullsized":"2024-04-26T12:52:06.202377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:41.899361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295358+0000","last_change":"2024-04-26T12:50:02.272171+0000","last_active":"2024-04-26T12:50:34.295358+0000","last_peered":"2024-04-26T12:50:34.295358+0000","last_clean":"2024-04-26T12:50:34.295358+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:50:34.295358+0000","last_undegraded":"2024-04-26T12:50:34.295358+0000","last_fullsized":"2024-04-26T12:50:34.295358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:30.101175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.128428+0000","last_change":"2024-04-26T12:50:04.281931+0000","last_active":"2024-04-26T12:52:08.128428+0000","last_peered":"2024-04-26T12:52:08.128428+0000","last_clean":"2024-04-26T12:52:08.128428+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:52:08.128428+0000","last_undegraded":"2024-04-26T12:52:08.128428+0000","last_fullsized":"2024-04-26T12:52:08.128428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:16.500952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:40.677407+0000","last_change":"2024-04-26T12:49:56.224826+0000","last_active":"2024-04-26T12:50:40.677407+0000","last_peered":"2024-04-26T12:50:40.677407+0000","last_clean":"2024-04-26T12:50:40.677407+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:50:40.677407+0000","last_undegraded":"2024-04-26T12:50:40.677407+0000","last_fullsized":"2024-04-26T12:50:40.677407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:46.111343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305246+0000","last_change":"2024-04-26T12:49:54.243620+0000","last_active":"2024-04-26T12:50:34.305246+0000","last_peered":"2024-04-26T12:50:34.305246+0000","last_clean":"2024-04-26T12:50:34.305246+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:50:34.305246+0000","last_undegraded":"2024-04-26T12:50:34.305246+0000","last_fullsized":"2024-04-26T12:50:34.305246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:15.939299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303655+0000","last_change":"2024-04-26T12:49:58.220247+0000","last_active":"2024-04-26T12:50:34.303655+0000","last_peered":"2024-04-26T12:50:34.303655+0000","last_clean":"2024-04-26T12:50:34.303655+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:50:34.303655+0000","last_undegraded":"2024-04-26T12:50:34.303655+0000","last_fullsized":"2024-04-26T12:50:34.303655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:55.363024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'40","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.297202+0000","last_change":"2024-04-26T12:50:00.270194+0000","last_active":"2024-04-26T12:53:16.297202+0000","last_peered":"2024-04-26T12:53:16.297202+0000","last_clean":"2024-04-26T12:53:16.297202+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:53:16.297202+0000","last_undegraded":"2024-04-26T12:53:16.297202+0000","last_fullsized":"2024-04-26T12:53:16.297202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:34.153884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308720+0000","last_change":"2024-04-26T12:50:02.286102+0000","last_active":"2024-04-26T12:50:34.308720+0000","last_peered":"2024-04-26T12:50:34.308720+0000","last_clean":"2024-04-26T12:50:34.308720+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:50:34.308720+0000","last_undegraded":"2024-04-26T12:50:34.308720+0000","last_fullsized":"2024-04-26T12:50:34.308720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:48.894931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301117+0000","last_change":"2024-04-26T12:50:04.302095+0000","last_active":"2024-04-26T12:50:34.301117+0000","last_peered":"2024-04-26T12:50:34.301117+0000","last_clean":"2024-04-26T12:50:34.301117+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:50:34.301117+0000","last_undegraded":"2024-04-26T12:50:34.301117+0000","last_fullsized":"2024-04-26T12:50:34.301117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:22.017086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.067641+0000","last_change":"2024-04-26T12:49:56.232608+0000","last_active":"2024-04-26T12:53:09.067641+0000","last_peered":"2024-04-26T12:53:09.067641+0000","last_clean":"2024-04-26T12:53:09.067641+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:09.067641+0000","last_undegraded":"2024-04-26T12:53:09.067641+0000","last_fullsized":"2024-04-26T12:53:09.067641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:33.707470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.311238+0000","last_change":"2024-04-26T12:49:54.229682+0000","last_active":"2024-04-26T12:50:34.311238+0000","last_peered":"2024-04-26T12:50:34.311238+0000","last_clean":"2024-04-26T12:50:34.311238+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:50:34.311238+0000","last_undegraded":"2024-04-26T12:50:34.311238+0000","last_fullsized":"2024-04-26T12:50:34.311238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:28.696722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295742+0000","last_change":"2024-04-26T12:49:58.218998+0000","last_active":"2024-04-26T12:50:34.295742+0000","last_peered":"2024-04-26T12:50:34.295742+0000","last_clean":"2024-04-26T12:50:34.295742+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:50:34.295742+0000","last_undegraded":"2024-04-26T12:50:34.295742+0000","last_fullsized":"2024-04-26T12:50:34.295742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:57.143731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.762812+0000","last_change":"2024-04-26T12:50:00.239798+0000","last_active":"2024-04-26T12:52:05.762812+0000","last_peered":"2024-04-26T12:52:05.762812+0000","last_clean":"2024-04-26T12:52:05.762812+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:52:05.762812+0000","last_undegraded":"2024-04-26T12:52:05.762812+0000","last_fullsized":"2024-04-26T12:52:05.762812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:35.710193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301139+0000","last_change":"2024-04-26T12:50:02.273673+0000","last_active":"2024-04-26T12:50:34.301139+0000","last_peered":"2024-04-26T12:50:34.301139+0000","last_clean":"2024-04-26T12:50:34.301139+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:50:34.301139+0000","last_undegraded":"2024-04-26T12:50:34.301139+0000","last_fullsized":"2024-04-26T12:50:34.301139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:50.707635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.274746+0000","last_change":"2024-04-26T12:50:04.302374+0000","last_active":"2024-04-26T12:52:08.274746+0000","last_peered":"2024-04-26T12:52:08.274746+0000","last_clean":"2024-04-26T12:52:08.274746+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:52:08.274746+0000","last_undegraded":"2024-04-26T12:52:08.274746+0000","last_fullsized":"2024-04-26T12:52:08.274746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:28.339845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303315+0000","last_change":"2024-04-26T12:49:56.219301+0000","last_active":"2024-04-26T12:50:34.303315+0000","last_peered":"2024-04-26T12:50:34.303315+0000","last_clean":"2024-04-26T12:50:34.303315+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:50:34.303315+0000","last_undegraded":"2024-04-26T12:50:34.303315+0000","last_fullsized":"2024-04-26T12:50:34.303315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:09.581494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.308258+0000","last_change":"2024-04-26T12:49:54.253819+0000","last_active":"2024-04-26T12:50:34.308258+0000","last_peered":"2024-04-26T12:50:34.308258+0000","last_clean":"2024-04-26T12:50:34.308258+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:50:34.308258+0000","last_undegraded":"2024-04-26T12:50:34.308258+0000","last_fullsized":"2024-04-26T12:50:34.308258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:40.717814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319765+0000","last_change":"2024-04-26T12:49:58.227003+0000","last_active":"2024-04-26T12:50:34.319765+0000","last_peered":"2024-04-26T12:50:34.319765+0000","last_clean":"2024-04-26T12:50:34.319765+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:50:34.319765+0000","last_undegraded":"2024-04-26T12:50:34.319765+0000","last_fullsized":"2024-04-26T12:50:34.319765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:18.551779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.322080+0000","last_change":"2024-04-26T12:50:00.272784+0000","last_active":"2024-04-26T12:50:34.322080+0000","last_peered":"2024-04-26T12:50:34.322080+0000","last_clean":"2024-04-26T12:50:34.322080+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:50:34.322080+0000","last_undegraded":"2024-04-26T12:50:34.322080+0000","last_fullsized":"2024-04-26T12:50:34.322080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:08.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.002814+0000","last_change":"2024-04-26T12:50:02.294579+0000","last_active":"2024-04-26T12:53:16.002814+0000","last_peered":"2024-04-26T12:53:16.002814+0000","last_clean":"2024-04-26T12:53:16.002814+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:16.002814+0000","last_undegraded":"2024-04-26T12:53:16.002814+0000","last_fullsized":"2024-04-26T12:53:16.002814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:13.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299552+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:50:34.299552+0000","last_peered":"2024-04-26T12:50:34.299552+0000","last_clean":"2024-04-26T12:50:34.299552+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:50:34.299552+0000","last_undegraded":"2024-04-26T12:50:34.299552+0000","last_fullsized":"2024-04-26T12:50:34.299552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:52.067129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'23","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.283786+0000","last_change":"2024-04-26T12:49:56.213304+0000","last_active":"2024-04-26T12:53:09.283786+0000","last_peered":"2024-04-26T12:53:09.283786+0000","last_clean":"2024-04-26T12:53:09.283786+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:09.283786+0000","last_undegraded":"2024-04-26T12:53:09.283786+0000","last_fullsized":"2024-04-26T12:53:09.283786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:27.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315379+0000","last_change":"2024-04-26T12:49:54.247955+0000","last_active":"2024-04-26T12:50:34.315379+0000","last_peered":"2024-04-26T12:50:34.315379+0000","last_clean":"2024-04-26T12:50:34.315379+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:50:34.315379+0000","last_undegraded":"2024-04-26T12:50:34.315379+0000","last_fullsized":"2024-04-26T12:50:34.315379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313932+0000","last_change":"2024-04-26T12:49:58.227232+0000","last_active":"2024-04-26T12:50:34.313932+0000","last_peered":"2024-04-26T12:50:34.313932+0000","last_clean":"2024-04-26T12:50:34.313932+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:50:34.313932+0000","last_undegraded":"2024-04-26T12:50:34.313932+0000","last_fullsized":"2024-04-26T12:50:34.313932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:55.045703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'39","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.211611+0000","last_change":"2024-04-26T12:50:00.233705+0000","last_active":"2024-04-26T12:53:16.211611+0000","last_peered":"2024-04-26T12:53:16.211611+0000","last_clean":"2024-04-26T12:53:16.211611+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:53:16.211611+0000","last_undegraded":"2024-04-26T12:53:16.211611+0000","last_fullsized":"2024-04-26T12:53:16.211611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:28.085543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297060+0000","last_change":"2024-04-26T12:50:02.271715+0000","last_active":"2024-04-26T12:50:34.297060+0000","last_peered":"2024-04-26T12:50:34.297060+0000","last_clean":"2024-04-26T12:50:34.297060+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:50:34.297060+0000","last_undegraded":"2024-04-26T12:50:34.297060+0000","last_fullsized":"2024-04-26T12:50:34.297060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:04.365884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.319372+0000","last_change":"2024-04-26T12:50:04.283754+0000","last_active":"2024-04-26T12:50:34.319372+0000","last_peered":"2024-04-26T12:50:34.319372+0000","last_clean":"2024-04-26T12:50:34.319372+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:50:34.319372+0000","last_undegraded":"2024-04-26T12:50:34.319372+0000","last_fullsized":"2024-04-26T12:50:34.319372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:32.583019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.295908+0000","last_change":"2024-04-26T12:49:56.216716+0000","last_active":"2024-04-26T12:50:34.295908+0000","last_peered":"2024-04-26T12:50:34.295908+0000","last_clean":"2024-04-26T12:50:34.295908+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:50:34.295908+0000","last_undegraded":"2024-04-26T12:50:34.295908+0000","last_fullsized":"2024-04-26T12:50:34.295908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:46.747501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316296+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:50:34.316296+0000","last_peered":"2024-04-26T12:50:34.316296+0000","last_clean":"2024-04-26T12:50:34.316296+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:50:34.316296+0000","last_undegraded":"2024-04-26T12:50:34.316296+0000","last_fullsized":"2024-04-26T12:50:34.316296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:12.923066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.298228+0000","last_change":"2024-04-26T12:49:58.219225+0000","last_active":"2024-04-26T12:50:34.298228+0000","last_peered":"2024-04-26T12:50:34.298228+0000","last_clean":"2024-04-26T12:50:34.298228+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:50:34.298228+0000","last_undegraded":"2024-04-26T12:50:34.298228+0000","last_fullsized":"2024-04-26T12:50:34.298228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:14.134748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.158832+0000","last_change":"2024-04-26T12:50:00.239861+0000","last_active":"2024-04-26T12:52:06.158832+0000","last_peered":"2024-04-26T12:52:06.158832+0000","last_clean":"2024-04-26T12:52:06.158832+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:52:06.158832+0000","last_undegraded":"2024-04-26T12:52:06.158832+0000","last_fullsized":"2024-04-26T12:52:06.158832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:31.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301391+0000","last_change":"2024-04-26T12:50:02.287940+0000","last_active":"2024-04-26T12:50:34.301391+0000","last_peered":"2024-04-26T12:50:34.301391+0000","last_clean":"2024-04-26T12:50:34.301391+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:50:34.301391+0000","last_undegraded":"2024-04-26T12:50:34.301391+0000","last_fullsized":"2024-04-26T12:50:34.301391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:02.592328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.315974+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:50:34.315974+0000","last_peered":"2024-04-26T12:50:34.315974+0000","last_clean":"2024-04-26T12:50:34.315974+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:50:34.315974+0000","last_undegraded":"2024-04-26T12:50:34.315974+0000","last_fullsized":"2024-04-26T12:50:34.315974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:25.596341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.420535+0000","last_change":"2024-04-26T12:49:56.223405+0000","last_active":"2024-04-26T12:53:09.420535+0000","last_peered":"2024-04-26T12:53:09.420535+0000","last_clean":"2024-04-26T12:53:09.420535+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:53:09.420535+0000","last_undegraded":"2024-04-26T12:53:09.420535+0000","last_fullsized":"2024-04-26T12:53:09.420535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:55.440404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.303556+0000","last_change":"2024-04-26T12:49:54.239137+0000","last_active":"2024-04-26T12:50:34.303556+0000","last_peered":"2024-04-26T12:50:34.303556+0000","last_clean":"2024-04-26T12:50:34.303556+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:50:34.303556+0000","last_undegraded":"2024-04-26T12:50:34.303556+0000","last_fullsized":"2024-04-26T12:50:34.303556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:18.714967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304001+0000","last_change":"2024-04-26T12:49:58.241371+0000","last_active":"2024-04-26T12:50:34.304001+0000","last_peered":"2024-04-26T12:50:34.304001+0000","last_clean":"2024-04-26T12:50:34.304001+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:50:34.304001+0000","last_undegraded":"2024-04-26T12:50:34.304001+0000","last_fullsized":"2024-04-26T12:50:34.304001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:35.312565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.161311+0000","last_change":"2024-04-26T12:50:00.270650+0000","last_active":"2024-04-26T12:53:16.161311+0000","last_peered":"2024-04-26T12:53:16.161311+0000","last_clean":"2024-04-26T12:53:16.161311+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:53:16.161311+0000","last_undegraded":"2024-04-26T12:53:16.161311+0000","last_fullsized":"2024-04-26T12:53:16.161311+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:56.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.306598+0000","last_change":"2024-04-26T12:50:02.288529+0000","last_active":"2024-04-26T12:50:34.306598+0000","last_peered":"2024-04-26T12:50:34.306598+0000","last_clean":"2024-04-26T12:50:34.306598+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:50:34.306598+0000","last_undegraded":"2024-04-26T12:50:34.306598+0000","last_fullsized":"2024-04-26T12:50:34.306598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:56.040177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.279169+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:08.279169+0000","last_peered":"2024-04-26T12:52:08.279169+0000","last_clean":"2024-04-26T12:52:08.279169+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:08.279169+0000","last_undegraded":"2024-04-26T12:52:08.279169+0000","last_fullsized":"2024-04-26T12:52:08.279169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:19.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.013381+0000","last_change":"2024-04-26T12:49:56.215521+0000","last_active":"2024-04-26T12:51:23.013381+0000","last_peered":"2024-04-26T12:51:23.013381+0000","last_clean":"2024-04-26T12:51:23.013381+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:51:23.013381+0000","last_undegraded":"2024-04-26T12:51:23.013381+0000","last_fullsized":"2024-04-26T12:51:23.013381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:02.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.788018+0000","last_change":"2024-04-26T12:49:54.245556+0000","last_active":"2024-04-26T12:53:08.788018+0000","last_peered":"2024-04-26T12:53:08.788018+0000","last_clean":"2024-04-26T12:53:08.788018+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:53:08.788018+0000","last_undegraded":"2024-04-26T12:53:08.788018+0000","last_fullsized":"2024-04-26T12:53:08.788018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:33.882932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:04.471472+0000","last_change":"2024-04-26T12:49:58.241812+0000","last_active":"2024-04-26T12:52:04.471472+0000","last_peered":"2024-04-26T12:52:04.471472+0000","last_clean":"2024-04-26T12:52:04.471472+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:52:04.471472+0000","last_undegraded":"2024-04-26T12:52:04.471472+0000","last_fullsized":"2024-04-26T12:52:04.471472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:49.780417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'35","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.178220+0000","last_change":"2024-04-26T12:50:00.271893+0000","last_active":"2024-04-26T12:53:16.178220+0000","last_peered":"2024-04-26T12:53:16.178220+0000","last_clean":"2024-04-26T12:53:16.178220+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:16.178220+0000","last_undegraded":"2024-04-26T12:53:16.178220+0000","last_fullsized":"2024-04-26T12:53:16.178220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:36.554225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.299396+0000","last_change":"2024-04-26T12:50:02.271711+0000","last_active":"2024-04-26T12:50:34.299396+0000","last_peered":"2024-04-26T12:50:34.299396+0000","last_clean":"2024-04-26T12:50:34.299396+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:50:34.299396+0000","last_undegraded":"2024-04-26T12:50:34.299396+0000","last_fullsized":"2024-04-26T12:50:34.299396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:58.972643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:06.217037+0000","last_change":"2024-04-26T12:50:04.302279+0000","last_active":"2024-04-26T12:52:06.217037+0000","last_peered":"2024-04-26T12:52:06.217037+0000","last_clean":"2024-04-26T12:52:06.217037+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:52:06.217037+0000","last_undegraded":"2024-04-26T12:52:06.217037+0000","last_fullsized":"2024-04-26T12:52:06.217037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:45.287306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.350011+0000","last_change":"2024-04-26T12:49:56.234400+0000","last_active":"2024-04-26T12:53:09.350011+0000","last_peered":"2024-04-26T12:53:09.350011+0000","last_clean":"2024-04-26T12:53:09.350011+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:09.350011+0000","last_undegraded":"2024-04-26T12:53:09.350011+0000","last_fullsized":"2024-04-26T12:53:09.350011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:24.034799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.066998+0000","last_change":"2024-04-26T12:49:54.248434+0000","last_active":"2024-04-26T12:52:08.066998+0000","last_peered":"2024-04-26T12:52:08.066998+0000","last_clean":"2024-04-26T12:52:08.066998+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:52:08.066998+0000","last_undegraded":"2024-04-26T12:52:08.066998+0000","last_fullsized":"2024-04-26T12:52:08.066998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:14.001818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.419891+0000","last_change":"2024-04-26T12:49:56.215256+0000","last_active":"2024-04-26T12:53:09.419891+0000","last_peered":"2024-04-26T12:53:09.419891+0000","last_clean":"2024-04-26T12:53:09.419891+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:09.419891+0000","last_undegraded":"2024-04-26T12:53:09.419891+0000","last_fullsized":"2024-04-26T12:53:09.419891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:41.050135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297396+0000","last_change":"2024-04-26T12:49:54.242913+0000","last_active":"2024-04-26T12:50:34.297396+0000","last_peered":"2024-04-26T12:50:34.297396+0000","last_clean":"2024-04-26T12:50:34.297396+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:50:34.297396+0000","last_undegraded":"2024-04-26T12:50:34.297396+0000","last_fullsized":"2024-04-26T12:50:34.297396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:29.042508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265592+0000","last_change":"2024-04-26T12:49:56.225688+0000","last_active":"2024-04-26T12:53:09.265592+0000","last_peered":"2024-04-26T12:53:09.265592+0000","last_clean":"2024-04-26T12:53:09.265592+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:53:09.265592+0000","last_undegraded":"2024-04-26T12:53:09.265592+0000","last_fullsized":"2024-04-26T12:53:09.265592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:33.308436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.755701+0000","last_change":"2024-04-26T12:49:54.236188+0000","last_active":"2024-04-26T12:53:08.755701+0000","last_peered":"2024-04-26T12:53:08.755701+0000","last_clean":"2024-04-26T12:53:08.755701+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:53:08.755701+0000","last_undegraded":"2024-04-26T12:53:08.755701+0000","last_fullsized":"2024-04-26T12:53:08.755701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:23.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.285259+0000","last_change":"2024-04-26T12:49:56.223112+0000","last_active":"2024-04-26T12:52:08.285259+0000","last_peered":"2024-04-26T12:52:08.285259+0000","last_clean":"2024-04-26T12:52:08.285259+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:52:08.285259+0000","last_undegraded":"2024-04-26T12:52:08.285259+0000","last_fullsized":"2024-04-26T12:52:08.285259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:24.739463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162110+0000","last_change":"2024-04-26T12:49:54.226434+0000","last_active":"2024-04-26T12:52:00.162110+0000","last_peered":"2024-04-26T12:52:00.162110+0000","last_clean":"2024-04-26T12:52:00.162110+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:52:00.162110+0000","last_undegraded":"2024-04-26T12:52:00.162110+0000","last_fullsized":"2024-04-26T12:52:00.162110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:43.586258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301648+0000","last_change":"2024-04-26T12:49:56.221387+0000","last_active":"2024-04-26T12:50:34.301648+0000","last_peered":"2024-04-26T12:50:34.301648+0000","last_clean":"2024-04-26T12:50:34.301648+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:50:34.301648+0000","last_undegraded":"2024-04-26T12:50:34.301648+0000","last_fullsized":"2024-04-26T12:50:34.301648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:33.157222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301072+0000","last_change":"2024-04-26T12:49:54.243199+0000","last_active":"2024-04-26T12:50:34.301072+0000","last_peered":"2024-04-26T12:50:34.301072+0000","last_clean":"2024-04-26T12:50:34.301072+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:50:34.301072+0000","last_undegraded":"2024-04-26T12:50:34.301072+0000","last_fullsized":"2024-04-26T12:50:34.301072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:36.903122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352717+0000","last_change":"2024-04-26T12:49:56.235320+0000","last_active":"2024-04-26T12:53:09.352717+0000","last_peered":"2024-04-26T12:53:09.352717+0000","last_clean":"2024-04-26T12:53:09.352717+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:09.352717+0000","last_undegraded":"2024-04-26T12:53:09.352717+0000","last_fullsized":"2024-04-26T12:53:09.352717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:12.130618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.309160+0000","last_change":"2024-04-26T12:49:54.238503+0000","last_active":"2024-04-26T12:50:34.309160+0000","last_peered":"2024-04-26T12:50:34.309160+0000","last_clean":"2024-04-26T12:50:34.309160+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:50:34.309160+0000","last_undegraded":"2024-04-26T12:50:34.309160+0000","last_fullsized":"2024-04-26T12:50:34.309160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:50.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265292+0000","last_change":"2024-04-26T12:49:56.225647+0000","last_active":"2024-04-26T12:53:09.265292+0000","last_peered":"2024-04-26T12:53:09.265292+0000","last_clean":"2024-04-26T12:53:09.265292+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:53:09.265292+0000","last_undegraded":"2024-04-26T12:53:09.265292+0000","last_fullsized":"2024-04-26T12:53:09.265292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:03.813014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.304680+0000","last_change":"2024-04-26T12:49:54.250162+0000","last_active":"2024-04-26T12:50:34.304680+0000","last_peered":"2024-04-26T12:50:34.304680+0000","last_clean":"2024-04-26T12:50:34.304680+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:50:34.304680+0000","last_undegraded":"2024-04-26T12:50:34.304680+0000","last_fullsized":"2024-04-26T12:50:34.304680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:04.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'7","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.958844+0000","last_change":"2024-04-26T12:49:56.231475+0000","last_active":"2024-04-26T12:52:02.958844+0000","last_peered":"2024-04-26T12:52:02.958844+0000","last_clean":"2024-04-26T12:52:02.958844+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:52:02.958844+0000","last_undegraded":"2024-04-26T12:52:02.958844+0000","last_fullsized":"2024-04-26T12:52:02.958844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:14.927329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439372+0000","last_change":"2024-04-26T12:49:54.229901+0000","last_active":"2024-04-26T12:50:38.439372+0000","last_peered":"2024-04-26T12:50:38.439372+0000","last_clean":"2024-04-26T12:50:38.439372+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:50:38.439372+0000","last_undegraded":"2024-04-26T12:50:38.439372+0000","last_fullsized":"2024-04-26T12:50:38.439372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:38.907969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.083486+0000","last_change":"2024-04-26T12:49:56.218286+0000","last_active":"2024-04-26T12:53:09.083486+0000","last_peered":"2024-04-26T12:53:09.083486+0000","last_clean":"2024-04-26T12:53:09.083486+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:09.083486+0000","last_undegraded":"2024-04-26T12:53:09.083486+0000","last_fullsized":"2024-04-26T12:53:09.083486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:17.751539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.712630+0000","last_change":"2024-04-26T12:49:54.240647+0000","last_active":"2024-04-26T12:53:08.712630+0000","last_peered":"2024-04-26T12:53:08.712630+0000","last_clean":"2024-04-26T12:53:08.712630+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:53:08.712630+0000","last_undegraded":"2024-04-26T12:53:08.712630+0000","last_fullsized":"2024-04-26T12:53:08.712630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:55.293561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.323510+0000","last_change":"2024-04-26T12:49:56.230003+0000","last_active":"2024-04-26T12:50:34.323510+0000","last_peered":"2024-04-26T12:50:34.323510+0000","last_clean":"2024-04-26T12:50:34.323510+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:50:34.323510+0000","last_undegraded":"2024-04-26T12:50:34.323510+0000","last_fullsized":"2024-04-26T12:50:34.323510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:12.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.297885+0000","last_change":"2024-04-26T12:49:54.238656+0000","last_active":"2024-04-26T12:50:34.297885+0000","last_peered":"2024-04-26T12:50:34.297885+0000","last_clean":"2024-04-26T12:50:34.297885+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:50:34.297885+0000","last_undegraded":"2024-04-26T12:50:34.297885+0000","last_fullsized":"2024-04-26T12:50:34.297885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:36.879257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.313256+0000","last_change":"2024-04-26T12:50:34.312404+0000","last_active":"2024-04-26T12:50:34.313256+0000","last_peered":"2024-04-26T12:50:34.313256+0000","last_clean":"2024-04-26T12:50:34.313256+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:50:34.313256+0000","last_undegraded":"2024-04-26T12:50:34.313256+0000","last_fullsized":"2024-04-26T12:50:34.313256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:47.220860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:38.439966+0000","last_change":"2024-04-26T12:49:54.236940+0000","last_active":"2024-04-26T12:50:38.439966+0000","last_peered":"2024-04-26T12:50:38.439966+0000","last_clean":"2024-04-26T12:50:38.439966+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:50:38.439966+0000","last_undegraded":"2024-04-26T12:50:38.439966+0000","last_fullsized":"2024-04-26T12:50:38.439966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:44.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960904+0000","last_change":"2024-04-26T12:49:56.231000+0000","last_active":"2024-04-26T12:52:12.960904+0000","last_peered":"2024-04-26T12:52:12.960904+0000","last_clean":"2024-04-26T12:52:12.960904+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:52:12.960904+0000","last_undegraded":"2024-04-26T12:52:12.960904+0000","last_fullsized":"2024-04-26T12:52:12.960904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:23.072591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.252156+0000","last_change":"2024-04-26T12:49:54.233875+0000","last_active":"2024-04-26T12:53:09.252156+0000","last_peered":"2024-04-26T12:53:09.252156+0000","last_clean":"2024-04-26T12:53:09.252156+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:53:09.252156+0000","last_undegraded":"2024-04-26T12:53:09.252156+0000","last_fullsized":"2024-04-26T12:53:09.252156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:58.620406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352765+0000","last_change":"2024-04-26T12:49:56.234879+0000","last_active":"2024-04-26T12:53:09.352765+0000","last_peered":"2024-04-26T12:53:09.352765+0000","last_clean":"2024-04-26T12:53:09.352765+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:09.352765+0000","last_undegraded":"2024-04-26T12:53:09.352765+0000","last_fullsized":"2024-04-26T12:53:09.352765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:36.234142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316217+0000","last_change":"2024-04-26T12:49:54.252713+0000","last_active":"2024-04-26T12:50:34.316217+0000","last_peered":"2024-04-26T12:50:34.316217+0000","last_clean":"2024-04-26T12:50:34.316217+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:50:34.316217+0000","last_undegraded":"2024-04-26T12:50:34.316217+0000","last_fullsized":"2024-04-26T12:50:34.316217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:16.359098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.927242+0000","last_change":"2024-04-26T12:49:56.223432+0000","last_active":"2024-04-26T12:53:08.927242+0000","last_peered":"2024-04-26T12:53:08.927242+0000","last_clean":"2024-04-26T12:53:08.927242+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:08.927242+0000","last_undegraded":"2024-04-26T12:53:08.927242+0000","last_fullsized":"2024-04-26T12:53:08.927242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.316540+0000","last_change":"2024-04-26T12:49:54.258313+0000","last_active":"2024-04-26T12:50:34.316540+0000","last_peered":"2024-04-26T12:50:34.316540+0000","last_clean":"2024-04-26T12:50:34.316540+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:50:34.316540+0000","last_undegraded":"2024-04-26T12:50:34.316540+0000","last_fullsized":"2024-04-26T12:50:34.316540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:25.040941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.265442+0000","last_change":"2024-04-26T12:49:56.228594+0000","last_active":"2024-04-26T12:53:09.265442+0000","last_peered":"2024-04-26T12:53:09.265442+0000","last_clean":"2024-04-26T12:53:09.265442+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:53:09.265442+0000","last_undegraded":"2024-04-26T12:53:09.265442+0000","last_fullsized":"2024-04-26T12:53:09.265442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:49.872348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.305357+0000","last_change":"2024-04-26T12:49:54.248935+0000","last_active":"2024-04-26T12:50:34.305357+0000","last_peered":"2024-04-26T12:50:34.305357+0000","last_clean":"2024-04-26T12:50:34.305357+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:50:34.305357+0000","last_undegraded":"2024-04-26T12:50:34.305357+0000","last_fullsized":"2024-04-26T12:50:34.305357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:16.074935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.268306+0000","last_change":"2024-04-26T12:49:56.231485+0000","last_active":"2024-04-26T12:52:08.268306+0000","last_peered":"2024-04-26T12:52:08.268306+0000","last_clean":"2024-04-26T12:52:08.268306+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:52:08.268306+0000","last_undegraded":"2024-04-26T12:52:08.268306+0000","last_fullsized":"2024-04-26T12:52:08.268306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:41.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.687845+0000","last_change":"2024-04-26T12:49:54.258409+0000","last_active":"2024-04-26T12:53:08.687845+0000","last_peered":"2024-04-26T12:53:08.687845+0000","last_clean":"2024-04-26T12:53:08.687845+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:53:08.687845+0000","last_undegraded":"2024-04-26T12:53:08.687845+0000","last_fullsized":"2024-04-26T12:53:08.687845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:44.743239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:34.301388+0000","last_change":"2024-04-26T12:49:54.241113+0000","last_active":"2024-04-26T12:50:34.301388+0000","last_peered":"2024-04-26T12:50:34.301388+0000","last_clean":"2024-04-26T12:50:34.301388+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:50:34.301388+0000","last_undegraded":"2024-04-26T12:50:34.301388+0000","last_fullsized":"2024-04-26T12:50:34.301388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.409242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.352305+0000","last_change":"2024-04-26T12:49:56.227407+0000","last_active":"2024-04-26T12:53:09.352305+0000","last_peered":"2024-04-26T12:53:09.352305+0000","last_clean":"2024-04-26T12:53:09.352305+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:09.352305+0000","last_undegraded":"2024-04-26T12:53:09.352305+0000","last_fullsized":"2024-04-26T12:53:09.352305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:50.519330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:50:39.910309+0000","last_change":"2024-04-26T12:49:54.244752+0000","last_active":"2024-04-26T12:50:39.910309+0000","last_peered":"2024-04-26T12:50:39.910309+0000","last_clean":"2024-04-26T12:50:39.910309+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:50:39.910309+0000","last_undegraded":"2024-04-26T12:50:39.910309+0000","last_fullsized":"2024-04-26T12:50:39.910309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.113655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:23.011511+0000","last_change":"2024-04-26T12:49:56.232881+0000","last_active":"2024-04-26T12:51:23.011511+0000","last_peered":"2024-04-26T12:51:23.011511+0000","last_clean":"2024-04-26T12:51:23.011511+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:51:23.011511+0000","last_undegraded":"2024-04-26T12:51:23.011511+0000","last_fullsized":"2024-04-26T12:51:23.011511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:53.358894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2271,"ondisk_log_size":2271,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1558,"num_read_kb":1355,"num_write":583,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1353,"ondisk_log_size":1353,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":968,"num_read_kb":968,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":87,"num_write":315,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":491520,"data_stored":153627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1015808,"data_stored":740708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640304,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1040384,"data_stored":740685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":8956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":9170944,"data_stored":8865182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.217 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.218 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.219 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.220 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.221 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.222 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.223 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.224 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.225 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.226 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:49:39.927089+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.227 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.228 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.229 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.230 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.231 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.232 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.233 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.234 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.235 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.236 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.237 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.238 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.239 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.240 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.241 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.242 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.243 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.244 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.245 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.245 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:21.245 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:53:41.246 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:53:41.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f3560839640 1 Processor -- start 2024-04-26T12:53:41.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f3560839640 1 -- start start 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f3560839640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f355c095390 0x7f355c095770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f3560839640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355c09d410 con 0x7f355c095cb0 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f3560839640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f355c093cb0 con 0x7f355c095390 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f355a59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f355c095390 0x7f355c095770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f3559d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f355c095cb0 0x7f355c12f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36284/0 (socket says 172.21.15.29:36284) 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.378+0000 7f3559d9b640 1 -- 172.21.15.29:0/2578815989 learned_addr learned my addr 172.21.15.29:0/2578815989 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.382+0000 7f355a59c640 1 -- 172.21.15.29:0/2578815989 >> v1:172.21.15.29:6789/0 conn(0x7f355c095cb0 legacy=0x7f355c12f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.382+0000 7f355a59c640 1 -- 172.21.15.29:0/2578815989 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c090e70 con 0x7f355c095390 2024-04-26T12:53:41.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.382+0000 7f355959a640 1 -- 172.21.15.29:0/2578815989 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656430152 0 0) 0x7f355c09d410 con 0x7f355c095cb0 2024-04-26T12:53:41.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.382+0000 7f355a59c640 1 --2- 172.21.15.29:0/2578815989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c095770 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f354c009740 tx=0x7f354c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e90dced974715 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:41.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355959a640 1 -- 172.21.15.29:0/2578815989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354c0b1070 con 0x7f355c095390 2024-04-26T12:53:41.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355959a640 1 -- 172.21.15.29:0/2578815989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c0ac520 con 0x7f355c095390 2024-04-26T12:53:41.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355959a640 1 -- 172.21.15.29:0/2578815989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354c0ac820 con 0x7f355c095390 2024-04-26T12:53:41.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- 172.21.15.29:0/2578815989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 msgr2=0x7f355c095770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:41.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 --2- 172.21.15.29:0/2578815989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c095770 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f354c009740 tx=0x7f354c01c370 comp rx=0 tx=0).stop 2024-04-26T12:53:41.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- 172.21.15.29:0/2578815989 shutdown_connections 2024-04-26T12:53:41.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 --2- 172.21.15.29:0/2578815989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c095770 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:41.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- 172.21.15.29:0/2578815989 >> 172.21.15.29:0/2578815989 conn(0x7f355c09a3f0 msgr2=0x7f355c09a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:41.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- 172.21.15.29:0/2578815989 shutdown_connections 2024-04-26T12:53:41.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- 172.21.15.29:0/2578815989 wait complete. 2024-04-26T12:53:41.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 Processor -- start 2024-04-26T12:53:41.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- start start 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c12ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f355c1337c0 con 0x7f355c095390 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c12ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c12ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46220/0 (socket says 172.21.15.29:46220) 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355a59c640 1 -- 172.21.15.29:0/3273818016 learned_addr learned my addr 172.21.15.29:0/3273818016 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355a59c640 1 -- 172.21.15.29:0/3273818016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c094fc0 con 0x7f355c095390 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f355a59c640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c12ee90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f354c019fa0 tx=0x7f354c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:41.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f354affd640 1 -- 172.21.15.29:0/3273818016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354c0b1050 con 0x7f355c095390 2024-04-26T12:53:41.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f354affd640 1 -- 172.21.15.29:0/3273818016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c0b2040 con 0x7f355c095390 2024-04-26T12:53:41.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355c0944e0 con 0x7f355c095390 2024-04-26T12:53:41.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f354affd640 1 -- 172.21.15.29:0/3273818016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354c004280 con 0x7f355c095390 2024-04-26T12:53:41.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.386+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355c08f440 con 0x7f355c095390 2024-04-26T12:53:41.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.390+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355c062f80 con 0x7f355c095390 2024-04-26T12:53:41.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.390+0000 7f354affd640 1 -- 172.21.15.29:0/3273818016 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f354c0bf060 con 0x7f355c095390 2024-04-26T12:53:41.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.390+0000 7f354affd640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f353c035e00 0x7f353c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:53:41.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.390+0000 7f354affd640 1 -- 172.21.15.29:0/3273818016 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f354c0e2ba0 con 0x7f355c095390 2024-04-26T12:53:41.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.390+0000 7f3559d9b640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f353c035e00 0x7f353c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:53:41.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.390+0000 7f3559d9b640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f353c035e00 0x7f353c0382c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3550007fd0 tx=0x7f3550007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:53:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.394+0000 7f354affd640 1 -- 172.21.15.29:0/3273818016 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f355c090e70 con 0x7f355c095390 2024-04-26T12:53:41.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.554+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f355c08e7c0 con 0x7f353c035e00 2024-04-26T12:53:41.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.598+0000 7f354affd640 1 -- 172.21.15.29:0/3273818016 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658593 (secure 0 0 0) 0x7f355c08e7c0 con 0x7f353c035e00 2024-04-26T12:53:41.605 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:53:41.611 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:53:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f353c035e00 msgr2=0x7f353c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f353c035e00 0x7f353c0382c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3550007fd0 tx=0x7f3550007980 comp rx=0 tx=0).stop 2024-04-26T12:53:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 msgr2=0x7f355c12ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:53:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c12ee90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f354c019fa0 tx=0x7f354c01abb0 comp rx=0 tx=0).stop 2024-04-26T12:53:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 shutdown_connections 2024-04-26T12:53:41.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f353c035e00 0x7f353c0382c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 --2- 172.21.15.29:0/3273818016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f355c095390 0x7f355c12ee90 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:53:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.602+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 >> 172.21.15.29:0/3273818016 conn(0x7f355c09a3f0 msgr2=0x7f355c12f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:53:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.606+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 shutdown_connections 2024-04-26T12:53:41.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:53:41.606+0000 7f3560839640 1 -- 172.21.15.29:0/3273818016 wait complete. 2024-04-26T12:53:41.625 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-04-26T12:53:41.247814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4726,"ondisk_log_size":4726,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144280,"kb_used_data":2936,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343080,"statfs":{"total":386547056640,"available":386399313920,"internally_reserved":0,"allocated":3006464,"data_stored":1788010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":144697107},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006683"},"pg_stats":[{"pgid":"3.3f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.255958+0000","last_change":"2024-04-26T12:49:54.242608+0000","last_active":"2024-04-26T12:53:16.255958+0000","last_peered":"2024-04-26T12:53:16.255958+0000","last_clean":"2024-04-26T12:53:16.255958+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:53:16.255958+0000","last_undegraded":"2024-04-26T12:53:16.255958+0000","last_fullsized":"2024-04-26T12:53:16.255958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.965175+0000","last_change":"2024-04-26T12:49:56.222755+0000","last_active":"2024-04-26T12:52:27.965175+0000","last_peered":"2024-04-26T12:52:27.965175+0000","last_clean":"2024-04-26T12:52:27.965175+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:52:27.965175+0000","last_undegraded":"2024-04-26T12:52:27.965175+0000","last_fullsized":"2024-04-26T12:52:27.965175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162234+0000","last_change":"2024-04-26T12:49:54.235378+0000","last_active":"2024-04-26T12:52:00.162234+0000","last_peered":"2024-04-26T12:52:00.162234+0000","last_clean":"2024-04-26T12:52:00.162234+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:52:00.162234+0000","last_undegraded":"2024-04-26T12:52:00.162234+0000","last_fullsized":"2024-04-26T12:52:00.162234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439607+0000","last_change":"2024-04-26T12:49:56.223502+0000","last_active":"2024-04-26T12:53:09.439607+0000","last_peered":"2024-04-26T12:53:09.439607+0000","last_clean":"2024-04-26T12:53:09.439607+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:53:09.439607+0000","last_undegraded":"2024-04-26T12:53:09.439607+0000","last_fullsized":"2024-04-26T12:53:09.439607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963446+0000","last_change":"2024-04-26T12:49:54.259543+0000","last_active":"2024-04-26T12:52:02.963446+0000","last_peered":"2024-04-26T12:52:02.963446+0000","last_clean":"2024-04-26T12:52:02.963446+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:52:02.963446+0000","last_undegraded":"2024-04-26T12:52:02.963446+0000","last_fullsized":"2024-04-26T12:52:02.963446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'5","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.524608+0000","last_change":"2024-04-26T12:49:56.230220+0000","last_active":"2024-04-26T12:53:09.524608+0000","last_peered":"2024-04-26T12:53:09.524608+0000","last_clean":"2024-04-26T12:53:09.524608+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:09.524608+0000","last_undegraded":"2024-04-26T12:53:09.524608+0000","last_fullsized":"2024-04-26T12:53:09.524608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.989586+0000","last_change":"2024-04-26T12:49:54.243452+0000","last_active":"2024-04-26T12:52:07.989586+0000","last_peered":"2024-04-26T12:52:07.989586+0000","last_clean":"2024-04-26T12:52:07.989586+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:52:07.989586+0000","last_undegraded":"2024-04-26T12:52:07.989586+0000","last_fullsized":"2024-04-26T12:52:07.989586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.284399+0000","last_change":"2024-04-26T12:50:34.320557+0000","last_active":"2024-04-26T12:53:09.284399+0000","last_peered":"2024-04-26T12:53:09.284399+0000","last_clean":"2024-04-26T12:53:09.284399+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:53:09.284399+0000","last_undegraded":"2024-04-26T12:53:09.284399+0000","last_fullsized":"2024-04-26T12:53:09.284399+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969661+0000","last_change":"2024-04-26T12:49:54.237140+0000","last_active":"2024-04-26T12:52:27.969661+0000","last_peered":"2024-04-26T12:52:27.969661+0000","last_clean":"2024-04-26T12:52:27.969661+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:52:27.969661+0000","last_undegraded":"2024-04-26T12:52:27.969661+0000","last_fullsized":"2024-04-26T12:52:27.969661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:57.957622+0000","last_change":"2024-04-26T12:49:56.231677+0000","last_active":"2024-04-26T12:51:57.957622+0000","last_peered":"2024-04-26T12:51:57.957622+0000","last_clean":"2024-04-26T12:51:57.957622+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:51:57.957622+0000","last_undegraded":"2024-04-26T12:51:57.957622+0000","last_fullsized":"2024-04-26T12:51:57.957622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.966006+0000","last_change":"2024-04-26T12:49:54.242489+0000","last_active":"2024-04-26T12:52:27.966006+0000","last_peered":"2024-04-26T12:52:27.966006+0000","last_clean":"2024-04-26T12:52:27.966006+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:52:27.966006+0000","last_undegraded":"2024-04-26T12:52:27.966006+0000","last_fullsized":"2024-04-26T12:52:27.966006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963379+0000","last_change":"2024-04-26T12:49:56.229364+0000","last_active":"2024-04-26T12:52:02.963379+0000","last_peered":"2024-04-26T12:52:02.963379+0000","last_clean":"2024-04-26T12:52:02.963379+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:52:02.963379+0000","last_undegraded":"2024-04-26T12:52:02.963379+0000","last_fullsized":"2024-04-26T12:52:02.963379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969368+0000","last_change":"2024-04-26T12:49:54.238559+0000","last_active":"2024-04-26T12:52:27.969368+0000","last_peered":"2024-04-26T12:52:27.969368+0000","last_clean":"2024-04-26T12:52:27.969368+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:52:27.969368+0000","last_undegraded":"2024-04-26T12:52:27.969368+0000","last_fullsized":"2024-04-26T12:52:27.969368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'6","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.526906+0000","last_change":"2024-04-26T12:49:56.219293+0000","last_active":"2024-04-26T12:53:09.526906+0000","last_peered":"2024-04-26T12:53:09.526906+0000","last_clean":"2024-04-26T12:53:09.526906+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:09.526906+0000","last_undegraded":"2024-04-26T12:53:09.526906+0000","last_fullsized":"2024-04-26T12:53:09.526906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:25.168089+0000","last_change":"2024-04-26T12:49:54.238122+0000","last_active":"2024-04-26T12:52:25.168089+0000","last_peered":"2024-04-26T12:52:25.168089+0000","last_clean":"2024-04-26T12:52:25.168089+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:52:25.168089+0000","last_undegraded":"2024-04-26T12:52:25.168089+0000","last_fullsized":"2024-04-26T12:52:25.168089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.951836+0000","last_change":"2024-04-26T12:49:56.214215+0000","last_active":"2024-04-26T12:52:03.951836+0000","last_peered":"2024-04-26T12:52:03.951836+0000","last_clean":"2024-04-26T12:52:03.951836+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:52:03.951836+0000","last_undegraded":"2024-04-26T12:52:03.951836+0000","last_fullsized":"2024-04-26T12:52:03.951836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.080713+0000","last_change":"2024-04-26T12:49:56.220575+0000","last_active":"2024-04-26T12:53:09.080713+0000","last_peered":"2024-04-26T12:53:09.080713+0000","last_clean":"2024-04-26T12:53:09.080713+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:53:09.080713+0000","last_undegraded":"2024-04-26T12:53:09.080713+0000","last_fullsized":"2024-04-26T12:53:09.080713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964132+0000","last_change":"2024-04-26T12:49:54.245871+0000","last_active":"2024-04-26T12:52:22.964132+0000","last_peered":"2024-04-26T12:52:22.964132+0000","last_clean":"2024-04-26T12:52:22.964132+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:52:22.964132+0000","last_undegraded":"2024-04-26T12:52:22.964132+0000","last_fullsized":"2024-04-26T12:52:22.964132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.285973+0000","last_change":"2024-04-26T12:49:56.220421+0000","last_active":"2024-04-26T12:53:09.285973+0000","last_peered":"2024-04-26T12:53:09.285973+0000","last_clean":"2024-04-26T12:53:09.285973+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:09.285973+0000","last_undegraded":"2024-04-26T12:53:09.285973+0000","last_fullsized":"2024-04-26T12:53:09.285973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'4","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.256244+0000","last_change":"2024-04-26T12:49:54.250106+0000","last_active":"2024-04-26T12:53:16.256244+0000","last_peered":"2024-04-26T12:53:16.256244+0000","last_clean":"2024-04-26T12:53:16.256244+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:53:16.256244+0000","last_undegraded":"2024-04-26T12:53:16.256244+0000","last_fullsized":"2024-04-26T12:53:16.256244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.368886+0000","last_change":"2024-04-26T12:49:56.222834+0000","last_active":"2024-04-26T12:53:09.368886+0000","last_peered":"2024-04-26T12:53:09.368886+0000","last_clean":"2024-04-26T12:53:09.368886+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:09.368886+0000","last_undegraded":"2024-04-26T12:53:09.368886+0000","last_fullsized":"2024-04-26T12:53:09.368886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.963925+0000","last_change":"2024-04-26T12:49:54.244413+0000","last_active":"2024-04-26T12:52:22.963925+0000","last_peered":"2024-04-26T12:52:22.963925+0000","last_clean":"2024-04-26T12:52:22.963925+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:52:22.963925+0000","last_undegraded":"2024-04-26T12:52:22.963925+0000","last_fullsized":"2024-04-26T12:52:22.963925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.947497+0000","last_change":"2024-04-26T12:49:56.221481+0000","last_active":"2024-04-26T12:53:08.947497+0000","last_peered":"2024-04-26T12:53:08.947497+0000","last_clean":"2024-04-26T12:53:08.947497+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:53:08.947497+0000","last_undegraded":"2024-04-26T12:53:08.947497+0000","last_fullsized":"2024-04-26T12:53:08.947497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.226025+0000","last_change":"2024-04-26T12:49:54.246419+0000","last_active":"2024-04-26T12:53:09.226025+0000","last_peered":"2024-04-26T12:53:09.226025+0000","last_clean":"2024-04-26T12:53:09.226025+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:09.226025+0000","last_undegraded":"2024-04-26T12:53:09.226025+0000","last_fullsized":"2024-04-26T12:53:09.226025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964648+0000","last_change":"2024-04-26T12:49:56.215781+0000","last_active":"2024-04-26T12:52:22.964648+0000","last_peered":"2024-04-26T12:52:22.964648+0000","last_clean":"2024-04-26T12:52:22.964648+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:52:22.964648+0000","last_undegraded":"2024-04-26T12:52:22.964648+0000","last_fullsized":"2024-04-26T12:52:22.964648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:20.167049+0000","last_change":"2024-04-26T12:49:54.235967+0000","last_active":"2024-04-26T12:52:20.167049+0000","last_peered":"2024-04-26T12:52:20.167049+0000","last_clean":"2024-04-26T12:52:20.167049+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:52:20.167049+0000","last_undegraded":"2024-04-26T12:52:20.167049+0000","last_fullsized":"2024-04-26T12:52:20.167049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.369311+0000","last_change":"2024-04-26T12:49:56.230516+0000","last_active":"2024-04-26T12:53:09.369311+0000","last_peered":"2024-04-26T12:53:09.369311+0000","last_clean":"2024-04-26T12:53:09.369311+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:09.369311+0000","last_undegraded":"2024-04-26T12:53:09.369311+0000","last_fullsized":"2024-04-26T12:53:09.369311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966599+0000","last_change":"2024-04-26T12:49:54.231273+0000","last_active":"2024-04-26T12:52:17.966599+0000","last_peered":"2024-04-26T12:52:17.966599+0000","last_clean":"2024-04-26T12:52:17.966599+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:52:17.966599+0000","last_undegraded":"2024-04-26T12:52:17.966599+0000","last_fullsized":"2024-04-26T12:52:17.966599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.464226+0000","last_change":"2024-04-26T12:50:04.290015+0000","last_active":"2024-04-26T12:53:09.464226+0000","last_peered":"2024-04-26T12:53:09.464226+0000","last_clean":"2024-04-26T12:53:09.464226+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:53:09.464226+0000","last_undegraded":"2024-04-26T12:53:09.464226+0000","last_fullsized":"2024-04-26T12:53:09.464226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.523853+0000","last_change":"2024-04-26T12:49:56.230418+0000","last_active":"2024-04-26T12:53:09.523853+0000","last_peered":"2024-04-26T12:53:09.523853+0000","last_clean":"2024-04-26T12:53:09.523853+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:53:09.523853+0000","last_undegraded":"2024-04-26T12:53:09.523853+0000","last_fullsized":"2024-04-26T12:53:09.523853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966667+0000","last_change":"2024-04-26T12:49:54.258161+0000","last_active":"2024-04-26T12:52:17.966667+0000","last_peered":"2024-04-26T12:52:17.966667+0000","last_clean":"2024-04-26T12:52:17.966667+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:52:17.966667+0000","last_undegraded":"2024-04-26T12:52:17.966667+0000","last_fullsized":"2024-04-26T12:52:17.966667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.392070+0000","last_change":"2024-04-26T12:53:23.392134+0000","last_active":"2024-04-26T12:53:23.392070+0000","last_peered":"2024-04-26T12:53:23.392070+0000","last_clean":"2024-04-26T12:53:23.392070+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:53:23.392070+0000","last_undegraded":"2024-04-26T12:53:23.392070+0000","last_fullsized":"2024-04-26T12:53:23.392070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.391874+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:06.575701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.391893+0000","last_change":"2024-04-26T12:53:37.391968+0000","last_active":"2024-04-26T12:53:37.391893+0000","last_peered":"2024-04-26T12:53:37.391893+0000","last_clean":"2024-04-26T12:53:37.391893+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:53:37.391893+0000","last_undegraded":"2024-04-26T12:53:37.391893+0000","last_fullsized":"2024-04-26T12:53:37.391893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.391713+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:06.145759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.965758+0000","last_change":"2024-04-26T12:50:02.286913+0000","last_active":"2024-04-26T12:52:27.965758+0000","last_peered":"2024-04-26T12:52:27.965758+0000","last_clean":"2024-04-26T12:52:27.965758+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:52:27.965758+0000","last_undegraded":"2024-04-26T12:52:27.965758+0000","last_fullsized":"2024-04-26T12:52:27.965758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.966913+0000","last_change":"2024-04-26T12:50:04.289706+0000","last_active":"2024-04-26T12:52:32.966913+0000","last_peered":"2024-04-26T12:52:32.966913+0000","last_clean":"2024-04-26T12:52:32.966913+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:52:32.966913+0000","last_undegraded":"2024-04-26T12:52:32.966913+0000","last_fullsized":"2024-04-26T12:52:32.966913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.384124+0000","last_change":"2024-04-26T12:53:36.384186+0000","last_active":"2024-04-26T12:53:36.384124+0000","last_peered":"2024-04-26T12:53:36.384124+0000","last_clean":"2024-04-26T12:53:36.384124+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:36.384124+0000","last_undegraded":"2024-04-26T12:53:36.384124+0000","last_fullsized":"2024-04-26T12:53:36.384124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.383922+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:56.789282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.963133+0000","last_change":"2024-04-26T12:49:54.239992+0000","last_active":"2024-04-26T12:52:17.963133+0000","last_peered":"2024-04-26T12:52:17.963133+0000","last_clean":"2024-04-26T12:52:17.963133+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:52:17.963133+0000","last_undegraded":"2024-04-26T12:52:17.963133+0000","last_fullsized":"2024-04-26T12:52:17.963133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:20.167079+0000","last_change":"2024-04-26T12:49:58.222832+0000","last_active":"2024-04-26T12:52:20.167079+0000","last_peered":"2024-04-26T12:52:20.167079+0000","last_clean":"2024-04-26T12:52:20.167079+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:52:20.167079+0000","last_undegraded":"2024-04-26T12:52:20.167079+0000","last_fullsized":"2024-04-26T12:52:20.167079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.076724+0000","last_change":"2024-04-26T12:53:23.076800+0000","last_active":"2024-04-26T12:53:23.076724+0000","last_peered":"2024-04-26T12:53:23.076724+0000","last_clean":"2024-04-26T12:53:23.076724+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:53:23.076724+0000","last_undegraded":"2024-04-26T12:53:23.076724+0000","last_fullsized":"2024-04-26T12:53:23.076724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.076513+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:18.548345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.104710+0000","last_change":"2024-04-26T12:53:32.104841+0000","last_active":"2024-04-26T12:53:32.104710+0000","last_peered":"2024-04-26T12:53:32.104710+0000","last_clean":"2024-04-26T12:53:32.104710+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:53:32.104710+0000","last_undegraded":"2024-04-26T12:53:32.104710+0000","last_fullsized":"2024-04-26T12:53:32.104710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.104460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:40.209749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:35.170398+0000","last_change":"2024-04-26T12:50:04.281974+0000","last_active":"2024-04-26T12:52:35.170398+0000","last_peered":"2024-04-26T12:52:35.170398+0000","last_clean":"2024-04-26T12:52:35.170398+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:52:35.170398+0000","last_undegraded":"2024-04-26T12:52:35.170398+0000","last_fullsized":"2024-04-26T12:52:35.170398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.968311+0000","last_change":"2024-04-26T12:49:56.230322+0000","last_active":"2024-04-26T12:52:22.968311+0000","last_peered":"2024-04-26T12:52:22.968311+0000","last_clean":"2024-04-26T12:52:22.968311+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:52:22.968311+0000","last_undegraded":"2024-04-26T12:52:22.968311+0000","last_fullsized":"2024-04-26T12:52:22.968311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966529+0000","last_change":"2024-04-26T12:49:54.238247+0000","last_active":"2024-04-26T12:52:17.966529+0000","last_peered":"2024-04-26T12:52:17.966529+0000","last_clean":"2024-04-26T12:52:17.966529+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:52:17.966529+0000","last_undegraded":"2024-04-26T12:52:17.966529+0000","last_fullsized":"2024-04-26T12:52:17.966529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:25.168384+0000","last_change":"2024-04-26T12:49:58.227229+0000","last_active":"2024-04-26T12:52:25.168384+0000","last_peered":"2024-04-26T12:52:25.168384+0000","last_clean":"2024-04-26T12:52:25.168384+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:52:25.168384+0000","last_undegraded":"2024-04-26T12:52:25.168384+0000","last_fullsized":"2024-04-26T12:52:25.168384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.735659+0000","last_change":"2024-04-26T12:53:25.735736+0000","last_active":"2024-04-26T12:53:25.735659+0000","last_peered":"2024-04-26T12:53:25.735659+0000","last_clean":"2024-04-26T12:53:25.735659+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:53:25.735659+0000","last_undegraded":"2024-04-26T12:53:25.735659+0000","last_fullsized":"2024-04-26T12:53:25.735659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.735419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.323105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":390,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.311968+0000","last_change":"2024-04-26T12:50:02.294244+0000","last_active":"2024-04-26T12:53:16.311968+0000","last_peered":"2024-04-26T12:53:16.311968+0000","last_clean":"2024-04-26T12:53:16.311968+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:16.311968+0000","last_undegraded":"2024-04-26T12:53:16.311968+0000","last_fullsized":"2024-04-26T12:53:16.311968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:37.968667+0000","last_change":"2024-04-26T12:50:04.283093+0000","last_active":"2024-04-26T12:52:37.968667+0000","last_peered":"2024-04-26T12:52:37.968667+0000","last_clean":"2024-04-26T12:52:37.968667+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:52:37.968667+0000","last_undegraded":"2024-04-26T12:52:37.968667+0000","last_fullsized":"2024-04-26T12:52:37.968667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.369313+0000","last_change":"2024-04-26T12:49:56.227048+0000","last_active":"2024-04-26T12:53:09.369313+0000","last_peered":"2024-04-26T12:53:09.369313+0000","last_clean":"2024-04-26T12:53:09.369313+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:09.369313+0000","last_undegraded":"2024-04-26T12:53:09.369313+0000","last_fullsized":"2024-04-26T12:53:09.369313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.962034+0000","last_change":"2024-04-26T12:49:54.236350+0000","last_active":"2024-04-26T12:52:17.962034+0000","last_peered":"2024-04-26T12:52:17.962034+0000","last_clean":"2024-04-26T12:52:17.962034+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:52:17.962034+0000","last_undegraded":"2024-04-26T12:52:17.962034+0000","last_fullsized":"2024-04-26T12:52:17.962034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.380805+0000","last_change":"2024-04-26T12:53:22.380865+0000","last_active":"2024-04-26T12:53:22.380805+0000","last_peered":"2024-04-26T12:53:22.380805+0000","last_clean":"2024-04-26T12:53:22.380805+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:53:22.380805+0000","last_undegraded":"2024-04-26T12:53:22.380805+0000","last_fullsized":"2024-04-26T12:53:22.380805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.380528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.319667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.752160+0000","last_change":"2024-04-26T12:53:26.752246+0000","last_active":"2024-04-26T12:53:26.752160+0000","last_peered":"2024-04-26T12:53:26.752160+0000","last_clean":"2024-04-26T12:53:26.752160+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:53:26.752160+0000","last_undegraded":"2024-04-26T12:53:26.752160+0000","last_fullsized":"2024-04-26T12:53:26.752160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.751972+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:59.415047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":414,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.264797+0000","last_change":"2024-04-26T12:53:27.264864+0000","last_active":"2024-04-26T12:53:27.264797+0000","last_peered":"2024-04-26T12:53:27.264797+0000","last_clean":"2024-04-26T12:53:27.264797+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:27.264797+0000","last_undegraded":"2024-04-26T12:53:27.264797+0000","last_fullsized":"2024-04-26T12:53:27.264797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.264595+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:14.426766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.948099+0000","last_change":"2024-04-26T12:49:56.225947+0000","last_active":"2024-04-26T12:53:08.948099+0000","last_peered":"2024-04-26T12:53:08.948099+0000","last_clean":"2024-04-26T12:53:08.948099+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:53:08.948099+0000","last_undegraded":"2024-04-26T12:53:08.948099+0000","last_fullsized":"2024-04-26T12:53:08.948099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.234533+0000","last_change":"2024-04-26T12:49:54.242591+0000","last_active":"2024-04-26T12:53:09.234533+0000","last_peered":"2024-04-26T12:53:09.234533+0000","last_clean":"2024-04-26T12:53:09.234533+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:53:09.234533+0000","last_undegraded":"2024-04-26T12:53:09.234533+0000","last_fullsized":"2024-04-26T12:53:09.234533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.034820+0000","last_change":"2024-04-26T12:53:29.034874+0000","last_active":"2024-04-26T12:53:29.034820+0000","last_peered":"2024-04-26T12:53:29.034820+0000","last_clean":"2024-04-26T12:53:29.034820+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:53:29.034820+0000","last_undegraded":"2024-04-26T12:53:29.034820+0000","last_fullsized":"2024-04-26T12:53:29.034820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.034638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:13.359122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.842225+0000","last_change":"2024-04-26T12:53:33.842323+0000","last_active":"2024-04-26T12:53:33.842225+0000","last_peered":"2024-04-26T12:53:33.842225+0000","last_clean":"2024-04-26T12:53:33.842225+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:53:33.842225+0000","last_undegraded":"2024-04-26T12:53:33.842225+0000","last_fullsized":"2024-04-26T12:53:33.842225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.842014+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.029425+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.367707+0000","last_change":"2024-04-26T12:53:20.367753+0000","last_active":"2024-04-26T12:53:20.367707+0000","last_peered":"2024-04-26T12:53:20.367707+0000","last_clean":"2024-04-26T12:53:20.367707+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:53:20.367707+0000","last_undegraded":"2024-04-26T12:53:20.367707+0000","last_fullsized":"2024-04-26T12:53:20.367707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.367584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:03.848633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.431771+0000","last_change":"2024-04-26T12:50:04.291139+0000","last_active":"2024-04-26T12:53:09.431771+0000","last_peered":"2024-04-26T12:53:09.431771+0000","last_clean":"2024-04-26T12:53:09.431771+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:53:09.431771+0000","last_undegraded":"2024-04-26T12:53:09.431771+0000","last_fullsized":"2024-04-26T12:53:09.431771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.959713+0000","last_change":"2024-04-26T12:49:56.227916+0000","last_active":"2024-04-26T12:52:07.959713+0000","last_peered":"2024-04-26T12:52:07.959713+0000","last_clean":"2024-04-26T12:52:07.959713+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:52:07.959713+0000","last_undegraded":"2024-04-26T12:52:07.959713+0000","last_fullsized":"2024-04-26T12:52:07.959713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.259029+0000","last_change":"2024-04-26T12:49:54.247789+0000","last_active":"2024-04-26T12:53:16.259029+0000","last_peered":"2024-04-26T12:53:16.259029+0000","last_clean":"2024-04-26T12:53:16.259029+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:53:16.259029+0000","last_undegraded":"2024-04-26T12:53:16.259029+0000","last_fullsized":"2024-04-26T12:53:16.259029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.210053+0000","last_change":"2024-04-26T12:53:39.210108+0000","last_active":"2024-04-26T12:53:39.210053+0000","last_peered":"2024-04-26T12:53:39.210053+0000","last_clean":"2024-04-26T12:53:39.210053+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:53:39.210053+0000","last_undegraded":"2024-04-26T12:53:39.210053+0000","last_fullsized":"2024-04-26T12:53:39.210053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.209817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:09.302793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.322616+0000","last_change":"2024-04-26T12:53:25.322771+0000","last_active":"2024-04-26T12:53:25.322616+0000","last_peered":"2024-04-26T12:53:25.322616+0000","last_clean":"2024-04-26T12:53:25.322616+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:53:25.322616+0000","last_undegraded":"2024-04-26T12:53:25.322616+0000","last_fullsized":"2024-04-26T12:53:25.322616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.322379+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:57.683471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.239097+0000","last_change":"2024-04-26T12:53:33.239150+0000","last_active":"2024-04-26T12:53:33.239097+0000","last_peered":"2024-04-26T12:53:33.239097+0000","last_clean":"2024-04-26T12:53:33.239097+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:53:33.239097+0000","last_undegraded":"2024-04-26T12:53:33.239097+0000","last_fullsized":"2024-04-26T12:53:33.239097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.238876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:14.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960948+0000","last_change":"2024-04-26T12:50:04.276914+0000","last_active":"2024-04-26T12:52:12.960948+0000","last_peered":"2024-04-26T12:52:12.960948+0000","last_clean":"2024-04-26T12:52:12.960948+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:52:12.960948+0000","last_undegraded":"2024-04-26T12:52:12.960948+0000","last_fullsized":"2024-04-26T12:52:12.960948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.960813+0000","last_change":"2024-04-26T12:49:56.217097+0000","last_active":"2024-04-26T12:52:07.960813+0000","last_peered":"2024-04-26T12:52:07.960813+0000","last_clean":"2024-04-26T12:52:07.960813+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:52:07.960813+0000","last_undegraded":"2024-04-26T12:52:07.960813+0000","last_fullsized":"2024-04-26T12:52:07.960813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965392+0000","last_change":"2024-04-26T12:49:54.252650+0000","last_active":"2024-04-26T12:52:12.965392+0000","last_peered":"2024-04-26T12:52:12.965392+0000","last_clean":"2024-04-26T12:52:12.965392+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:52:12.965392+0000","last_undegraded":"2024-04-26T12:52:12.965392+0000","last_fullsized":"2024-04-26T12:52:12.965392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.216496+0000","last_change":"2024-04-26T12:53:36.216552+0000","last_active":"2024-04-26T12:53:36.216496+0000","last_peered":"2024-04-26T12:53:36.216496+0000","last_clean":"2024-04-26T12:53:36.216496+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:53:36.216496+0000","last_undegraded":"2024-04-26T12:53:36.216496+0000","last_fullsized":"2024-04-26T12:53:36.216496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.216285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:41.525193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'39","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.158258+0000","last_change":"2024-04-26T12:50:00.268771+0000","last_active":"2024-04-26T12:53:16.158258+0000","last_peered":"2024-04-26T12:53:16.158258+0000","last_clean":"2024-04-26T12:53:16.158258+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:53:16.158258+0000","last_undegraded":"2024-04-26T12:53:16.158258+0000","last_fullsized":"2024-04-26T12:53:16.158258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":361,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.260275+0000","last_change":"2024-04-26T12:53:23.260340+0000","last_active":"2024-04-26T12:53:23.260275+0000","last_peered":"2024-04-26T12:53:23.260275+0000","last_clean":"2024-04-26T12:53:23.260275+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:23.260275+0000","last_undegraded":"2024-04-26T12:53:23.260275+0000","last_fullsized":"2024-04-26T12:53:23.260275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.260077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:08.869807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:15.165930+0000","last_change":"2024-04-26T12:50:04.295468+0000","last_active":"2024-04-26T12:52:15.165930+0000","last_peered":"2024-04-26T12:52:15.165930+0000","last_clean":"2024-04-26T12:52:15.165930+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:52:15.165930+0000","last_undegraded":"2024-04-26T12:52:15.165930+0000","last_fullsized":"2024-04-26T12:52:15.165930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439226+0000","last_change":"2024-04-26T12:49:56.213567+0000","last_active":"2024-04-26T12:53:09.439226+0000","last_peered":"2024-04-26T12:53:09.439226+0000","last_clean":"2024-04-26T12:53:09.439226+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:09.439226+0000","last_undegraded":"2024-04-26T12:53:09.439226+0000","last_fullsized":"2024-04-26T12:53:09.439226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.414720+0000","last_change":"2024-04-26T12:49:54.259981+0000","last_active":"2024-04-26T12:53:09.414720+0000","last_peered":"2024-04-26T12:53:09.414720+0000","last_clean":"2024-04-26T12:53:09.414720+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:53:09.414720+0000","last_undegraded":"2024-04-26T12:53:09.414720+0000","last_fullsized":"2024-04-26T12:53:09.414720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:47.971254+0000","last_change":"2024-04-26T12:50:34.307424+0000","last_active":"2024-04-26T12:52:47.971254+0000","last_peered":"2024-04-26T12:52:47.971254+0000","last_clean":"2024-04-26T12:52:47.971254+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:52:47.971254+0000","last_undegraded":"2024-04-26T12:52:47.971254+0000","last_fullsized":"2024-04-26T12:52:47.971254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'65","reported_seq":138,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.301251+0000","last_change":"2024-04-26T12:53:33.301331+0000","last_active":"2024-04-26T12:53:33.301251+0000","last_peered":"2024-04-26T12:53:33.301251+0000","last_clean":"2024-04-26T12:53:33.301251+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:53:33.301251+0000","last_undegraded":"2024-04-26T12:53:33.301251+0000","last_fullsized":"2024-04-26T12:53:33.301251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'65","last_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_deep_scrub":"35'65","last_deep_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.301040+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:07.289330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.319344+0000","last_change":"2024-04-26T12:53:25.319398+0000","last_active":"2024-04-26T12:53:25.319344+0000","last_peered":"2024-04-26T12:53:25.319344+0000","last_clean":"2024-04-26T12:53:25.319344+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:53:25.319344+0000","last_undegraded":"2024-04-26T12:53:25.319344+0000","last_fullsized":"2024-04-26T12:53:25.319344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.319148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:51.725423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'20","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.595887+0000","last_change":"2024-04-26T12:50:04.303330+0000","last_active":"2024-04-26T12:53:09.595887+0000","last_peered":"2024-04-26T12:53:09.595887+0000","last_clean":"2024-04-26T12:53:09.595887+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:53:09.595887+0000","last_undegraded":"2024-04-26T12:53:09.595887+0000","last_fullsized":"2024-04-26T12:53:09.595887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960880+0000","last_change":"2024-04-26T12:49:56.234590+0000","last_active":"2024-04-26T12:52:12.960880+0000","last_peered":"2024-04-26T12:52:12.960880+0000","last_clean":"2024-04-26T12:52:12.960880+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:52:12.960880+0000","last_undegraded":"2024-04-26T12:52:12.960880+0000","last_fullsized":"2024-04-26T12:52:12.960880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:10.164593+0000","last_change":"2024-04-26T12:49:54.239087+0000","last_active":"2024-04-26T12:52:10.164593+0000","last_peered":"2024-04-26T12:52:10.164593+0000","last_clean":"2024-04-26T12:52:10.164593+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:52:10.164593+0000","last_undegraded":"2024-04-26T12:52:10.164593+0000","last_fullsized":"2024-04-26T12:52:10.164593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.821259+0000","last_change":"2024-04-26T12:53:35.821321+0000","last_active":"2024-04-26T12:53:35.821259+0000","last_peered":"2024-04-26T12:53:35.821259+0000","last_clean":"2024-04-26T12:53:35.821259+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:53:35.821259+0000","last_undegraded":"2024-04-26T12:53:35.821259+0000","last_fullsized":"2024-04-26T12:53:35.821259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.821050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:59.952098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.093329+0000","last_change":"2024-04-26T12:53:26.093504+0000","last_active":"2024-04-26T12:53:26.093329+0000","last_peered":"2024-04-26T12:53:26.093329+0000","last_clean":"2024-04-26T12:53:26.093329+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:53:26.093329+0000","last_undegraded":"2024-04-26T12:53:26.093329+0000","last_fullsized":"2024-04-26T12:53:26.093329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.093081+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:46.353316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966895+0000","last_change":"2024-04-26T12:50:02.283252+0000","last_active":"2024-04-26T12:52:17.966895+0000","last_peered":"2024-04-26T12:52:17.966895+0000","last_clean":"2024-04-26T12:52:17.966895+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:52:17.966895+0000","last_undegraded":"2024-04-26T12:52:17.966895+0000","last_fullsized":"2024-04-26T12:52:17.966895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.534820+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:53:09.534820+0000","last_peered":"2024-04-26T12:53:09.534820+0000","last_clean":"2024-04-26T12:53:09.534820+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:53:09.534820+0000","last_undegraded":"2024-04-26T12:53:09.534820+0000","last_fullsized":"2024-04-26T12:53:09.534820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.371773+0000","last_change":"2024-04-26T12:49:56.229878+0000","last_active":"2024-04-26T12:53:09.371773+0000","last_peered":"2024-04-26T12:53:09.371773+0000","last_clean":"2024-04-26T12:53:09.371773+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:09.371773+0000","last_undegraded":"2024-04-26T12:53:09.371773+0000","last_fullsized":"2024-04-26T12:53:09.371773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964107+0000","last_change":"2024-04-26T12:49:54.231974+0000","last_active":"2024-04-26T12:52:07.964107+0000","last_peered":"2024-04-26T12:52:07.964107+0000","last_clean":"2024-04-26T12:52:07.964107+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:52:07.964107+0000","last_undegraded":"2024-04-26T12:52:07.964107+0000","last_fullsized":"2024-04-26T12:52:07.964107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.184467+0000","last_change":"2024-04-26T12:53:38.184522+0000","last_active":"2024-04-26T12:53:38.184467+0000","last_peered":"2024-04-26T12:53:38.184467+0000","last_clean":"2024-04-26T12:53:38.184467+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:53:38.184467+0000","last_undegraded":"2024-04-26T12:53:38.184467+0000","last_fullsized":"2024-04-26T12:53:38.184467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.184269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:49.731527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.784049+0000","last_change":"2024-04-26T12:53:29.784129+0000","last_active":"2024-04-26T12:53:29.784049+0000","last_peered":"2024-04-26T12:53:29.784049+0000","last_clean":"2024-04-26T12:53:29.784049+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:53:29.784049+0000","last_undegraded":"2024-04-26T12:53:29.784049+0000","last_fullsized":"2024-04-26T12:53:29.784049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.783856+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:02.402474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":416,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.700221+0000","last_change":"2024-04-26T12:53:20.700292+0000","last_active":"2024-04-26T12:53:20.700221+0000","last_peered":"2024-04-26T12:53:20.700221+0000","last_clean":"2024-04-26T12:53:20.700221+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:20.700221+0000","last_undegraded":"2024-04-26T12:53:20.700221+0000","last_fullsized":"2024-04-26T12:53:20.700221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.700008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:02.748840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.609420+0000","last_change":"2024-04-26T12:50:04.296504+0000","last_active":"2024-04-26T12:53:09.609420+0000","last_peered":"2024-04-26T12:53:09.609420+0000","last_clean":"2024-04-26T12:53:09.609420+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:53:09.609420+0000","last_undegraded":"2024-04-26T12:53:09.609420+0000","last_fullsized":"2024-04-26T12:53:09.609420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.962026+0000","last_change":"2024-04-26T12:49:56.221290+0000","last_active":"2024-04-26T12:52:12.962026+0000","last_peered":"2024-04-26T12:52:12.962026+0000","last_clean":"2024-04-26T12:52:12.962026+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:52:12.962026+0000","last_undegraded":"2024-04-26T12:52:12.962026+0000","last_fullsized":"2024-04-26T12:52:12.962026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964074+0000","last_change":"2024-04-26T12:49:54.237237+0000","last_active":"2024-04-26T12:52:07.964074+0000","last_peered":"2024-04-26T12:52:07.964074+0000","last_clean":"2024-04-26T12:52:07.964074+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:52:07.964074+0000","last_undegraded":"2024-04-26T12:52:07.964074+0000","last_fullsized":"2024-04-26T12:52:07.964074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.149981+0000","last_change":"2024-04-26T12:53:35.150051+0000","last_active":"2024-04-26T12:53:35.149981+0000","last_peered":"2024-04-26T12:53:35.149981+0000","last_clean":"2024-04-26T12:53:35.149981+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:53:35.149981+0000","last_undegraded":"2024-04-26T12:53:35.149981+0000","last_fullsized":"2024-04-26T12:53:35.149981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.149786+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:44.314364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966770+0000","last_change":"2024-04-26T12:50:00.268687+0000","last_active":"2024-04-26T12:52:17.966770+0000","last_peered":"2024-04-26T12:52:17.966770+0000","last_clean":"2024-04-26T12:52:17.966770+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:52:17.966770+0000","last_undegraded":"2024-04-26T12:52:17.966770+0000","last_fullsized":"2024-04-26T12:52:17.966770+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.083440+0000","last_change":"2024-04-26T12:53:24.083502+0000","last_active":"2024-04-26T12:53:24.083440+0000","last_peered":"2024-04-26T12:53:24.083440+0000","last_clean":"2024-04-26T12:53:24.083440+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:24.083440+0000","last_undegraded":"2024-04-26T12:53:24.083440+0000","last_fullsized":"2024-04-26T12:53:24.083440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.083257+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:10.408030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.864636+0000","last_change":"2024-04-26T12:53:36.864780+0000","last_active":"2024-04-26T12:53:36.864636+0000","last_peered":"2024-04-26T12:53:36.864636+0000","last_clean":"2024-04-26T12:53:36.864636+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:53:36.864636+0000","last_undegraded":"2024-04-26T12:53:36.864636+0000","last_fullsized":"2024-04-26T12:53:36.864636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.864409+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:22.533038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.083769+0000","last_change":"2024-04-26T12:49:56.234752+0000","last_active":"2024-04-26T12:53:09.083769+0000","last_peered":"2024-04-26T12:53:09.083769+0000","last_clean":"2024-04-26T12:53:09.083769+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:09.083769+0000","last_undegraded":"2024-04-26T12:53:09.083769+0000","last_fullsized":"2024-04-26T12:53:09.083769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964038+0000","last_change":"2024-04-26T12:49:54.243701+0000","last_active":"2024-04-26T12:52:07.964038+0000","last_peered":"2024-04-26T12:52:07.964038+0000","last_clean":"2024-04-26T12:52:07.964038+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:52:07.964038+0000","last_undegraded":"2024-04-26T12:52:07.964038+0000","last_fullsized":"2024-04-26T12:52:07.964038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.364150+0000","last_change":"2024-04-26T12:53:26.364210+0000","last_active":"2024-04-26T12:53:26.364150+0000","last_peered":"2024-04-26T12:53:26.364150+0000","last_clean":"2024-04-26T12:53:26.364150+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:53:26.364150+0000","last_undegraded":"2024-04-26T12:53:26.364150+0000","last_fullsized":"2024-04-26T12:53:26.364150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.363915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.300166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.062381+0000","last_change":"2024-04-26T12:53:25.062459+0000","last_active":"2024-04-26T12:53:25.062381+0000","last_peered":"2024-04-26T12:53:25.062381+0000","last_clean":"2024-04-26T12:53:25.062381+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:53:25.062381+0000","last_undegraded":"2024-04-26T12:53:25.062381+0000","last_fullsized":"2024-04-26T12:53:25.062381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.062142+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:45.249553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.744487+0000","last_change":"2024-04-26T12:53:28.744541+0000","last_active":"2024-04-26T12:53:28.744487+0000","last_peered":"2024-04-26T12:53:28.744487+0000","last_clean":"2024-04-26T12:53:28.744487+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:53:28.744487+0000","last_undegraded":"2024-04-26T12:53:28.744487+0000","last_fullsized":"2024-04-26T12:53:28.744487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.744289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:22.796067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'8","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.591021+0000","last_change":"2024-04-26T12:50:04.271998+0000","last_active":"2024-04-26T12:53:09.591021+0000","last_peered":"2024-04-26T12:53:09.591021+0000","last_clean":"2024-04-26T12:53:09.591021+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:09.591021+0000","last_undegraded":"2024-04-26T12:53:09.591021+0000","last_fullsized":"2024-04-26T12:53:09.591021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:03.951714+0000","last_change":"2024-04-26T12:49:56.231794+0000","last_active":"2024-04-26T12:52:03.951714+0000","last_peered":"2024-04-26T12:52:03.951714+0000","last_clean":"2024-04-26T12:52:03.951714+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:52:03.951714+0000","last_undegraded":"2024-04-26T12:52:03.951714+0000","last_fullsized":"2024-04-26T12:52:03.951714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":203,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:42.954277+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:51:42.954277+0000","last_peered":"2024-04-26T12:51:42.954277+0000","last_clean":"2024-04-26T12:51:42.954277+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:51:42.954277+0000","last_undegraded":"2024-04-26T12:51:42.954277+0000","last_fullsized":"2024-04-26T12:51:42.954277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:52.960872+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:51:52.960872+0000","last_peered":"2024-04-26T12:51:52.960872+0000","last_clean":"2024-04-26T12:51:52.960872+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:51:52.960872+0000","last_undegraded":"2024-04-26T12:51:52.960872+0000","last_fullsized":"2024-04-26T12:51:52.960872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.881076+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:08.881076+0000","last_peered":"2024-04-26T12:53:08.881076+0000","last_clean":"2024-04-26T12:53:08.881076+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:08.881076+0000","last_undegraded":"2024-04-26T12:53:08.881076+0000","last_fullsized":"2024-04-26T12:53:08.881076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.959025+0000","last_change":"2024-04-26T12:49:58.226523+0000","last_active":"2024-04-26T12:52:02.959025+0000","last_peered":"2024-04-26T12:52:02.959025+0000","last_clean":"2024-04-26T12:52:02.959025+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:52:02.959025+0000","last_undegraded":"2024-04-26T12:52:02.959025+0000","last_fullsized":"2024-04-26T12:52:02.959025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'88","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.405917+0000","last_change":"2024-04-26T12:53:29.405993+0000","last_active":"2024-04-26T12:53:29.405917+0000","last_peered":"2024-04-26T12:53:29.405917+0000","last_clean":"2024-04-26T12:53:29.405917+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:53:29.405917+0000","last_undegraded":"2024-04-26T12:53:29.405917+0000","last_fullsized":"2024-04-26T12:53:29.405917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'88","last_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_deep_scrub":"35'88","last_deep_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.405693+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.745474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:15.165954+0000","last_change":"2024-04-26T12:50:02.283713+0000","last_active":"2024-04-26T12:52:15.165954+0000","last_peered":"2024-04-26T12:52:15.165954+0000","last_clean":"2024-04-26T12:52:15.165954+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:52:15.165954+0000","last_undegraded":"2024-04-26T12:52:15.165954+0000","last_fullsized":"2024-04-26T12:52:15.165954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.459451+0000","last_change":"2024-04-26T12:50:04.295222+0000","last_active":"2024-04-26T12:53:09.459451+0000","last_peered":"2024-04-26T12:53:09.459451+0000","last_clean":"2024-04-26T12:53:09.459451+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:53:09.459451+0000","last_undegraded":"2024-04-26T12:53:09.459451+0000","last_fullsized":"2024-04-26T12:53:09.459451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964185+0000","last_change":"2024-04-26T12:49:56.229772+0000","last_active":"2024-04-26T12:52:07.964185+0000","last_peered":"2024-04-26T12:52:07.964185+0000","last_clean":"2024-04-26T12:52:07.964185+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:52:07.964185+0000","last_undegraded":"2024-04-26T12:52:07.964185+0000","last_fullsized":"2024-04-26T12:52:07.964185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:47.959578+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:51:47.959578+0000","last_peered":"2024-04-26T12:51:47.959578+0000","last_clean":"2024-04-26T12:51:47.959578+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:51:47.959578+0000","last_undegraded":"2024-04-26T12:51:47.959578+0000","last_fullsized":"2024-04-26T12:51:47.959578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162041+0000","last_change":"2024-04-26T12:49:54.242621+0000","last_active":"2024-04-26T12:52:00.162041+0000","last_peered":"2024-04-26T12:52:00.162041+0000","last_clean":"2024-04-26T12:52:00.162041+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:52:00.162041+0000","last_undegraded":"2024-04-26T12:52:00.162041+0000","last_fullsized":"2024-04-26T12:52:00.162041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.382679+0000","last_change":"2024-04-26T12:53:28.382731+0000","last_active":"2024-04-26T12:53:28.382679+0000","last_peered":"2024-04-26T12:53:28.382679+0000","last_clean":"2024-04-26T12:53:28.382679+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:53:28.382679+0000","last_undegraded":"2024-04-26T12:53:28.382679+0000","last_fullsized":"2024-04-26T12:53:28.382679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.382477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:09.281461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":516,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.070823+0000","last_change":"2024-04-26T12:53:22.070911+0000","last_active":"2024-04-26T12:53:22.070823+0000","last_peered":"2024-04-26T12:53:22.070823+0000","last_clean":"2024-04-26T12:53:22.070823+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:22.070823+0000","last_undegraded":"2024-04-26T12:53:22.070823+0000","last_fullsized":"2024-04-26T12:53:22.070823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.070631+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:58.378060+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964140+0000","last_change":"2024-04-26T12:50:02.283171+0000","last_active":"2024-04-26T12:52:07.964140+0000","last_peered":"2024-04-26T12:52:07.964140+0000","last_clean":"2024-04-26T12:52:07.964140+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:52:07.964140+0000","last_undegraded":"2024-04-26T12:52:07.964140+0000","last_fullsized":"2024-04-26T12:52:07.964140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.962203+0000","last_change":"2024-04-26T12:50:04.282566+0000","last_active":"2024-04-26T12:52:17.962203+0000","last_peered":"2024-04-26T12:52:17.962203+0000","last_clean":"2024-04-26T12:52:17.962203+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:52:17.962203+0000","last_undegraded":"2024-04-26T12:52:17.962203+0000","last_fullsized":"2024-04-26T12:52:17.962203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439208+0000","last_change":"2024-04-26T12:49:56.225899+0000","last_active":"2024-04-26T12:53:09.439208+0000","last_peered":"2024-04-26T12:53:09.439208+0000","last_clean":"2024-04-26T12:53:09.439208+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:09.439208+0000","last_undegraded":"2024-04-26T12:53:09.439208+0000","last_fullsized":"2024-04-26T12:53:09.439208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:47.956781+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:51:47.956781+0000","last_peered":"2024-04-26T12:51:47.956781+0000","last_clean":"2024-04-26T12:51:47.956781+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:51:47.956781+0000","last_undegraded":"2024-04-26T12:51:47.956781+0000","last_fullsized":"2024-04-26T12:51:47.956781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.250933+0000","last_change":"2024-04-26T12:49:54.236038+0000","last_active":"2024-04-26T12:53:09.250933+0000","last_peered":"2024-04-26T12:53:09.250933+0000","last_clean":"2024-04-26T12:53:09.250933+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:53:09.250933+0000","last_undegraded":"2024-04-26T12:53:09.250933+0000","last_fullsized":"2024-04-26T12:53:09.250933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.960874+0000","last_change":"2024-04-26T12:50:34.328152+0000","last_active":"2024-04-26T12:52:07.960874+0000","last_peered":"2024-04-26T12:52:07.960874+0000","last_clean":"2024-04-26T12:52:07.960874+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:52:07.960874+0000","last_undegraded":"2024-04-26T12:52:07.960874+0000","last_fullsized":"2024-04-26T12:52:07.960874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.770929+0000","last_change":"2024-04-26T12:53:30.771034+0000","last_active":"2024-04-26T12:53:30.770929+0000","last_peered":"2024-04-26T12:53:30.770929+0000","last_clean":"2024-04-26T12:53:30.770929+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:30.770929+0000","last_undegraded":"2024-04-26T12:53:30.770929+0000","last_fullsized":"2024-04-26T12:53:30.770929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.770734+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:16.557148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.218388+0000","last_change":"2024-04-26T12:53:37.218444+0000","last_active":"2024-04-26T12:53:37.218388+0000","last_peered":"2024-04-26T12:53:37.218388+0000","last_clean":"2024-04-26T12:53:37.218388+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:53:37.218388+0000","last_undegraded":"2024-04-26T12:53:37.218388+0000","last_fullsized":"2024-04-26T12:53:37.218388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.218195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:55.090465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.086777+0000","last_change":"2024-04-26T12:50:04.302141+0000","last_active":"2024-04-26T12:53:09.086777+0000","last_peered":"2024-04-26T12:53:09.086777+0000","last_clean":"2024-04-26T12:53:09.086777+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:53:09.086777+0000","last_undegraded":"2024-04-26T12:53:09.086777+0000","last_fullsized":"2024-04-26T12:53:09.086777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163378+0000","last_change":"2024-04-26T12:49:56.218654+0000","last_active":"2024-04-26T12:52:05.163378+0000","last_peered":"2024-04-26T12:52:05.163378+0000","last_clean":"2024-04-26T12:52:05.163378+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:52:05.163378+0000","last_undegraded":"2024-04-26T12:52:05.163378+0000","last_fullsized":"2024-04-26T12:52:05.163378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:52.960800+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:51:52.960800+0000","last_peered":"2024-04-26T12:51:52.960800+0000","last_clean":"2024-04-26T12:51:52.960800+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:51:52.960800+0000","last_undegraded":"2024-04-26T12:51:52.960800+0000","last_fullsized":"2024-04-26T12:51:52.960800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.959920+0000","last_change":"2024-04-26T12:49:54.228710+0000","last_active":"2024-04-26T12:52:02.959920+0000","last_peered":"2024-04-26T12:52:02.959920+0000","last_clean":"2024-04-26T12:52:02.959920+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:52:02.959920+0000","last_undegraded":"2024-04-26T12:52:02.959920+0000","last_fullsized":"2024-04-26T12:52:02.959920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163407+0000","last_change":"2024-04-26T12:49:58.226208+0000","last_active":"2024-04-26T12:52:05.163407+0000","last_peered":"2024-04-26T12:52:05.163407+0000","last_clean":"2024-04-26T12:52:05.163407+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:52:05.163407+0000","last_undegraded":"2024-04-26T12:52:05.163407+0000","last_fullsized":"2024-04-26T12:52:05.163407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'21","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.345151+0000","last_change":"2024-04-26T12:53:27.345235+0000","last_active":"2024-04-26T12:53:27.345151+0000","last_peered":"2024-04-26T12:53:27.345151+0000","last_clean":"2024-04-26T12:53:27.345151+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:27.345151+0000","last_undegraded":"2024-04-26T12:53:27.345151+0000","last_fullsized":"2024-04-26T12:53:27.345151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.344956+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:36.530634+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965572+0000","last_change":"2024-04-26T12:50:02.286212+0000","last_active":"2024-04-26T12:52:12.965572+0000","last_peered":"2024-04-26T12:52:12.965572+0000","last_clean":"2024-04-26T12:52:12.965572+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:52:12.965572+0000","last_undegraded":"2024-04-26T12:52:12.965572+0000","last_fullsized":"2024-04-26T12:52:12.965572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.962092+0000","last_change":"2024-04-26T12:50:04.290606+0000","last_active":"2024-04-26T12:52:17.962092+0000","last_peered":"2024-04-26T12:52:17.962092+0000","last_clean":"2024-04-26T12:52:17.962092+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:52:17.962092+0000","last_undegraded":"2024-04-26T12:52:17.962092+0000","last_fullsized":"2024-04-26T12:52:17.962092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.948437+0000","last_change":"2024-04-26T12:49:56.234671+0000","last_active":"2024-04-26T12:53:08.948437+0000","last_peered":"2024-04-26T12:53:08.948437+0000","last_clean":"2024-04-26T12:53:08.948437+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:08.948437+0000","last_undegraded":"2024-04-26T12:53:08.948437+0000","last_fullsized":"2024-04-26T12:53:08.948437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.960009+0000","last_change":"2024-04-26T12:49:54.227464+0000","last_active":"2024-04-26T12:52:02.960009+0000","last_peered":"2024-04-26T12:52:02.960009+0000","last_clean":"2024-04-26T12:52:02.960009+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:52:02.960009+0000","last_undegraded":"2024-04-26T12:52:02.960009+0000","last_fullsized":"2024-04-26T12:52:02.960009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:50.159938+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:51:50.159938+0000","last_peered":"2024-04-26T12:51:50.159938+0000","last_clean":"2024-04-26T12:51:50.159938+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:51:50.159938+0000","last_undegraded":"2024-04-26T12:51:50.159938+0000","last_fullsized":"2024-04-26T12:51:50.159938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:15.999140+0000","last_change":"2024-04-26T12:49:58.218010+0000","last_active":"2024-04-26T12:53:15.999140+0000","last_peered":"2024-04-26T12:53:15.999140+0000","last_clean":"2024-04-26T12:53:15.999140+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:53:15.999140+0000","last_undegraded":"2024-04-26T12:53:15.999140+0000","last_fullsized":"2024-04-26T12:53:15.999140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'73","reported_seq":149,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.205029+0000","last_change":"2024-04-26T12:53:30.205126+0000","last_active":"2024-04-26T12:53:30.205029+0000","last_peered":"2024-04-26T12:53:30.205029+0000","last_clean":"2024-04-26T12:53:30.205029+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:53:30.205029+0000","last_undegraded":"2024-04-26T12:53:30.205029+0000","last_fullsized":"2024-04-26T12:53:30.205029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.204804+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:53.044186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.761205+0000","last_change":"2024-04-26T12:53:22.761261+0000","last_active":"2024-04-26T12:53:22.761205+0000","last_peered":"2024-04-26T12:53:22.761205+0000","last_clean":"2024-04-26T12:53:22.761205+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:53:22.761205+0000","last_undegraded":"2024-04-26T12:53:22.761205+0000","last_fullsized":"2024-04-26T12:53:22.761205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.761001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:49.570682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:20.167145+0000","last_change":"2024-04-26T12:50:04.282702+0000","last_active":"2024-04-26T12:52:20.167145+0000","last_peered":"2024-04-26T12:52:20.167145+0000","last_clean":"2024-04-26T12:52:20.167145+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:52:20.167145+0000","last_undegraded":"2024-04-26T12:52:20.167145+0000","last_fullsized":"2024-04-26T12:52:20.167145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'7","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.524708+0000","last_change":"2024-04-26T12:49:56.231876+0000","last_active":"2024-04-26T12:53:09.524708+0000","last_peered":"2024-04-26T12:53:09.524708+0000","last_clean":"2024-04-26T12:53:09.524708+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:09.524708+0000","last_undegraded":"2024-04-26T12:53:09.524708+0000","last_fullsized":"2024-04-26T12:53:09.524708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162168+0000","last_change":"2024-04-26T12:49:54.242611+0000","last_active":"2024-04-26T12:52:00.162168+0000","last_peered":"2024-04-26T12:52:00.162168+0000","last_clean":"2024-04-26T12:52:00.162168+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:52:00.162168+0000","last_undegraded":"2024-04-26T12:52:00.162168+0000","last_fullsized":"2024-04-26T12:52:00.162168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:52.960948+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:51:52.960948+0000","last_peered":"2024-04-26T12:51:52.960948+0000","last_clean":"2024-04-26T12:51:52.960948+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:51:52.960948+0000","last_undegraded":"2024-04-26T12:51:52.960948+0000","last_fullsized":"2024-04-26T12:51:52.960948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.364064+0000","last_change":"2024-04-26T12:53:30.364121+0000","last_active":"2024-04-26T12:53:30.364064+0000","last_peered":"2024-04-26T12:53:30.364064+0000","last_clean":"2024-04-26T12:53:30.364064+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:53:30.364064+0000","last_undegraded":"2024-04-26T12:53:30.364064+0000","last_fullsized":"2024-04-26T12:53:30.364064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.363860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:46.377113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'23","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.060913+0000","last_change":"2024-04-26T12:53:21.061000+0000","last_active":"2024-04-26T12:53:21.060913+0000","last_peered":"2024-04-26T12:53:21.060913+0000","last_clean":"2024-04-26T12:53:21.060913+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:53:21.060913+0000","last_undegraded":"2024-04-26T12:53:21.060913+0000","last_fullsized":"2024-04-26T12:53:21.060913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.060723+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:54.780796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":368,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.077483+0000","last_change":"2024-04-26T12:53:28.077560+0000","last_active":"2024-04-26T12:53:28.077483+0000","last_peered":"2024-04-26T12:53:28.077483+0000","last_clean":"2024-04-26T12:53:28.077483+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:28.077483+0000","last_undegraded":"2024-04-26T12:53:28.077483+0000","last_fullsized":"2024-04-26T12:53:28.077483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.077291+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:13.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.968368+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:52:22.968368+0000","last_peered":"2024-04-26T12:52:22.968368+0000","last_clean":"2024-04-26T12:52:22.968368+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:52:22.968368+0000","last_undegraded":"2024-04-26T12:52:22.968368+0000","last_fullsized":"2024-04-26T12:52:22.968368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'9","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.525507+0000","last_change":"2024-04-26T12:49:56.226197+0000","last_active":"2024-04-26T12:53:09.525507+0000","last_peered":"2024-04-26T12:53:09.525507+0000","last_clean":"2024-04-26T12:53:09.525507+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:53:09.525507+0000","last_undegraded":"2024-04-26T12:53:09.525507+0000","last_fullsized":"2024-04-26T12:53:09.525507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964205+0000","last_change":"2024-04-26T12:49:54.253396+0000","last_active":"2024-04-26T12:52:07.964205+0000","last_peered":"2024-04-26T12:52:07.964205+0000","last_clean":"2024-04-26T12:52:07.964205+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:52:07.964205+0000","last_undegraded":"2024-04-26T12:52:07.964205+0000","last_fullsized":"2024-04-26T12:52:07.964205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:55.161072+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:51:55.161072+0000","last_peered":"2024-04-26T12:51:55.161072+0000","last_clean":"2024-04-26T12:51:55.161072+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:51:55.161072+0000","last_undegraded":"2024-04-26T12:51:55.161072+0000","last_fullsized":"2024-04-26T12:51:55.161072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.421284+0000","last_change":"2024-04-26T12:53:21.421343+0000","last_active":"2024-04-26T12:53:21.421284+0000","last_peered":"2024-04-26T12:53:21.421284+0000","last_clean":"2024-04-26T12:53:21.421284+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:53:21.421284+0000","last_undegraded":"2024-04-26T12:53:21.421284+0000","last_fullsized":"2024-04-26T12:53:21.421284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.421080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:06.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964097+0000","last_change":"2024-04-26T12:50:00.271933+0000","last_active":"2024-04-26T12:52:07.964097+0000","last_peered":"2024-04-26T12:52:07.964097+0000","last_clean":"2024-04-26T12:52:07.964097+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:52:07.964097+0000","last_undegraded":"2024-04-26T12:52:07.964097+0000","last_fullsized":"2024-04-26T12:52:07.964097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":442,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.333915+0000","last_change":"2024-04-26T12:53:21.333981+0000","last_active":"2024-04-26T12:53:21.333915+0000","last_peered":"2024-04-26T12:53:21.333915+0000","last_clean":"2024-04-26T12:53:21.333915+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:21.333915+0000","last_undegraded":"2024-04-26T12:53:21.333915+0000","last_fullsized":"2024-04-26T12:53:21.333915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.333725+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:27.636643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.963806+0000","last_change":"2024-04-26T12:50:04.301343+0000","last_active":"2024-04-26T12:52:22.963806+0000","last_peered":"2024-04-26T12:52:22.963806+0000","last_clean":"2024-04-26T12:52:22.963806+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:52:22.963806+0000","last_undegraded":"2024-04-26T12:52:22.963806+0000","last_fullsized":"2024-04-26T12:52:22.963806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.959842+0000","last_change":"2024-04-26T12:49:56.215393+0000","last_active":"2024-04-26T12:52:02.959842+0000","last_peered":"2024-04-26T12:52:02.959842+0000","last_clean":"2024-04-26T12:52:02.959842+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:52:02.959842+0000","last_undegraded":"2024-04-26T12:52:02.959842+0000","last_fullsized":"2024-04-26T12:52:02.959842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.222363+0000","last_change":"2024-04-26T12:49:54.239381+0000","last_active":"2024-04-26T12:52:08.222363+0000","last_peered":"2024-04-26T12:52:08.222363+0000","last_clean":"2024-04-26T12:52:08.222363+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:52:08.222363+0000","last_undegraded":"2024-04-26T12:52:08.222363+0000","last_fullsized":"2024-04-26T12:52:08.222363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:57.962197+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:51:57.962197+0000","last_peered":"2024-04-26T12:51:57.962197+0000","last_clean":"2024-04-26T12:51:57.962197+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:51:57.962197+0000","last_undegraded":"2024-04-26T12:51:57.962197+0000","last_fullsized":"2024-04-26T12:51:57.962197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.334759+0000","last_change":"2024-04-26T12:53:31.334821+0000","last_active":"2024-04-26T12:53:31.334759+0000","last_peered":"2024-04-26T12:53:31.334759+0000","last_clean":"2024-04-26T12:53:31.334759+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:53:31.334759+0000","last_undegraded":"2024-04-26T12:53:31.334759+0000","last_fullsized":"2024-04-26T12:53:31.334759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.334536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:45.400333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'99","reported_seq":192,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.718701+0000","last_change":"2024-04-26T12:53:27.718800+0000","last_active":"2024-04-26T12:53:27.718701+0000","last_peered":"2024-04-26T12:53:27.718701+0000","last_clean":"2024-04-26T12:53:27.718701+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:53:27.718701+0000","last_undegraded":"2024-04-26T12:53:27.718701+0000","last_fullsized":"2024-04-26T12:53:27.718701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'99","last_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_deep_scrub":"35'99","last_deep_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.718504+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:03.589502+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.215290+0000","last_change":"2024-04-26T12:53:29.215348+0000","last_active":"2024-04-26T12:53:29.215290+0000","last_peered":"2024-04-26T12:53:29.215290+0000","last_clean":"2024-04-26T12:53:29.215290+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:53:29.215290+0000","last_undegraded":"2024-04-26T12:53:29.215290+0000","last_fullsized":"2024-04-26T12:53:29.215290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.215091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:55.609962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964738+0000","last_change":"2024-04-26T12:50:04.283865+0000","last_active":"2024-04-26T12:52:22.964738+0000","last_peered":"2024-04-26T12:52:22.964738+0000","last_clean":"2024-04-26T12:52:22.964738+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:52:22.964738+0000","last_undegraded":"2024-04-26T12:52:22.964738+0000","last_fullsized":"2024-04-26T12:52:22.964738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.962059+0000","last_change":"2024-04-26T12:50:04.289462+0000","last_active":"2024-04-26T12:52:12.962059+0000","last_peered":"2024-04-26T12:52:12.962059+0000","last_clean":"2024-04-26T12:52:12.962059+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:52:12.962059+0000","last_undegraded":"2024-04-26T12:52:12.962059+0000","last_fullsized":"2024-04-26T12:52:12.962059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.963191+0000","last_change":"2024-04-26T12:49:56.224657+0000","last_active":"2024-04-26T12:52:17.963191+0000","last_peered":"2024-04-26T12:52:17.963191+0000","last_clean":"2024-04-26T12:52:17.963191+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:52:17.963191+0000","last_undegraded":"2024-04-26T12:52:17.963191+0000","last_fullsized":"2024-04-26T12:52:17.963191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966720+0000","last_change":"2024-04-26T12:49:54.259672+0000","last_active":"2024-04-26T12:52:17.966720+0000","last_peered":"2024-04-26T12:52:17.966720+0000","last_clean":"2024-04-26T12:52:17.966720+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:52:17.966720+0000","last_undegraded":"2024-04-26T12:52:17.966720+0000","last_fullsized":"2024-04-26T12:52:17.966720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.182269+0000","last_change":"2024-04-26T12:53:37.182402+0000","last_active":"2024-04-26T12:53:37.182269+0000","last_peered":"2024-04-26T12:53:37.182269+0000","last_clean":"2024-04-26T12:53:37.182269+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:53:37.182269+0000","last_undegraded":"2024-04-26T12:53:37.182269+0000","last_fullsized":"2024-04-26T12:53:37.182269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.182009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.668088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.379326+0000","last_change":"2024-04-26T12:53:35.379487+0000","last_active":"2024-04-26T12:53:35.379326+0000","last_peered":"2024-04-26T12:53:35.379326+0000","last_clean":"2024-04-26T12:53:35.379326+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:53:35.379326+0000","last_undegraded":"2024-04-26T12:53:35.379326+0000","last_fullsized":"2024-04-26T12:53:35.379326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.379029+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:12.600563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.967842+0000","last_change":"2024-04-26T12:50:02.282972+0000","last_active":"2024-04-26T12:52:22.967842+0000","last_peered":"2024-04-26T12:52:22.967842+0000","last_clean":"2024-04-26T12:52:22.967842+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:52:22.967842+0000","last_undegraded":"2024-04-26T12:52:22.967842+0000","last_fullsized":"2024-04-26T12:52:22.967842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.785997+0000","last_change":"2024-04-26T12:50:04.286573+0000","last_active":"2024-04-26T12:52:05.785997+0000","last_peered":"2024-04-26T12:52:05.785997+0000","last_clean":"2024-04-26T12:52:05.785997+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:52:05.785997+0000","last_undegraded":"2024-04-26T12:52:05.785997+0000","last_fullsized":"2024-04-26T12:52:05.785997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.437673+0000","last_change":"2024-04-26T12:50:34.331364+0000","last_active":"2024-04-26T12:53:09.437673+0000","last_peered":"2024-04-26T12:53:09.437673+0000","last_clean":"2024-04-26T12:53:09.437673+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:53:09.437673+0000","last_undegraded":"2024-04-26T12:53:09.437673+0000","last_fullsized":"2024-04-26T12:53:09.437673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964694+0000","last_change":"2024-04-26T12:49:54.242795+0000","last_active":"2024-04-26T12:52:22.964694+0000","last_peered":"2024-04-26T12:52:22.964694+0000","last_clean":"2024-04-26T12:52:22.964694+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:52:22.964694+0000","last_undegraded":"2024-04-26T12:52:22.964694+0000","last_fullsized":"2024-04-26T12:52:22.964694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966695+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:52:17.966695+0000","last_peered":"2024-04-26T12:52:17.966695+0000","last_clean":"2024-04-26T12:52:17.966695+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:52:17.966695+0000","last_undegraded":"2024-04-26T12:52:17.966695+0000","last_fullsized":"2024-04-26T12:52:17.966695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.245428+0000","last_change":"2024-04-26T12:53:35.245501+0000","last_active":"2024-04-26T12:53:35.245428+0000","last_peered":"2024-04-26T12:53:35.245428+0000","last_clean":"2024-04-26T12:53:35.245428+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:35.245428+0000","last_undegraded":"2024-04-26T12:53:35.245428+0000","last_fullsized":"2024-04-26T12:53:35.245428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.245236+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:33.087428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.725793+0000","last_change":"2024-04-26T12:53:24.725849+0000","last_active":"2024-04-26T12:53:24.725793+0000","last_peered":"2024-04-26T12:53:24.725793+0000","last_clean":"2024-04-26T12:53:24.725793+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:53:24.725793+0000","last_undegraded":"2024-04-26T12:53:24.725793+0000","last_fullsized":"2024-04-26T12:53:24.725793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.725577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:57.154247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.939853+0000","last_change":"2024-04-26T12:50:04.281861+0000","last_active":"2024-04-26T12:53:08.939853+0000","last_peered":"2024-04-26T12:53:08.939853+0000","last_clean":"2024-04-26T12:53:08.939853+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:08.939853+0000","last_undegraded":"2024-04-26T12:53:08.939853+0000","last_fullsized":"2024-04-26T12:53:08.939853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'15","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.524291+0000","last_change":"2024-04-26T12:49:56.221075+0000","last_active":"2024-04-26T12:53:09.524291+0000","last_peered":"2024-04-26T12:53:09.524291+0000","last_clean":"2024-04-26T12:53:09.524291+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:09.524291+0000","last_undegraded":"2024-04-26T12:53:09.524291+0000","last_fullsized":"2024-04-26T12:53:09.524291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964787+0000","last_change":"2024-04-26T12:49:54.248072+0000","last_active":"2024-04-26T12:52:22.964787+0000","last_peered":"2024-04-26T12:52:22.964787+0000","last_clean":"2024-04-26T12:52:22.964787+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:52:22.964787+0000","last_undegraded":"2024-04-26T12:52:22.964787+0000","last_fullsized":"2024-04-26T12:52:22.964787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.837679+0000","last_change":"2024-04-26T12:53:34.837739+0000","last_active":"2024-04-26T12:53:34.837679+0000","last_peered":"2024-04-26T12:53:34.837679+0000","last_clean":"2024-04-26T12:53:34.837679+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:53:34.837679+0000","last_undegraded":"2024-04-26T12:53:34.837679+0000","last_fullsized":"2024-04-26T12:53:34.837679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.837461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:55.097696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":119,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.252254+0000","last_change":"2024-04-26T12:53:34.252332+0000","last_active":"2024-04-26T12:53:34.252254+0000","last_peered":"2024-04-26T12:53:34.252254+0000","last_clean":"2024-04-26T12:53:34.252254+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:34.252254+0000","last_undegraded":"2024-04-26T12:53:34.252254+0000","last_fullsized":"2024-04-26T12:53:34.252254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.252055+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:22.283776+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.049935+0000","last_change":"2024-04-26T12:53:20.049974+0000","last_active":"2024-04-26T12:53:20.049935+0000","last_peered":"2024-04-26T12:53:20.049935+0000","last_clean":"2024-04-26T12:53:20.049935+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:53:20.049935+0000","last_undegraded":"2024-04-26T12:53:20.049935+0000","last_fullsized":"2024-04-26T12:53:20.049935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.049783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:14.101561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:37.972599+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:52:37.972599+0000","last_peered":"2024-04-26T12:52:37.972599+0000","last_clean":"2024-04-26T12:52:37.972599+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:52:37.972599+0000","last_undegraded":"2024-04-26T12:52:37.972599+0000","last_fullsized":"2024-04-26T12:52:37.972599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.948331+0000","last_change":"2024-04-26T12:49:56.230150+0000","last_active":"2024-04-26T12:53:08.948331+0000","last_peered":"2024-04-26T12:53:08.948331+0000","last_clean":"2024-04-26T12:53:08.948331+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:08.948331+0000","last_undegraded":"2024-04-26T12:53:08.948331+0000","last_fullsized":"2024-04-26T12:53:08.948331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964085+0000","last_change":"2024-04-26T12:49:54.238487+0000","last_active":"2024-04-26T12:52:22.964085+0000","last_peered":"2024-04-26T12:52:22.964085+0000","last_clean":"2024-04-26T12:52:22.964085+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:52:22.964085+0000","last_undegraded":"2024-04-26T12:52:22.964085+0000","last_fullsized":"2024-04-26T12:52:22.964085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.347547+0000","last_change":"2024-04-26T12:53:24.347602+0000","last_active":"2024-04-26T12:53:24.347547+0000","last_peered":"2024-04-26T12:53:24.347547+0000","last_clean":"2024-04-26T12:53:24.347547+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:53:24.347547+0000","last_undegraded":"2024-04-26T12:53:24.347547+0000","last_fullsized":"2024-04-26T12:53:24.347547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.347350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:48.923924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.801252+0000","last_change":"2024-04-26T12:53:31.801328+0000","last_active":"2024-04-26T12:53:31.801252+0000","last_peered":"2024-04-26T12:53:31.801252+0000","last_clean":"2024-04-26T12:53:31.801252+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:53:31.801252+0000","last_undegraded":"2024-04-26T12:53:31.801252+0000","last_fullsized":"2024-04-26T12:53:31.801252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.801011+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:27.272844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.740640+0000","last_change":"2024-04-26T12:53:23.740693+0000","last_active":"2024-04-26T12:53:23.740640+0000","last_peered":"2024-04-26T12:53:23.740640+0000","last_clean":"2024-04-26T12:53:23.740640+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:53:23.740640+0000","last_undegraded":"2024-04-26T12:53:23.740640+0000","last_fullsized":"2024-04-26T12:53:23.740640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.740437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:49.029310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.334571+0000","last_change":"2024-04-26T12:53:34.334631+0000","last_active":"2024-04-26T12:53:34.334571+0000","last_peered":"2024-04-26T12:53:34.334571+0000","last_clean":"2024-04-26T12:53:34.334571+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:34.334571+0000","last_undegraded":"2024-04-26T12:53:34.334571+0000","last_fullsized":"2024-04-26T12:53:34.334571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.334375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:02.613019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.967784+0000","last_change":"2024-04-26T12:49:54.241633+0000","last_active":"2024-04-26T12:52:22.967784+0000","last_peered":"2024-04-26T12:52:22.967784+0000","last_clean":"2024-04-26T12:52:22.967784+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:52:22.967784+0000","last_undegraded":"2024-04-26T12:52:22.967784+0000","last_fullsized":"2024-04-26T12:52:22.967784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'4","reported_seq":229,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:15.981965+0000","last_change":"2024-04-26T12:49:58.224668+0000","last_active":"2024-04-26T12:53:15.981965+0000","last_peered":"2024-04-26T12:53:15.981965+0000","last_clean":"2024-04-26T12:53:15.981965+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:53:15.981965+0000","last_undegraded":"2024-04-26T12:53:15.981965+0000","last_fullsized":"2024-04-26T12:53:15.981965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.227085+0000","last_change":"2024-04-26T12:53:28.227166+0000","last_active":"2024-04-26T12:53:28.227085+0000","last_peered":"2024-04-26T12:53:28.227085+0000","last_clean":"2024-04-26T12:53:28.227085+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:53:28.227085+0000","last_undegraded":"2024-04-26T12:53:28.227085+0000","last_fullsized":"2024-04-26T12:53:28.227085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.226873+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:23.499693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.736545+0000","last_change":"2024-04-26T12:53:21.736604+0000","last_active":"2024-04-26T12:53:21.736545+0000","last_peered":"2024-04-26T12:53:21.736545+0000","last_clean":"2024-04-26T12:53:21.736545+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:53:21.736545+0000","last_undegraded":"2024-04-26T12:53:21.736545+0000","last_fullsized":"2024-04-26T12:53:21.736545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.736352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:21.809175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:25.168169+0000","last_change":"2024-04-26T12:50:04.281931+0000","last_active":"2024-04-26T12:52:25.168169+0000","last_peered":"2024-04-26T12:52:25.168169+0000","last_clean":"2024-04-26T12:52:25.168169+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:52:25.168169+0000","last_undegraded":"2024-04-26T12:52:25.168169+0000","last_fullsized":"2024-04-26T12:52:25.168169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162258+0000","last_change":"2024-04-26T12:49:56.224826+0000","last_active":"2024-04-26T12:52:00.162258+0000","last_peered":"2024-04-26T12:52:00.162258+0000","last_clean":"2024-04-26T12:52:00.162258+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:52:00.162258+0000","last_undegraded":"2024-04-26T12:52:00.162258+0000","last_fullsized":"2024-04-26T12:52:00.162258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.963597+0000","last_change":"2024-04-26T12:49:54.243620+0000","last_active":"2024-04-26T12:52:22.963597+0000","last_peered":"2024-04-26T12:52:22.963597+0000","last_clean":"2024-04-26T12:52:22.963597+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:52:22.963597+0000","last_undegraded":"2024-04-26T12:52:22.963597+0000","last_fullsized":"2024-04-26T12:52:22.963597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.904703+0000","last_change":"2024-04-26T12:53:37.904759+0000","last_active":"2024-04-26T12:53:37.904703+0000","last_peered":"2024-04-26T12:53:37.904703+0000","last_clean":"2024-04-26T12:53:37.904703+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:53:37.904703+0000","last_undegraded":"2024-04-26T12:53:37.904703+0000","last_fullsized":"2024-04-26T12:53:37.904703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.904494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:22.228978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'40","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.299196+0000","last_change":"2024-04-26T12:50:00.270194+0000","last_active":"2024-04-26T12:53:16.299196+0000","last_peered":"2024-04-26T12:53:16.299196+0000","last_clean":"2024-04-26T12:53:16.299196+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:53:16.299196+0000","last_undegraded":"2024-04-26T12:53:16.299196+0000","last_fullsized":"2024-04-26T12:53:16.299196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.155724+0000","last_change":"2024-04-26T12:53:36.155779+0000","last_active":"2024-04-26T12:53:36.155724+0000","last_peered":"2024-04-26T12:53:36.155724+0000","last_clean":"2024-04-26T12:53:36.155724+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:53:36.155724+0000","last_undegraded":"2024-04-26T12:53:36.155724+0000","last_fullsized":"2024-04-26T12:53:36.155724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.155541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:38.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969449+0000","last_change":"2024-04-26T12:50:04.302095+0000","last_active":"2024-04-26T12:52:27.969449+0000","last_peered":"2024-04-26T12:52:27.969449+0000","last_clean":"2024-04-26T12:52:27.969449+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:52:27.969449+0000","last_undegraded":"2024-04-26T12:52:27.969449+0000","last_fullsized":"2024-04-26T12:52:27.969449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.304021+0000","last_change":"2024-04-26T12:53:32.304100+0000","last_active":"2024-04-26T12:53:32.304021+0000","last_peered":"2024-04-26T12:53:32.304021+0000","last_clean":"2024-04-26T12:53:32.304021+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:32.304021+0000","last_undegraded":"2024-04-26T12:53:32.304021+0000","last_fullsized":"2024-04-26T12:53:32.304021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.303812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:44.406488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.965351+0000","last_change":"2024-04-26T12:49:54.229682+0000","last_active":"2024-04-26T12:52:27.965351+0000","last_peered":"2024-04-26T12:52:27.965351+0000","last_clean":"2024-04-26T12:52:27.965351+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:52:27.965351+0000","last_undegraded":"2024-04-26T12:52:27.965351+0000","last_fullsized":"2024-04-26T12:52:27.965351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.966135+0000","last_change":"2024-04-26T12:49:58.218998+0000","last_active":"2024-04-26T12:52:27.966135+0000","last_peered":"2024-04-26T12:52:27.966135+0000","last_clean":"2024-04-26T12:52:27.966135+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:52:27.966135+0000","last_undegraded":"2024-04-26T12:52:27.966135+0000","last_fullsized":"2024-04-26T12:52:27.966135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.199549+0000","last_change":"2024-04-26T12:53:32.199626+0000","last_active":"2024-04-26T12:53:32.199549+0000","last_peered":"2024-04-26T12:53:32.199549+0000","last_clean":"2024-04-26T12:53:32.199549+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:53:32.199549+0000","last_undegraded":"2024-04-26T12:53:32.199549+0000","last_fullsized":"2024-04-26T12:53:32.199549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.199339+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:43.051403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.287110+0000","last_change":"2024-04-26T12:53:22.287181+0000","last_active":"2024-04-26T12:53:22.287110+0000","last_peered":"2024-04-26T12:53:22.287110+0000","last_clean":"2024-04-26T12:53:22.287110+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:53:22.287110+0000","last_undegraded":"2024-04-26T12:53:22.287110+0000","last_fullsized":"2024-04-26T12:53:22.287110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.286848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:37.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969394+0000","last_change":"2024-04-26T12:50:04.302374+0000","last_active":"2024-04-26T12:52:27.969394+0000","last_peered":"2024-04-26T12:52:27.969394+0000","last_clean":"2024-04-26T12:52:27.969394+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:52:27.969394+0000","last_undegraded":"2024-04-26T12:52:27.969394+0000","last_fullsized":"2024-04-26T12:52:27.969394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:30.169415+0000","last_change":"2024-04-26T12:49:56.219301+0000","last_active":"2024-04-26T12:52:30.169415+0000","last_peered":"2024-04-26T12:52:30.169415+0000","last_clean":"2024-04-26T12:52:30.169415+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:52:30.169415+0000","last_undegraded":"2024-04-26T12:52:30.169415+0000","last_fullsized":"2024-04-26T12:52:30.169415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969621+0000","last_change":"2024-04-26T12:49:54.253819+0000","last_active":"2024-04-26T12:52:27.969621+0000","last_peered":"2024-04-26T12:52:27.969621+0000","last_clean":"2024-04-26T12:52:27.969621+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:52:27.969621+0000","last_undegraded":"2024-04-26T12:52:27.969621+0000","last_fullsized":"2024-04-26T12:52:27.969621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.124744+0000","last_change":"2024-04-26T12:53:34.124797+0000","last_active":"2024-04-26T12:53:34.124744+0000","last_peered":"2024-04-26T12:53:34.124744+0000","last_clean":"2024-04-26T12:53:34.124744+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:53:34.124744+0000","last_undegraded":"2024-04-26T12:53:34.124744+0000","last_fullsized":"2024-04-26T12:53:34.124744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.124506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:09.569031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963492+0000","last_change":"2024-04-26T12:50:00.272784+0000","last_active":"2024-04-26T12:52:02.963492+0000","last_peered":"2024-04-26T12:52:02.963492+0000","last_clean":"2024-04-26T12:52:02.963492+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:52:02.963492+0000","last_undegraded":"2024-04-26T12:52:02.963492+0000","last_fullsized":"2024-04-26T12:52:02.963492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":430,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.832413+0000","last_change":"2024-04-26T12:53:32.832479+0000","last_active":"2024-04-26T12:53:32.832413+0000","last_peered":"2024-04-26T12:53:32.832413+0000","last_clean":"2024-04-26T12:53:32.832413+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:32.832413+0000","last_undegraded":"2024-04-26T12:53:32.832413+0000","last_fullsized":"2024-04-26T12:53:32.832413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.832206+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:19.156979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969244+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:52:27.969244+0000","last_peered":"2024-04-26T12:52:27.969244+0000","last_clean":"2024-04-26T12:52:27.969244+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:52:27.969244+0000","last_undegraded":"2024-04-26T12:52:27.969244+0000","last_fullsized":"2024-04-26T12:52:27.969244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'23","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.524895+0000","last_change":"2024-04-26T12:49:56.213304+0000","last_active":"2024-04-26T12:53:09.524895+0000","last_peered":"2024-04-26T12:53:09.524895+0000","last_clean":"2024-04-26T12:53:09.524895+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:09.524895+0000","last_undegraded":"2024-04-26T12:53:09.524895+0000","last_fullsized":"2024-04-26T12:53:09.524895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.965547+0000","last_change":"2024-04-26T12:49:54.247955+0000","last_active":"2024-04-26T12:52:27.965547+0000","last_peered":"2024-04-26T12:52:27.965547+0000","last_clean":"2024-04-26T12:52:27.965547+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:52:27.965547+0000","last_undegraded":"2024-04-26T12:52:27.965547+0000","last_fullsized":"2024-04-26T12:52:27.965547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.121759+0000","last_change":"2024-04-26T12:53:33.121816+0000","last_active":"2024-04-26T12:53:33.121759+0000","last_peered":"2024-04-26T12:53:33.121759+0000","last_clean":"2024-04-26T12:53:33.121759+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:53:33.121759+0000","last_undegraded":"2024-04-26T12:53:33.121759+0000","last_fullsized":"2024-04-26T12:53:33.121759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.121556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:50.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.092152+0000","last_change":"2024-04-26T12:53:27.092239+0000","last_active":"2024-04-26T12:53:27.092152+0000","last_peered":"2024-04-26T12:53:27.092152+0000","last_clean":"2024-04-26T12:53:27.092152+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:53:27.092152+0000","last_undegraded":"2024-04-26T12:53:27.092152+0000","last_fullsized":"2024-04-26T12:53:27.092152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.091940+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:51.222988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.289177+0000","last_change":"2024-04-26T12:53:24.289294+0000","last_active":"2024-04-26T12:53:24.289177+0000","last_peered":"2024-04-26T12:53:24.289177+0000","last_clean":"2024-04-26T12:53:24.289177+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:53:24.289177+0000","last_undegraded":"2024-04-26T12:53:24.289177+0000","last_fullsized":"2024-04-26T12:53:24.289177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.288887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:44.523664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.967224+0000","last_change":"2024-04-26T12:50:04.283754+0000","last_active":"2024-04-26T12:52:32.967224+0000","last_peered":"2024-04-26T12:52:32.967224+0000","last_clean":"2024-04-26T12:52:32.967224+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:52:32.967224+0000","last_undegraded":"2024-04-26T12:52:32.967224+0000","last_fullsized":"2024-04-26T12:52:32.967224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.965948+0000","last_change":"2024-04-26T12:49:56.216716+0000","last_active":"2024-04-26T12:52:27.965948+0000","last_peered":"2024-04-26T12:52:27.965948+0000","last_clean":"2024-04-26T12:52:27.965948+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:52:27.965948+0000","last_undegraded":"2024-04-26T12:52:27.965948+0000","last_fullsized":"2024-04-26T12:52:27.965948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969824+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:52:27.969824+0000","last_peered":"2024-04-26T12:52:27.969824+0000","last_clean":"2024-04-26T12:52:27.969824+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:52:27.969824+0000","last_undegraded":"2024-04-26T12:52:27.969824+0000","last_fullsized":"2024-04-26T12:52:27.969824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.966101+0000","last_change":"2024-04-26T12:49:58.219225+0000","last_active":"2024-04-26T12:52:27.966101+0000","last_peered":"2024-04-26T12:52:27.966101+0000","last_clean":"2024-04-26T12:52:27.966101+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:52:27.966101+0000","last_undegraded":"2024-04-26T12:52:27.966101+0000","last_fullsized":"2024-04-26T12:52:27.966101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.240483+0000","last_change":"2024-04-26T12:53:31.240665+0000","last_active":"2024-04-26T12:53:31.240483+0000","last_peered":"2024-04-26T12:53:31.240483+0000","last_clean":"2024-04-26T12:53:31.240483+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:53:31.240483+0000","last_undegraded":"2024-04-26T12:53:31.240483+0000","last_fullsized":"2024-04-26T12:53:31.240483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.240229+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:11.099663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969329+0000","last_change":"2024-04-26T12:50:02.287940+0000","last_active":"2024-04-26T12:52:27.969329+0000","last_peered":"2024-04-26T12:52:27.969329+0000","last_clean":"2024-04-26T12:52:27.969329+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:52:27.969329+0000","last_undegraded":"2024-04-26T12:52:27.969329+0000","last_fullsized":"2024-04-26T12:52:27.969329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971454+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:52:32.971454+0000","last_peered":"2024-04-26T12:52:32.971454+0000","last_clean":"2024-04-26T12:52:32.971454+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:52:32.971454+0000","last_undegraded":"2024-04-26T12:52:32.971454+0000","last_fullsized":"2024-04-26T12:52:32.971454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.438266+0000","last_change":"2024-04-26T12:49:56.223405+0000","last_active":"2024-04-26T12:53:09.438266+0000","last_peered":"2024-04-26T12:53:09.438266+0000","last_clean":"2024-04-26T12:53:09.438266+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:53:09.438266+0000","last_undegraded":"2024-04-26T12:53:09.438266+0000","last_fullsized":"2024-04-26T12:53:09.438266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:55.161098+0000","last_change":"2024-04-26T12:49:54.239137+0000","last_active":"2024-04-26T12:51:55.161098+0000","last_peered":"2024-04-26T12:51:55.161098+0000","last_clean":"2024-04-26T12:51:55.161098+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:51:55.161098+0000","last_undegraded":"2024-04-26T12:51:55.161098+0000","last_fullsized":"2024-04-26T12:51:55.161098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.068318+0000","last_change":"2024-04-26T12:53:31.068439+0000","last_active":"2024-04-26T12:53:31.068318+0000","last_peered":"2024-04-26T12:53:31.068318+0000","last_clean":"2024-04-26T12:53:31.068318+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:53:31.068318+0000","last_undegraded":"2024-04-26T12:53:31.068318+0000","last_fullsized":"2024-04-26T12:53:31.068318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.068090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:16.753074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.162927+0000","last_change":"2024-04-26T12:50:00.270650+0000","last_active":"2024-04-26T12:53:16.162927+0000","last_peered":"2024-04-26T12:53:16.162927+0000","last_clean":"2024-04-26T12:53:16.162927+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:53:16.162927+0000","last_undegraded":"2024-04-26T12:53:16.162927+0000","last_fullsized":"2024-04-26T12:53:16.162927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971079+0000","last_change":"2024-04-26T12:50:02.288529+0000","last_active":"2024-04-26T12:52:32.971079+0000","last_peered":"2024-04-26T12:52:32.971079+0000","last_clean":"2024-04-26T12:52:32.971079+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:52:32.971079+0000","last_undegraded":"2024-04-26T12:52:32.971079+0000","last_fullsized":"2024-04-26T12:52:32.971079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:01.222106+0000","last_clean_scrub_stamp":"2024-04-26T12:50:01.222106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971345+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:32.971345+0000","last_peered":"2024-04-26T12:52:32.971345+0000","last_clean":"2024-04-26T12:52:32.971345+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:32.971345+0000","last_undegraded":"2024-04-26T12:52:32.971345+0000","last_fullsized":"2024-04-26T12:52:32.971345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964457+0000","last_change":"2024-04-26T12:49:56.215521+0000","last_active":"2024-04-26T12:52:22.964457+0000","last_peered":"2024-04-26T12:52:22.964457+0000","last_clean":"2024-04-26T12:52:22.964457+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:52:22.964457+0000","last_undegraded":"2024-04-26T12:52:22.964457+0000","last_fullsized":"2024-04-26T12:52:22.964457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.794776+0000","last_change":"2024-04-26T12:49:54.245556+0000","last_active":"2024-04-26T12:53:08.794776+0000","last_peered":"2024-04-26T12:53:08.794776+0000","last_clean":"2024-04-26T12:53:08.794776+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:53:08.794776+0000","last_undegraded":"2024-04-26T12:53:08.794776+0000","last_fullsized":"2024-04-26T12:53:08.794776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.069160+0000","last_change":"2024-04-26T12:53:30.069291+0000","last_active":"2024-04-26T12:53:30.069160+0000","last_peered":"2024-04-26T12:53:30.069160+0000","last_clean":"2024-04-26T12:53:30.069160+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:53:30.069160+0000","last_undegraded":"2024-04-26T12:53:30.069160+0000","last_fullsized":"2024-04-26T12:53:30.069160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.068914+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:20.274170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'35","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.179597+0000","last_change":"2024-04-26T12:50:00.271893+0000","last_active":"2024-04-26T12:53:16.179597+0000","last_peered":"2024-04-26T12:53:16.179597+0000","last_clean":"2024-04-26T12:53:16.179597+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:16.179597+0000","last_undegraded":"2024-04-26T12:53:16.179597+0000","last_fullsized":"2024-04-26T12:53:16.179597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:59.206474+0000","last_clean_scrub_stamp":"2024-04-26T12:49:59.206474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.295415+0000","last_change":"2024-04-26T12:53:26.295546+0000","last_active":"2024-04-26T12:53:26.295415+0000","last_peered":"2024-04-26T12:53:26.295415+0000","last_clean":"2024-04-26T12:53:26.295415+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:53:26.295415+0000","last_undegraded":"2024-04-26T12:53:26.295415+0000","last_fullsized":"2024-04-26T12:53:26.295415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.295181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:21.587262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969712+0000","last_change":"2024-04-26T12:50:04.302279+0000","last_active":"2024-04-26T12:52:27.969712+0000","last_peered":"2024-04-26T12:52:27.969712+0000","last_clean":"2024-04-26T12:52:27.969712+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:52:27.969712+0000","last_undegraded":"2024-04-26T12:52:27.969712+0000","last_fullsized":"2024-04-26T12:52:27.969712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.369986+0000","last_change":"2024-04-26T12:49:56.234400+0000","last_active":"2024-04-26T12:53:09.369986+0000","last_peered":"2024-04-26T12:53:09.369986+0000","last_clean":"2024-04-26T12:53:09.369986+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:09.369986+0000","last_undegraded":"2024-04-26T12:53:09.369986+0000","last_fullsized":"2024-04-26T12:53:09.369986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.074544+0000","last_change":"2024-04-26T12:49:54.248434+0000","last_active":"2024-04-26T12:52:08.074544+0000","last_peered":"2024-04-26T12:52:08.074544+0000","last_clean":"2024-04-26T12:52:08.074544+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:52:08.074544+0000","last_undegraded":"2024-04-26T12:52:08.074544+0000","last_fullsized":"2024-04-26T12:52:08.074544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439717+0000","last_change":"2024-04-26T12:49:56.215256+0000","last_active":"2024-04-26T12:53:09.439717+0000","last_peered":"2024-04-26T12:53:09.439717+0000","last_clean":"2024-04-26T12:53:09.439717+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:09.439717+0000","last_undegraded":"2024-04-26T12:53:09.439717+0000","last_fullsized":"2024-04-26T12:53:09.439717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162020+0000","last_change":"2024-04-26T12:49:54.242913+0000","last_active":"2024-04-26T12:52:00.162020+0000","last_peered":"2024-04-26T12:52:00.162020+0000","last_clean":"2024-04-26T12:52:00.162020+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:52:00.162020+0000","last_undegraded":"2024-04-26T12:52:00.162020+0000","last_fullsized":"2024-04-26T12:52:00.162020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.283786+0000","last_change":"2024-04-26T12:49:56.225688+0000","last_active":"2024-04-26T12:53:09.283786+0000","last_peered":"2024-04-26T12:53:09.283786+0000","last_clean":"2024-04-26T12:53:09.283786+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:53:09.283786+0000","last_undegraded":"2024-04-26T12:53:09.283786+0000","last_fullsized":"2024-04-26T12:53:09.283786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.256513+0000","last_change":"2024-04-26T12:49:54.236188+0000","last_active":"2024-04-26T12:53:16.256513+0000","last_peered":"2024-04-26T12:53:16.256513+0000","last_clean":"2024-04-26T12:53:16.256513+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:53:16.256513+0000","last_undegraded":"2024-04-26T12:53:16.256513+0000","last_fullsized":"2024-04-26T12:53:16.256513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:10.164671+0000","last_change":"2024-04-26T12:49:56.223112+0000","last_active":"2024-04-26T12:52:10.164671+0000","last_peered":"2024-04-26T12:52:10.164671+0000","last_clean":"2024-04-26T12:52:10.164671+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:52:10.164671+0000","last_undegraded":"2024-04-26T12:52:10.164671+0000","last_fullsized":"2024-04-26T12:52:10.164671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.256500+0000","last_change":"2024-04-26T12:49:54.226434+0000","last_active":"2024-04-26T12:53:16.256500+0000","last_peered":"2024-04-26T12:53:16.256500+0000","last_clean":"2024-04-26T12:53:16.256500+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:53:16.256500+0000","last_undegraded":"2024-04-26T12:53:16.256500+0000","last_fullsized":"2024-04-26T12:53:16.256500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163263+0000","last_change":"2024-04-26T12:49:56.221387+0000","last_active":"2024-04-26T12:52:05.163263+0000","last_peered":"2024-04-26T12:52:05.163263+0000","last_clean":"2024-04-26T12:52:05.163263+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:52:05.163263+0000","last_undegraded":"2024-04-26T12:52:05.163263+0000","last_fullsized":"2024-04-26T12:52:05.163263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163350+0000","last_change":"2024-04-26T12:49:54.243199+0000","last_active":"2024-04-26T12:52:05.163350+0000","last_peered":"2024-04-26T12:52:05.163350+0000","last_clean":"2024-04-26T12:52:05.163350+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:52:05.163350+0000","last_undegraded":"2024-04-26T12:52:05.163350+0000","last_fullsized":"2024-04-26T12:52:05.163350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.371504+0000","last_change":"2024-04-26T12:49:56.235320+0000","last_active":"2024-04-26T12:53:09.371504+0000","last_peered":"2024-04-26T12:53:09.371504+0000","last_clean":"2024-04-26T12:53:09.371504+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:09.371504+0000","last_undegraded":"2024-04-26T12:53:09.371504+0000","last_fullsized":"2024-04-26T12:53:09.371504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.959785+0000","last_change":"2024-04-26T12:49:54.238503+0000","last_active":"2024-04-26T12:52:07.959785+0000","last_peered":"2024-04-26T12:52:07.959785+0000","last_clean":"2024-04-26T12:52:07.959785+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:52:07.959785+0000","last_undegraded":"2024-04-26T12:52:07.959785+0000","last_fullsized":"2024-04-26T12:52:07.959785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.285033+0000","last_change":"2024-04-26T12:49:56.225647+0000","last_active":"2024-04-26T12:53:09.285033+0000","last_peered":"2024-04-26T12:53:09.285033+0000","last_clean":"2024-04-26T12:53:09.285033+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:53:09.285033+0000","last_undegraded":"2024-04-26T12:53:09.285033+0000","last_fullsized":"2024-04-26T12:53:09.285033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.960885+0000","last_change":"2024-04-26T12:49:54.250162+0000","last_active":"2024-04-26T12:52:07.960885+0000","last_peered":"2024-04-26T12:52:07.960885+0000","last_clean":"2024-04-26T12:52:07.960885+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:52:07.960885+0000","last_undegraded":"2024-04-26T12:52:07.960885+0000","last_fullsized":"2024-04-26T12:52:07.960885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'7","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.523007+0000","last_change":"2024-04-26T12:49:56.231475+0000","last_active":"2024-04-26T12:53:09.523007+0000","last_peered":"2024-04-26T12:53:09.523007+0000","last_clean":"2024-04-26T12:53:09.523007+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:53:09.523007+0000","last_undegraded":"2024-04-26T12:53:09.523007+0000","last_fullsized":"2024-04-26T12:53:09.523007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163524+0000","last_change":"2024-04-26T12:49:54.229901+0000","last_active":"2024-04-26T12:52:05.163524+0000","last_peered":"2024-04-26T12:52:05.163524+0000","last_clean":"2024-04-26T12:52:05.163524+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:52:05.163524+0000","last_undegraded":"2024-04-26T12:52:05.163524+0000","last_fullsized":"2024-04-26T12:52:05.163524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'9","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.524356+0000","last_change":"2024-04-26T12:49:56.218286+0000","last_active":"2024-04-26T12:53:09.524356+0000","last_peered":"2024-04-26T12:53:09.524356+0000","last_clean":"2024-04-26T12:53:09.524356+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:09.524356+0000","last_undegraded":"2024-04-26T12:53:09.524356+0000","last_fullsized":"2024-04-26T12:53:09.524356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.256395+0000","last_change":"2024-04-26T12:49:54.240647+0000","last_active":"2024-04-26T12:53:16.256395+0000","last_peered":"2024-04-26T12:53:16.256395+0000","last_clean":"2024-04-26T12:53:16.256395+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:53:16.256395+0000","last_undegraded":"2024-04-26T12:53:16.256395+0000","last_fullsized":"2024-04-26T12:53:16.256395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966853+0000","last_change":"2024-04-26T12:49:56.230003+0000","last_active":"2024-04-26T12:52:17.966853+0000","last_peered":"2024-04-26T12:52:17.966853+0000","last_clean":"2024-04-26T12:52:17.966853+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:52:17.966853+0000","last_undegraded":"2024-04-26T12:52:17.966853+0000","last_fullsized":"2024-04-26T12:52:17.966853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:10.164497+0000","last_change":"2024-04-26T12:49:54.238656+0000","last_active":"2024-04-26T12:52:10.164497+0000","last_peered":"2024-04-26T12:52:10.164497+0000","last_clean":"2024-04-26T12:52:10.164497+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:52:10.164497+0000","last_undegraded":"2024-04-26T12:52:10.164497+0000","last_fullsized":"2024-04-26T12:52:10.164497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:15.165902+0000","last_change":"2024-04-26T12:50:34.312404+0000","last_active":"2024-04-26T12:52:15.165902+0000","last_peered":"2024-04-26T12:52:15.165902+0000","last_clean":"2024-04-26T12:52:15.165902+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:52:15.165902+0000","last_undegraded":"2024-04-26T12:52:15.165902+0000","last_fullsized":"2024-04-26T12:52:15.165902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960715+0000","last_change":"2024-04-26T12:49:54.236940+0000","last_active":"2024-04-26T12:52:12.960715+0000","last_peered":"2024-04-26T12:52:12.960715+0000","last_clean":"2024-04-26T12:52:12.960715+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:52:12.960715+0000","last_undegraded":"2024-04-26T12:52:12.960715+0000","last_fullsized":"2024-04-26T12:52:12.960715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.524532+0000","last_change":"2024-04-26T12:49:56.231000+0000","last_active":"2024-04-26T12:53:09.524532+0000","last_peered":"2024-04-26T12:53:09.524532+0000","last_clean":"2024-04-26T12:53:09.524532+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:53:09.524532+0000","last_undegraded":"2024-04-26T12:53:09.524532+0000","last_fullsized":"2024-04-26T12:53:09.524532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.259371+0000","last_change":"2024-04-26T12:49:54.233875+0000","last_active":"2024-04-26T12:53:09.259371+0000","last_peered":"2024-04-26T12:53:09.259371+0000","last_clean":"2024-04-26T12:53:09.259371+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:53:09.259371+0000","last_undegraded":"2024-04-26T12:53:09.259371+0000","last_fullsized":"2024-04-26T12:53:09.259371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.369986+0000","last_change":"2024-04-26T12:49:56.234879+0000","last_active":"2024-04-26T12:53:09.369986+0000","last_peered":"2024-04-26T12:53:09.369986+0000","last_clean":"2024-04-26T12:53:09.369986+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:09.369986+0000","last_undegraded":"2024-04-26T12:53:09.369986+0000","last_fullsized":"2024-04-26T12:53:09.369986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965283+0000","last_change":"2024-04-26T12:49:54.252713+0000","last_active":"2024-04-26T12:52:12.965283+0000","last_peered":"2024-04-26T12:52:12.965283+0000","last_clean":"2024-04-26T12:52:12.965283+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:52:12.965283+0000","last_undegraded":"2024-04-26T12:52:12.965283+0000","last_fullsized":"2024-04-26T12:52:12.965283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.946481+0000","last_change":"2024-04-26T12:49:56.223432+0000","last_active":"2024-04-26T12:53:08.946481+0000","last_peered":"2024-04-26T12:53:08.946481+0000","last_clean":"2024-04-26T12:53:08.946481+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:08.946481+0000","last_undegraded":"2024-04-26T12:53:08.946481+0000","last_fullsized":"2024-04-26T12:53:08.946481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965369+0000","last_change":"2024-04-26T12:49:54.258313+0000","last_active":"2024-04-26T12:52:12.965369+0000","last_peered":"2024-04-26T12:52:12.965369+0000","last_clean":"2024-04-26T12:52:12.965369+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:52:12.965369+0000","last_undegraded":"2024-04-26T12:52:12.965369+0000","last_fullsized":"2024-04-26T12:52:12.965369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.285908+0000","last_change":"2024-04-26T12:49:56.228594+0000","last_active":"2024-04-26T12:53:09.285908+0000","last_peered":"2024-04-26T12:53:09.285908+0000","last_clean":"2024-04-26T12:53:09.285908+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:53:09.285908+0000","last_undegraded":"2024-04-26T12:53:09.285908+0000","last_fullsized":"2024-04-26T12:53:09.285908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.963371+0000","last_change":"2024-04-26T12:49:54.248935+0000","last_active":"2024-04-26T12:52:17.963371+0000","last_peered":"2024-04-26T12:52:17.963371+0000","last_clean":"2024-04-26T12:52:17.963371+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:52:17.963371+0000","last_undegraded":"2024-04-26T12:52:17.963371+0000","last_fullsized":"2024-04-26T12:52:17.963371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.286456+0000","last_change":"2024-04-26T12:49:56.231485+0000","last_active":"2024-04-26T12:52:08.286456+0000","last_peered":"2024-04-26T12:52:08.286456+0000","last_clean":"2024-04-26T12:52:08.286456+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:52:08.286456+0000","last_undegraded":"2024-04-26T12:52:08.286456+0000","last_fullsized":"2024-04-26T12:52:08.286456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.259413+0000","last_change":"2024-04-26T12:49:54.258409+0000","last_active":"2024-04-26T12:53:16.259413+0000","last_peered":"2024-04-26T12:53:16.259413+0000","last_clean":"2024-04-26T12:53:16.259413+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:53:16.259413+0000","last_undegraded":"2024-04-26T12:53:16.259413+0000","last_fullsized":"2024-04-26T12:53:16.259413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966444+0000","last_change":"2024-04-26T12:49:54.241113+0000","last_active":"2024-04-26T12:52:17.966444+0000","last_peered":"2024-04-26T12:52:17.966444+0000","last_clean":"2024-04-26T12:52:17.966444+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:52:17.966444+0000","last_undegraded":"2024-04-26T12:52:17.966444+0000","last_fullsized":"2024-04-26T12:52:17.966444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.369254+0000","last_change":"2024-04-26T12:49:56.227407+0000","last_active":"2024-04-26T12:53:09.369254+0000","last_peered":"2024-04-26T12:53:09.369254+0000","last_clean":"2024-04-26T12:53:09.369254+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:09.369254+0000","last_undegraded":"2024-04-26T12:53:09.369254+0000","last_fullsized":"2024-04-26T12:53:09.369254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:15.165696+0000","last_change":"2024-04-26T12:49:54.244752+0000","last_active":"2024-04-26T12:52:15.165696+0000","last_peered":"2024-04-26T12:52:15.165696+0000","last_clean":"2024-04-26T12:52:15.165696+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:52:15.165696+0000","last_undegraded":"2024-04-26T12:52:15.165696+0000","last_fullsized":"2024-04-26T12:52:15.165696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964019+0000","last_change":"2024-04-26T12:49:56.232881+0000","last_active":"2024-04-26T12:52:22.964019+0000","last_peered":"2024-04-26T12:52:22.964019+0000","last_clean":"2024-04-26T12:52:22.964019+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:52:22.964019+0000","last_undegraded":"2024-04-26T12:52:22.964019+0000","last_fullsized":"2024-04-26T12:52:22.964019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1489,"ondisk_log_size":1489,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640308,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":153627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1015808,"data_stored":740708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640308,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335488,"statfs":{"total":96636764160,"available":96599539712,"internally_reserved":0,"allocated":1040384,"data_stored":740685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":152990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:53:41.672 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.672 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.672 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.673 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.674 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.675 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.676 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.677 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.677 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.677 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.677 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.677 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.677 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.677 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.678 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.679 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:49:39.927089+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.680 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.681 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.682 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.683 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.684 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.685 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.686 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.687 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.688 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.689 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T12:50:01.222106+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-26T12:49:59.206474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=59, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.690 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.691 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.692 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.693 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.694 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.694 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.694 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:53:41.694 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:54:01.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:54:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa24e2fe640 1 Processor -- start 2024-04-26T12:54:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa24e2fe640 1 -- start start 2024-04-26T12:54:01.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa24e2fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa248095390 0x7fa248095770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa24e2fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24809d410 con 0x7fa248095cb0 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa24e2fe640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa248093cb0 con 0x7fa248095390 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa2477fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa248095cb0 0x7fa24812f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56398/0 (socket says 172.21.15.29:56398) 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa2477fe640 1 -- 172.21.15.29:0/1897386895 learned_addr learned my addr 172.21.15.29:0/1897386895 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.821+0000 7fa247fff640 1 --2- 172.21.15.29:0/1897386895 >> v2:172.21.15.29:3300/0 conn(0x7fa248095390 0x7fa248095770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa246ffd640 1 -- 172.21.15.29:0/1897386895 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889548935 0 0) 0x7fa24809d410 con 0x7fa248095cb0 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa246ffd640 1 -- 172.21.15.29:0/1897386895 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa230003530 con 0x7fa248095cb0 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa247fff640 1 -- 172.21.15.29:0/1897386895 >> v1:172.21.15.29:6789/0 conn(0x7fa248095cb0 legacy=0x7fa24812f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:01.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa247fff640 1 -- 172.21.15.29:0/1897386895 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa248090e70 con 0x7fa248095390 2024-04-26T12:54:01.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa247fff640 1 --2- 172.21.15.29:0/1897386895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa248095770 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa238009740 tx=0x7fa23801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebecc47edb018dd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:01.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa246ffd640 1 -- 172.21.15.29:0/1897386895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2380b1070 con 0x7fa248095390 2024-04-26T12:54:01.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa246ffd640 1 -- 172.21.15.29:0/1897386895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2380ac520 con 0x7fa248095390 2024-04-26T12:54:01.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa246ffd640 1 -- 172.21.15.29:0/1897386895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2380ac820 con 0x7fa248095390 2024-04-26T12:54:01.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa24e2fe640 1 -- 172.21.15.29:0/1897386895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 msgr2=0x7fa248095770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:01.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa24e2fe640 1 --2- 172.21.15.29:0/1897386895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa248095770 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa238009740 tx=0x7fa23801c370 comp rx=0 tx=0).stop 2024-04-26T12:54:01.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa24e2fe640 1 -- 172.21.15.29:0/1897386895 shutdown_connections 2024-04-26T12:54:01.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa24e2fe640 1 --2- 172.21.15.29:0/1897386895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa248095770 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:01.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa24e2fe640 1 -- 172.21.15.29:0/1897386895 >> 172.21.15.29:0/1897386895 conn(0x7fa24809a3f0 msgr2=0x7fa24809a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:54:01.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa24e2fe640 1 -- 172.21.15.29:0/1897386895 shutdown_connections 2024-04-26T12:54:01.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.825+0000 7fa24e2fe640 1 -- 172.21.15.29:0/1897386895 wait complete. 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa24e2fe640 1 Processor -- start 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa24e2fe640 1 -- start start 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa24e2fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa24812f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa24e2fe640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481337c0 con 0x7fa248095390 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa247fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa24812f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa247fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa24812f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49664/0 (socket says 172.21.15.29:49664) 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa247fff640 1 -- 172.21.15.29:0/3417670299 learned_addr learned my addr 172.21.15.29:0/3417670299 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa247fff640 1 -- 172.21.15.29:0/3417670299 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24808f670 con 0x7fa248095390 2024-04-26T12:54:01.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa247fff640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa24812f9e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa2380af040 tx=0x7fa23801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa244ff9640 1 -- 172.21.15.29:0/3417670299 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2380b1050 con 0x7fa248095390 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa244ff9640 1 -- 172.21.15.29:0/3417670299 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2380b2040 con 0x7fa248095390 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa248122f20 con 0x7fa248095390 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa244ff9640 1 -- 172.21.15.29:0/3417670299 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2380b85c0 con 0x7fa248095390 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa248123f90 con 0x7fa248095390 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248062f80 con 0x7fa248095390 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa244ff9640 1 -- 172.21.15.29:0/3417670299 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa2380bf030 con 0x7fa248095390 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa244ff9640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa234035db0 0x7fa234038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:01.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa244ff9640 1 -- 172.21.15.29:0/3417670299 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fa2380bd070 con 0x7fa248095390 2024-04-26T12:54:01.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.829+0000 7fa2477fe640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa234035db0 0x7fa234038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:01.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.833+0000 7fa2477fe640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa234035db0 0x7fa234038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa23c007fd0 tx=0x7fa23c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:01.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.837+0000 7fa244ff9640 1 -- 172.21.15.29:0/3417670299 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa2380c6060 con 0x7fa248095390 2024-04-26T12:54:01.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:01.993+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa24806c2f0 con 0x7fa234035db0 2024-04-26T12:54:02.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.037+0000 7fa244ff9640 1 -- 172.21.15.29:0/3417670299 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661732 (secure 0 0 0) 0x7fa24806c2f0 con 0x7fa234035db0 2024-04-26T12:54:02.044 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:54:02.050 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:54:02.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa234035db0 msgr2=0x7fa234038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:02.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa234035db0 0x7fa234038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa23c007fd0 tx=0x7fa23c007980 comp rx=0 tx=0).stop 2024-04-26T12:54:02.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 msgr2=0x7fa24812f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:02.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa24812f9e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa2380af040 tx=0x7fa23801abb0 comp rx=0 tx=0).stop 2024-04-26T12:54:02.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 shutdown_connections 2024-04-26T12:54:02.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fa234035db0 0x7fa234038270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:02.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 --2- 172.21.15.29:0/3417670299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa248095390 0x7fa24812f9e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:02.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 >> 172.21.15.29:0/3417670299 conn(0x7fa24809a3f0 msgr2=0x7fa248071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:54:02.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 shutdown_connections 2024-04-26T12:54:02.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:02.041+0000 7fa24e2fe640 1 -- 172.21.15.29:0/3417670299 wait complete. 2024-04-26T12:54:02.062 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-04-26T12:54:01.258702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4774,"ondisk_log_size":4774,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144280,"kb_used_data":2936,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343080,"statfs":{"total":386547056640,"available":386399313920,"internally_reserved":0,"allocated":3006464,"data_stored":1788010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":144697107},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1307,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006834"},"pg_stats":[{"pgid":"3.3f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.255958+0000","last_change":"2024-04-26T12:49:54.242608+0000","last_active":"2024-04-26T12:53:16.255958+0000","last_peered":"2024-04-26T12:53:16.255958+0000","last_clean":"2024-04-26T12:53:16.255958+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:53:16.255958+0000","last_undegraded":"2024-04-26T12:53:16.255958+0000","last_fullsized":"2024-04-26T12:53:16.255958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.180121+0000","last_change":"2024-04-26T12:53:50.180182+0000","last_active":"2024-04-26T12:53:50.180121+0000","last_peered":"2024-04-26T12:53:50.180121+0000","last_clean":"2024-04-26T12:53:50.180121+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:53:50.180121+0000","last_undegraded":"2024-04-26T12:53:50.180121+0000","last_fullsized":"2024-04-26T12:53:50.180121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.179924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:48.519706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:00.162234+0000","last_change":"2024-04-26T12:49:54.235378+0000","last_active":"2024-04-26T12:52:00.162234+0000","last_peered":"2024-04-26T12:52:00.162234+0000","last_clean":"2024-04-26T12:52:00.162234+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:52:00.162234+0000","last_undegraded":"2024-04-26T12:52:00.162234+0000","last_fullsized":"2024-04-26T12:52:00.162234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.439607+0000","last_change":"2024-04-26T12:49:56.223502+0000","last_active":"2024-04-26T12:53:09.439607+0000","last_peered":"2024-04-26T12:53:09.439607+0000","last_clean":"2024-04-26T12:53:09.439607+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:53:09.439607+0000","last_undegraded":"2024-04-26T12:53:09.439607+0000","last_fullsized":"2024-04-26T12:53:09.439607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963446+0000","last_change":"2024-04-26T12:49:54.259543+0000","last_active":"2024-04-26T12:52:02.963446+0000","last_peered":"2024-04-26T12:52:02.963446+0000","last_clean":"2024-04-26T12:52:02.963446+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:52:02.963446+0000","last_undegraded":"2024-04-26T12:52:02.963446+0000","last_fullsized":"2024-04-26T12:52:02.963446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.501855+0000","last_change":"2024-04-26T12:53:55.501925+0000","last_active":"2024-04-26T12:53:55.501855+0000","last_peered":"2024-04-26T12:53:55.501855+0000","last_clean":"2024-04-26T12:53:55.501855+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:55.501855+0000","last_undegraded":"2024-04-26T12:53:55.501855+0000","last_fullsized":"2024-04-26T12:53:55.501855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.501661+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:47.218244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.343969+0000","last_change":"2024-04-26T12:49:54.243452+0000","last_active":"2024-04-26T12:53:20.343969+0000","last_peered":"2024-04-26T12:53:20.343969+0000","last_clean":"2024-04-26T12:53:20.343969+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:53:20.343969+0000","last_undegraded":"2024-04-26T12:53:20.343969+0000","last_fullsized":"2024-04-26T12:53:20.343969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.284399+0000","last_change":"2024-04-26T12:50:34.320557+0000","last_active":"2024-04-26T12:53:09.284399+0000","last_peered":"2024-04-26T12:53:09.284399+0000","last_clean":"2024-04-26T12:53:09.284399+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:53:09.284399+0000","last_undegraded":"2024-04-26T12:53:09.284399+0000","last_fullsized":"2024-04-26T12:53:09.284399+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969661+0000","last_change":"2024-04-26T12:49:54.237140+0000","last_active":"2024-04-26T12:52:27.969661+0000","last_peered":"2024-04-26T12:52:27.969661+0000","last_clean":"2024-04-26T12:52:27.969661+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:52:27.969661+0000","last_undegraded":"2024-04-26T12:52:27.969661+0000","last_fullsized":"2024-04-26T12:52:27.969661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:19.870936+0000","last_change":"2024-04-26T12:49:56.231677+0000","last_active":"2024-04-26T12:53:19.870936+0000","last_peered":"2024-04-26T12:53:19.870936+0000","last_clean":"2024-04-26T12:53:19.870936+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:53:19.870936+0000","last_undegraded":"2024-04-26T12:53:19.870936+0000","last_fullsized":"2024-04-26T12:53:19.870936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.966006+0000","last_change":"2024-04-26T12:49:54.242489+0000","last_active":"2024-04-26T12:52:27.966006+0000","last_peered":"2024-04-26T12:52:27.966006+0000","last_clean":"2024-04-26T12:52:27.966006+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:52:27.966006+0000","last_undegraded":"2024-04-26T12:52:27.966006+0000","last_fullsized":"2024-04-26T12:52:27.966006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.963379+0000","last_change":"2024-04-26T12:49:56.229364+0000","last_active":"2024-04-26T12:52:02.963379+0000","last_peered":"2024-04-26T12:52:02.963379+0000","last_clean":"2024-04-26T12:52:02.963379+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:52:02.963379+0000","last_undegraded":"2024-04-26T12:52:02.963379+0000","last_fullsized":"2024-04-26T12:52:02.963379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969368+0000","last_change":"2024-04-26T12:49:54.238559+0000","last_active":"2024-04-26T12:52:27.969368+0000","last_peered":"2024-04-26T12:52:27.969368+0000","last_clean":"2024-04-26T12:52:27.969368+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:52:27.969368+0000","last_undegraded":"2024-04-26T12:52:27.969368+0000","last_fullsized":"2024-04-26T12:52:27.969368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.002525+0000","last_change":"2024-04-26T12:53:57.002599+0000","last_active":"2024-04-26T12:53:57.002525+0000","last_peered":"2024-04-26T12:53:57.002525+0000","last_clean":"2024-04-26T12:53:57.002525+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:57.002525+0000","last_undegraded":"2024-04-26T12:53:57.002525+0000","last_fullsized":"2024-04-26T12:53:57.002525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.002331+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:55.456014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:25.168089+0000","last_change":"2024-04-26T12:49:54.238122+0000","last_active":"2024-04-26T12:52:25.168089+0000","last_peered":"2024-04-26T12:52:25.168089+0000","last_clean":"2024-04-26T12:52:25.168089+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:52:25.168089+0000","last_undegraded":"2024-04-26T12:52:25.168089+0000","last_fullsized":"2024-04-26T12:52:25.168089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.035665+0000","last_change":"2024-04-26T12:53:45.035799+0000","last_active":"2024-04-26T12:53:45.035665+0000","last_peered":"2024-04-26T12:53:45.035665+0000","last_clean":"2024-04-26T12:53:45.035665+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:53:45.035665+0000","last_undegraded":"2024-04-26T12:53:45.035665+0000","last_fullsized":"2024-04-26T12:53:45.035665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.035418+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:47.435437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.080713+0000","last_change":"2024-04-26T12:49:56.220575+0000","last_active":"2024-04-26T12:53:09.080713+0000","last_peered":"2024-04-26T12:53:09.080713+0000","last_clean":"2024-04-26T12:53:09.080713+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:53:09.080713+0000","last_undegraded":"2024-04-26T12:53:09.080713+0000","last_fullsized":"2024-04-26T12:53:09.080713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964132+0000","last_change":"2024-04-26T12:49:54.245871+0000","last_active":"2024-04-26T12:52:22.964132+0000","last_peered":"2024-04-26T12:52:22.964132+0000","last_clean":"2024-04-26T12:52:22.964132+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:52:22.964132+0000","last_undegraded":"2024-04-26T12:52:22.964132+0000","last_fullsized":"2024-04-26T12:52:22.964132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.168713+0000","last_change":"2024-04-26T12:53:51.168771+0000","last_active":"2024-04-26T12:53:51.168713+0000","last_peered":"2024-04-26T12:53:51.168713+0000","last_clean":"2024-04-26T12:53:51.168713+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:51.168713+0000","last_undegraded":"2024-04-26T12:53:51.168713+0000","last_fullsized":"2024-04-26T12:53:51.168713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.168499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:07.181751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.966465+0000","last_change":"2024-04-26T12:53:47.966602+0000","last_active":"2024-04-26T12:53:47.966465+0000","last_peered":"2024-04-26T12:53:47.966465+0000","last_clean":"2024-04-26T12:53:47.966465+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:53:47.966465+0000","last_undegraded":"2024-04-26T12:53:47.966465+0000","last_fullsized":"2024-04-26T12:53:47.966465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.966229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:14.686968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.162469+0000","last_change":"2024-04-26T12:53:52.162532+0000","last_active":"2024-04-26T12:53:52.162469+0000","last_peered":"2024-04-26T12:53:52.162469+0000","last_clean":"2024-04-26T12:53:52.162469+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:52.162469+0000","last_undegraded":"2024-04-26T12:53:52.162469+0000","last_fullsized":"2024-04-26T12:53:52.162469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.162284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:06.228081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.963925+0000","last_change":"2024-04-26T12:49:54.244413+0000","last_active":"2024-04-26T12:52:22.963925+0000","last_peered":"2024-04-26T12:52:22.963925+0000","last_clean":"2024-04-26T12:52:22.963925+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:52:22.963925+0000","last_undegraded":"2024-04-26T12:52:22.963925+0000","last_fullsized":"2024-04-26T12:52:22.963925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.947497+0000","last_change":"2024-04-26T12:49:56.221481+0000","last_active":"2024-04-26T12:53:08.947497+0000","last_peered":"2024-04-26T12:53:08.947497+0000","last_clean":"2024-04-26T12:53:08.947497+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:53:08.947497+0000","last_undegraded":"2024-04-26T12:53:08.947497+0000","last_fullsized":"2024-04-26T12:53:08.947497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.171211+0000","last_change":"2024-04-26T12:53:57.171275+0000","last_active":"2024-04-26T12:53:57.171211+0000","last_peered":"2024-04-26T12:53:57.171211+0000","last_clean":"2024-04-26T12:53:57.171211+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:57.171211+0000","last_undegraded":"2024-04-26T12:53:57.171211+0000","last_fullsized":"2024-04-26T12:53:57.171211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.171024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:17.576384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.937879+0000","last_change":"2024-04-26T12:53:48.937942+0000","last_active":"2024-04-26T12:53:48.937879+0000","last_peered":"2024-04-26T12:53:48.937879+0000","last_clean":"2024-04-26T12:53:48.937879+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:53:48.937879+0000","last_undegraded":"2024-04-26T12:53:48.937879+0000","last_fullsized":"2024-04-26T12:53:48.937879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.937678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:30.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:20.167049+0000","last_change":"2024-04-26T12:49:54.235967+0000","last_active":"2024-04-26T12:52:20.167049+0000","last_peered":"2024-04-26T12:52:20.167049+0000","last_clean":"2024-04-26T12:52:20.167049+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:52:20.167049+0000","last_undegraded":"2024-04-26T12:52:20.167049+0000","last_fullsized":"2024-04-26T12:52:20.167049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.369311+0000","last_change":"2024-04-26T12:49:56.230516+0000","last_active":"2024-04-26T12:53:09.369311+0000","last_peered":"2024-04-26T12:53:09.369311+0000","last_clean":"2024-04-26T12:53:09.369311+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:09.369311+0000","last_undegraded":"2024-04-26T12:53:09.369311+0000","last_fullsized":"2024-04-26T12:53:09.369311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966599+0000","last_change":"2024-04-26T12:49:54.231273+0000","last_active":"2024-04-26T12:52:17.966599+0000","last_peered":"2024-04-26T12:52:17.966599+0000","last_clean":"2024-04-26T12:52:17.966599+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:52:17.966599+0000","last_undegraded":"2024-04-26T12:52:17.966599+0000","last_fullsized":"2024-04-26T12:52:17.966599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.464226+0000","last_change":"2024-04-26T12:50:04.290015+0000","last_active":"2024-04-26T12:53:09.464226+0000","last_peered":"2024-04-26T12:53:09.464226+0000","last_clean":"2024-04-26T12:53:09.464226+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:53:09.464226+0000","last_undegraded":"2024-04-26T12:53:09.464226+0000","last_fullsized":"2024-04-26T12:53:09.464226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.415353+0000","last_change":"2024-04-26T12:53:39.415428+0000","last_active":"2024-04-26T12:53:39.415353+0000","last_peered":"2024-04-26T12:53:39.415353+0000","last_clean":"2024-04-26T12:53:39.415353+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:53:39.415353+0000","last_undegraded":"2024-04-26T12:53:39.415353+0000","last_fullsized":"2024-04-26T12:53:39.415353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.415162+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:24.418176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966667+0000","last_change":"2024-04-26T12:49:54.258161+0000","last_active":"2024-04-26T12:52:17.966667+0000","last_peered":"2024-04-26T12:52:17.966667+0000","last_clean":"2024-04-26T12:52:17.966667+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:52:17.966667+0000","last_undegraded":"2024-04-26T12:52:17.966667+0000","last_fullsized":"2024-04-26T12:52:17.966667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.392070+0000","last_change":"2024-04-26T12:53:23.392134+0000","last_active":"2024-04-26T12:53:23.392070+0000","last_peered":"2024-04-26T12:53:23.392070+0000","last_clean":"2024-04-26T12:53:23.392070+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:53:23.392070+0000","last_undegraded":"2024-04-26T12:53:23.392070+0000","last_fullsized":"2024-04-26T12:53:23.392070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.391874+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:06.575701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.391893+0000","last_change":"2024-04-26T12:53:37.391968+0000","last_active":"2024-04-26T12:53:37.391893+0000","last_peered":"2024-04-26T12:53:37.391893+0000","last_clean":"2024-04-26T12:53:37.391893+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:53:37.391893+0000","last_undegraded":"2024-04-26T12:53:37.391893+0000","last_fullsized":"2024-04-26T12:53:37.391893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.391713+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:06.145759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.193575+0000","last_change":"2024-04-26T12:53:40.193637+0000","last_active":"2024-04-26T12:53:40.193575+0000","last_peered":"2024-04-26T12:53:40.193575+0000","last_clean":"2024-04-26T12:53:40.193575+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:53:40.193575+0000","last_undegraded":"2024-04-26T12:53:40.193575+0000","last_fullsized":"2024-04-26T12:53:40.193575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.193370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:21.524309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.966913+0000","last_change":"2024-04-26T12:50:04.289706+0000","last_active":"2024-04-26T12:52:32.966913+0000","last_peered":"2024-04-26T12:52:32.966913+0000","last_clean":"2024-04-26T12:52:32.966913+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:52:32.966913+0000","last_undegraded":"2024-04-26T12:52:32.966913+0000","last_fullsized":"2024-04-26T12:52:32.966913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.384124+0000","last_change":"2024-04-26T12:53:36.384186+0000","last_active":"2024-04-26T12:53:36.384124+0000","last_peered":"2024-04-26T12:53:36.384124+0000","last_clean":"2024-04-26T12:53:36.384124+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:36.384124+0000","last_undegraded":"2024-04-26T12:53:36.384124+0000","last_fullsized":"2024-04-26T12:53:36.384124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.383922+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:56.789282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.963133+0000","last_change":"2024-04-26T12:49:54.239992+0000","last_active":"2024-04-26T12:52:17.963133+0000","last_peered":"2024-04-26T12:52:17.963133+0000","last_clean":"2024-04-26T12:52:17.963133+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:52:17.963133+0000","last_undegraded":"2024-04-26T12:52:17.963133+0000","last_fullsized":"2024-04-26T12:52:17.963133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.280139+0000","last_change":"2024-04-26T12:53:44.280249+0000","last_active":"2024-04-26T12:53:44.280139+0000","last_peered":"2024-04-26T12:53:44.280139+0000","last_clean":"2024-04-26T12:53:44.280139+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:53:44.280139+0000","last_undegraded":"2024-04-26T12:53:44.280139+0000","last_fullsized":"2024-04-26T12:53:44.280139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.279907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:46.896122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.076724+0000","last_change":"2024-04-26T12:53:23.076800+0000","last_active":"2024-04-26T12:53:23.076724+0000","last_peered":"2024-04-26T12:53:23.076724+0000","last_clean":"2024-04-26T12:53:23.076724+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:53:23.076724+0000","last_undegraded":"2024-04-26T12:53:23.076724+0000","last_fullsized":"2024-04-26T12:53:23.076724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.076513+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:18.548345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.104710+0000","last_change":"2024-04-26T12:53:32.104841+0000","last_active":"2024-04-26T12:53:32.104710+0000","last_peered":"2024-04-26T12:53:32.104710+0000","last_clean":"2024-04-26T12:53:32.104710+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:53:32.104710+0000","last_undegraded":"2024-04-26T12:53:32.104710+0000","last_fullsized":"2024-04-26T12:53:32.104710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.104460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:40.209749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:35.170398+0000","last_change":"2024-04-26T12:50:04.281974+0000","last_active":"2024-04-26T12:52:35.170398+0000","last_peered":"2024-04-26T12:52:35.170398+0000","last_clean":"2024-04-26T12:52:35.170398+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:52:35.170398+0000","last_undegraded":"2024-04-26T12:52:35.170398+0000","last_fullsized":"2024-04-26T12:52:35.170398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.411066+0000","last_change":"2024-04-26T12:53:42.411216+0000","last_active":"2024-04-26T12:53:42.411066+0000","last_peered":"2024-04-26T12:53:42.411066+0000","last_clean":"2024-04-26T12:53:42.411066+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:53:42.411066+0000","last_undegraded":"2024-04-26T12:53:42.411066+0000","last_fullsized":"2024-04-26T12:53:42.411066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.410832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:41.173115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966529+0000","last_change":"2024-04-26T12:49:54.238247+0000","last_active":"2024-04-26T12:52:17.966529+0000","last_peered":"2024-04-26T12:52:17.966529+0000","last_clean":"2024-04-26T12:52:17.966529+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:52:17.966529+0000","last_undegraded":"2024-04-26T12:52:17.966529+0000","last_fullsized":"2024-04-26T12:52:17.966529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.256223+0000","last_change":"2024-04-26T12:53:40.256277+0000","last_active":"2024-04-26T12:53:40.256223+0000","last_peered":"2024-04-26T12:53:40.256223+0000","last_clean":"2024-04-26T12:53:40.256223+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:53:40.256223+0000","last_undegraded":"2024-04-26T12:53:40.256223+0000","last_fullsized":"2024-04-26T12:53:40.256223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.256017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:51.409965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.735659+0000","last_change":"2024-04-26T12:53:25.735736+0000","last_active":"2024-04-26T12:53:25.735659+0000","last_peered":"2024-04-26T12:53:25.735659+0000","last_clean":"2024-04-26T12:53:25.735659+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:53:25.735659+0000","last_undegraded":"2024-04-26T12:53:25.735659+0000","last_fullsized":"2024-04-26T12:53:25.735659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.735419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.323105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":399,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.468422+0000","last_change":"2024-04-26T12:53:57.468486+0000","last_active":"2024-04-26T12:53:57.468422+0000","last_peered":"2024-04-26T12:53:57.468422+0000","last_clean":"2024-04-26T12:53:57.468422+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:57.468422+0000","last_undegraded":"2024-04-26T12:53:57.468422+0000","last_fullsized":"2024-04-26T12:53:57.468422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.468221+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:49.873023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.945880+0000","last_change":"2024-04-26T12:53:40.945988+0000","last_active":"2024-04-26T12:53:40.945880+0000","last_peered":"2024-04-26T12:53:40.945880+0000","last_clean":"2024-04-26T12:53:40.945880+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:53:40.945880+0000","last_undegraded":"2024-04-26T12:53:40.945880+0000","last_fullsized":"2024-04-26T12:53:40.945880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.945653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:49.050942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.286893+0000","last_change":"2024-04-26T12:53:48.286965+0000","last_active":"2024-04-26T12:53:48.286893+0000","last_peered":"2024-04-26T12:53:48.286893+0000","last_clean":"2024-04-26T12:53:48.286893+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:48.286893+0000","last_undegraded":"2024-04-26T12:53:48.286893+0000","last_fullsized":"2024-04-26T12:53:48.286893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.286688+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:28.578485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.962034+0000","last_change":"2024-04-26T12:49:54.236350+0000","last_active":"2024-04-26T12:52:17.962034+0000","last_peered":"2024-04-26T12:52:17.962034+0000","last_clean":"2024-04-26T12:52:17.962034+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:52:17.962034+0000","last_undegraded":"2024-04-26T12:52:17.962034+0000","last_fullsized":"2024-04-26T12:52:17.962034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.380805+0000","last_change":"2024-04-26T12:53:22.380865+0000","last_active":"2024-04-26T12:53:22.380805+0000","last_peered":"2024-04-26T12:53:22.380805+0000","last_clean":"2024-04-26T12:53:22.380805+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:53:22.380805+0000","last_undegraded":"2024-04-26T12:53:22.380805+0000","last_fullsized":"2024-04-26T12:53:22.380805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.380528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.319667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.752160+0000","last_change":"2024-04-26T12:53:26.752246+0000","last_active":"2024-04-26T12:53:26.752160+0000","last_peered":"2024-04-26T12:53:26.752160+0000","last_clean":"2024-04-26T12:53:26.752160+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:53:26.752160+0000","last_undegraded":"2024-04-26T12:53:26.752160+0000","last_fullsized":"2024-04-26T12:53:26.752160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.751972+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:59.415047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":414,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.264797+0000","last_change":"2024-04-26T12:53:27.264864+0000","last_active":"2024-04-26T12:53:27.264797+0000","last_peered":"2024-04-26T12:53:27.264797+0000","last_clean":"2024-04-26T12:53:27.264797+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:27.264797+0000","last_undegraded":"2024-04-26T12:53:27.264797+0000","last_fullsized":"2024-04-26T12:53:27.264797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.264595+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:14.426766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.948099+0000","last_change":"2024-04-26T12:49:56.225947+0000","last_active":"2024-04-26T12:53:08.948099+0000","last_peered":"2024-04-26T12:53:08.948099+0000","last_clean":"2024-04-26T12:53:08.948099+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:53:08.948099+0000","last_undegraded":"2024-04-26T12:53:08.948099+0000","last_fullsized":"2024-04-26T12:53:08.948099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.234533+0000","last_change":"2024-04-26T12:49:54.242591+0000","last_active":"2024-04-26T12:53:09.234533+0000","last_peered":"2024-04-26T12:53:09.234533+0000","last_clean":"2024-04-26T12:53:09.234533+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:53:09.234533+0000","last_undegraded":"2024-04-26T12:53:09.234533+0000","last_fullsized":"2024-04-26T12:53:09.234533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.034820+0000","last_change":"2024-04-26T12:53:29.034874+0000","last_active":"2024-04-26T12:53:29.034820+0000","last_peered":"2024-04-26T12:53:29.034820+0000","last_clean":"2024-04-26T12:53:29.034820+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:53:29.034820+0000","last_undegraded":"2024-04-26T12:53:29.034820+0000","last_fullsized":"2024-04-26T12:53:29.034820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.034638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:13.359122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.842225+0000","last_change":"2024-04-26T12:53:33.842323+0000","last_active":"2024-04-26T12:53:33.842225+0000","last_peered":"2024-04-26T12:53:33.842225+0000","last_clean":"2024-04-26T12:53:33.842225+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:53:33.842225+0000","last_undegraded":"2024-04-26T12:53:33.842225+0000","last_fullsized":"2024-04-26T12:53:33.842225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.842014+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.029425+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.367707+0000","last_change":"2024-04-26T12:53:20.367753+0000","last_active":"2024-04-26T12:53:20.367707+0000","last_peered":"2024-04-26T12:53:20.367707+0000","last_clean":"2024-04-26T12:53:20.367707+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:53:20.367707+0000","last_undegraded":"2024-04-26T12:53:20.367707+0000","last_fullsized":"2024-04-26T12:53:20.367707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.367584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:03.848633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.431771+0000","last_change":"2024-04-26T12:50:04.291139+0000","last_active":"2024-04-26T12:53:09.431771+0000","last_peered":"2024-04-26T12:53:09.431771+0000","last_clean":"2024-04-26T12:53:09.431771+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:53:09.431771+0000","last_undegraded":"2024-04-26T12:53:09.431771+0000","last_fullsized":"2024-04-26T12:53:09.431771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.125005+0000","last_change":"2024-04-26T12:53:56.125068+0000","last_active":"2024-04-26T12:53:56.125005+0000","last_peered":"2024-04-26T12:53:56.125005+0000","last_clean":"2024-04-26T12:53:56.125005+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:53:56.125005+0000","last_undegraded":"2024-04-26T12:53:56.125005+0000","last_fullsized":"2024-04-26T12:53:56.125005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.124818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:33.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.971561+0000","last_change":"2024-04-26T12:53:55.971631+0000","last_active":"2024-04-26T12:53:55.971561+0000","last_peered":"2024-04-26T12:53:55.971561+0000","last_clean":"2024-04-26T12:53:55.971561+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:53:55.971561+0000","last_undegraded":"2024-04-26T12:53:55.971561+0000","last_fullsized":"2024-04-26T12:53:55.971561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.971365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:55.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.210053+0000","last_change":"2024-04-26T12:53:39.210108+0000","last_active":"2024-04-26T12:53:39.210053+0000","last_peered":"2024-04-26T12:53:39.210053+0000","last_clean":"2024-04-26T12:53:39.210053+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:53:39.210053+0000","last_undegraded":"2024-04-26T12:53:39.210053+0000","last_fullsized":"2024-04-26T12:53:39.210053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.209817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:09.302793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.322616+0000","last_change":"2024-04-26T12:53:25.322771+0000","last_active":"2024-04-26T12:53:25.322616+0000","last_peered":"2024-04-26T12:53:25.322616+0000","last_clean":"2024-04-26T12:53:25.322616+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:53:25.322616+0000","last_undegraded":"2024-04-26T12:53:25.322616+0000","last_fullsized":"2024-04-26T12:53:25.322616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.322379+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:57.683471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.239097+0000","last_change":"2024-04-26T12:53:33.239150+0000","last_active":"2024-04-26T12:53:33.239097+0000","last_peered":"2024-04-26T12:53:33.239097+0000","last_clean":"2024-04-26T12:53:33.239097+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:53:33.239097+0000","last_undegraded":"2024-04-26T12:53:33.239097+0000","last_fullsized":"2024-04-26T12:53:33.239097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.238876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:14.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'6","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.164859+0000","last_change":"2024-04-26T12:53:48.164922+0000","last_active":"2024-04-26T12:53:48.164859+0000","last_peered":"2024-04-26T12:53:48.164859+0000","last_clean":"2024-04-26T12:53:48.164859+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:53:48.164859+0000","last_undegraded":"2024-04-26T12:53:48.164859+0000","last_fullsized":"2024-04-26T12:53:48.164859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.164674+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:57.350352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.954276+0000","last_change":"2024-04-26T12:53:52.954336+0000","last_active":"2024-04-26T12:53:52.954276+0000","last_peered":"2024-04-26T12:53:52.954276+0000","last_clean":"2024-04-26T12:53:52.954276+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:53:52.954276+0000","last_undegraded":"2024-04-26T12:53:52.954276+0000","last_fullsized":"2024-04-26T12:53:52.954276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.954084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:23.735894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965392+0000","last_change":"2024-04-26T12:49:54.252650+0000","last_active":"2024-04-26T12:52:12.965392+0000","last_peered":"2024-04-26T12:52:12.965392+0000","last_clean":"2024-04-26T12:52:12.965392+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:52:12.965392+0000","last_undegraded":"2024-04-26T12:52:12.965392+0000","last_fullsized":"2024-04-26T12:52:12.965392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.216496+0000","last_change":"2024-04-26T12:53:36.216552+0000","last_active":"2024-04-26T12:53:36.216496+0000","last_peered":"2024-04-26T12:53:36.216496+0000","last_clean":"2024-04-26T12:53:36.216496+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:53:36.216496+0000","last_undegraded":"2024-04-26T12:53:36.216496+0000","last_fullsized":"2024-04-26T12:53:36.216496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.216285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:41.525193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.550270+0000","last_change":"2024-04-26T12:53:54.550362+0000","last_active":"2024-04-26T12:53:54.550270+0000","last_peered":"2024-04-26T12:53:54.550270+0000","last_clean":"2024-04-26T12:53:54.550270+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:53:54.550270+0000","last_undegraded":"2024-04-26T12:53:54.550270+0000","last_fullsized":"2024-04-26T12:53:54.550270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.550077+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:28.913960+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":361,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.260275+0000","last_change":"2024-04-26T12:53:23.260340+0000","last_active":"2024-04-26T12:53:23.260275+0000","last_peered":"2024-04-26T12:53:23.260275+0000","last_clean":"2024-04-26T12:53:23.260275+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:23.260275+0000","last_undegraded":"2024-04-26T12:53:23.260275+0000","last_fullsized":"2024-04-26T12:53:23.260275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.260077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:08.869807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:15.165930+0000","last_change":"2024-04-26T12:50:04.295468+0000","last_active":"2024-04-26T12:52:15.165930+0000","last_peered":"2024-04-26T12:52:15.165930+0000","last_clean":"2024-04-26T12:52:15.165930+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:52:15.165930+0000","last_undegraded":"2024-04-26T12:52:15.165930+0000","last_fullsized":"2024-04-26T12:52:15.165930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.962945+0000","last_change":"2024-04-26T12:53:42.963004+0000","last_active":"2024-04-26T12:53:42.962945+0000","last_peered":"2024-04-26T12:53:42.962945+0000","last_clean":"2024-04-26T12:53:42.962945+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:42.962945+0000","last_undegraded":"2024-04-26T12:53:42.962945+0000","last_fullsized":"2024-04-26T12:53:42.962945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.962751+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:04.429485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.414720+0000","last_change":"2024-04-26T12:49:54.259981+0000","last_active":"2024-04-26T12:53:09.414720+0000","last_peered":"2024-04-26T12:53:09.414720+0000","last_clean":"2024-04-26T12:53:09.414720+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:53:09.414720+0000","last_undegraded":"2024-04-26T12:53:09.414720+0000","last_fullsized":"2024-04-26T12:53:09.414720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:47.971254+0000","last_change":"2024-04-26T12:50:34.307424+0000","last_active":"2024-04-26T12:52:47.971254+0000","last_peered":"2024-04-26T12:52:47.971254+0000","last_clean":"2024-04-26T12:52:47.971254+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:52:47.971254+0000","last_undegraded":"2024-04-26T12:52:47.971254+0000","last_fullsized":"2024-04-26T12:52:47.971254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'65","reported_seq":138,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.301251+0000","last_change":"2024-04-26T12:53:33.301331+0000","last_active":"2024-04-26T12:53:33.301251+0000","last_peered":"2024-04-26T12:53:33.301251+0000","last_clean":"2024-04-26T12:53:33.301251+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:53:33.301251+0000","last_undegraded":"2024-04-26T12:53:33.301251+0000","last_fullsized":"2024-04-26T12:53:33.301251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'65","last_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_deep_scrub":"35'65","last_deep_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.301040+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:07.289330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.319344+0000","last_change":"2024-04-26T12:53:25.319398+0000","last_active":"2024-04-26T12:53:25.319344+0000","last_peered":"2024-04-26T12:53:25.319344+0000","last_clean":"2024-04-26T12:53:25.319344+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:53:25.319344+0000","last_undegraded":"2024-04-26T12:53:25.319344+0000","last_fullsized":"2024-04-26T12:53:25.319344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.319148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:51.725423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'20","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.595887+0000","last_change":"2024-04-26T12:50:04.303330+0000","last_active":"2024-04-26T12:53:09.595887+0000","last_peered":"2024-04-26T12:53:09.595887+0000","last_clean":"2024-04-26T12:53:09.595887+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:53:09.595887+0000","last_undegraded":"2024-04-26T12:53:09.595887+0000","last_fullsized":"2024-04-26T12:53:09.595887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.147213+0000","last_change":"2024-04-26T12:53:45.147271+0000","last_active":"2024-04-26T12:53:45.147213+0000","last_peered":"2024-04-26T12:53:45.147213+0000","last_clean":"2024-04-26T12:53:45.147213+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:53:45.147213+0000","last_undegraded":"2024-04-26T12:53:45.147213+0000","last_fullsized":"2024-04-26T12:53:45.147213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.147005+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.360231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:10.164593+0000","last_change":"2024-04-26T12:49:54.239087+0000","last_active":"2024-04-26T12:52:10.164593+0000","last_peered":"2024-04-26T12:52:10.164593+0000","last_clean":"2024-04-26T12:52:10.164593+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:52:10.164593+0000","last_undegraded":"2024-04-26T12:52:10.164593+0000","last_fullsized":"2024-04-26T12:52:10.164593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.821259+0000","last_change":"2024-04-26T12:53:35.821321+0000","last_active":"2024-04-26T12:53:35.821259+0000","last_peered":"2024-04-26T12:53:35.821259+0000","last_clean":"2024-04-26T12:53:35.821259+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:53:35.821259+0000","last_undegraded":"2024-04-26T12:53:35.821259+0000","last_fullsized":"2024-04-26T12:53:35.821259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.821050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:59.952098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.093329+0000","last_change":"2024-04-26T12:53:26.093504+0000","last_active":"2024-04-26T12:53:26.093329+0000","last_peered":"2024-04-26T12:53:26.093329+0000","last_clean":"2024-04-26T12:53:26.093329+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:53:26.093329+0000","last_undegraded":"2024-04-26T12:53:26.093329+0000","last_fullsized":"2024-04-26T12:53:26.093329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.093081+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:46.353316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.345766+0000","last_change":"2024-04-26T12:53:44.345823+0000","last_active":"2024-04-26T12:53:44.345766+0000","last_peered":"2024-04-26T12:53:44.345766+0000","last_clean":"2024-04-26T12:53:44.345766+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:53:44.345766+0000","last_undegraded":"2024-04-26T12:53:44.345766+0000","last_fullsized":"2024-04-26T12:53:44.345766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.345550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:44.028093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.534820+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:53:09.534820+0000","last_peered":"2024-04-26T12:53:09.534820+0000","last_clean":"2024-04-26T12:53:09.534820+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:53:09.534820+0000","last_undegraded":"2024-04-26T12:53:09.534820+0000","last_fullsized":"2024-04-26T12:53:09.534820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.390362+0000","last_change":"2024-04-26T12:53:40.390424+0000","last_active":"2024-04-26T12:53:40.390362+0000","last_peered":"2024-04-26T12:53:40.390362+0000","last_clean":"2024-04-26T12:53:40.390362+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:40.390362+0000","last_undegraded":"2024-04-26T12:53:40.390362+0000","last_fullsized":"2024-04-26T12:53:40.390362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.390158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:34.578850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964107+0000","last_change":"2024-04-26T12:49:54.231974+0000","last_active":"2024-04-26T12:52:07.964107+0000","last_peered":"2024-04-26T12:52:07.964107+0000","last_clean":"2024-04-26T12:52:07.964107+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:52:07.964107+0000","last_undegraded":"2024-04-26T12:52:07.964107+0000","last_fullsized":"2024-04-26T12:52:07.964107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.184467+0000","last_change":"2024-04-26T12:53:38.184522+0000","last_active":"2024-04-26T12:53:38.184467+0000","last_peered":"2024-04-26T12:53:38.184467+0000","last_clean":"2024-04-26T12:53:38.184467+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:53:38.184467+0000","last_undegraded":"2024-04-26T12:53:38.184467+0000","last_fullsized":"2024-04-26T12:53:38.184467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.184269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:49.731527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.784049+0000","last_change":"2024-04-26T12:53:29.784129+0000","last_active":"2024-04-26T12:53:29.784049+0000","last_peered":"2024-04-26T12:53:29.784049+0000","last_clean":"2024-04-26T12:53:29.784049+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:53:29.784049+0000","last_undegraded":"2024-04-26T12:53:29.784049+0000","last_fullsized":"2024-04-26T12:53:29.784049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.783856+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:02.402474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":416,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.700221+0000","last_change":"2024-04-26T12:53:20.700292+0000","last_active":"2024-04-26T12:53:20.700221+0000","last_peered":"2024-04-26T12:53:20.700221+0000","last_clean":"2024-04-26T12:53:20.700221+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:20.700221+0000","last_undegraded":"2024-04-26T12:53:20.700221+0000","last_fullsized":"2024-04-26T12:53:20.700221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.700008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:02.748840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'14","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.609420+0000","last_change":"2024-04-26T12:50:04.296504+0000","last_active":"2024-04-26T12:53:09.609420+0000","last_peered":"2024-04-26T12:53:09.609420+0000","last_clean":"2024-04-26T12:53:09.609420+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:53:09.609420+0000","last_undegraded":"2024-04-26T12:53:09.609420+0000","last_fullsized":"2024-04-26T12:53:09.609420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.962026+0000","last_change":"2024-04-26T12:49:56.221290+0000","last_active":"2024-04-26T12:52:12.962026+0000","last_peered":"2024-04-26T12:52:12.962026+0000","last_clean":"2024-04-26T12:52:12.962026+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:52:12.962026+0000","last_undegraded":"2024-04-26T12:52:12.962026+0000","last_fullsized":"2024-04-26T12:52:12.962026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964074+0000","last_change":"2024-04-26T12:49:54.237237+0000","last_active":"2024-04-26T12:52:07.964074+0000","last_peered":"2024-04-26T12:52:07.964074+0000","last_clean":"2024-04-26T12:52:07.964074+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:52:07.964074+0000","last_undegraded":"2024-04-26T12:52:07.964074+0000","last_fullsized":"2024-04-26T12:52:07.964074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.149981+0000","last_change":"2024-04-26T12:53:35.150051+0000","last_active":"2024-04-26T12:53:35.149981+0000","last_peered":"2024-04-26T12:53:35.149981+0000","last_clean":"2024-04-26T12:53:35.149981+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:53:35.149981+0000","last_undegraded":"2024-04-26T12:53:35.149981+0000","last_fullsized":"2024-04-26T12:53:35.149981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.149786+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:44.314364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.384790+0000","last_change":"2024-04-26T12:53:41.384877+0000","last_active":"2024-04-26T12:53:41.384790+0000","last_peered":"2024-04-26T12:53:41.384790+0000","last_clean":"2024-04-26T12:53:41.384790+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:53:41.384790+0000","last_undegraded":"2024-04-26T12:53:41.384790+0000","last_fullsized":"2024-04-26T12:53:41.384790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.384606+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:41.807107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.083440+0000","last_change":"2024-04-26T12:53:24.083502+0000","last_active":"2024-04-26T12:53:24.083440+0000","last_peered":"2024-04-26T12:53:24.083440+0000","last_clean":"2024-04-26T12:53:24.083440+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:24.083440+0000","last_undegraded":"2024-04-26T12:53:24.083440+0000","last_fullsized":"2024-04-26T12:53:24.083440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.083257+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:10.408030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.864636+0000","last_change":"2024-04-26T12:53:36.864780+0000","last_active":"2024-04-26T12:53:36.864636+0000","last_peered":"2024-04-26T12:53:36.864636+0000","last_clean":"2024-04-26T12:53:36.864636+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:53:36.864636+0000","last_undegraded":"2024-04-26T12:53:36.864636+0000","last_fullsized":"2024-04-26T12:53:36.864636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.864409+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:22.533038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.165769+0000","last_change":"2024-04-26T12:53:42.165833+0000","last_active":"2024-04-26T12:53:42.165769+0000","last_peered":"2024-04-26T12:53:42.165769+0000","last_clean":"2024-04-26T12:53:42.165769+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:42.165769+0000","last_undegraded":"2024-04-26T12:53:42.165769+0000","last_fullsized":"2024-04-26T12:53:42.165769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.165579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:29.622380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964038+0000","last_change":"2024-04-26T12:49:54.243701+0000","last_active":"2024-04-26T12:52:07.964038+0000","last_peered":"2024-04-26T12:52:07.964038+0000","last_clean":"2024-04-26T12:52:07.964038+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:52:07.964038+0000","last_undegraded":"2024-04-26T12:52:07.964038+0000","last_fullsized":"2024-04-26T12:52:07.964038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.364150+0000","last_change":"2024-04-26T12:53:26.364210+0000","last_active":"2024-04-26T12:53:26.364150+0000","last_peered":"2024-04-26T12:53:26.364150+0000","last_clean":"2024-04-26T12:53:26.364150+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:53:26.364150+0000","last_undegraded":"2024-04-26T12:53:26.364150+0000","last_fullsized":"2024-04-26T12:53:26.364150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.363915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.300166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.062381+0000","last_change":"2024-04-26T12:53:25.062459+0000","last_active":"2024-04-26T12:53:25.062381+0000","last_peered":"2024-04-26T12:53:25.062381+0000","last_clean":"2024-04-26T12:53:25.062381+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:53:25.062381+0000","last_undegraded":"2024-04-26T12:53:25.062381+0000","last_fullsized":"2024-04-26T12:53:25.062381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.062142+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:45.249553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.744487+0000","last_change":"2024-04-26T12:53:28.744541+0000","last_active":"2024-04-26T12:53:28.744487+0000","last_peered":"2024-04-26T12:53:28.744487+0000","last_clean":"2024-04-26T12:53:28.744487+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:53:28.744487+0000","last_undegraded":"2024-04-26T12:53:28.744487+0000","last_fullsized":"2024-04-26T12:53:28.744487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.744289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:22.796067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.133539+0000","last_change":"2024-04-26T12:53:44.133618+0000","last_active":"2024-04-26T12:53:44.133539+0000","last_peered":"2024-04-26T12:53:44.133539+0000","last_clean":"2024-04-26T12:53:44.133539+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:44.133539+0000","last_undegraded":"2024-04-26T12:53:44.133539+0000","last_fullsized":"2024-04-26T12:53:44.133539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.133322+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:14.915132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.385224+0000","last_change":"2024-04-26T12:53:38.385289+0000","last_active":"2024-04-26T12:53:38.385224+0000","last_peered":"2024-04-26T12:53:38.385224+0000","last_clean":"2024-04-26T12:53:38.385224+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:53:38.385224+0000","last_undegraded":"2024-04-26T12:53:38.385224+0000","last_fullsized":"2024-04-26T12:53:38.385224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.385015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:40.285540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:19.869808+0000","last_change":"2024-04-26T12:49:41.039901+0000","last_active":"2024-04-26T12:53:19.869808+0000","last_peered":"2024-04-26T12:53:19.869808+0000","last_clean":"2024-04-26T12:53:19.869808+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:53:19.869808+0000","last_undegraded":"2024-04-26T12:53:19.869808+0000","last_fullsized":"2024-04-26T12:53:19.869808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:39.927089+0000","last_clean_scrub_stamp":"2024-04-26T12:49:39.927089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818887+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:53:20.818887+0000","last_peered":"2024-04-26T12:53:20.818887+0000","last_clean":"2024-04-26T12:53:20.818887+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:53:20.818887+0000","last_undegraded":"2024-04-26T12:53:20.818887+0000","last_fullsized":"2024-04-26T12:53:20.818887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.881076+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:08.881076+0000","last_peered":"2024-04-26T12:53:08.881076+0000","last_clean":"2024-04-26T12:53:08.881076+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:08.881076+0000","last_undegraded":"2024-04-26T12:53:08.881076+0000","last_fullsized":"2024-04-26T12:53:08.881076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.223603+0000","last_change":"2024-04-26T12:53:38.223660+0000","last_active":"2024-04-26T12:53:38.223603+0000","last_peered":"2024-04-26T12:53:38.223603+0000","last_clean":"2024-04-26T12:53:38.223603+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:53:38.223603+0000","last_undegraded":"2024-04-26T12:53:38.223603+0000","last_fullsized":"2024-04-26T12:53:38.223603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.223416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:18.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'88","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.405917+0000","last_change":"2024-04-26T12:53:29.405993+0000","last_active":"2024-04-26T12:53:29.405917+0000","last_peered":"2024-04-26T12:53:29.405917+0000","last_clean":"2024-04-26T12:53:29.405917+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:53:29.405917+0000","last_undegraded":"2024-04-26T12:53:29.405917+0000","last_fullsized":"2024-04-26T12:53:29.405917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'88","last_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_deep_scrub":"35'88","last_deep_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.405693+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.745474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.224147+0000","last_change":"2024-04-26T12:53:41.224221+0000","last_active":"2024-04-26T12:53:41.224147+0000","last_peered":"2024-04-26T12:53:41.224147+0000","last_clean":"2024-04-26T12:53:41.224147+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:53:41.224147+0000","last_undegraded":"2024-04-26T12:53:41.224147+0000","last_fullsized":"2024-04-26T12:53:41.224147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.223941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:36.119504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.459451+0000","last_change":"2024-04-26T12:50:04.295222+0000","last_active":"2024-04-26T12:53:09.459451+0000","last_peered":"2024-04-26T12:53:09.459451+0000","last_clean":"2024-04-26T12:53:09.459451+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:53:09.459451+0000","last_undegraded":"2024-04-26T12:53:09.459451+0000","last_fullsized":"2024-04-26T12:53:09.459451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964185+0000","last_change":"2024-04-26T12:49:56.229772+0000","last_active":"2024-04-26T12:52:07.964185+0000","last_peered":"2024-04-26T12:52:07.964185+0000","last_clean":"2024-04-26T12:52:07.964185+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:52:07.964185+0000","last_undegraded":"2024-04-26T12:52:07.964185+0000","last_fullsized":"2024-04-26T12:52:07.964185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818854+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:53:20.818854+0000","last_peered":"2024-04-26T12:53:20.818854+0000","last_clean":"2024-04-26T12:53:20.818854+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:53:20.818854+0000","last_undegraded":"2024-04-26T12:53:20.818854+0000","last_fullsized":"2024-04-26T12:53:20.818854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.115517+0000","last_change":"2024-04-26T12:53:58.115583+0000","last_active":"2024-04-26T12:53:58.115517+0000","last_peered":"2024-04-26T12:53:58.115517+0000","last_clean":"2024-04-26T12:53:58.115517+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:53:58.115517+0000","last_undegraded":"2024-04-26T12:53:58.115517+0000","last_fullsized":"2024-04-26T12:53:58.115517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.115321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:52.115400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.382679+0000","last_change":"2024-04-26T12:53:28.382731+0000","last_active":"2024-04-26T12:53:28.382679+0000","last_peered":"2024-04-26T12:53:28.382679+0000","last_clean":"2024-04-26T12:53:28.382679+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:53:28.382679+0000","last_undegraded":"2024-04-26T12:53:28.382679+0000","last_fullsized":"2024-04-26T12:53:28.382679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.382477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:09.281461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":516,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.070823+0000","last_change":"2024-04-26T12:53:22.070911+0000","last_active":"2024-04-26T12:53:22.070823+0000","last_peered":"2024-04-26T12:53:22.070823+0000","last_clean":"2024-04-26T12:53:22.070823+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:22.070823+0000","last_undegraded":"2024-04-26T12:53:22.070823+0000","last_fullsized":"2024-04-26T12:53:22.070823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.070631+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:58.378060+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.372637+0000","last_change":"2024-04-26T12:53:43.372693+0000","last_active":"2024-04-26T12:53:43.372637+0000","last_peered":"2024-04-26T12:53:43.372637+0000","last_clean":"2024-04-26T12:53:43.372637+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:53:43.372637+0000","last_undegraded":"2024-04-26T12:53:43.372637+0000","last_fullsized":"2024-04-26T12:53:43.372637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.372441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:12.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.962203+0000","last_change":"2024-04-26T12:50:04.282566+0000","last_active":"2024-04-26T12:52:17.962203+0000","last_peered":"2024-04-26T12:52:17.962203+0000","last_clean":"2024-04-26T12:52:17.962203+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:52:17.962203+0000","last_undegraded":"2024-04-26T12:52:17.962203+0000","last_fullsized":"2024-04-26T12:52:17.962203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.276452+0000","last_change":"2024-04-26T12:53:50.276515+0000","last_active":"2024-04-26T12:53:50.276452+0000","last_peered":"2024-04-26T12:53:50.276452+0000","last_clean":"2024-04-26T12:53:50.276452+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:50.276452+0000","last_undegraded":"2024-04-26T12:53:50.276452+0000","last_fullsized":"2024-04-26T12:53:50.276452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.276254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:50.769163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.343658+0000","last_change":"2024-04-26T12:49:44.964879+0000","last_active":"2024-04-26T12:53:20.343658+0000","last_peered":"2024-04-26T12:53:20.343658+0000","last_clean":"2024-04-26T12:53:20.343658+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:53:20.343658+0000","last_undegraded":"2024-04-26T12:53:20.343658+0000","last_fullsized":"2024-04-26T12:53:20.343658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:19.388796+0000","last_change":"2024-04-26T12:49:54.236038+0000","last_active":"2024-04-26T12:53:19.388796+0000","last_peered":"2024-04-26T12:53:19.388796+0000","last_clean":"2024-04-26T12:53:19.388796+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:53:19.388796+0000","last_undegraded":"2024-04-26T12:53:19.388796+0000","last_fullsized":"2024-04-26T12:53:19.388796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.960874+0000","last_change":"2024-04-26T12:50:34.328152+0000","last_active":"2024-04-26T12:52:07.960874+0000","last_peered":"2024-04-26T12:52:07.960874+0000","last_clean":"2024-04-26T12:52:07.960874+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:52:07.960874+0000","last_undegraded":"2024-04-26T12:52:07.960874+0000","last_fullsized":"2024-04-26T12:52:07.960874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.770929+0000","last_change":"2024-04-26T12:53:30.771034+0000","last_active":"2024-04-26T12:53:30.770929+0000","last_peered":"2024-04-26T12:53:30.770929+0000","last_clean":"2024-04-26T12:53:30.770929+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:30.770929+0000","last_undegraded":"2024-04-26T12:53:30.770929+0000","last_fullsized":"2024-04-26T12:53:30.770929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.770734+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:16.557148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.218388+0000","last_change":"2024-04-26T12:53:37.218444+0000","last_active":"2024-04-26T12:53:37.218388+0000","last_peered":"2024-04-26T12:53:37.218388+0000","last_clean":"2024-04-26T12:53:37.218388+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:53:37.218388+0000","last_undegraded":"2024-04-26T12:53:37.218388+0000","last_fullsized":"2024-04-26T12:53:37.218388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.218195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:55.090465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.086777+0000","last_change":"2024-04-26T12:50:04.302141+0000","last_active":"2024-04-26T12:53:09.086777+0000","last_peered":"2024-04-26T12:53:09.086777+0000","last_clean":"2024-04-26T12:53:09.086777+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:53:09.086777+0000","last_undegraded":"2024-04-26T12:53:09.086777+0000","last_fullsized":"2024-04-26T12:53:09.086777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.225749+0000","last_change":"2024-04-26T12:53:53.225812+0000","last_active":"2024-04-26T12:53:53.225749+0000","last_peered":"2024-04-26T12:53:53.225749+0000","last_clean":"2024-04-26T12:53:53.225749+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:53:53.225749+0000","last_undegraded":"2024-04-26T12:53:53.225749+0000","last_fullsized":"2024-04-26T12:53:53.225749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.225550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:27.498113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818889+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:53:20.818889+0000","last_peered":"2024-04-26T12:53:20.818889+0000","last_clean":"2024-04-26T12:53:20.818889+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:53:20.818889+0000","last_undegraded":"2024-04-26T12:53:20.818889+0000","last_fullsized":"2024-04-26T12:53:20.818889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.959920+0000","last_change":"2024-04-26T12:49:54.228710+0000","last_active":"2024-04-26T12:52:02.959920+0000","last_peered":"2024-04-26T12:52:02.959920+0000","last_clean":"2024-04-26T12:52:02.959920+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:52:02.959920+0000","last_undegraded":"2024-04-26T12:52:02.959920+0000","last_fullsized":"2024-04-26T12:52:02.959920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.187668+0000","last_change":"2024-04-26T12:53:42.187723+0000","last_active":"2024-04-26T12:53:42.187668+0000","last_peered":"2024-04-26T12:53:42.187668+0000","last_clean":"2024-04-26T12:53:42.187668+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:53:42.187668+0000","last_undegraded":"2024-04-26T12:53:42.187668+0000","last_fullsized":"2024-04-26T12:53:42.187668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.187463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:46.572342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'21","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.345151+0000","last_change":"2024-04-26T12:53:27.345235+0000","last_active":"2024-04-26T12:53:27.345151+0000","last_peered":"2024-04-26T12:53:27.345151+0000","last_clean":"2024-04-26T12:53:27.345151+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:27.345151+0000","last_undegraded":"2024-04-26T12:53:27.345151+0000","last_fullsized":"2024-04-26T12:53:27.345151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.344956+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:36.530634+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.363391+0000","last_change":"2024-04-26T12:53:45.363447+0000","last_active":"2024-04-26T12:53:45.363391+0000","last_peered":"2024-04-26T12:53:45.363391+0000","last_clean":"2024-04-26T12:53:45.363391+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:53:45.363391+0000","last_undegraded":"2024-04-26T12:53:45.363391+0000","last_fullsized":"2024-04-26T12:53:45.363391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.363192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:54.085665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.962092+0000","last_change":"2024-04-26T12:50:04.290606+0000","last_active":"2024-04-26T12:52:17.962092+0000","last_peered":"2024-04-26T12:52:17.962092+0000","last_clean":"2024-04-26T12:52:17.962092+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:52:17.962092+0000","last_undegraded":"2024-04-26T12:52:17.962092+0000","last_fullsized":"2024-04-26T12:52:17.962092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.172329+0000","last_change":"2024-04-26T12:53:43.172388+0000","last_active":"2024-04-26T12:53:43.172329+0000","last_peered":"2024-04-26T12:53:43.172329+0000","last_clean":"2024-04-26T12:53:43.172329+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:43.172329+0000","last_undegraded":"2024-04-26T12:53:43.172329+0000","last_fullsized":"2024-04-26T12:53:43.172329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.172137+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:20.834194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:02.960009+0000","last_change":"2024-04-26T12:49:54.227464+0000","last_active":"2024-04-26T12:52:02.960009+0000","last_peered":"2024-04-26T12:52:02.960009+0000","last_clean":"2024-04-26T12:52:02.960009+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:52:02.960009+0000","last_undegraded":"2024-04-26T12:52:02.960009+0000","last_fullsized":"2024-04-26T12:52:02.960009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:19.388728+0000","last_change":"2024-04-26T12:49:44.966529+0000","last_active":"2024-04-26T12:53:19.388728+0000","last_peered":"2024-04-26T12:53:19.388728+0000","last_clean":"2024-04-26T12:53:19.388728+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:53:19.388728+0000","last_undegraded":"2024-04-26T12:53:19.388728+0000","last_fullsized":"2024-04-26T12:53:19.388728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.270930+0000","last_change":"2024-04-26T12:53:46.271022+0000","last_active":"2024-04-26T12:53:46.270930+0000","last_peered":"2024-04-26T12:53:46.270930+0000","last_clean":"2024-04-26T12:53:46.270930+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:53:46.270930+0000","last_undegraded":"2024-04-26T12:53:46.270930+0000","last_fullsized":"2024-04-26T12:53:46.270930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.270733+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:53.862641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'73","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.205126+0000","last_change":"2024-04-26T12:53:30.205126+0000","last_active":"2024-04-26T12:53:30.205126+0000","last_peered":"2024-04-26T12:53:30.205126+0000","last_clean":"2024-04-26T12:53:30.205126+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:53:30.205126+0000","last_undegraded":"2024-04-26T12:53:30.205126+0000","last_fullsized":"2024-04-26T12:53:30.205126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.204804+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:53.044186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.761205+0000","last_change":"2024-04-26T12:53:22.761261+0000","last_active":"2024-04-26T12:53:22.761205+0000","last_peered":"2024-04-26T12:53:22.761205+0000","last_clean":"2024-04-26T12:53:22.761205+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:53:22.761205+0000","last_undegraded":"2024-04-26T12:53:22.761205+0000","last_fullsized":"2024-04-26T12:53:22.761205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.761001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:49.570682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:20.167145+0000","last_change":"2024-04-26T12:50:04.282702+0000","last_active":"2024-04-26T12:52:20.167145+0000","last_peered":"2024-04-26T12:52:20.167145+0000","last_clean":"2024-04-26T12:52:20.167145+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:52:20.167145+0000","last_undegraded":"2024-04-26T12:52:20.167145+0000","last_fullsized":"2024-04-26T12:52:20.167145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.197944+0000","last_change":"2024-04-26T12:53:49.198011+0000","last_active":"2024-04-26T12:53:49.197944+0000","last_peered":"2024-04-26T12:53:49.197944+0000","last_clean":"2024-04-26T12:53:49.197944+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:49.197944+0000","last_undegraded":"2024-04-26T12:53:49.197944+0000","last_fullsized":"2024-04-26T12:53:49.197944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.197740+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:50.051462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.057253+0000","last_change":"2024-04-26T12:54:00.057310+0000","last_active":"2024-04-26T12:54:00.057253+0000","last_peered":"2024-04-26T12:54:00.057253+0000","last_clean":"2024-04-26T12:54:00.057253+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:54:00.057253+0000","last_undegraded":"2024-04-26T12:54:00.057253+0000","last_fullsized":"2024-04-26T12:54:00.057253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.057054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:25.513480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818903+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:53:20.818903+0000","last_peered":"2024-04-26T12:53:20.818903+0000","last_clean":"2024-04-26T12:53:20.818903+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:53:20.818903+0000","last_undegraded":"2024-04-26T12:53:20.818903+0000","last_fullsized":"2024-04-26T12:53:20.818903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.364064+0000","last_change":"2024-04-26T12:53:30.364121+0000","last_active":"2024-04-26T12:53:30.364064+0000","last_peered":"2024-04-26T12:53:30.364064+0000","last_clean":"2024-04-26T12:53:30.364064+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:53:30.364064+0000","last_undegraded":"2024-04-26T12:53:30.364064+0000","last_fullsized":"2024-04-26T12:53:30.364064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.363860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:46.377113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'23","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.060913+0000","last_change":"2024-04-26T12:53:21.061000+0000","last_active":"2024-04-26T12:53:21.060913+0000","last_peered":"2024-04-26T12:53:21.060913+0000","last_clean":"2024-04-26T12:53:21.060913+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:53:21.060913+0000","last_undegraded":"2024-04-26T12:53:21.060913+0000","last_fullsized":"2024-04-26T12:53:21.060913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.060723+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:54.780796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":368,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.077483+0000","last_change":"2024-04-26T12:53:28.077560+0000","last_active":"2024-04-26T12:53:28.077483+0000","last_peered":"2024-04-26T12:53:28.077483+0000","last_clean":"2024-04-26T12:53:28.077483+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:28.077483+0000","last_undegraded":"2024-04-26T12:53:28.077483+0000","last_fullsized":"2024-04-26T12:53:28.077483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.077291+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:13.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.968368+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:52:22.968368+0000","last_peered":"2024-04-26T12:52:22.968368+0000","last_clean":"2024-04-26T12:52:22.968368+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:52:22.968368+0000","last_undegraded":"2024-04-26T12:52:22.968368+0000","last_fullsized":"2024-04-26T12:52:22.968368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.820139+0000","last_change":"2024-04-26T12:49:56.226197+0000","last_active":"2024-04-26T12:53:20.820139+0000","last_peered":"2024-04-26T12:53:20.820139+0000","last_clean":"2024-04-26T12:53:20.820139+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:53:20.820139+0000","last_undegraded":"2024-04-26T12:53:20.820139+0000","last_fullsized":"2024-04-26T12:53:20.820139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.964205+0000","last_change":"2024-04-26T12:49:54.253396+0000","last_active":"2024-04-26T12:52:07.964205+0000","last_peered":"2024-04-26T12:52:07.964205+0000","last_clean":"2024-04-26T12:52:07.964205+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:52:07.964205+0000","last_undegraded":"2024-04-26T12:52:07.964205+0000","last_fullsized":"2024-04-26T12:52:07.964205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:55.161072+0000","last_change":"2024-04-26T12:49:44.966012+0000","last_active":"2024-04-26T12:51:55.161072+0000","last_peered":"2024-04-26T12:51:55.161072+0000","last_clean":"2024-04-26T12:51:55.161072+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:51:55.161072+0000","last_undegraded":"2024-04-26T12:51:55.161072+0000","last_fullsized":"2024-04-26T12:51:55.161072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.421284+0000","last_change":"2024-04-26T12:53:21.421343+0000","last_active":"2024-04-26T12:53:21.421284+0000","last_peered":"2024-04-26T12:53:21.421284+0000","last_clean":"2024-04-26T12:53:21.421284+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:53:21.421284+0000","last_undegraded":"2024-04-26T12:53:21.421284+0000","last_fullsized":"2024-04-26T12:53:21.421284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.421080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:06.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'16","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.399476+0000","last_change":"2024-04-26T12:53:48.399644+0000","last_active":"2024-04-26T12:53:48.399476+0000","last_peered":"2024-04-26T12:53:48.399476+0000","last_clean":"2024-04-26T12:53:48.399476+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:53:48.399476+0000","last_undegraded":"2024-04-26T12:53:48.399476+0000","last_fullsized":"2024-04-26T12:53:48.399476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.399160+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:20.449086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":442,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.333915+0000","last_change":"2024-04-26T12:53:21.333981+0000","last_active":"2024-04-26T12:53:21.333915+0000","last_peered":"2024-04-26T12:53:21.333915+0000","last_clean":"2024-04-26T12:53:21.333915+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:21.333915+0000","last_undegraded":"2024-04-26T12:53:21.333915+0000","last_fullsized":"2024-04-26T12:53:21.333915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.333725+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:27.636643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.963806+0000","last_change":"2024-04-26T12:50:04.301343+0000","last_active":"2024-04-26T12:52:22.963806+0000","last_peered":"2024-04-26T12:52:22.963806+0000","last_clean":"2024-04-26T12:52:22.963806+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:52:22.963806+0000","last_undegraded":"2024-04-26T12:52:22.963806+0000","last_fullsized":"2024-04-26T12:52:22.963806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.991716+0000","last_change":"2024-04-26T12:53:46.991775+0000","last_active":"2024-04-26T12:53:46.991716+0000","last_peered":"2024-04-26T12:53:46.991716+0000","last_clean":"2024-04-26T12:53:46.991716+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:53:46.991716+0000","last_undegraded":"2024-04-26T12:53:46.991716+0000","last_fullsized":"2024-04-26T12:53:46.991716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.991502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:27.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.222363+0000","last_change":"2024-04-26T12:49:54.239381+0000","last_active":"2024-04-26T12:52:08.222363+0000","last_peered":"2024-04-26T12:52:08.222363+0000","last_clean":"2024-04-26T12:52:08.222363+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:52:08.222363+0000","last_undegraded":"2024-04-26T12:52:08.222363+0000","last_fullsized":"2024-04-26T12:52:08.222363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:51:57.962197+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:51:57.962197+0000","last_peered":"2024-04-26T12:51:57.962197+0000","last_clean":"2024-04-26T12:51:57.962197+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:51:57.962197+0000","last_undegraded":"2024-04-26T12:51:57.962197+0000","last_fullsized":"2024-04-26T12:51:57.962197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.334821+0000","last_change":"2024-04-26T12:53:31.334821+0000","last_active":"2024-04-26T12:53:31.334821+0000","last_peered":"2024-04-26T12:53:31.334821+0000","last_clean":"2024-04-26T12:53:31.334821+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:53:31.334821+0000","last_undegraded":"2024-04-26T12:53:31.334821+0000","last_fullsized":"2024-04-26T12:53:31.334821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.334536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:45.400333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'99","reported_seq":192,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.718701+0000","last_change":"2024-04-26T12:53:27.718800+0000","last_active":"2024-04-26T12:53:27.718701+0000","last_peered":"2024-04-26T12:53:27.718701+0000","last_clean":"2024-04-26T12:53:27.718701+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:53:27.718701+0000","last_undegraded":"2024-04-26T12:53:27.718701+0000","last_fullsized":"2024-04-26T12:53:27.718701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'99","last_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_deep_scrub":"35'99","last_deep_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.718504+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:03.589502+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.215290+0000","last_change":"2024-04-26T12:53:29.215348+0000","last_active":"2024-04-26T12:53:29.215290+0000","last_peered":"2024-04-26T12:53:29.215290+0000","last_clean":"2024-04-26T12:53:29.215290+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:53:29.215290+0000","last_undegraded":"2024-04-26T12:53:29.215290+0000","last_fullsized":"2024-04-26T12:53:29.215290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.215091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:55.609962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964738+0000","last_change":"2024-04-26T12:50:04.283865+0000","last_active":"2024-04-26T12:52:22.964738+0000","last_peered":"2024-04-26T12:52:22.964738+0000","last_clean":"2024-04-26T12:52:22.964738+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:52:22.964738+0000","last_undegraded":"2024-04-26T12:52:22.964738+0000","last_fullsized":"2024-04-26T12:52:22.964738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.962059+0000","last_change":"2024-04-26T12:50:04.289462+0000","last_active":"2024-04-26T12:52:12.962059+0000","last_peered":"2024-04-26T12:52:12.962059+0000","last_clean":"2024-04-26T12:52:12.962059+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:52:12.962059+0000","last_undegraded":"2024-04-26T12:52:12.962059+0000","last_fullsized":"2024-04-26T12:52:12.962059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.929712+0000","last_change":"2024-04-26T12:53:41.929781+0000","last_active":"2024-04-26T12:53:41.929712+0000","last_peered":"2024-04-26T12:53:41.929712+0000","last_clean":"2024-04-26T12:53:41.929712+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:53:41.929712+0000","last_undegraded":"2024-04-26T12:53:41.929712+0000","last_fullsized":"2024-04-26T12:53:41.929712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.929472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:59.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966720+0000","last_change":"2024-04-26T12:49:54.259672+0000","last_active":"2024-04-26T12:52:17.966720+0000","last_peered":"2024-04-26T12:52:17.966720+0000","last_clean":"2024-04-26T12:52:17.966720+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:52:17.966720+0000","last_undegraded":"2024-04-26T12:52:17.966720+0000","last_fullsized":"2024-04-26T12:52:17.966720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.182269+0000","last_change":"2024-04-26T12:53:37.182402+0000","last_active":"2024-04-26T12:53:37.182269+0000","last_peered":"2024-04-26T12:53:37.182269+0000","last_clean":"2024-04-26T12:53:37.182269+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:53:37.182269+0000","last_undegraded":"2024-04-26T12:53:37.182269+0000","last_fullsized":"2024-04-26T12:53:37.182269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.182009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.668088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.379326+0000","last_change":"2024-04-26T12:53:35.379487+0000","last_active":"2024-04-26T12:53:35.379326+0000","last_peered":"2024-04-26T12:53:35.379326+0000","last_clean":"2024-04-26T12:53:35.379326+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:53:35.379326+0000","last_undegraded":"2024-04-26T12:53:35.379326+0000","last_fullsized":"2024-04-26T12:53:35.379326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.379029+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:12.600563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.355791+0000","last_change":"2024-04-26T12:53:46.355844+0000","last_active":"2024-04-26T12:53:46.355791+0000","last_peered":"2024-04-26T12:53:46.355791+0000","last_clean":"2024-04-26T12:53:46.355791+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:53:46.355791+0000","last_undegraded":"2024-04-26T12:53:46.355791+0000","last_fullsized":"2024-04-26T12:53:46.355791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.355590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:41.624485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.785997+0000","last_change":"2024-04-26T12:50:04.286573+0000","last_active":"2024-04-26T12:52:05.785997+0000","last_peered":"2024-04-26T12:52:05.785997+0000","last_clean":"2024-04-26T12:52:05.785997+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:52:05.785997+0000","last_undegraded":"2024-04-26T12:52:05.785997+0000","last_fullsized":"2024-04-26T12:52:05.785997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.437673+0000","last_change":"2024-04-26T12:50:34.331364+0000","last_active":"2024-04-26T12:53:09.437673+0000","last_peered":"2024-04-26T12:53:09.437673+0000","last_clean":"2024-04-26T12:53:09.437673+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:53:09.437673+0000","last_undegraded":"2024-04-26T12:53:09.437673+0000","last_fullsized":"2024-04-26T12:53:09.437673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964694+0000","last_change":"2024-04-26T12:49:54.242795+0000","last_active":"2024-04-26T12:52:22.964694+0000","last_peered":"2024-04-26T12:52:22.964694+0000","last_clean":"2024-04-26T12:52:22.964694+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:52:22.964694+0000","last_undegraded":"2024-04-26T12:52:22.964694+0000","last_fullsized":"2024-04-26T12:52:22.964694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966695+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:52:17.966695+0000","last_peered":"2024-04-26T12:52:17.966695+0000","last_clean":"2024-04-26T12:52:17.966695+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:52:17.966695+0000","last_undegraded":"2024-04-26T12:52:17.966695+0000","last_fullsized":"2024-04-26T12:52:17.966695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.245428+0000","last_change":"2024-04-26T12:53:35.245501+0000","last_active":"2024-04-26T12:53:35.245428+0000","last_peered":"2024-04-26T12:53:35.245428+0000","last_clean":"2024-04-26T12:53:35.245428+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:35.245428+0000","last_undegraded":"2024-04-26T12:53:35.245428+0000","last_fullsized":"2024-04-26T12:53:35.245428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.245236+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:33.087428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.725793+0000","last_change":"2024-04-26T12:53:24.725849+0000","last_active":"2024-04-26T12:53:24.725793+0000","last_peered":"2024-04-26T12:53:24.725793+0000","last_clean":"2024-04-26T12:53:24.725793+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:53:24.725793+0000","last_undegraded":"2024-04-26T12:53:24.725793+0000","last_fullsized":"2024-04-26T12:53:24.725793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.725577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:57.154247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.302405+0000","last_change":"2024-04-26T12:53:45.302468+0000","last_active":"2024-04-26T12:53:45.302405+0000","last_peered":"2024-04-26T12:53:45.302405+0000","last_clean":"2024-04-26T12:53:45.302405+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:45.302405+0000","last_undegraded":"2024-04-26T12:53:45.302405+0000","last_fullsized":"2024-04-26T12:53:45.302405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.302211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.021522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'16","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.150114+0000","last_change":"2024-04-26T12:53:57.150181+0000","last_active":"2024-04-26T12:53:57.150114+0000","last_peered":"2024-04-26T12:53:57.150114+0000","last_clean":"2024-04-26T12:53:57.150114+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:57.150114+0000","last_undegraded":"2024-04-26T12:53:57.150114+0000","last_fullsized":"2024-04-26T12:53:57.150114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.149914+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:33.210100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.962337+0000","last_change":"2024-04-26T12:53:53.962501+0000","last_active":"2024-04-26T12:53:53.962337+0000","last_peered":"2024-04-26T12:53:53.962337+0000","last_clean":"2024-04-26T12:53:53.962337+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:53:53.962337+0000","last_undegraded":"2024-04-26T12:53:53.962337+0000","last_fullsized":"2024-04-26T12:53:53.962337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.962061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:05.175288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.837679+0000","last_change":"2024-04-26T12:53:34.837739+0000","last_active":"2024-04-26T12:53:34.837679+0000","last_peered":"2024-04-26T12:53:34.837679+0000","last_clean":"2024-04-26T12:53:34.837679+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:53:34.837679+0000","last_undegraded":"2024-04-26T12:53:34.837679+0000","last_fullsized":"2024-04-26T12:53:34.837679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.837461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:55.097696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":119,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.252254+0000","last_change":"2024-04-26T12:53:34.252332+0000","last_active":"2024-04-26T12:53:34.252254+0000","last_peered":"2024-04-26T12:53:34.252254+0000","last_clean":"2024-04-26T12:53:34.252254+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:34.252254+0000","last_undegraded":"2024-04-26T12:53:34.252254+0000","last_fullsized":"2024-04-26T12:53:34.252254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.252055+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:22.283776+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.049935+0000","last_change":"2024-04-26T12:53:20.049974+0000","last_active":"2024-04-26T12:53:20.049935+0000","last_peered":"2024-04-26T12:53:20.049935+0000","last_clean":"2024-04-26T12:53:20.049935+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:53:20.049935+0000","last_undegraded":"2024-04-26T12:53:20.049935+0000","last_fullsized":"2024-04-26T12:53:20.049935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.049783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:14.101561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:37.972599+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:52:37.972599+0000","last_peered":"2024-04-26T12:52:37.972599+0000","last_clean":"2024-04-26T12:52:37.972599+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:52:37.972599+0000","last_undegraded":"2024-04-26T12:52:37.972599+0000","last_fullsized":"2024-04-26T12:52:37.972599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.504155+0000","last_change":"2024-04-26T12:53:56.504321+0000","last_active":"2024-04-26T12:53:56.504155+0000","last_peered":"2024-04-26T12:53:56.504155+0000","last_clean":"2024-04-26T12:53:56.504155+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:56.504155+0000","last_undegraded":"2024-04-26T12:53:56.504155+0000","last_fullsized":"2024-04-26T12:53:56.504155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.503910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.738314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.964085+0000","last_change":"2024-04-26T12:49:54.238487+0000","last_active":"2024-04-26T12:52:22.964085+0000","last_peered":"2024-04-26T12:52:22.964085+0000","last_clean":"2024-04-26T12:52:22.964085+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:52:22.964085+0000","last_undegraded":"2024-04-26T12:52:22.964085+0000","last_fullsized":"2024-04-26T12:52:22.964085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.347547+0000","last_change":"2024-04-26T12:53:24.347602+0000","last_active":"2024-04-26T12:53:24.347547+0000","last_peered":"2024-04-26T12:53:24.347547+0000","last_clean":"2024-04-26T12:53:24.347547+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:53:24.347547+0000","last_undegraded":"2024-04-26T12:53:24.347547+0000","last_fullsized":"2024-04-26T12:53:24.347547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.347350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:48.923924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.801252+0000","last_change":"2024-04-26T12:53:31.801328+0000","last_active":"2024-04-26T12:53:31.801252+0000","last_peered":"2024-04-26T12:53:31.801252+0000","last_clean":"2024-04-26T12:53:31.801252+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:53:31.801252+0000","last_undegraded":"2024-04-26T12:53:31.801252+0000","last_fullsized":"2024-04-26T12:53:31.801252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.801011+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:27.272844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.740640+0000","last_change":"2024-04-26T12:53:23.740693+0000","last_active":"2024-04-26T12:53:23.740640+0000","last_peered":"2024-04-26T12:53:23.740640+0000","last_clean":"2024-04-26T12:53:23.740640+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:53:23.740640+0000","last_undegraded":"2024-04-26T12:53:23.740640+0000","last_fullsized":"2024-04-26T12:53:23.740640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.740437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:49.029310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.334571+0000","last_change":"2024-04-26T12:53:34.334631+0000","last_active":"2024-04-26T12:53:34.334571+0000","last_peered":"2024-04-26T12:53:34.334571+0000","last_clean":"2024-04-26T12:53:34.334571+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:34.334571+0000","last_undegraded":"2024-04-26T12:53:34.334571+0000","last_fullsized":"2024-04-26T12:53:34.334571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.334375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:02.613019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.967784+0000","last_change":"2024-04-26T12:49:54.241633+0000","last_active":"2024-04-26T12:52:22.967784+0000","last_peered":"2024-04-26T12:52:22.967784+0000","last_clean":"2024-04-26T12:52:22.967784+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:52:22.967784+0000","last_undegraded":"2024-04-26T12:52:22.967784+0000","last_fullsized":"2024-04-26T12:52:22.967784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":239,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.234809+0000","last_change":"2024-04-26T12:53:43.234809+0000","last_active":"2024-04-26T12:53:43.234809+0000","last_peered":"2024-04-26T12:53:43.234809+0000","last_clean":"2024-04-26T12:53:43.234809+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:53:43.234809+0000","last_undegraded":"2024-04-26T12:53:43.234809+0000","last_fullsized":"2024-04-26T12:53:43.234809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.234542+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:14.014272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.227085+0000","last_change":"2024-04-26T12:53:28.227166+0000","last_active":"2024-04-26T12:53:28.227085+0000","last_peered":"2024-04-26T12:53:28.227085+0000","last_clean":"2024-04-26T12:53:28.227085+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:53:28.227085+0000","last_undegraded":"2024-04-26T12:53:28.227085+0000","last_fullsized":"2024-04-26T12:53:28.227085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.226873+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:23.499693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.736545+0000","last_change":"2024-04-26T12:53:21.736604+0000","last_active":"2024-04-26T12:53:21.736545+0000","last_peered":"2024-04-26T12:53:21.736545+0000","last_clean":"2024-04-26T12:53:21.736545+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:53:21.736545+0000","last_undegraded":"2024-04-26T12:53:21.736545+0000","last_fullsized":"2024-04-26T12:53:21.736545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.736352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:21.809175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.288231+0000","last_change":"2024-04-26T12:53:49.288385+0000","last_active":"2024-04-26T12:53:49.288231+0000","last_peered":"2024-04-26T12:53:49.288231+0000","last_clean":"2024-04-26T12:53:49.288231+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:53:49.288231+0000","last_undegraded":"2024-04-26T12:53:49.288231+0000","last_fullsized":"2024-04-26T12:53:49.288231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.288000+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:06.328966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:19.389309+0000","last_change":"2024-04-26T12:49:56.224826+0000","last_active":"2024-04-26T12:53:19.389309+0000","last_peered":"2024-04-26T12:53:19.389309+0000","last_clean":"2024-04-26T12:53:19.389309+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:53:19.389309+0000","last_undegraded":"2024-04-26T12:53:19.389309+0000","last_fullsized":"2024-04-26T12:53:19.389309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.963597+0000","last_change":"2024-04-26T12:49:54.243620+0000","last_active":"2024-04-26T12:52:22.963597+0000","last_peered":"2024-04-26T12:52:22.963597+0000","last_clean":"2024-04-26T12:52:22.963597+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:52:22.963597+0000","last_undegraded":"2024-04-26T12:52:22.963597+0000","last_fullsized":"2024-04-26T12:52:22.963597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.904703+0000","last_change":"2024-04-26T12:53:37.904759+0000","last_active":"2024-04-26T12:53:37.904703+0000","last_peered":"2024-04-26T12:53:37.904703+0000","last_clean":"2024-04-26T12:53:37.904703+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:53:37.904703+0000","last_undegraded":"2024-04-26T12:53:37.904703+0000","last_fullsized":"2024-04-26T12:53:37.904703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.904494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:22.228978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'47","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.491629+0000","last_change":"2024-04-26T12:53:52.491707+0000","last_active":"2024-04-26T12:53:52.491629+0000","last_peered":"2024-04-26T12:53:52.491629+0000","last_clean":"2024-04-26T12:53:52.491629+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:53:52.491629+0000","last_undegraded":"2024-04-26T12:53:52.491629+0000","last_fullsized":"2024-04-26T12:53:52.491629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.491439+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:11.972259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.155724+0000","last_change":"2024-04-26T12:53:36.155779+0000","last_active":"2024-04-26T12:53:36.155724+0000","last_peered":"2024-04-26T12:53:36.155724+0000","last_clean":"2024-04-26T12:53:36.155724+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:53:36.155724+0000","last_undegraded":"2024-04-26T12:53:36.155724+0000","last_fullsized":"2024-04-26T12:53:36.155724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.155541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:38.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969449+0000","last_change":"2024-04-26T12:50:04.302095+0000","last_active":"2024-04-26T12:52:27.969449+0000","last_peered":"2024-04-26T12:52:27.969449+0000","last_clean":"2024-04-26T12:52:27.969449+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:52:27.969449+0000","last_undegraded":"2024-04-26T12:52:27.969449+0000","last_fullsized":"2024-04-26T12:52:27.969449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.304021+0000","last_change":"2024-04-26T12:53:32.304100+0000","last_active":"2024-04-26T12:53:32.304021+0000","last_peered":"2024-04-26T12:53:32.304021+0000","last_clean":"2024-04-26T12:53:32.304021+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:32.304021+0000","last_undegraded":"2024-04-26T12:53:32.304021+0000","last_fullsized":"2024-04-26T12:53:32.304021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.303812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:44.406488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.965351+0000","last_change":"2024-04-26T12:49:54.229682+0000","last_active":"2024-04-26T12:52:27.965351+0000","last_peered":"2024-04-26T12:52:27.965351+0000","last_clean":"2024-04-26T12:52:27.965351+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:52:27.965351+0000","last_undegraded":"2024-04-26T12:52:27.965351+0000","last_fullsized":"2024-04-26T12:52:27.965351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.917230+0000","last_change":"2024-04-26T12:53:39.917284+0000","last_active":"2024-04-26T12:53:39.917230+0000","last_peered":"2024-04-26T12:53:39.917230+0000","last_clean":"2024-04-26T12:53:39.917230+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:53:39.917230+0000","last_undegraded":"2024-04-26T12:53:39.917230+0000","last_fullsized":"2024-04-26T12:53:39.917230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.917036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:25.602021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.199549+0000","last_change":"2024-04-26T12:53:32.199626+0000","last_active":"2024-04-26T12:53:32.199549+0000","last_peered":"2024-04-26T12:53:32.199549+0000","last_clean":"2024-04-26T12:53:32.199549+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:53:32.199549+0000","last_undegraded":"2024-04-26T12:53:32.199549+0000","last_fullsized":"2024-04-26T12:53:32.199549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.199339+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:43.051403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.287110+0000","last_change":"2024-04-26T12:53:22.287181+0000","last_active":"2024-04-26T12:53:22.287110+0000","last_peered":"2024-04-26T12:53:22.287110+0000","last_clean":"2024-04-26T12:53:22.287110+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:53:22.287110+0000","last_undegraded":"2024-04-26T12:53:22.287110+0000","last_fullsized":"2024-04-26T12:53:22.287110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.286848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:37.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969394+0000","last_change":"2024-04-26T12:50:04.302374+0000","last_active":"2024-04-26T12:52:27.969394+0000","last_peered":"2024-04-26T12:52:27.969394+0000","last_clean":"2024-04-26T12:52:27.969394+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:52:27.969394+0000","last_undegraded":"2024-04-26T12:52:27.969394+0000","last_fullsized":"2024-04-26T12:52:27.969394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.153511+0000","last_change":"2024-04-26T12:53:55.153568+0000","last_active":"2024-04-26T12:53:55.153511+0000","last_peered":"2024-04-26T12:53:55.153511+0000","last_clean":"2024-04-26T12:53:55.153511+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:53:55.153511+0000","last_undegraded":"2024-04-26T12:53:55.153511+0000","last_fullsized":"2024-04-26T12:53:55.153511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.153308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:06.760317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969621+0000","last_change":"2024-04-26T12:49:54.253819+0000","last_active":"2024-04-26T12:52:27.969621+0000","last_peered":"2024-04-26T12:52:27.969621+0000","last_clean":"2024-04-26T12:52:27.969621+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:52:27.969621+0000","last_undegraded":"2024-04-26T12:52:27.969621+0000","last_fullsized":"2024-04-26T12:52:27.969621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.124744+0000","last_change":"2024-04-26T12:53:34.124797+0000","last_active":"2024-04-26T12:53:34.124744+0000","last_peered":"2024-04-26T12:53:34.124744+0000","last_clean":"2024-04-26T12:53:34.124744+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:53:34.124744+0000","last_undegraded":"2024-04-26T12:53:34.124744+0000","last_fullsized":"2024-04-26T12:53:34.124744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.124506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:09.569031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.385883+0000","last_change":"2024-04-26T12:53:47.385969+0000","last_active":"2024-04-26T12:53:47.385883+0000","last_peered":"2024-04-26T12:53:47.385883+0000","last_clean":"2024-04-26T12:53:47.385883+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:53:47.385883+0000","last_undegraded":"2024-04-26T12:53:47.385883+0000","last_fullsized":"2024-04-26T12:53:47.385883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.385688+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:42.214059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":430,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.832413+0000","last_change":"2024-04-26T12:53:32.832479+0000","last_active":"2024-04-26T12:53:32.832413+0000","last_peered":"2024-04-26T12:53:32.832413+0000","last_clean":"2024-04-26T12:53:32.832413+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:32.832413+0000","last_undegraded":"2024-04-26T12:53:32.832413+0000","last_fullsized":"2024-04-26T12:53:32.832413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.832206+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:19.156979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969244+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:52:27.969244+0000","last_peered":"2024-04-26T12:52:27.969244+0000","last_clean":"2024-04-26T12:52:27.969244+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:52:27.969244+0000","last_undegraded":"2024-04-26T12:52:27.969244+0000","last_fullsized":"2024-04-26T12:52:27.969244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'24","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.994253+0000","last_change":"2024-04-26T12:53:43.994314+0000","last_active":"2024-04-26T12:53:43.994253+0000","last_peered":"2024-04-26T12:53:43.994253+0000","last_clean":"2024-04-26T12:53:43.994253+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:43.994253+0000","last_undegraded":"2024-04-26T12:53:43.994253+0000","last_fullsized":"2024-04-26T12:53:43.994253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.994064+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:53.158642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.121700+0000","last_change":"2024-04-26T12:53:55.121759+0000","last_active":"2024-04-26T12:53:55.121700+0000","last_peered":"2024-04-26T12:53:55.121700+0000","last_clean":"2024-04-26T12:53:55.121700+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:53:55.121700+0000","last_undegraded":"2024-04-26T12:53:55.121700+0000","last_fullsized":"2024-04-26T12:53:55.121700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.121449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:23.400093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.121759+0000","last_change":"2024-04-26T12:53:33.121816+0000","last_active":"2024-04-26T12:53:33.121759+0000","last_peered":"2024-04-26T12:53:33.121759+0000","last_clean":"2024-04-26T12:53:33.121759+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:53:33.121759+0000","last_undegraded":"2024-04-26T12:53:33.121759+0000","last_fullsized":"2024-04-26T12:53:33.121759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.121556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:50.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.092152+0000","last_change":"2024-04-26T12:53:27.092239+0000","last_active":"2024-04-26T12:53:27.092152+0000","last_peered":"2024-04-26T12:53:27.092152+0000","last_clean":"2024-04-26T12:53:27.092152+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:53:27.092152+0000","last_undegraded":"2024-04-26T12:53:27.092152+0000","last_fullsized":"2024-04-26T12:53:27.092152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.091940+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:51.222988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.289177+0000","last_change":"2024-04-26T12:53:24.289294+0000","last_active":"2024-04-26T12:53:24.289177+0000","last_peered":"2024-04-26T12:53:24.289177+0000","last_clean":"2024-04-26T12:53:24.289177+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:53:24.289177+0000","last_undegraded":"2024-04-26T12:53:24.289177+0000","last_fullsized":"2024-04-26T12:53:24.289177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.288887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:44.523664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.967224+0000","last_change":"2024-04-26T12:50:04.283754+0000","last_active":"2024-04-26T12:52:32.967224+0000","last_peered":"2024-04-26T12:52:32.967224+0000","last_clean":"2024-04-26T12:52:32.967224+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:52:32.967224+0000","last_undegraded":"2024-04-26T12:52:32.967224+0000","last_fullsized":"2024-04-26T12:52:32.967224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.893739+0000","last_change":"2024-04-26T12:53:50.893805+0000","last_active":"2024-04-26T12:53:50.893739+0000","last_peered":"2024-04-26T12:53:50.893739+0000","last_clean":"2024-04-26T12:53:50.893739+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:53:50.893739+0000","last_undegraded":"2024-04-26T12:53:50.893739+0000","last_fullsized":"2024-04-26T12:53:50.893739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.893537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:00.221642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969824+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:52:27.969824+0000","last_peered":"2024-04-26T12:52:27.969824+0000","last_clean":"2024-04-26T12:52:27.969824+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:52:27.969824+0000","last_undegraded":"2024-04-26T12:52:27.969824+0000","last_fullsized":"2024-04-26T12:52:27.969824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.929195+0000","last_change":"2024-04-26T12:53:38.929256+0000","last_active":"2024-04-26T12:53:38.929195+0000","last_peered":"2024-04-26T12:53:38.929195+0000","last_clean":"2024-04-26T12:53:38.929195+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:53:38.929195+0000","last_undegraded":"2024-04-26T12:53:38.929195+0000","last_fullsized":"2024-04-26T12:53:38.929195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.928996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:29.134252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.240483+0000","last_change":"2024-04-26T12:53:31.240665+0000","last_active":"2024-04-26T12:53:31.240483+0000","last_peered":"2024-04-26T12:53:31.240483+0000","last_clean":"2024-04-26T12:53:31.240483+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:53:31.240483+0000","last_undegraded":"2024-04-26T12:53:31.240483+0000","last_fullsized":"2024-04-26T12:53:31.240483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.240229+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:11.099663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.435994+0000","last_change":"2024-04-26T12:53:49.436052+0000","last_active":"2024-04-26T12:53:49.435994+0000","last_peered":"2024-04-26T12:53:49.435994+0000","last_clean":"2024-04-26T12:53:49.435994+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:53:49.435994+0000","last_undegraded":"2024-04-26T12:53:49.435994+0000","last_fullsized":"2024-04-26T12:53:49.435994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.435800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.047458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971454+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:52:32.971454+0000","last_peered":"2024-04-26T12:52:32.971454+0000","last_clean":"2024-04-26T12:52:32.971454+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:52:32.971454+0000","last_undegraded":"2024-04-26T12:52:32.971454+0000","last_fullsized":"2024-04-26T12:52:32.971454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.438266+0000","last_change":"2024-04-26T12:49:56.223405+0000","last_active":"2024-04-26T12:53:09.438266+0000","last_peered":"2024-04-26T12:53:09.438266+0000","last_clean":"2024-04-26T12:53:09.438266+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:53:09.438266+0000","last_undegraded":"2024-04-26T12:53:09.438266+0000","last_fullsized":"2024-04-26T12:53:09.438266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:19.388749+0000","last_change":"2024-04-26T12:49:54.239137+0000","last_active":"2024-04-26T12:53:19.388749+0000","last_peered":"2024-04-26T12:53:19.388749+0000","last_clean":"2024-04-26T12:53:19.388749+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:53:19.388749+0000","last_undegraded":"2024-04-26T12:53:19.388749+0000","last_fullsized":"2024-04-26T12:53:19.388749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.068318+0000","last_change":"2024-04-26T12:53:31.068439+0000","last_active":"2024-04-26T12:53:31.068318+0000","last_peered":"2024-04-26T12:53:31.068318+0000","last_clean":"2024-04-26T12:53:31.068318+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:53:31.068318+0000","last_undegraded":"2024-04-26T12:53:31.068318+0000","last_fullsized":"2024-04-26T12:53:31.068318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.068090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:16.753074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'32","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.452853+0000","last_change":"2024-04-26T12:53:51.452990+0000","last_active":"2024-04-26T12:53:51.452853+0000","last_peered":"2024-04-26T12:53:51.452853+0000","last_clean":"2024-04-26T12:53:51.452853+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:53:51.452853+0000","last_undegraded":"2024-04-26T12:53:51.452853+0000","last_fullsized":"2024-04-26T12:53:51.452853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'32","last_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_deep_scrub":"35'32","last_deep_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.452618+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.889839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.506938+0000","last_change":"2024-04-26T12:53:53.506996+0000","last_active":"2024-04-26T12:53:53.506938+0000","last_peered":"2024-04-26T12:53:53.506938+0000","last_clean":"2024-04-26T12:53:53.506938+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:53:53.506938+0000","last_undegraded":"2024-04-26T12:53:53.506938+0000","last_fullsized":"2024-04-26T12:53:53.506938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.506716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:38.844443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971345+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:32.971345+0000","last_peered":"2024-04-26T12:52:32.971345+0000","last_clean":"2024-04-26T12:52:32.971345+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:32.971345+0000","last_undegraded":"2024-04-26T12:52:32.971345+0000","last_fullsized":"2024-04-26T12:52:32.971345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.981002+0000","last_change":"2024-04-26T12:53:54.981135+0000","last_active":"2024-04-26T12:53:54.981002+0000","last_peered":"2024-04-26T12:53:54.981002+0000","last_clean":"2024-04-26T12:53:54.981002+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:53:54.981002+0000","last_undegraded":"2024-04-26T12:53:54.981002+0000","last_fullsized":"2024-04-26T12:53:54.981002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.980684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:23.450201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:08.794776+0000","last_change":"2024-04-26T12:49:54.245556+0000","last_active":"2024-04-26T12:53:08.794776+0000","last_peered":"2024-04-26T12:53:08.794776+0000","last_clean":"2024-04-26T12:53:08.794776+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:53:08.794776+0000","last_undegraded":"2024-04-26T12:53:08.794776+0000","last_fullsized":"2024-04-26T12:53:08.794776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.069160+0000","last_change":"2024-04-26T12:53:30.069291+0000","last_active":"2024-04-26T12:53:30.069160+0000","last_peered":"2024-04-26T12:53:30.069160+0000","last_clean":"2024-04-26T12:53:30.069160+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:53:30.069160+0000","last_undegraded":"2024-04-26T12:53:30.069160+0000","last_fullsized":"2024-04-26T12:53:30.069160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.068914+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:20.274170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.418105+0000","last_change":"2024-04-26T12:53:50.418159+0000","last_active":"2024-04-26T12:53:50.418105+0000","last_peered":"2024-04-26T12:53:50.418105+0000","last_clean":"2024-04-26T12:53:50.418105+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:50.418105+0000","last_undegraded":"2024-04-26T12:53:50.418105+0000","last_fullsized":"2024-04-26T12:53:50.418105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.417994+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:42.018459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.295415+0000","last_change":"2024-04-26T12:53:26.295546+0000","last_active":"2024-04-26T12:53:26.295415+0000","last_peered":"2024-04-26T12:53:26.295415+0000","last_clean":"2024-04-26T12:53:26.295415+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:53:26.295415+0000","last_undegraded":"2024-04-26T12:53:26.295415+0000","last_fullsized":"2024-04-26T12:53:26.295415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.295181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:21.587262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969712+0000","last_change":"2024-04-26T12:50:04.302279+0000","last_active":"2024-04-26T12:52:27.969712+0000","last_peered":"2024-04-26T12:52:27.969712+0000","last_clean":"2024-04-26T12:52:27.969712+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:52:27.969712+0000","last_undegraded":"2024-04-26T12:52:27.969712+0000","last_fullsized":"2024-04-26T12:52:27.969712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.144111+0000","last_change":"2024-04-26T12:53:46.144167+0000","last_active":"2024-04-26T12:53:46.144111+0000","last_peered":"2024-04-26T12:53:46.144111+0000","last_clean":"2024-04-26T12:53:46.144111+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:46.144111+0000","last_undegraded":"2024-04-26T12:53:46.144111+0000","last_fullsized":"2024-04-26T12:53:46.144111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.143916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:10.720490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.939748+0000","last_change":"2024-04-26T12:53:51.939817+0000","last_active":"2024-04-26T12:53:51.939748+0000","last_peered":"2024-04-26T12:53:51.939748+0000","last_clean":"2024-04-26T12:53:51.939748+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:53:51.939748+0000","last_undegraded":"2024-04-26T12:53:51.939748+0000","last_fullsized":"2024-04-26T12:53:51.939748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.939533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:29.601591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.262439+0000","last_change":"2024-04-26T12:53:51.262502+0000","last_active":"2024-04-26T12:53:51.262439+0000","last_peered":"2024-04-26T12:53:51.262439+0000","last_clean":"2024-04-26T12:53:51.262439+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:51.262439+0000","last_undegraded":"2024-04-26T12:53:51.262439+0000","last_fullsized":"2024-04-26T12:53:51.262439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.262245+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.721553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.165673+0000","last_change":"2024-04-26T12:53:56.165739+0000","last_active":"2024-04-26T12:53:56.165673+0000","last_peered":"2024-04-26T12:53:56.165673+0000","last_clean":"2024-04-26T12:53:56.165673+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:53:56.165673+0000","last_undegraded":"2024-04-26T12:53:56.165673+0000","last_fullsized":"2024-04-26T12:53:56.165673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.165465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:33.355823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.283786+0000","last_change":"2024-04-26T12:49:56.225688+0000","last_active":"2024-04-26T12:53:09.283786+0000","last_peered":"2024-04-26T12:53:09.283786+0000","last_clean":"2024-04-26T12:53:09.283786+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:53:09.283786+0000","last_undegraded":"2024-04-26T12:53:09.283786+0000","last_fullsized":"2024-04-26T12:53:09.283786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.256513+0000","last_change":"2024-04-26T12:49:54.236188+0000","last_active":"2024-04-26T12:53:16.256513+0000","last_peered":"2024-04-26T12:53:16.256513+0000","last_clean":"2024-04-26T12:53:16.256513+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:53:16.256513+0000","last_undegraded":"2024-04-26T12:53:16.256513+0000","last_fullsized":"2024-04-26T12:53:16.256513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:10.164671+0000","last_change":"2024-04-26T12:49:56.223112+0000","last_active":"2024-04-26T12:52:10.164671+0000","last_peered":"2024-04-26T12:52:10.164671+0000","last_clean":"2024-04-26T12:52:10.164671+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:52:10.164671+0000","last_undegraded":"2024-04-26T12:52:10.164671+0000","last_fullsized":"2024-04-26T12:52:10.164671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.256500+0000","last_change":"2024-04-26T12:49:54.226434+0000","last_active":"2024-04-26T12:53:16.256500+0000","last_peered":"2024-04-26T12:53:16.256500+0000","last_clean":"2024-04-26T12:53:16.256500+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:53:16.256500+0000","last_undegraded":"2024-04-26T12:53:16.256500+0000","last_fullsized":"2024-04-26T12:53:16.256500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.097535+0000","last_change":"2024-04-26T12:53:59.097598+0000","last_active":"2024-04-26T12:53:59.097535+0000","last_peered":"2024-04-26T12:53:59.097535+0000","last_clean":"2024-04-26T12:53:59.097535+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:53:59.097535+0000","last_undegraded":"2024-04-26T12:53:59.097535+0000","last_fullsized":"2024-04-26T12:53:59.097535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.097326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:47.866871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.202486+0000","last_change":"2024-04-26T12:53:54.202547+0000","last_active":"2024-04-26T12:53:54.202486+0000","last_peered":"2024-04-26T12:53:54.202486+0000","last_clean":"2024-04-26T12:53:54.202486+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:53:54.202486+0000","last_undegraded":"2024-04-26T12:53:54.202486+0000","last_fullsized":"2024-04-26T12:53:54.202486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.202278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:55.097855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":99,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.220277+0000","last_change":"2024-04-26T12:53:39.220338+0000","last_active":"2024-04-26T12:53:39.220277+0000","last_peered":"2024-04-26T12:53:39.220277+0000","last_clean":"2024-04-26T12:53:39.220277+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:39.220277+0000","last_undegraded":"2024-04-26T12:53:39.220277+0000","last_fullsized":"2024-04-26T12:53:39.220277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.220089+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:13.125940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:07.959785+0000","last_change":"2024-04-26T12:49:54.238503+0000","last_active":"2024-04-26T12:52:07.959785+0000","last_peered":"2024-04-26T12:52:07.959785+0000","last_clean":"2024-04-26T12:52:07.959785+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:52:07.959785+0000","last_undegraded":"2024-04-26T12:52:07.959785+0000","last_fullsized":"2024-04-26T12:52:07.959785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.285033+0000","last_change":"2024-04-26T12:49:56.225647+0000","last_active":"2024-04-26T12:53:09.285033+0000","last_peered":"2024-04-26T12:53:09.285033+0000","last_clean":"2024-04-26T12:53:09.285033+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:53:09.285033+0000","last_undegraded":"2024-04-26T12:53:09.285033+0000","last_fullsized":"2024-04-26T12:53:09.285033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.022756+0000","last_change":"2024-04-26T12:53:46.022822+0000","last_active":"2024-04-26T12:53:46.022756+0000","last_peered":"2024-04-26T12:53:46.022756+0000","last_clean":"2024-04-26T12:53:46.022756+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:53:46.022756+0000","last_undegraded":"2024-04-26T12:53:46.022756+0000","last_fullsized":"2024-04-26T12:53:46.022756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.022525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:48.747486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'7","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.523007+0000","last_change":"2024-04-26T12:49:56.231475+0000","last_active":"2024-04-26T12:53:09.523007+0000","last_peered":"2024-04-26T12:53:09.523007+0000","last_clean":"2024-04-26T12:53:09.523007+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:53:09.523007+0000","last_undegraded":"2024-04-26T12:53:09.523007+0000","last_fullsized":"2024-04-26T12:53:09.523007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:05.163524+0000","last_change":"2024-04-26T12:49:54.229901+0000","last_active":"2024-04-26T12:52:05.163524+0000","last_peered":"2024-04-26T12:52:05.163524+0000","last_clean":"2024-04-26T12:52:05.163524+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:52:05.163524+0000","last_undegraded":"2024-04-26T12:52:05.163524+0000","last_fullsized":"2024-04-26T12:52:05.163524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'10","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.188694+0000","last_change":"2024-04-26T12:53:53.188767+0000","last_active":"2024-04-26T12:53:53.188694+0000","last_peered":"2024-04-26T12:53:53.188694+0000","last_clean":"2024-04-26T12:53:53.188694+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:53.188694+0000","last_undegraded":"2024-04-26T12:53:53.188694+0000","last_fullsized":"2024-04-26T12:53:53.188694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.188457+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.177200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.256395+0000","last_change":"2024-04-26T12:49:54.240647+0000","last_active":"2024-04-26T12:53:16.256395+0000","last_peered":"2024-04-26T12:53:16.256395+0000","last_clean":"2024-04-26T12:53:16.256395+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:53:16.256395+0000","last_undegraded":"2024-04-26T12:53:16.256395+0000","last_fullsized":"2024-04-26T12:53:16.256395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966853+0000","last_change":"2024-04-26T12:49:56.230003+0000","last_active":"2024-04-26T12:52:17.966853+0000","last_peered":"2024-04-26T12:52:17.966853+0000","last_clean":"2024-04-26T12:52:17.966853+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:52:17.966853+0000","last_undegraded":"2024-04-26T12:52:17.966853+0000","last_fullsized":"2024-04-26T12:52:17.966853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:10.164497+0000","last_change":"2024-04-26T12:49:54.238656+0000","last_active":"2024-04-26T12:52:10.164497+0000","last_peered":"2024-04-26T12:52:10.164497+0000","last_clean":"2024-04-26T12:52:10.164497+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:52:10.164497+0000","last_undegraded":"2024-04-26T12:52:10.164497+0000","last_fullsized":"2024-04-26T12:52:10.164497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:15.165902+0000","last_change":"2024-04-26T12:50:34.312404+0000","last_active":"2024-04-26T12:52:15.165902+0000","last_peered":"2024-04-26T12:52:15.165902+0000","last_clean":"2024-04-26T12:52:15.165902+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:52:15.165902+0000","last_undegraded":"2024-04-26T12:52:15.165902+0000","last_fullsized":"2024-04-26T12:52:15.165902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.960715+0000","last_change":"2024-04-26T12:49:54.236940+0000","last_active":"2024-04-26T12:52:12.960715+0000","last_peered":"2024-04-26T12:52:12.960715+0000","last_clean":"2024-04-26T12:52:12.960715+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:52:12.960715+0000","last_undegraded":"2024-04-26T12:52:12.960715+0000","last_fullsized":"2024-04-26T12:52:12.960715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.524532+0000","last_change":"2024-04-26T12:49:56.231000+0000","last_active":"2024-04-26T12:53:09.524532+0000","last_peered":"2024-04-26T12:53:09.524532+0000","last_clean":"2024-04-26T12:53:09.524532+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:53:09.524532+0000","last_undegraded":"2024-04-26T12:53:09.524532+0000","last_fullsized":"2024-04-26T12:53:09.524532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.259371+0000","last_change":"2024-04-26T12:49:54.233875+0000","last_active":"2024-04-26T12:53:09.259371+0000","last_peered":"2024-04-26T12:53:09.259371+0000","last_clean":"2024-04-26T12:53:09.259371+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:53:09.259371+0000","last_undegraded":"2024-04-26T12:53:09.259371+0000","last_fullsized":"2024-04-26T12:53:09.259371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.211868+0000","last_change":"2024-04-26T12:53:41.211925+0000","last_active":"2024-04-26T12:53:41.211868+0000","last_peered":"2024-04-26T12:53:41.211868+0000","last_clean":"2024-04-26T12:53:41.211868+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:41.211868+0000","last_undegraded":"2024-04-26T12:53:41.211868+0000","last_fullsized":"2024-04-26T12:53:41.211868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.211668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:06.215290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965283+0000","last_change":"2024-04-26T12:49:54.252713+0000","last_active":"2024-04-26T12:52:12.965283+0000","last_peered":"2024-04-26T12:52:12.965283+0000","last_clean":"2024-04-26T12:52:12.965283+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:52:12.965283+0000","last_undegraded":"2024-04-26T12:52:12.965283+0000","last_fullsized":"2024-04-26T12:52:12.965283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.141249+0000","last_change":"2024-04-26T12:53:54.141316+0000","last_active":"2024-04-26T12:53:54.141249+0000","last_peered":"2024-04-26T12:53:54.141249+0000","last_clean":"2024-04-26T12:53:54.141249+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:54.141249+0000","last_undegraded":"2024-04-26T12:53:54.141249+0000","last_fullsized":"2024-04-26T12:53:54.141249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.141037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:28.129327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965369+0000","last_change":"2024-04-26T12:49:54.258313+0000","last_active":"2024-04-26T12:52:12.965369+0000","last_peered":"2024-04-26T12:52:12.965369+0000","last_clean":"2024-04-26T12:52:12.965369+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:52:12.965369+0000","last_undegraded":"2024-04-26T12:52:12.965369+0000","last_fullsized":"2024-04-26T12:52:12.965369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.285908+0000","last_change":"2024-04-26T12:49:56.228594+0000","last_active":"2024-04-26T12:53:09.285908+0000","last_peered":"2024-04-26T12:53:09.285908+0000","last_clean":"2024-04-26T12:53:09.285908+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:53:09.285908+0000","last_undegraded":"2024-04-26T12:53:09.285908+0000","last_fullsized":"2024-04-26T12:53:09.285908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.914000+0000","last_change":"2024-04-26T12:53:49.914055+0000","last_active":"2024-04-26T12:53:49.914000+0000","last_peered":"2024-04-26T12:53:49.914000+0000","last_clean":"2024-04-26T12:53:49.914000+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:53:49.914000+0000","last_undegraded":"2024-04-26T12:53:49.914000+0000","last_fullsized":"2024-04-26T12:53:49.914000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.913803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:16.913370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:08.286456+0000","last_change":"2024-04-26T12:49:56.231485+0000","last_active":"2024-04-26T12:52:08.286456+0000","last_peered":"2024-04-26T12:52:08.286456+0000","last_clean":"2024-04-26T12:52:08.286456+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:52:08.286456+0000","last_undegraded":"2024-04-26T12:52:08.286456+0000","last_fullsized":"2024-04-26T12:52:08.286456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.259413+0000","last_change":"2024-04-26T12:49:54.258409+0000","last_active":"2024-04-26T12:53:16.259413+0000","last_peered":"2024-04-26T12:53:16.259413+0000","last_clean":"2024-04-26T12:53:16.259413+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:53:16.259413+0000","last_undegraded":"2024-04-26T12:53:16.259413+0000","last_fullsized":"2024-04-26T12:53:16.259413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966444+0000","last_change":"2024-04-26T12:49:54.241113+0000","last_active":"2024-04-26T12:52:17.966444+0000","last_peered":"2024-04-26T12:52:17.966444+0000","last_clean":"2024-04-26T12:52:17.966444+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:52:17.966444+0000","last_undegraded":"2024-04-26T12:52:17.966444+0000","last_fullsized":"2024-04-26T12:52:17.966444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.297136+0000","last_change":"2024-04-26T12:53:47.297203+0000","last_active":"2024-04-26T12:53:47.297136+0000","last_peered":"2024-04-26T12:53:47.297136+0000","last_clean":"2024-04-26T12:53:47.297136+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:47.297136+0000","last_undegraded":"2024-04-26T12:53:47.297136+0000","last_fullsized":"2024-04-26T12:53:47.297136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.296913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:39.557010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.257485+0000","last_change":"2024-04-26T12:53:52.257555+0000","last_active":"2024-04-26T12:53:52.257485+0000","last_peered":"2024-04-26T12:53:52.257485+0000","last_clean":"2024-04-26T12:53:52.257485+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:53:52.257485+0000","last_undegraded":"2024-04-26T12:53:52.257485+0000","last_fullsized":"2024-04-26T12:53:52.257485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.257248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:36.650269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.154392+0000","last_change":"2024-04-26T12:53:47.154450+0000","last_active":"2024-04-26T12:53:47.154392+0000","last_peered":"2024-04-26T12:53:47.154392+0000","last_clean":"2024-04-26T12:53:47.154392+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:53:47.154392+0000","last_undegraded":"2024-04-26T12:53:47.154392+0000","last_fullsized":"2024-04-26T12:53:47.154392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.154181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:47.175281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640312,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":153627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640312,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1015808,"data_stored":740708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640312,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335488,"statfs":{"total":96636764160,"available":96599539712,"internally_reserved":0,"allocated":1040384,"data_stored":740685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":152990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:54:02.072 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.072 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.073 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.074 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.074 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.074 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.074 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.074 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.074 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.074 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.075 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.076 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.077 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:49:39.927089+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.078 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.079 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.080 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.081 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.082 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.083 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.084 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.085 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.086 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.086 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.086 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:02.086 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:54:22.087 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:54:22.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.217+0000 7f11dbd57640 1 Processor -- start 2024-04-26T12:54:22.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.217+0000 7f11dbd57640 1 -- start start 2024-04-26T12:54:22.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.217+0000 7f11dbd57640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11d406ea20 0x7f11d41339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:22.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.217+0000 7f11dbd57640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d406f3f0 con 0x7f11d406df30 2024-04-26T12:54:22.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f11d409e210 con 0x7f11d406ea20 2024-04-26T12:54:22.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d92f2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11d406ea20 0x7f11d41339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:22.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d9af3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f11d406df30 0x7f11d406e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36590/0 (socket says 172.21.15.29:36590) 2024-04-26T12:54:22.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d9af3640 1 -- 172.21.15.29:0/1402409017 learned_addr learned my addr 172.21.15.29:0/1402409017 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:54:22.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d92f2640 1 -- 172.21.15.29:0/1402409017 >> v1:172.21.15.29:6789/0 conn(0x7f11d406df30 legacy=0x7f11d406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:22.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d92f2640 1 -- 172.21.15.29:0/1402409017 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d406fde0 con 0x7f11d406ea20 2024-04-26T12:54:22.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d92f2640 1 --2- 172.21.15.29:0/1402409017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406ea20 0x7f11d41339c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009740 tx=0x7f11c401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c352f6c36a447635 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:22.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d8af1640 1 -- 172.21.15.29:0/1402409017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11c40b0070 con 0x7f11d406ea20 2024-04-26T12:54:22.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d8af1640 1 -- 172.21.15.29:0/1402409017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c40ab530 con 0x7f11d406ea20 2024-04-26T12:54:22.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11d8af1640 1 -- 172.21.15.29:0/1402409017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11c40ab830 con 0x7f11d406ea20 2024-04-26T12:54:22.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 -- 172.21.15.29:0/1402409017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406ea20 msgr2=0x7f11d41339c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:22.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 --2- 172.21.15.29:0/1402409017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406ea20 0x7f11d41339c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009740 tx=0x7f11c401c370 comp rx=0 tx=0).stop 2024-04-26T12:54:22.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 -- 172.21.15.29:0/1402409017 shutdown_connections 2024-04-26T12:54:22.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 --2- 172.21.15.29:0/1402409017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406ea20 0x7f11d41339c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:22.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 -- 172.21.15.29:0/1402409017 >> 172.21.15.29:0/1402409017 conn(0x7f11d409b4d0 msgr2=0x7f11d409b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:54:22.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 -- 172.21.15.29:0/1402409017 shutdown_connections 2024-04-26T12:54:22.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.221+0000 7f11dbd57640 1 -- 172.21.15.29:0/1402409017 wait complete. 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11dbd57640 1 Processor -- start 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11dbd57640 1 -- start start 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11dbd57640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406df30 0x7f11d411d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11dbd57640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4136930 con 0x7f11d406df30 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11d9af3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406df30 0x7f11d411d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11d9af3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406df30 0x7f11d411d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53316/0 (socket says 172.21.15.29:53316) 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11d9af3640 1 -- 172.21.15.29:0/1204803444 learned_addr learned my addr 172.21.15.29:0/1204803444 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:54:22.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11d9af3640 1 -- 172.21.15.29:0/1204803444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d4133a00 con 0x7f11d406df30 2024-04-26T12:54:22.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11d9af3640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406df30 0x7f11d411d330 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c380 tx=0x7f11d000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:22.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11ca7fc640 1 -- 172.21.15.29:0/1204803444 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11d0017070 con 0x7f11d406df30 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11ca7fc640 1 -- 172.21.15.29:0/1204803444 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d0005c20 con 0x7f11d406df30 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d4120580 con 0x7f11d406df30 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11ca7fc640 1 -- 172.21.15.29:0/1204803444 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11d00070d0 con 0x7f11d406df30 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d41209c0 con 0x7f11d406df30 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11ca7fc640 1 -- 172.21.15.29:0/1204803444 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f11d001a070 con 0x7f11d406df30 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d4062f80 con 0x7f11d406df30 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11ca7fc640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f11b8035db0 0x7f11b8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:22.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.225+0000 7f11ca7fc640 1 -- 172.21.15.29:0/1204803444 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f11d00483f0 con 0x7f11d406df30 2024-04-26T12:54:22.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.229+0000 7f11d92f2640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f11b8035db0 0x7f11b8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:22.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.229+0000 7f11d92f2640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f11b8035db0 0x7f11b8038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f11c40ad000 tx=0x7f11c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:22.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.233+0000 7f11ca7fc640 1 -- 172.21.15.29:0/1204803444 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f11d0012400 con 0x7f11d406df30 2024-04-26T12:54:22.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.393+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11d411fcd0 con 0x7f11b8035db0 2024-04-26T12:54:22.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.437+0000 7f11ca7fc640 1 -- 172.21.15.29:0/1204803444 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664708 (secure 0 0 0) 0x7f11d411fcd0 con 0x7f11b8035db0 2024-04-26T12:54:22.446 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:54:22.452 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.441+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f11b8035db0 msgr2=0x7f11b8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.441+0000 7f11dbd57640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f11b8035db0 0x7f11b8038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f11c40ad000 tx=0x7f11c40a6000 comp rx=0 tx=0).stop 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.441+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406df30 msgr2=0x7f11d411d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.441+0000 7f11dbd57640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406df30 0x7f11d411d330 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c380 tx=0x7f11d000c840 comp rx=0 tx=0).stop 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.445+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 shutdown_connections 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.445+0000 7f11dbd57640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f11b8035db0 0x7f11b8038270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.445+0000 7f11dbd57640 1 --2- 172.21.15.29:0/1204803444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11d406df30 0x7f11d411d330 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.445+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 >> 172.21.15.29:0/1204803444 conn(0x7f11d409b4d0 msgr2=0x7f11d4130560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.445+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 shutdown_connections 2024-04-26T12:54:22.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:22.445+0000 7f11dbd57640 1 -- 172.21.15.29:0/1204803444 wait complete. 2024-04-26T12:54:22.464 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-04-26T12:54:21.269284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4782,"ondisk_log_size":4782,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152600,"kb_used_data":2936,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334760,"statfs":{"total":386547056640,"available":386390794240,"internally_reserved":0,"allocated":3006464,"data_stored":1788010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":153216787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006695"},"pg_stats":[{"pgid":"3.3f","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.101579+0000","last_change":"2024-04-26T12:54:05.101579+0000","last_active":"2024-04-26T12:54:05.101579+0000","last_peered":"2024-04-26T12:54:05.101579+0000","last_clean":"2024-04-26T12:54:05.101579+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:54:05.101579+0000","last_undegraded":"2024-04-26T12:54:05.101579+0000","last_fullsized":"2024-04-26T12:54:05.101579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:05.101171+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:05.101171+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.101171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:33.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.180121+0000","last_change":"2024-04-26T12:53:50.180182+0000","last_active":"2024-04-26T12:53:50.180121+0000","last_peered":"2024-04-26T12:53:50.180121+0000","last_clean":"2024-04-26T12:53:50.180121+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:53:50.180121+0000","last_undegraded":"2024-04-26T12:53:50.180121+0000","last_fullsized":"2024-04-26T12:53:50.180121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.179924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:48.519706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.094761+0000","last_change":"2024-04-26T12:54:11.094820+0000","last_active":"2024-04-26T12:54:11.094761+0000","last_peered":"2024-04-26T12:54:11.094761+0000","last_clean":"2024-04-26T12:54:11.094761+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:54:11.094761+0000","last_undegraded":"2024-04-26T12:54:11.094761+0000","last_fullsized":"2024-04-26T12:54:11.094761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:11.094551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:11.094551+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.094551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:33.971975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.437987+0000","last_change":"2024-04-26T12:54:07.438155+0000","last_active":"2024-04-26T12:54:07.437987+0000","last_peered":"2024-04-26T12:54:07.437987+0000","last_clean":"2024-04-26T12:54:07.437987+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:54:07.437987+0000","last_undegraded":"2024-04-26T12:54:07.437987+0000","last_fullsized":"2024-04-26T12:54:07.437987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:07.437770+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:07.437770+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.437770+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:25.917131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.613235+0000","last_change":"2024-04-26T12:54:14.613301+0000","last_active":"2024-04-26T12:54:14.613235+0000","last_peered":"2024-04-26T12:54:14.613235+0000","last_clean":"2024-04-26T12:54:14.613235+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:54:14.613235+0000","last_undegraded":"2024-04-26T12:54:14.613235+0000","last_fullsized":"2024-04-26T12:54:14.613235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:14.613017+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:14.613017+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.613017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:01.524008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.501855+0000","last_change":"2024-04-26T12:53:55.501925+0000","last_active":"2024-04-26T12:53:55.501855+0000","last_peered":"2024-04-26T12:53:55.501855+0000","last_clean":"2024-04-26T12:53:55.501855+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:55.501855+0000","last_undegraded":"2024-04-26T12:53:55.501855+0000","last_fullsized":"2024-04-26T12:53:55.501855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.501661+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:47.218244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.030404+0000","last_change":"2024-04-26T12:53:58.030471+0000","last_active":"2024-04-26T12:53:58.030404+0000","last_peered":"2024-04-26T12:53:58.030404+0000","last_clean":"2024-04-26T12:53:58.030404+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:53:58.030404+0000","last_undegraded":"2024-04-26T12:53:58.030404+0000","last_fullsized":"2024-04-26T12:53:58.030404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:58.030190+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:58.030190+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.030190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:58.883912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.156618+0000","last_change":"2024-04-26T12:54:13.156680+0000","last_active":"2024-04-26T12:54:13.156618+0000","last_peered":"2024-04-26T12:54:13.156618+0000","last_clean":"2024-04-26T12:54:13.156618+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:54:13.156618+0000","last_undegraded":"2024-04-26T12:54:13.156618+0000","last_fullsized":"2024-04-26T12:54:13.156618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:54:13.156427+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:54:13.156427+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.156427+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:11.918711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969661+0000","last_change":"2024-04-26T12:49:54.237140+0000","last_active":"2024-04-26T12:52:27.969661+0000","last_peered":"2024-04-26T12:52:27.969661+0000","last_clean":"2024-04-26T12:52:27.969661+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:52:27.969661+0000","last_undegraded":"2024-04-26T12:52:27.969661+0000","last_fullsized":"2024-04-26T12:52:27.969661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.425667+0000","last_change":"2024-04-26T12:54:14.425735+0000","last_active":"2024-04-26T12:54:14.425667+0000","last_peered":"2024-04-26T12:54:14.425667+0000","last_clean":"2024-04-26T12:54:14.425667+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:54:14.425667+0000","last_undegraded":"2024-04-26T12:54:14.425667+0000","last_fullsized":"2024-04-26T12:54:14.425667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:14.425453+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:14.425453+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.425453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:33.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.087640+0000","last_change":"2024-04-26T12:54:03.087785+0000","last_active":"2024-04-26T12:54:03.087640+0000","last_peered":"2024-04-26T12:54:03.087640+0000","last_clean":"2024-04-26T12:54:03.087640+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:54:03.087640+0000","last_undegraded":"2024-04-26T12:54:03.087640+0000","last_fullsized":"2024-04-26T12:54:03.087640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:03.087384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:03.087384+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.087384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:15.190060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.551347+0000","last_change":"2024-04-26T12:54:00.551347+0000","last_active":"2024-04-26T12:54:00.551347+0000","last_peered":"2024-04-26T12:54:00.551347+0000","last_clean":"2024-04-26T12:54:00.551347+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:54:00.551347+0000","last_undegraded":"2024-04-26T12:54:00.551347+0000","last_fullsized":"2024-04-26T12:54:00.551347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:00.551092+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:00.551092+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.551092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:09.956495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969368+0000","last_change":"2024-04-26T12:49:54.238559+0000","last_active":"2024-04-26T12:52:27.969368+0000","last_peered":"2024-04-26T12:52:27.969368+0000","last_clean":"2024-04-26T12:52:27.969368+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:52:27.969368+0000","last_undegraded":"2024-04-26T12:52:27.969368+0000","last_fullsized":"2024-04-26T12:52:27.969368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.002599+0000","last_change":"2024-04-26T12:53:57.002599+0000","last_active":"2024-04-26T12:53:57.002599+0000","last_peered":"2024-04-26T12:53:57.002599+0000","last_clean":"2024-04-26T12:53:57.002599+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:57.002599+0000","last_undegraded":"2024-04-26T12:53:57.002599+0000","last_fullsized":"2024-04-26T12:53:57.002599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.002331+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:55.456014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.057740+0000","last_change":"2024-04-26T12:54:13.057862+0000","last_active":"2024-04-26T12:54:13.057740+0000","last_peered":"2024-04-26T12:54:13.057740+0000","last_clean":"2024-04-26T12:54:13.057740+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:54:13.057740+0000","last_undegraded":"2024-04-26T12:54:13.057740+0000","last_fullsized":"2024-04-26T12:54:13.057740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:13.057507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:13.057507+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.057507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:20.511598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.035799+0000","last_change":"2024-04-26T12:53:45.035799+0000","last_active":"2024-04-26T12:53:45.035799+0000","last_peered":"2024-04-26T12:53:45.035799+0000","last_clean":"2024-04-26T12:53:45.035799+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:53:45.035799+0000","last_undegraded":"2024-04-26T12:53:45.035799+0000","last_fullsized":"2024-04-26T12:53:45.035799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.035418+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:47.435437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.531805+0000","last_change":"2024-04-26T12:54:10.531865+0000","last_active":"2024-04-26T12:54:10.531805+0000","last_peered":"2024-04-26T12:54:10.531805+0000","last_clean":"2024-04-26T12:54:10.531805+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:54:10.531805+0000","last_undegraded":"2024-04-26T12:54:10.531805+0000","last_fullsized":"2024-04-26T12:54:10.531805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:10.531604+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:10.531604+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.531604+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:00.093217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.186182+0000","last_change":"2024-04-26T12:53:59.186243+0000","last_active":"2024-04-26T12:53:59.186182+0000","last_peered":"2024-04-26T12:53:59.186182+0000","last_clean":"2024-04-26T12:53:59.186182+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:53:59.186182+0000","last_undegraded":"2024-04-26T12:53:59.186182+0000","last_fullsized":"2024-04-26T12:53:59.186182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:59.185989+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:59.185989+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.185989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:01.086515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.168713+0000","last_change":"2024-04-26T12:53:51.168771+0000","last_active":"2024-04-26T12:53:51.168713+0000","last_peered":"2024-04-26T12:53:51.168713+0000","last_clean":"2024-04-26T12:53:51.168713+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:51.168713+0000","last_undegraded":"2024-04-26T12:53:51.168713+0000","last_fullsized":"2024-04-26T12:53:51.168713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.168499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:07.181751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.966465+0000","last_change":"2024-04-26T12:53:47.966602+0000","last_active":"2024-04-26T12:53:47.966465+0000","last_peered":"2024-04-26T12:53:47.966465+0000","last_clean":"2024-04-26T12:53:47.966465+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:53:47.966465+0000","last_undegraded":"2024-04-26T12:53:47.966465+0000","last_fullsized":"2024-04-26T12:53:47.966465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.966229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:14.686968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.162469+0000","last_change":"2024-04-26T12:53:52.162532+0000","last_active":"2024-04-26T12:53:52.162469+0000","last_peered":"2024-04-26T12:53:52.162469+0000","last_clean":"2024-04-26T12:53:52.162469+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:52.162469+0000","last_undegraded":"2024-04-26T12:53:52.162469+0000","last_fullsized":"2024-04-26T12:53:52.162469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.162284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:06.228081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.317985+0000","last_change":"2024-04-26T12:54:03.318049+0000","last_active":"2024-04-26T12:54:03.317985+0000","last_peered":"2024-04-26T12:54:03.317985+0000","last_clean":"2024-04-26T12:54:03.317985+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:54:03.317985+0000","last_undegraded":"2024-04-26T12:54:03.317985+0000","last_fullsized":"2024-04-26T12:54:03.317985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:03.317789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:03.317789+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.317789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:02.080072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.098851+0000","last_change":"2024-04-26T12:54:01.098985+0000","last_active":"2024-04-26T12:54:01.098851+0000","last_peered":"2024-04-26T12:54:01.098851+0000","last_clean":"2024-04-26T12:54:01.098851+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:54:01.098851+0000","last_undegraded":"2024-04-26T12:54:01.098851+0000","last_fullsized":"2024-04-26T12:54:01.098851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:01.098623+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:01.098623+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.098623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:43.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.171211+0000","last_change":"2024-04-26T12:53:57.171275+0000","last_active":"2024-04-26T12:53:57.171211+0000","last_peered":"2024-04-26T12:53:57.171211+0000","last_clean":"2024-04-26T12:53:57.171211+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:57.171211+0000","last_undegraded":"2024-04-26T12:53:57.171211+0000","last_fullsized":"2024-04-26T12:53:57.171211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.171024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:17.576384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.937879+0000","last_change":"2024-04-26T12:53:48.937942+0000","last_active":"2024-04-26T12:53:48.937879+0000","last_peered":"2024-04-26T12:53:48.937879+0000","last_clean":"2024-04-26T12:53:48.937879+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:53:48.937879+0000","last_undegraded":"2024-04-26T12:53:48.937879+0000","last_fullsized":"2024-04-26T12:53:48.937879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.937678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:30.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.050730+0000","last_change":"2024-04-26T12:54:12.050791+0000","last_active":"2024-04-26T12:54:12.050730+0000","last_peered":"2024-04-26T12:54:12.050730+0000","last_clean":"2024-04-26T12:54:12.050730+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:54:12.050730+0000","last_undegraded":"2024-04-26T12:54:12.050730+0000","last_fullsized":"2024-04-26T12:54:12.050730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.050528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.050528+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.050528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:40.968443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.155704+0000","last_change":"2024-04-26T12:53:58.155762+0000","last_active":"2024-04-26T12:53:58.155704+0000","last_peered":"2024-04-26T12:53:58.155704+0000","last_clean":"2024-04-26T12:53:58.155704+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:58.155704+0000","last_undegraded":"2024-04-26T12:53:58.155704+0000","last_fullsized":"2024-04-26T12:53:58.155704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:58.155520+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:58.155520+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.155520+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:26.909565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966599+0000","last_change":"2024-04-26T12:49:54.231273+0000","last_active":"2024-04-26T12:52:17.966599+0000","last_peered":"2024-04-26T12:52:17.966599+0000","last_clean":"2024-04-26T12:52:17.966599+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:52:17.966599+0000","last_undegraded":"2024-04-26T12:52:17.966599+0000","last_fullsized":"2024-04-26T12:52:17.966599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'35","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.464226+0000","last_change":"2024-04-26T12:50:04.290015+0000","last_active":"2024-04-26T12:53:09.464226+0000","last_peered":"2024-04-26T12:53:09.464226+0000","last_clean":"2024-04-26T12:53:09.464226+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:53:09.464226+0000","last_undegraded":"2024-04-26T12:53:09.464226+0000","last_fullsized":"2024-04-26T12:53:09.464226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.415353+0000","last_change":"2024-04-26T12:53:39.415428+0000","last_active":"2024-04-26T12:53:39.415353+0000","last_peered":"2024-04-26T12:53:39.415353+0000","last_clean":"2024-04-26T12:53:39.415353+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:53:39.415353+0000","last_undegraded":"2024-04-26T12:53:39.415353+0000","last_fullsized":"2024-04-26T12:53:39.415353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.415162+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:24.418176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966667+0000","last_change":"2024-04-26T12:49:54.258161+0000","last_active":"2024-04-26T12:52:17.966667+0000","last_peered":"2024-04-26T12:52:17.966667+0000","last_clean":"2024-04-26T12:52:17.966667+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:52:17.966667+0000","last_undegraded":"2024-04-26T12:52:17.966667+0000","last_fullsized":"2024-04-26T12:52:17.966667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.392070+0000","last_change":"2024-04-26T12:53:23.392134+0000","last_active":"2024-04-26T12:53:23.392070+0000","last_peered":"2024-04-26T12:53:23.392070+0000","last_clean":"2024-04-26T12:53:23.392070+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:53:23.392070+0000","last_undegraded":"2024-04-26T12:53:23.392070+0000","last_fullsized":"2024-04-26T12:53:23.392070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.391874+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:06.575701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.391893+0000","last_change":"2024-04-26T12:53:37.391968+0000","last_active":"2024-04-26T12:53:37.391893+0000","last_peered":"2024-04-26T12:53:37.391893+0000","last_clean":"2024-04-26T12:53:37.391893+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:53:37.391893+0000","last_undegraded":"2024-04-26T12:53:37.391893+0000","last_fullsized":"2024-04-26T12:53:37.391893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.391713+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:06.145759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.193575+0000","last_change":"2024-04-26T12:53:40.193637+0000","last_active":"2024-04-26T12:53:40.193575+0000","last_peered":"2024-04-26T12:53:40.193575+0000","last_clean":"2024-04-26T12:53:40.193575+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:53:40.193575+0000","last_undegraded":"2024-04-26T12:53:40.193575+0000","last_fullsized":"2024-04-26T12:53:40.193575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.193370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:21.524309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.378848+0000","last_change":"2024-04-26T12:54:17.378906+0000","last_active":"2024-04-26T12:54:17.378848+0000","last_peered":"2024-04-26T12:54:17.378848+0000","last_clean":"2024-04-26T12:54:17.378848+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:54:17.378848+0000","last_undegraded":"2024-04-26T12:54:17.378848+0000","last_fullsized":"2024-04-26T12:54:17.378848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-04-26T12:54:17.378654+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-04-26T12:54:17.378654+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.378654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:43.119977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.384124+0000","last_change":"2024-04-26T12:53:36.384186+0000","last_active":"2024-04-26T12:53:36.384124+0000","last_peered":"2024-04-26T12:53:36.384124+0000","last_clean":"2024-04-26T12:53:36.384124+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:36.384124+0000","last_undegraded":"2024-04-26T12:53:36.384124+0000","last_fullsized":"2024-04-26T12:53:36.384124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.383922+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:56.789282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.087155+0000","last_change":"2024-04-26T12:54:02.087214+0000","last_active":"2024-04-26T12:54:02.087155+0000","last_peered":"2024-04-26T12:54:02.087155+0000","last_clean":"2024-04-26T12:54:02.087155+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:54:02.087155+0000","last_undegraded":"2024-04-26T12:54:02.087155+0000","last_fullsized":"2024-04-26T12:54:02.087155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:02.086942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:02.086942+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.086942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.033899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.280139+0000","last_change":"2024-04-26T12:53:44.280249+0000","last_active":"2024-04-26T12:53:44.280139+0000","last_peered":"2024-04-26T12:53:44.280139+0000","last_clean":"2024-04-26T12:53:44.280139+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:53:44.280139+0000","last_undegraded":"2024-04-26T12:53:44.280139+0000","last_fullsized":"2024-04-26T12:53:44.280139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.279907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:46.896122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.076724+0000","last_change":"2024-04-26T12:53:23.076800+0000","last_active":"2024-04-26T12:53:23.076724+0000","last_peered":"2024-04-26T12:53:23.076724+0000","last_clean":"2024-04-26T12:53:23.076724+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:53:23.076724+0000","last_undegraded":"2024-04-26T12:53:23.076724+0000","last_fullsized":"2024-04-26T12:53:23.076724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.076513+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:18.548345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.104710+0000","last_change":"2024-04-26T12:53:32.104841+0000","last_active":"2024-04-26T12:53:32.104710+0000","last_peered":"2024-04-26T12:53:32.104710+0000","last_clean":"2024-04-26T12:53:32.104710+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:53:32.104710+0000","last_undegraded":"2024-04-26T12:53:32.104710+0000","last_fullsized":"2024-04-26T12:53:32.104710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.104460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:40.209749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.037640+0000","last_change":"2024-04-26T12:54:16.037705+0000","last_active":"2024-04-26T12:54:16.037640+0000","last_peered":"2024-04-26T12:54:16.037640+0000","last_clean":"2024-04-26T12:54:16.037640+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:54:16.037640+0000","last_undegraded":"2024-04-26T12:54:16.037640+0000","last_fullsized":"2024-04-26T12:54:16.037640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:16.037432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:16.037432+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.037432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:31.763516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.411066+0000","last_change":"2024-04-26T12:53:42.411216+0000","last_active":"2024-04-26T12:53:42.411066+0000","last_peered":"2024-04-26T12:53:42.411066+0000","last_clean":"2024-04-26T12:53:42.411066+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:53:42.411066+0000","last_undegraded":"2024-04-26T12:53:42.411066+0000","last_fullsized":"2024-04-26T12:53:42.411066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.410832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:41.173115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966529+0000","last_change":"2024-04-26T12:49:54.238247+0000","last_active":"2024-04-26T12:52:17.966529+0000","last_peered":"2024-04-26T12:52:17.966529+0000","last_clean":"2024-04-26T12:52:17.966529+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:52:17.966529+0000","last_undegraded":"2024-04-26T12:52:17.966529+0000","last_fullsized":"2024-04-26T12:52:17.966529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.256223+0000","last_change":"2024-04-26T12:53:40.256277+0000","last_active":"2024-04-26T12:53:40.256223+0000","last_peered":"2024-04-26T12:53:40.256223+0000","last_clean":"2024-04-26T12:53:40.256223+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:53:40.256223+0000","last_undegraded":"2024-04-26T12:53:40.256223+0000","last_fullsized":"2024-04-26T12:53:40.256223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.256017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:51.409965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.735659+0000","last_change":"2024-04-26T12:53:25.735736+0000","last_active":"2024-04-26T12:53:25.735659+0000","last_peered":"2024-04-26T12:53:25.735659+0000","last_clean":"2024-04-26T12:53:25.735659+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:53:25.735659+0000","last_undegraded":"2024-04-26T12:53:25.735659+0000","last_fullsized":"2024-04-26T12:53:25.735659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.735419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.323105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":399,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.468422+0000","last_change":"2024-04-26T12:53:57.468486+0000","last_active":"2024-04-26T12:53:57.468422+0000","last_peered":"2024-04-26T12:53:57.468422+0000","last_clean":"2024-04-26T12:53:57.468422+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:57.468422+0000","last_undegraded":"2024-04-26T12:53:57.468422+0000","last_fullsized":"2024-04-26T12:53:57.468422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.468221+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:49.873023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.945880+0000","last_change":"2024-04-26T12:53:40.945988+0000","last_active":"2024-04-26T12:53:40.945880+0000","last_peered":"2024-04-26T12:53:40.945880+0000","last_clean":"2024-04-26T12:53:40.945880+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:53:40.945880+0000","last_undegraded":"2024-04-26T12:53:40.945880+0000","last_fullsized":"2024-04-26T12:53:40.945880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.945653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:49.050942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.286893+0000","last_change":"2024-04-26T12:53:48.286965+0000","last_active":"2024-04-26T12:53:48.286893+0000","last_peered":"2024-04-26T12:53:48.286893+0000","last_clean":"2024-04-26T12:53:48.286893+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:48.286893+0000","last_undegraded":"2024-04-26T12:53:48.286893+0000","last_fullsized":"2024-04-26T12:53:48.286893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.286688+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:28.578485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.318394+0000","last_change":"2024-04-26T12:54:09.318456+0000","last_active":"2024-04-26T12:54:09.318394+0000","last_peered":"2024-04-26T12:54:09.318394+0000","last_clean":"2024-04-26T12:54:09.318394+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:54:09.318394+0000","last_undegraded":"2024-04-26T12:54:09.318394+0000","last_fullsized":"2024-04-26T12:54:09.318394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:09.318195+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:09.318195+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.318195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:41.368120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.380805+0000","last_change":"2024-04-26T12:53:22.380865+0000","last_active":"2024-04-26T12:53:22.380805+0000","last_peered":"2024-04-26T12:53:22.380805+0000","last_clean":"2024-04-26T12:53:22.380805+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:53:22.380805+0000","last_undegraded":"2024-04-26T12:53:22.380805+0000","last_fullsized":"2024-04-26T12:53:22.380805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.380528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.319667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.752160+0000","last_change":"2024-04-26T12:53:26.752246+0000","last_active":"2024-04-26T12:53:26.752160+0000","last_peered":"2024-04-26T12:53:26.752160+0000","last_clean":"2024-04-26T12:53:26.752160+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:53:26.752160+0000","last_undegraded":"2024-04-26T12:53:26.752160+0000","last_fullsized":"2024-04-26T12:53:26.752160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.751972+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:59.415047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":414,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.264797+0000","last_change":"2024-04-26T12:53:27.264864+0000","last_active":"2024-04-26T12:53:27.264797+0000","last_peered":"2024-04-26T12:53:27.264797+0000","last_clean":"2024-04-26T12:53:27.264797+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:27.264797+0000","last_undegraded":"2024-04-26T12:53:27.264797+0000","last_fullsized":"2024-04-26T12:53:27.264797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.264595+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:14.426766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.474657+0000","last_change":"2024-04-26T12:54:04.474657+0000","last_active":"2024-04-26T12:54:04.474657+0000","last_peered":"2024-04-26T12:54:04.474657+0000","last_clean":"2024-04-26T12:54:04.474657+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:54:04.474657+0000","last_undegraded":"2024-04-26T12:54:04.474657+0000","last_fullsized":"2024-04-26T12:54:04.474657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:04.474241+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:04.474241+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.474241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:19.601202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.092063+0000","last_change":"2024-04-26T12:54:04.092120+0000","last_active":"2024-04-26T12:54:04.092063+0000","last_peered":"2024-04-26T12:54:04.092063+0000","last_clean":"2024-04-26T12:54:04.092063+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:54:04.092063+0000","last_undegraded":"2024-04-26T12:54:04.092063+0000","last_fullsized":"2024-04-26T12:54:04.092063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:04.091919+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:04.091919+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.091919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:38.080209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.034874+0000","last_change":"2024-04-26T12:53:29.034874+0000","last_active":"2024-04-26T12:53:29.034874+0000","last_peered":"2024-04-26T12:53:29.034874+0000","last_clean":"2024-04-26T12:53:29.034874+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:53:29.034874+0000","last_undegraded":"2024-04-26T12:53:29.034874+0000","last_fullsized":"2024-04-26T12:53:29.034874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.034638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:13.359122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.842225+0000","last_change":"2024-04-26T12:53:33.842323+0000","last_active":"2024-04-26T12:53:33.842225+0000","last_peered":"2024-04-26T12:53:33.842225+0000","last_clean":"2024-04-26T12:53:33.842225+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:53:33.842225+0000","last_undegraded":"2024-04-26T12:53:33.842225+0000","last_fullsized":"2024-04-26T12:53:33.842225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.842014+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.029425+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.367707+0000","last_change":"2024-04-26T12:53:20.367753+0000","last_active":"2024-04-26T12:53:20.367707+0000","last_peered":"2024-04-26T12:53:20.367707+0000","last_clean":"2024-04-26T12:53:20.367707+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:53:20.367707+0000","last_undegraded":"2024-04-26T12:53:20.367707+0000","last_fullsized":"2024-04-26T12:53:20.367707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.367584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:03.848633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.144579+0000","last_change":"2024-04-26T12:54:10.144579+0000","last_active":"2024-04-26T12:54:10.144579+0000","last_peered":"2024-04-26T12:54:10.144579+0000","last_clean":"2024-04-26T12:54:10.144579+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:54:10.144579+0000","last_undegraded":"2024-04-26T12:54:10.144579+0000","last_fullsized":"2024-04-26T12:54:10.144579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:54:10.144359+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:54:10.144359+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.144359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:01.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.125068+0000","last_change":"2024-04-26T12:53:56.125068+0000","last_active":"2024-04-26T12:53:56.125068+0000","last_peered":"2024-04-26T12:53:56.125068+0000","last_clean":"2024-04-26T12:53:56.125068+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:53:56.125068+0000","last_undegraded":"2024-04-26T12:53:56.125068+0000","last_fullsized":"2024-04-26T12:53:56.125068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.124818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:33.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.971561+0000","last_change":"2024-04-26T12:53:55.971631+0000","last_active":"2024-04-26T12:53:55.971561+0000","last_peered":"2024-04-26T12:53:55.971561+0000","last_clean":"2024-04-26T12:53:55.971561+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:53:55.971561+0000","last_undegraded":"2024-04-26T12:53:55.971561+0000","last_fullsized":"2024-04-26T12:53:55.971561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.971365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:55.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.210108+0000","last_change":"2024-04-26T12:53:39.210108+0000","last_active":"2024-04-26T12:53:39.210108+0000","last_peered":"2024-04-26T12:53:39.210108+0000","last_clean":"2024-04-26T12:53:39.210108+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:53:39.210108+0000","last_undegraded":"2024-04-26T12:53:39.210108+0000","last_fullsized":"2024-04-26T12:53:39.210108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.209817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:09.302793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.322616+0000","last_change":"2024-04-26T12:53:25.322771+0000","last_active":"2024-04-26T12:53:25.322616+0000","last_peered":"2024-04-26T12:53:25.322616+0000","last_clean":"2024-04-26T12:53:25.322616+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:53:25.322616+0000","last_undegraded":"2024-04-26T12:53:25.322616+0000","last_fullsized":"2024-04-26T12:53:25.322616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.322379+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:57.683471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.239097+0000","last_change":"2024-04-26T12:53:33.239150+0000","last_active":"2024-04-26T12:53:33.239097+0000","last_peered":"2024-04-26T12:53:33.239097+0000","last_clean":"2024-04-26T12:53:33.239097+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:53:33.239097+0000","last_undegraded":"2024-04-26T12:53:33.239097+0000","last_fullsized":"2024-04-26T12:53:33.239097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.238876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:14.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'6","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.164922+0000","last_change":"2024-04-26T12:53:48.164922+0000","last_active":"2024-04-26T12:53:48.164922+0000","last_peered":"2024-04-26T12:53:48.164922+0000","last_clean":"2024-04-26T12:53:48.164922+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:53:48.164922+0000","last_undegraded":"2024-04-26T12:53:48.164922+0000","last_fullsized":"2024-04-26T12:53:48.164922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.164674+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:57.350352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.954336+0000","last_change":"2024-04-26T12:53:52.954336+0000","last_active":"2024-04-26T12:53:52.954336+0000","last_peered":"2024-04-26T12:53:52.954336+0000","last_clean":"2024-04-26T12:53:52.954336+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:53:52.954336+0000","last_undegraded":"2024-04-26T12:53:52.954336+0000","last_fullsized":"2024-04-26T12:53:52.954336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.954084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:23.735894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.548612+0000","last_change":"2024-04-26T12:54:17.548671+0000","last_active":"2024-04-26T12:54:17.548612+0000","last_peered":"2024-04-26T12:54:17.548612+0000","last_clean":"2024-04-26T12:54:17.548612+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:54:17.548612+0000","last_undegraded":"2024-04-26T12:54:17.548612+0000","last_fullsized":"2024-04-26T12:54:17.548612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:17.548417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:17.548417+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.548417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:27.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.216496+0000","last_change":"2024-04-26T12:53:36.216552+0000","last_active":"2024-04-26T12:53:36.216496+0000","last_peered":"2024-04-26T12:53:36.216496+0000","last_clean":"2024-04-26T12:53:36.216496+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:53:36.216496+0000","last_undegraded":"2024-04-26T12:53:36.216496+0000","last_fullsized":"2024-04-26T12:53:36.216496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.216285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:41.525193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.550270+0000","last_change":"2024-04-26T12:53:54.550362+0000","last_active":"2024-04-26T12:53:54.550270+0000","last_peered":"2024-04-26T12:53:54.550270+0000","last_clean":"2024-04-26T12:53:54.550270+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:53:54.550270+0000","last_undegraded":"2024-04-26T12:53:54.550270+0000","last_fullsized":"2024-04-26T12:53:54.550270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.550077+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:28.913960+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":361,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.260275+0000","last_change":"2024-04-26T12:53:23.260340+0000","last_active":"2024-04-26T12:53:23.260275+0000","last_peered":"2024-04-26T12:53:23.260275+0000","last_clean":"2024-04-26T12:53:23.260275+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:23.260275+0000","last_undegraded":"2024-04-26T12:53:23.260275+0000","last_fullsized":"2024-04-26T12:53:23.260275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.260077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:08.869807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:19.050413+0000","last_change":"2024-04-26T12:54:19.050474+0000","last_active":"2024-04-26T12:54:19.050413+0000","last_peered":"2024-04-26T12:54:19.050413+0000","last_clean":"2024-04-26T12:54:19.050413+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:54:19.050413+0000","last_undegraded":"2024-04-26T12:54:19.050413+0000","last_fullsized":"2024-04-26T12:54:19.050413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:19.050217+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:19.050217+0000","last_clean_scrub_stamp":"2024-04-26T12:54:19.050217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.578291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.962945+0000","last_change":"2024-04-26T12:53:42.963004+0000","last_active":"2024-04-26T12:53:42.962945+0000","last_peered":"2024-04-26T12:53:42.962945+0000","last_clean":"2024-04-26T12:53:42.962945+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:42.962945+0000","last_undegraded":"2024-04-26T12:53:42.962945+0000","last_fullsized":"2024-04-26T12:53:42.962945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.962751+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:04.429485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.557728+0000","last_change":"2024-04-26T12:54:11.557788+0000","last_active":"2024-04-26T12:54:11.557728+0000","last_peered":"2024-04-26T12:54:11.557728+0000","last_clean":"2024-04-26T12:54:11.557728+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:54:11.557728+0000","last_undegraded":"2024-04-26T12:54:11.557728+0000","last_fullsized":"2024-04-26T12:54:11.557728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:11.557529+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:11.557529+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.557529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:03.013567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.116569+0000","last_change":"2024-04-26T12:54:12.116623+0000","last_active":"2024-04-26T12:54:12.116569+0000","last_peered":"2024-04-26T12:54:12.116569+0000","last_clean":"2024-04-26T12:54:12.116569+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:54:12.116569+0000","last_undegraded":"2024-04-26T12:54:12.116569+0000","last_fullsized":"2024-04-26T12:54:12.116569+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.116369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.116369+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.116369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:47.204045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'65","reported_seq":138,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.301251+0000","last_change":"2024-04-26T12:53:33.301331+0000","last_active":"2024-04-26T12:53:33.301251+0000","last_peered":"2024-04-26T12:53:33.301251+0000","last_clean":"2024-04-26T12:53:33.301251+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:53:33.301251+0000","last_undegraded":"2024-04-26T12:53:33.301251+0000","last_fullsized":"2024-04-26T12:53:33.301251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'65","last_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_deep_scrub":"35'65","last_deep_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.301040+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:07.289330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.319344+0000","last_change":"2024-04-26T12:53:25.319398+0000","last_active":"2024-04-26T12:53:25.319344+0000","last_peered":"2024-04-26T12:53:25.319344+0000","last_clean":"2024-04-26T12:53:25.319344+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:53:25.319344+0000","last_undegraded":"2024-04-26T12:53:25.319344+0000","last_fullsized":"2024-04-26T12:53:25.319344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.319148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:51.725423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'20","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.595887+0000","last_change":"2024-04-26T12:50:04.303330+0000","last_active":"2024-04-26T12:53:09.595887+0000","last_peered":"2024-04-26T12:53:09.595887+0000","last_clean":"2024-04-26T12:53:09.595887+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:53:09.595887+0000","last_undegraded":"2024-04-26T12:53:09.595887+0000","last_fullsized":"2024-04-26T12:53:09.595887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.147213+0000","last_change":"2024-04-26T12:53:45.147271+0000","last_active":"2024-04-26T12:53:45.147213+0000","last_peered":"2024-04-26T12:53:45.147213+0000","last_clean":"2024-04-26T12:53:45.147213+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:53:45.147213+0000","last_undegraded":"2024-04-26T12:53:45.147213+0000","last_fullsized":"2024-04-26T12:53:45.147213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.147005+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.360231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.093859+0000","last_change":"2024-04-26T12:54:04.093921+0000","last_active":"2024-04-26T12:54:04.093859+0000","last_peered":"2024-04-26T12:54:04.093859+0000","last_clean":"2024-04-26T12:54:04.093859+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:54:04.093859+0000","last_undegraded":"2024-04-26T12:54:04.093859+0000","last_fullsized":"2024-04-26T12:54:04.093859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:04.093611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:04.093611+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.093611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:06.282666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.821259+0000","last_change":"2024-04-26T12:53:35.821321+0000","last_active":"2024-04-26T12:53:35.821259+0000","last_peered":"2024-04-26T12:53:35.821259+0000","last_clean":"2024-04-26T12:53:35.821259+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:53:35.821259+0000","last_undegraded":"2024-04-26T12:53:35.821259+0000","last_fullsized":"2024-04-26T12:53:35.821259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.821050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:59.952098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.093329+0000","last_change":"2024-04-26T12:53:26.093504+0000","last_active":"2024-04-26T12:53:26.093329+0000","last_peered":"2024-04-26T12:53:26.093329+0000","last_clean":"2024-04-26T12:53:26.093329+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:53:26.093329+0000","last_undegraded":"2024-04-26T12:53:26.093329+0000","last_fullsized":"2024-04-26T12:53:26.093329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.093081+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:46.353316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.345766+0000","last_change":"2024-04-26T12:53:44.345823+0000","last_active":"2024-04-26T12:53:44.345766+0000","last_peered":"2024-04-26T12:53:44.345766+0000","last_clean":"2024-04-26T12:53:44.345766+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:53:44.345766+0000","last_undegraded":"2024-04-26T12:53:44.345766+0000","last_fullsized":"2024-04-26T12:53:44.345766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.345550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:44.028093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.822266+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:53:20.822266+0000","last_peered":"2024-04-26T12:53:20.822266+0000","last_clean":"2024-04-26T12:53:20.822266+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:53:20.822266+0000","last_undegraded":"2024-04-26T12:53:20.822266+0000","last_fullsized":"2024-04-26T12:53:20.822266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.390362+0000","last_change":"2024-04-26T12:53:40.390424+0000","last_active":"2024-04-26T12:53:40.390362+0000","last_peered":"2024-04-26T12:53:40.390362+0000","last_clean":"2024-04-26T12:53:40.390362+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:40.390362+0000","last_undegraded":"2024-04-26T12:53:40.390362+0000","last_fullsized":"2024-04-26T12:53:40.390362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.390158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:34.578850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.819226+0000","last_change":"2024-04-26T12:49:54.231974+0000","last_active":"2024-04-26T12:53:20.819226+0000","last_peered":"2024-04-26T12:53:20.819226+0000","last_clean":"2024-04-26T12:53:20.819226+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:53:20.819226+0000","last_undegraded":"2024-04-26T12:53:20.819226+0000","last_fullsized":"2024-04-26T12:53:20.819226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.184467+0000","last_change":"2024-04-26T12:53:38.184522+0000","last_active":"2024-04-26T12:53:38.184467+0000","last_peered":"2024-04-26T12:53:38.184467+0000","last_clean":"2024-04-26T12:53:38.184467+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:53:38.184467+0000","last_undegraded":"2024-04-26T12:53:38.184467+0000","last_fullsized":"2024-04-26T12:53:38.184467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.184269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:49.731527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.784049+0000","last_change":"2024-04-26T12:53:29.784129+0000","last_active":"2024-04-26T12:53:29.784049+0000","last_peered":"2024-04-26T12:53:29.784049+0000","last_clean":"2024-04-26T12:53:29.784049+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:53:29.784049+0000","last_undegraded":"2024-04-26T12:53:29.784049+0000","last_fullsized":"2024-04-26T12:53:29.784049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.783856+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:02.402474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":416,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.700221+0000","last_change":"2024-04-26T12:53:20.700292+0000","last_active":"2024-04-26T12:53:20.700221+0000","last_peered":"2024-04-26T12:53:20.700221+0000","last_clean":"2024-04-26T12:53:20.700221+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:20.700221+0000","last_undegraded":"2024-04-26T12:53:20.700221+0000","last_fullsized":"2024-04-26T12:53:20.700221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.700008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:02.748840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:20.063364+0000","last_change":"2024-04-26T12:54:20.063435+0000","last_active":"2024-04-26T12:54:20.063364+0000","last_peered":"2024-04-26T12:54:20.063364+0000","last_clean":"2024-04-26T12:54:20.063364+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:54:20.063364+0000","last_undegraded":"2024-04-26T12:54:20.063364+0000","last_fullsized":"2024-04-26T12:54:20.063364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:54:20.063162+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:54:20.063162+0000","last_clean_scrub_stamp":"2024-04-26T12:54:20.063162+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:53.641992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.164382+0000","last_change":"2024-04-26T12:54:07.164575+0000","last_active":"2024-04-26T12:54:07.164382+0000","last_peered":"2024-04-26T12:54:07.164382+0000","last_clean":"2024-04-26T12:54:07.164382+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:54:07.164382+0000","last_undegraded":"2024-04-26T12:54:07.164382+0000","last_fullsized":"2024-04-26T12:54:07.164382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:07.164157+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:07.164157+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.164157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:27.569518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.819219+0000","last_change":"2024-04-26T12:49:54.237237+0000","last_active":"2024-04-26T12:53:20.819219+0000","last_peered":"2024-04-26T12:53:20.819219+0000","last_clean":"2024-04-26T12:53:20.819219+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:53:20.819219+0000","last_undegraded":"2024-04-26T12:53:20.819219+0000","last_fullsized":"2024-04-26T12:53:20.819219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.149981+0000","last_change":"2024-04-26T12:53:35.150051+0000","last_active":"2024-04-26T12:53:35.149981+0000","last_peered":"2024-04-26T12:53:35.149981+0000","last_clean":"2024-04-26T12:53:35.149981+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:53:35.149981+0000","last_undegraded":"2024-04-26T12:53:35.149981+0000","last_fullsized":"2024-04-26T12:53:35.149981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.149786+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:44.314364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.384790+0000","last_change":"2024-04-26T12:53:41.384877+0000","last_active":"2024-04-26T12:53:41.384790+0000","last_peered":"2024-04-26T12:53:41.384790+0000","last_clean":"2024-04-26T12:53:41.384790+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:53:41.384790+0000","last_undegraded":"2024-04-26T12:53:41.384790+0000","last_fullsized":"2024-04-26T12:53:41.384790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.384606+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:41.807107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.083440+0000","last_change":"2024-04-26T12:53:24.083502+0000","last_active":"2024-04-26T12:53:24.083440+0000","last_peered":"2024-04-26T12:53:24.083440+0000","last_clean":"2024-04-26T12:53:24.083440+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:24.083440+0000","last_undegraded":"2024-04-26T12:53:24.083440+0000","last_fullsized":"2024-04-26T12:53:24.083440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.083257+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:10.408030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.864780+0000","last_change":"2024-04-26T12:53:36.864780+0000","last_active":"2024-04-26T12:53:36.864780+0000","last_peered":"2024-04-26T12:53:36.864780+0000","last_clean":"2024-04-26T12:53:36.864780+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:53:36.864780+0000","last_undegraded":"2024-04-26T12:53:36.864780+0000","last_fullsized":"2024-04-26T12:53:36.864780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.864409+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:22.533038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.165769+0000","last_change":"2024-04-26T12:53:42.165833+0000","last_active":"2024-04-26T12:53:42.165769+0000","last_peered":"2024-04-26T12:53:42.165769+0000","last_clean":"2024-04-26T12:53:42.165769+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:42.165769+0000","last_undegraded":"2024-04-26T12:53:42.165769+0000","last_fullsized":"2024-04-26T12:53:42.165769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.165579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:29.622380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.573825+0000","last_change":"2024-04-26T12:54:15.573825+0000","last_active":"2024-04-26T12:54:15.573825+0000","last_peered":"2024-04-26T12:54:15.573825+0000","last_clean":"2024-04-26T12:54:15.573825+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:54:15.573825+0000","last_undegraded":"2024-04-26T12:54:15.573825+0000","last_fullsized":"2024-04-26T12:54:15.573825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:15.573560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:15.573560+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.573560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.318576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.364150+0000","last_change":"2024-04-26T12:53:26.364210+0000","last_active":"2024-04-26T12:53:26.364150+0000","last_peered":"2024-04-26T12:53:26.364150+0000","last_clean":"2024-04-26T12:53:26.364150+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:53:26.364150+0000","last_undegraded":"2024-04-26T12:53:26.364150+0000","last_fullsized":"2024-04-26T12:53:26.364150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.363915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.300166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.062381+0000","last_change":"2024-04-26T12:53:25.062459+0000","last_active":"2024-04-26T12:53:25.062381+0000","last_peered":"2024-04-26T12:53:25.062381+0000","last_clean":"2024-04-26T12:53:25.062381+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:53:25.062381+0000","last_undegraded":"2024-04-26T12:53:25.062381+0000","last_fullsized":"2024-04-26T12:53:25.062381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.062142+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:45.249553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.744487+0000","last_change":"2024-04-26T12:53:28.744541+0000","last_active":"2024-04-26T12:53:28.744487+0000","last_peered":"2024-04-26T12:53:28.744487+0000","last_clean":"2024-04-26T12:53:28.744487+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:53:28.744487+0000","last_undegraded":"2024-04-26T12:53:28.744487+0000","last_fullsized":"2024-04-26T12:53:28.744487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.744289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:22.796067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'9","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.133618+0000","last_change":"2024-04-26T12:53:44.133618+0000","last_active":"2024-04-26T12:53:44.133618+0000","last_peered":"2024-04-26T12:53:44.133618+0000","last_clean":"2024-04-26T12:53:44.133618+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:44.133618+0000","last_undegraded":"2024-04-26T12:53:44.133618+0000","last_fullsized":"2024-04-26T12:53:44.133618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.133322+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:14.915132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.385289+0000","last_change":"2024-04-26T12:53:38.385289+0000","last_active":"2024-04-26T12:53:38.385289+0000","last_peered":"2024-04-26T12:53:38.385289+0000","last_clean":"2024-04-26T12:53:38.385289+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:53:38.385289+0000","last_undegraded":"2024-04-26T12:53:38.385289+0000","last_fullsized":"2024-04-26T12:53:38.385289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.385015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:40.285540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":214,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.350672+0000","last_change":"2024-04-26T12:54:06.350748+0000","last_active":"2024-04-26T12:54:06.350672+0000","last_peered":"2024-04-26T12:54:06.350672+0000","last_clean":"2024-04-26T12:54:06.350672+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:54:06.350672+0000","last_undegraded":"2024-04-26T12:54:06.350672+0000","last_fullsized":"2024-04-26T12:54:06.350672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-04-26T12:54:06.350483+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-04-26T12:54:06.350483+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.350483+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:01.619377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818887+0000","last_change":"2024-04-26T12:49:44.969341+0000","last_active":"2024-04-26T12:53:20.818887+0000","last_peered":"2024-04-26T12:53:20.818887+0000","last_clean":"2024-04-26T12:53:20.818887+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:53:20.818887+0000","last_undegraded":"2024-04-26T12:53:20.818887+0000","last_fullsized":"2024-04-26T12:53:20.818887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.819107+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:20.819107+0000","last_peered":"2024-04-26T12:53:20.819107+0000","last_clean":"2024-04-26T12:53:20.819107+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:20.819107+0000","last_undegraded":"2024-04-26T12:53:20.819107+0000","last_fullsized":"2024-04-26T12:53:20.819107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.223660+0000","last_change":"2024-04-26T12:53:38.223660+0000","last_active":"2024-04-26T12:53:38.223660+0000","last_peered":"2024-04-26T12:53:38.223660+0000","last_clean":"2024-04-26T12:53:38.223660+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:53:38.223660+0000","last_undegraded":"2024-04-26T12:53:38.223660+0000","last_fullsized":"2024-04-26T12:53:38.223660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.223416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:18.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'88","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.405917+0000","last_change":"2024-04-26T12:53:29.405993+0000","last_active":"2024-04-26T12:53:29.405917+0000","last_peered":"2024-04-26T12:53:29.405917+0000","last_clean":"2024-04-26T12:53:29.405917+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:53:29.405917+0000","last_undegraded":"2024-04-26T12:53:29.405917+0000","last_fullsized":"2024-04-26T12:53:29.405917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'88","last_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_deep_scrub":"35'88","last_deep_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.405693+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.745474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.224147+0000","last_change":"2024-04-26T12:53:41.224221+0000","last_active":"2024-04-26T12:53:41.224147+0000","last_peered":"2024-04-26T12:53:41.224147+0000","last_clean":"2024-04-26T12:53:41.224147+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:53:41.224147+0000","last_undegraded":"2024-04-26T12:53:41.224147+0000","last_fullsized":"2024-04-26T12:53:41.224147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.223941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:36.119504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":204,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.149846+0000","last_change":"2024-04-26T12:54:11.150023+0000","last_active":"2024-04-26T12:54:11.149846+0000","last_peered":"2024-04-26T12:54:11.149846+0000","last_clean":"2024-04-26T12:54:11.149846+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:54:11.149846+0000","last_undegraded":"2024-04-26T12:54:11.149846+0000","last_fullsized":"2024-04-26T12:54:11.149846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-04-26T12:54:11.149596+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-04-26T12:54:11.149596+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.149596+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:00.175753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.504046+0000","last_change":"2024-04-26T12:53:59.504046+0000","last_active":"2024-04-26T12:53:59.504046+0000","last_peered":"2024-04-26T12:53:59.504046+0000","last_clean":"2024-04-26T12:53:59.504046+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:53:59.504046+0000","last_undegraded":"2024-04-26T12:53:59.504046+0000","last_fullsized":"2024-04-26T12:53:59.504046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:59.503798+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:59.503798+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.503798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:31.598970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818854+0000","last_change":"2024-04-26T12:49:44.965297+0000","last_active":"2024-04-26T12:53:20.818854+0000","last_peered":"2024-04-26T12:53:20.818854+0000","last_clean":"2024-04-26T12:53:20.818854+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:53:20.818854+0000","last_undegraded":"2024-04-26T12:53:20.818854+0000","last_fullsized":"2024-04-26T12:53:20.818854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.115583+0000","last_change":"2024-04-26T12:53:58.115583+0000","last_active":"2024-04-26T12:53:58.115583+0000","last_peered":"2024-04-26T12:53:58.115583+0000","last_clean":"2024-04-26T12:53:58.115583+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:53:58.115583+0000","last_undegraded":"2024-04-26T12:53:58.115583+0000","last_fullsized":"2024-04-26T12:53:58.115583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.115321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:52.115400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.382731+0000","last_change":"2024-04-26T12:53:28.382731+0000","last_active":"2024-04-26T12:53:28.382731+0000","last_peered":"2024-04-26T12:53:28.382731+0000","last_clean":"2024-04-26T12:53:28.382731+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:53:28.382731+0000","last_undegraded":"2024-04-26T12:53:28.382731+0000","last_fullsized":"2024-04-26T12:53:28.382731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.382477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:09.281461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":517,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.070911+0000","last_change":"2024-04-26T12:53:22.070911+0000","last_active":"2024-04-26T12:53:22.070911+0000","last_peered":"2024-04-26T12:53:22.070911+0000","last_clean":"2024-04-26T12:53:22.070911+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:22.070911+0000","last_undegraded":"2024-04-26T12:53:22.070911+0000","last_fullsized":"2024-04-26T12:53:22.070911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.070631+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:58.378060+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.372693+0000","last_change":"2024-04-26T12:53:43.372693+0000","last_active":"2024-04-26T12:53:43.372693+0000","last_peered":"2024-04-26T12:53:43.372693+0000","last_clean":"2024-04-26T12:53:43.372693+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:53:43.372693+0000","last_undegraded":"2024-04-26T12:53:43.372693+0000","last_fullsized":"2024-04-26T12:53:43.372693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.372441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:12.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.400007+0000","last_change":"2024-04-26T12:54:15.400151+0000","last_active":"2024-04-26T12:54:15.400007+0000","last_peered":"2024-04-26T12:54:15.400007+0000","last_clean":"2024-04-26T12:54:15.400007+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:54:15.400007+0000","last_undegraded":"2024-04-26T12:54:15.400007+0000","last_fullsized":"2024-04-26T12:54:15.400007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:15.399681+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:15.399681+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.399681+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:34.871803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.276515+0000","last_change":"2024-04-26T12:53:50.276515+0000","last_active":"2024-04-26T12:53:50.276515+0000","last_peered":"2024-04-26T12:53:50.276515+0000","last_clean":"2024-04-26T12:53:50.276515+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:50.276515+0000","last_undegraded":"2024-04-26T12:53:50.276515+0000","last_fullsized":"2024-04-26T12:53:50.276515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.276254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:50.769163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.078510+0000","last_change":"2024-04-26T12:53:59.078562+0000","last_active":"2024-04-26T12:53:59.078510+0000","last_peered":"2024-04-26T12:53:59.078510+0000","last_clean":"2024-04-26T12:53:59.078510+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:53:59.078510+0000","last_undegraded":"2024-04-26T12:53:59.078510+0000","last_fullsized":"2024-04-26T12:53:59.078510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:59.078308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:59.078308+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.078308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:58.992648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.025034+0000","last_change":"2024-04-26T12:54:14.025122+0000","last_active":"2024-04-26T12:54:14.025034+0000","last_peered":"2024-04-26T12:54:14.025034+0000","last_clean":"2024-04-26T12:54:14.025034+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:54:14.025034+0000","last_undegraded":"2024-04-26T12:54:14.025034+0000","last_fullsized":"2024-04-26T12:54:14.025034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:14.024798+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:14.024798+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.024798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:50.094214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.141474+0000","last_change":"2024-04-26T12:54:14.141474+0000","last_active":"2024-04-26T12:54:14.141474+0000","last_peered":"2024-04-26T12:54:14.141474+0000","last_clean":"2024-04-26T12:54:14.141474+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:54:14.141474+0000","last_undegraded":"2024-04-26T12:54:14.141474+0000","last_fullsized":"2024-04-26T12:54:14.141474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:14.141184+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:14.141184+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.141184+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:28.916700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.771034+0000","last_change":"2024-04-26T12:53:30.771034+0000","last_active":"2024-04-26T12:53:30.771034+0000","last_peered":"2024-04-26T12:53:30.771034+0000","last_clean":"2024-04-26T12:53:30.771034+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:30.771034+0000","last_undegraded":"2024-04-26T12:53:30.771034+0000","last_fullsized":"2024-04-26T12:53:30.771034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.770734+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:16.557148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.218444+0000","last_change":"2024-04-26T12:53:37.218444+0000","last_active":"2024-04-26T12:53:37.218444+0000","last_peered":"2024-04-26T12:53:37.218444+0000","last_clean":"2024-04-26T12:53:37.218444+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:53:37.218444+0000","last_undegraded":"2024-04-26T12:53:37.218444+0000","last_fullsized":"2024-04-26T12:53:37.218444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.218195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:55.090465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.454688+0000","last_change":"2024-04-26T12:54:05.454748+0000","last_active":"2024-04-26T12:54:05.454688+0000","last_peered":"2024-04-26T12:54:05.454688+0000","last_clean":"2024-04-26T12:54:05.454688+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:54:05.454688+0000","last_undegraded":"2024-04-26T12:54:05.454688+0000","last_fullsized":"2024-04-26T12:54:05.454688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:05.454504+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:05.454504+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.454504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:45.412144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.225812+0000","last_change":"2024-04-26T12:53:53.225812+0000","last_active":"2024-04-26T12:53:53.225812+0000","last_peered":"2024-04-26T12:53:53.225812+0000","last_clean":"2024-04-26T12:53:53.225812+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:53:53.225812+0000","last_undegraded":"2024-04-26T12:53:53.225812+0000","last_fullsized":"2024-04-26T12:53:53.225812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.225550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:27.498113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818889+0000","last_change":"2024-04-26T12:49:44.965095+0000","last_active":"2024-04-26T12:53:20.818889+0000","last_peered":"2024-04-26T12:53:20.818889+0000","last_clean":"2024-04-26T12:53:20.818889+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:53:20.818889+0000","last_undegraded":"2024-04-26T12:53:20.818889+0000","last_fullsized":"2024-04-26T12:53:20.818889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.076416+0000","last_change":"2024-04-26T12:54:01.076416+0000","last_active":"2024-04-26T12:54:01.076416+0000","last_peered":"2024-04-26T12:54:01.076416+0000","last_clean":"2024-04-26T12:54:01.076416+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:54:01.076416+0000","last_undegraded":"2024-04-26T12:54:01.076416+0000","last_fullsized":"2024-04-26T12:54:01.076416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:01.076163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:01.076163+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.076163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:17.089416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.187723+0000","last_change":"2024-04-26T12:53:42.187723+0000","last_active":"2024-04-26T12:53:42.187723+0000","last_peered":"2024-04-26T12:53:42.187723+0000","last_clean":"2024-04-26T12:53:42.187723+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:53:42.187723+0000","last_undegraded":"2024-04-26T12:53:42.187723+0000","last_fullsized":"2024-04-26T12:53:42.187723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.187463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:46.572342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'21","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.345151+0000","last_change":"2024-04-26T12:53:27.345235+0000","last_active":"2024-04-26T12:53:27.345151+0000","last_peered":"2024-04-26T12:53:27.345151+0000","last_clean":"2024-04-26T12:53:27.345151+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:27.345151+0000","last_undegraded":"2024-04-26T12:53:27.345151+0000","last_fullsized":"2024-04-26T12:53:27.345151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.344956+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:36.530634+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.363391+0000","last_change":"2024-04-26T12:53:45.363447+0000","last_active":"2024-04-26T12:53:45.363391+0000","last_peered":"2024-04-26T12:53:45.363391+0000","last_clean":"2024-04-26T12:53:45.363391+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:53:45.363391+0000","last_undegraded":"2024-04-26T12:53:45.363391+0000","last_fullsized":"2024-04-26T12:53:45.363391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.363192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:54.085665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.962092+0000","last_change":"2024-04-26T12:50:04.290606+0000","last_active":"2024-04-26T12:52:17.962092+0000","last_peered":"2024-04-26T12:52:17.962092+0000","last_clean":"2024-04-26T12:52:17.962092+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:52:17.962092+0000","last_undegraded":"2024-04-26T12:52:17.962092+0000","last_fullsized":"2024-04-26T12:52:17.962092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":98,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.172388+0000","last_change":"2024-04-26T12:53:43.172388+0000","last_active":"2024-04-26T12:53:43.172388+0000","last_peered":"2024-04-26T12:53:43.172388+0000","last_clean":"2024-04-26T12:53:43.172388+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:43.172388+0000","last_undegraded":"2024-04-26T12:53:43.172388+0000","last_fullsized":"2024-04-26T12:53:43.172388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.172137+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:20.834194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.115672+0000","last_change":"2024-04-26T12:54:00.115672+0000","last_active":"2024-04-26T12:54:00.115672+0000","last_peered":"2024-04-26T12:54:00.115672+0000","last_clean":"2024-04-26T12:54:00.115672+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:54:00.115672+0000","last_undegraded":"2024-04-26T12:54:00.115672+0000","last_fullsized":"2024-04-26T12:54:00.115672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:00.115220+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:00.115220+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.115220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:59.052303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.159508+0000","last_change":"2024-04-26T12:54:08.159561+0000","last_active":"2024-04-26T12:54:08.159508+0000","last_peered":"2024-04-26T12:54:08.159508+0000","last_clean":"2024-04-26T12:54:08.159508+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:54:08.159508+0000","last_undegraded":"2024-04-26T12:54:08.159508+0000","last_fullsized":"2024-04-26T12:54:08.159508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:08.159306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:08.159306+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.159306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:40.086269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.271022+0000","last_change":"2024-04-26T12:53:46.271022+0000","last_active":"2024-04-26T12:53:46.271022+0000","last_peered":"2024-04-26T12:53:46.271022+0000","last_clean":"2024-04-26T12:53:46.271022+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:53:46.271022+0000","last_undegraded":"2024-04-26T12:53:46.271022+0000","last_fullsized":"2024-04-26T12:53:46.271022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.270733+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:53.862641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'73","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.205126+0000","last_change":"2024-04-26T12:53:30.205126+0000","last_active":"2024-04-26T12:53:30.205126+0000","last_peered":"2024-04-26T12:53:30.205126+0000","last_clean":"2024-04-26T12:53:30.205126+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:53:30.205126+0000","last_undegraded":"2024-04-26T12:53:30.205126+0000","last_fullsized":"2024-04-26T12:53:30.205126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.204804+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:53.044186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.761261+0000","last_change":"2024-04-26T12:53:22.761261+0000","last_active":"2024-04-26T12:53:22.761261+0000","last_peered":"2024-04-26T12:53:22.761261+0000","last_clean":"2024-04-26T12:53:22.761261+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:53:22.761261+0000","last_undegraded":"2024-04-26T12:53:22.761261+0000","last_fullsized":"2024-04-26T12:53:22.761261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.761001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:49.570682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.038873+0000","last_change":"2024-04-26T12:54:17.038968+0000","last_active":"2024-04-26T12:54:17.038873+0000","last_peered":"2024-04-26T12:54:17.038873+0000","last_clean":"2024-04-26T12:54:17.038873+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:54:17.038873+0000","last_undegraded":"2024-04-26T12:54:17.038873+0000","last_fullsized":"2024-04-26T12:54:17.038873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:54:17.038676+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:54:17.038676+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.038676+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:16.419398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.198011+0000","last_change":"2024-04-26T12:53:49.198011+0000","last_active":"2024-04-26T12:53:49.198011+0000","last_peered":"2024-04-26T12:53:49.198011+0000","last_clean":"2024-04-26T12:53:49.198011+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:49.198011+0000","last_undegraded":"2024-04-26T12:53:49.198011+0000","last_fullsized":"2024-04-26T12:53:49.198011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.197740+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:50.051462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.057310+0000","last_change":"2024-04-26T12:54:00.057310+0000","last_active":"2024-04-26T12:54:00.057310+0000","last_peered":"2024-04-26T12:54:00.057310+0000","last_clean":"2024-04-26T12:54:00.057310+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:54:00.057310+0000","last_undegraded":"2024-04-26T12:54:00.057310+0000","last_fullsized":"2024-04-26T12:54:00.057310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.057054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:25.513480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818903+0000","last_change":"2024-04-26T12:49:44.967351+0000","last_active":"2024-04-26T12:53:20.818903+0000","last_peered":"2024-04-26T12:53:20.818903+0000","last_clean":"2024-04-26T12:53:20.818903+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:53:20.818903+0000","last_undegraded":"2024-04-26T12:53:20.818903+0000","last_fullsized":"2024-04-26T12:53:20.818903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.364121+0000","last_change":"2024-04-26T12:53:30.364121+0000","last_active":"2024-04-26T12:53:30.364121+0000","last_peered":"2024-04-26T12:53:30.364121+0000","last_clean":"2024-04-26T12:53:30.364121+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:53:30.364121+0000","last_undegraded":"2024-04-26T12:53:30.364121+0000","last_fullsized":"2024-04-26T12:53:30.364121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.363860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:46.377113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'23","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.061000+0000","last_change":"2024-04-26T12:53:21.061000+0000","last_active":"2024-04-26T12:53:21.061000+0000","last_peered":"2024-04-26T12:53:21.061000+0000","last_clean":"2024-04-26T12:53:21.061000+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:53:21.061000+0000","last_undegraded":"2024-04-26T12:53:21.061000+0000","last_fullsized":"2024-04-26T12:53:21.061000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.060723+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:54.780796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":369,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.077560+0000","last_change":"2024-04-26T12:53:28.077560+0000","last_active":"2024-04-26T12:53:28.077560+0000","last_peered":"2024-04-26T12:53:28.077560+0000","last_clean":"2024-04-26T12:53:28.077560+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:28.077560+0000","last_undegraded":"2024-04-26T12:53:28.077560+0000","last_fullsized":"2024-04-26T12:53:28.077560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.077291+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:13.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.968368+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:52:22.968368+0000","last_peered":"2024-04-26T12:52:22.968368+0000","last_clean":"2024-04-26T12:52:22.968368+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:52:22.968368+0000","last_undegraded":"2024-04-26T12:52:22.968368+0000","last_fullsized":"2024-04-26T12:52:22.968368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'10","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.517273+0000","last_change":"2024-04-26T12:54:03.517340+0000","last_active":"2024-04-26T12:54:03.517273+0000","last_peered":"2024-04-26T12:54:03.517273+0000","last_clean":"2024-04-26T12:54:03.517273+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:54:03.517273+0000","last_undegraded":"2024-04-26T12:54:03.517273+0000","last_fullsized":"2024-04-26T12:54:03.517273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:03.517090+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:03.517090+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.517090+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:05.628227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.819124+0000","last_change":"2024-04-26T12:49:54.253396+0000","last_active":"2024-04-26T12:53:20.819124+0000","last_peered":"2024-04-26T12:53:20.819124+0000","last_clean":"2024-04-26T12:53:20.819124+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:53:20.819124+0000","last_undegraded":"2024-04-26T12:53:20.819124+0000","last_fullsized":"2024-04-26T12:53:20.819124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.123286+0000","last_change":"2024-04-26T12:54:07.123347+0000","last_active":"2024-04-26T12:54:07.123286+0000","last_peered":"2024-04-26T12:54:07.123286+0000","last_clean":"2024-04-26T12:54:07.123286+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:54:07.123286+0000","last_undegraded":"2024-04-26T12:54:07.123286+0000","last_fullsized":"2024-04-26T12:54:07.123286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:07.123085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:07.123085+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.123085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:47.764312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.421343+0000","last_change":"2024-04-26T12:53:21.421343+0000","last_active":"2024-04-26T12:53:21.421343+0000","last_peered":"2024-04-26T12:53:21.421343+0000","last_clean":"2024-04-26T12:53:21.421343+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:53:21.421343+0000","last_undegraded":"2024-04-26T12:53:21.421343+0000","last_fullsized":"2024-04-26T12:53:21.421343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.421080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:06.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'16","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.399644+0000","last_change":"2024-04-26T12:53:48.399644+0000","last_active":"2024-04-26T12:53:48.399644+0000","last_peered":"2024-04-26T12:53:48.399644+0000","last_clean":"2024-04-26T12:53:48.399644+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:53:48.399644+0000","last_undegraded":"2024-04-26T12:53:48.399644+0000","last_fullsized":"2024-04-26T12:53:48.399644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.399160+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:20.449086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.333981+0000","last_change":"2024-04-26T12:53:21.333981+0000","last_active":"2024-04-26T12:53:21.333981+0000","last_peered":"2024-04-26T12:53:21.333981+0000","last_clean":"2024-04-26T12:53:21.333981+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:21.333981+0000","last_undegraded":"2024-04-26T12:53:21.333981+0000","last_fullsized":"2024-04-26T12:53:21.333981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.333725+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:27.636643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:22.963806+0000","last_change":"2024-04-26T12:50:04.301343+0000","last_active":"2024-04-26T12:52:22.963806+0000","last_peered":"2024-04-26T12:52:22.963806+0000","last_clean":"2024-04-26T12:52:22.963806+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:52:22.963806+0000","last_undegraded":"2024-04-26T12:52:22.963806+0000","last_fullsized":"2024-04-26T12:52:22.963806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.991775+0000","last_change":"2024-04-26T12:53:46.991775+0000","last_active":"2024-04-26T12:53:46.991775+0000","last_peered":"2024-04-26T12:53:46.991775+0000","last_clean":"2024-04-26T12:53:46.991775+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:53:46.991775+0000","last_undegraded":"2024-04-26T12:53:46.991775+0000","last_fullsized":"2024-04-26T12:53:46.991775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.991502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:27.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.392770+0000","last_change":"2024-04-26T12:54:13.392770+0000","last_active":"2024-04-26T12:54:13.392770+0000","last_peered":"2024-04-26T12:54:13.392770+0000","last_clean":"2024-04-26T12:54:13.392770+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:54:13.392770+0000","last_undegraded":"2024-04-26T12:54:13.392770+0000","last_fullsized":"2024-04-26T12:54:13.392770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:13.392469+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:13.392469+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.392469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:35.832684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.818915+0000","last_change":"2024-04-26T12:49:44.967359+0000","last_active":"2024-04-26T12:53:20.818915+0000","last_peered":"2024-04-26T12:53:20.818915+0000","last_clean":"2024-04-26T12:53:20.818915+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:53:20.818915+0000","last_undegraded":"2024-04-26T12:53:20.818915+0000","last_fullsized":"2024-04-26T12:53:20.818915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:43.942632+0000","last_clean_scrub_stamp":"2024-04-26T12:49:43.942632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.334821+0000","last_change":"2024-04-26T12:53:31.334821+0000","last_active":"2024-04-26T12:53:31.334821+0000","last_peered":"2024-04-26T12:53:31.334821+0000","last_clean":"2024-04-26T12:53:31.334821+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:53:31.334821+0000","last_undegraded":"2024-04-26T12:53:31.334821+0000","last_fullsized":"2024-04-26T12:53:31.334821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.334536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:45.400333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'99","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.718800+0000","last_change":"2024-04-26T12:53:27.718800+0000","last_active":"2024-04-26T12:53:27.718800+0000","last_peered":"2024-04-26T12:53:27.718800+0000","last_clean":"2024-04-26T12:53:27.718800+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:53:27.718800+0000","last_undegraded":"2024-04-26T12:53:27.718800+0000","last_fullsized":"2024-04-26T12:53:27.718800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'99","last_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_deep_scrub":"35'99","last_deep_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.718504+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:03.589502+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.215348+0000","last_change":"2024-04-26T12:53:29.215348+0000","last_active":"2024-04-26T12:53:29.215348+0000","last_peered":"2024-04-26T12:53:29.215348+0000","last_clean":"2024-04-26T12:53:29.215348+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:53:29.215348+0000","last_undegraded":"2024-04-26T12:53:29.215348+0000","last_fullsized":"2024-04-26T12:53:29.215348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.215091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:55.609962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.118654+0000","last_change":"2024-04-26T12:54:08.118706+0000","last_active":"2024-04-26T12:54:08.118654+0000","last_peered":"2024-04-26T12:54:08.118654+0000","last_clean":"2024-04-26T12:54:08.118654+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:54:08.118654+0000","last_undegraded":"2024-04-26T12:54:08.118654+0000","last_fullsized":"2024-04-26T12:54:08.118654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:08.118446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:08.118446+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.118446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:36.872491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.122612+0000","last_change":"2024-04-26T12:54:09.122612+0000","last_active":"2024-04-26T12:54:09.122612+0000","last_peered":"2024-04-26T12:54:09.122612+0000","last_clean":"2024-04-26T12:54:09.122612+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:54:09.122612+0000","last_undegraded":"2024-04-26T12:54:09.122612+0000","last_fullsized":"2024-04-26T12:54:09.122612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:09.122366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:09.122366+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.122366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:10.237483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.929712+0000","last_change":"2024-04-26T12:53:41.929781+0000","last_active":"2024-04-26T12:53:41.929712+0000","last_peered":"2024-04-26T12:53:41.929712+0000","last_clean":"2024-04-26T12:53:41.929712+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:53:41.929712+0000","last_undegraded":"2024-04-26T12:53:41.929712+0000","last_fullsized":"2024-04-26T12:53:41.929712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.929472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:59.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.524528+0000","last_change":"2024-04-26T12:54:12.524587+0000","last_active":"2024-04-26T12:54:12.524528+0000","last_peered":"2024-04-26T12:54:12.524528+0000","last_clean":"2024-04-26T12:54:12.524528+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:54:12.524528+0000","last_undegraded":"2024-04-26T12:54:12.524528+0000","last_fullsized":"2024-04-26T12:54:12.524528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.524326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.524326+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.524326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:02.974028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.182269+0000","last_change":"2024-04-26T12:53:37.182402+0000","last_active":"2024-04-26T12:53:37.182269+0000","last_peered":"2024-04-26T12:53:37.182269+0000","last_clean":"2024-04-26T12:53:37.182269+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:53:37.182269+0000","last_undegraded":"2024-04-26T12:53:37.182269+0000","last_fullsized":"2024-04-26T12:53:37.182269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.182009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.668088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.379326+0000","last_change":"2024-04-26T12:53:35.379487+0000","last_active":"2024-04-26T12:53:35.379326+0000","last_peered":"2024-04-26T12:53:35.379326+0000","last_clean":"2024-04-26T12:53:35.379326+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:53:35.379326+0000","last_undegraded":"2024-04-26T12:53:35.379326+0000","last_fullsized":"2024-04-26T12:53:35.379326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.379029+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:12.600563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.355791+0000","last_change":"2024-04-26T12:53:46.355844+0000","last_active":"2024-04-26T12:53:46.355791+0000","last_peered":"2024-04-26T12:53:46.355791+0000","last_clean":"2024-04-26T12:53:46.355791+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:53:46.355791+0000","last_undegraded":"2024-04-26T12:53:46.355791+0000","last_fullsized":"2024-04-26T12:53:46.355791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.355590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:41.624485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:18.039190+0000","last_change":"2024-04-26T12:54:18.039252+0000","last_active":"2024-04-26T12:54:18.039190+0000","last_peered":"2024-04-26T12:54:18.039190+0000","last_clean":"2024-04-26T12:54:18.039190+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:54:18.039190+0000","last_undegraded":"2024-04-26T12:54:18.039190+0000","last_fullsized":"2024-04-26T12:54:18.039190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:54:18.038959+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:54:18.038959+0000","last_clean_scrub_stamp":"2024-04-26T12:54:18.038959+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:39.489918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:09.437673+0000","last_change":"2024-04-26T12:50:34.331364+0000","last_active":"2024-04-26T12:53:09.437673+0000","last_peered":"2024-04-26T12:53:09.437673+0000","last_clean":"2024-04-26T12:53:09.437673+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:53:09.437673+0000","last_undegraded":"2024-04-26T12:53:09.437673+0000","last_fullsized":"2024-04-26T12:53:09.437673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.115727+0000","last_change":"2024-04-26T12:54:06.115884+0000","last_active":"2024-04-26T12:54:06.115727+0000","last_peered":"2024-04-26T12:54:06.115727+0000","last_clean":"2024-04-26T12:54:06.115727+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:54:06.115727+0000","last_undegraded":"2024-04-26T12:54:06.115727+0000","last_fullsized":"2024-04-26T12:54:06.115727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:06.115455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:06.115455+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.115455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:28.333237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966695+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:52:17.966695+0000","last_peered":"2024-04-26T12:52:17.966695+0000","last_clean":"2024-04-26T12:52:17.966695+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:52:17.966695+0000","last_undegraded":"2024-04-26T12:52:17.966695+0000","last_fullsized":"2024-04-26T12:52:17.966695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.245428+0000","last_change":"2024-04-26T12:53:35.245501+0000","last_active":"2024-04-26T12:53:35.245428+0000","last_peered":"2024-04-26T12:53:35.245428+0000","last_clean":"2024-04-26T12:53:35.245428+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:35.245428+0000","last_undegraded":"2024-04-26T12:53:35.245428+0000","last_fullsized":"2024-04-26T12:53:35.245428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.245236+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:33.087428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.725793+0000","last_change":"2024-04-26T12:53:24.725849+0000","last_active":"2024-04-26T12:53:24.725793+0000","last_peered":"2024-04-26T12:53:24.725793+0000","last_clean":"2024-04-26T12:53:24.725793+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:53:24.725793+0000","last_undegraded":"2024-04-26T12:53:24.725793+0000","last_fullsized":"2024-04-26T12:53:24.725793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.725577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:57.154247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.302405+0000","last_change":"2024-04-26T12:53:45.302468+0000","last_active":"2024-04-26T12:53:45.302405+0000","last_peered":"2024-04-26T12:53:45.302405+0000","last_clean":"2024-04-26T12:53:45.302405+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:45.302405+0000","last_undegraded":"2024-04-26T12:53:45.302405+0000","last_fullsized":"2024-04-26T12:53:45.302405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.302211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.021522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'16","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.150114+0000","last_change":"2024-04-26T12:53:57.150181+0000","last_active":"2024-04-26T12:53:57.150114+0000","last_peered":"2024-04-26T12:53:57.150114+0000","last_clean":"2024-04-26T12:53:57.150114+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:57.150114+0000","last_undegraded":"2024-04-26T12:53:57.150114+0000","last_fullsized":"2024-04-26T12:53:57.150114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.149914+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:33.210100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.962337+0000","last_change":"2024-04-26T12:53:53.962501+0000","last_active":"2024-04-26T12:53:53.962337+0000","last_peered":"2024-04-26T12:53:53.962337+0000","last_clean":"2024-04-26T12:53:53.962337+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:53:53.962337+0000","last_undegraded":"2024-04-26T12:53:53.962337+0000","last_fullsized":"2024-04-26T12:53:53.962337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.962061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:05.175288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.837679+0000","last_change":"2024-04-26T12:53:34.837739+0000","last_active":"2024-04-26T12:53:34.837679+0000","last_peered":"2024-04-26T12:53:34.837679+0000","last_clean":"2024-04-26T12:53:34.837679+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:53:34.837679+0000","last_undegraded":"2024-04-26T12:53:34.837679+0000","last_fullsized":"2024-04-26T12:53:34.837679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.837461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:55.097696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":119,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.252254+0000","last_change":"2024-04-26T12:53:34.252332+0000","last_active":"2024-04-26T12:53:34.252254+0000","last_peered":"2024-04-26T12:53:34.252254+0000","last_clean":"2024-04-26T12:53:34.252254+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:34.252254+0000","last_undegraded":"2024-04-26T12:53:34.252254+0000","last_fullsized":"2024-04-26T12:53:34.252254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.252055+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:22.283776+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.049935+0000","last_change":"2024-04-26T12:53:20.049974+0000","last_active":"2024-04-26T12:53:20.049935+0000","last_peered":"2024-04-26T12:53:20.049935+0000","last_clean":"2024-04-26T12:53:20.049935+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:53:20.049935+0000","last_undegraded":"2024-04-26T12:53:20.049935+0000","last_fullsized":"2024-04-26T12:53:20.049935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.049783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:14.101561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:37.972599+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:52:37.972599+0000","last_peered":"2024-04-26T12:52:37.972599+0000","last_clean":"2024-04-26T12:52:37.972599+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:52:37.972599+0000","last_undegraded":"2024-04-26T12:52:37.972599+0000","last_fullsized":"2024-04-26T12:52:37.972599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.504155+0000","last_change":"2024-04-26T12:53:56.504321+0000","last_active":"2024-04-26T12:53:56.504155+0000","last_peered":"2024-04-26T12:53:56.504155+0000","last_clean":"2024-04-26T12:53:56.504155+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:56.504155+0000","last_undegraded":"2024-04-26T12:53:56.504155+0000","last_fullsized":"2024-04-26T12:53:56.504155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.503910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.738314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.385811+0000","last_change":"2024-04-26T12:54:12.385867+0000","last_active":"2024-04-26T12:54:12.385811+0000","last_peered":"2024-04-26T12:54:12.385811+0000","last_clean":"2024-04-26T12:54:12.385811+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:54:12.385811+0000","last_undegraded":"2024-04-26T12:54:12.385811+0000","last_fullsized":"2024-04-26T12:54:12.385811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.385615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.385615+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.385615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:05.886586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.347547+0000","last_change":"2024-04-26T12:53:24.347602+0000","last_active":"2024-04-26T12:53:24.347547+0000","last_peered":"2024-04-26T12:53:24.347547+0000","last_clean":"2024-04-26T12:53:24.347547+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:53:24.347547+0000","last_undegraded":"2024-04-26T12:53:24.347547+0000","last_fullsized":"2024-04-26T12:53:24.347547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.347350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:48.923924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.801252+0000","last_change":"2024-04-26T12:53:31.801328+0000","last_active":"2024-04-26T12:53:31.801252+0000","last_peered":"2024-04-26T12:53:31.801252+0000","last_clean":"2024-04-26T12:53:31.801252+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:53:31.801252+0000","last_undegraded":"2024-04-26T12:53:31.801252+0000","last_fullsized":"2024-04-26T12:53:31.801252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.801011+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:27.272844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.740640+0000","last_change":"2024-04-26T12:53:23.740693+0000","last_active":"2024-04-26T12:53:23.740640+0000","last_peered":"2024-04-26T12:53:23.740640+0000","last_clean":"2024-04-26T12:53:23.740640+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:53:23.740640+0000","last_undegraded":"2024-04-26T12:53:23.740640+0000","last_fullsized":"2024-04-26T12:53:23.740640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.740437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:49.029310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.334631+0000","last_change":"2024-04-26T12:53:34.334631+0000","last_active":"2024-04-26T12:53:34.334631+0000","last_peered":"2024-04-26T12:53:34.334631+0000","last_clean":"2024-04-26T12:53:34.334631+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:34.334631+0000","last_undegraded":"2024-04-26T12:53:34.334631+0000","last_fullsized":"2024-04-26T12:53:34.334631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.334375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:02.613019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.584722+0000","last_change":"2024-04-26T12:54:16.584779+0000","last_active":"2024-04-26T12:54:16.584722+0000","last_peered":"2024-04-26T12:54:16.584722+0000","last_clean":"2024-04-26T12:54:16.584722+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:54:16.584722+0000","last_undegraded":"2024-04-26T12:54:16.584722+0000","last_fullsized":"2024-04-26T12:54:16.584722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:16.584498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:16.584498+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.584498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:20.594239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":239,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.234809+0000","last_change":"2024-04-26T12:53:43.234809+0000","last_active":"2024-04-26T12:53:43.234809+0000","last_peered":"2024-04-26T12:53:43.234809+0000","last_clean":"2024-04-26T12:53:43.234809+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:53:43.234809+0000","last_undegraded":"2024-04-26T12:53:43.234809+0000","last_fullsized":"2024-04-26T12:53:43.234809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.234542+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:14.014272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.227085+0000","last_change":"2024-04-26T12:53:28.227166+0000","last_active":"2024-04-26T12:53:28.227085+0000","last_peered":"2024-04-26T12:53:28.227085+0000","last_clean":"2024-04-26T12:53:28.227085+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:53:28.227085+0000","last_undegraded":"2024-04-26T12:53:28.227085+0000","last_fullsized":"2024-04-26T12:53:28.227085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.226873+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:23.499693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.736545+0000","last_change":"2024-04-26T12:53:21.736604+0000","last_active":"2024-04-26T12:53:21.736545+0000","last_peered":"2024-04-26T12:53:21.736545+0000","last_clean":"2024-04-26T12:53:21.736545+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:53:21.736545+0000","last_undegraded":"2024-04-26T12:53:21.736545+0000","last_fullsized":"2024-04-26T12:53:21.736545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.736352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:21.809175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.288231+0000","last_change":"2024-04-26T12:53:49.288385+0000","last_active":"2024-04-26T12:53:49.288231+0000","last_peered":"2024-04-26T12:53:49.288231+0000","last_clean":"2024-04-26T12:53:49.288231+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:53:49.288231+0000","last_undegraded":"2024-04-26T12:53:49.288231+0000","last_fullsized":"2024-04-26T12:53:49.288231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.288000+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:06.328966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.099538+0000","last_change":"2024-04-26T12:54:05.099599+0000","last_active":"2024-04-26T12:54:05.099538+0000","last_peered":"2024-04-26T12:54:05.099538+0000","last_clean":"2024-04-26T12:54:05.099538+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:54:05.099538+0000","last_undegraded":"2024-04-26T12:54:05.099538+0000","last_fullsized":"2024-04-26T12:54:05.099538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:05.099328+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:05.099328+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.099328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:13.229996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.304926+0000","last_change":"2024-04-26T12:54:05.304979+0000","last_active":"2024-04-26T12:54:05.304926+0000","last_peered":"2024-04-26T12:54:05.304926+0000","last_clean":"2024-04-26T12:54:05.304926+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:54:05.304926+0000","last_undegraded":"2024-04-26T12:54:05.304926+0000","last_fullsized":"2024-04-26T12:54:05.304926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:05.304733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:05.304733+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.304733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:48.470972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.904759+0000","last_change":"2024-04-26T12:53:37.904759+0000","last_active":"2024-04-26T12:53:37.904759+0000","last_peered":"2024-04-26T12:53:37.904759+0000","last_clean":"2024-04-26T12:53:37.904759+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:53:37.904759+0000","last_undegraded":"2024-04-26T12:53:37.904759+0000","last_fullsized":"2024-04-26T12:53:37.904759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.904494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:22.228978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'47","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.491629+0000","last_change":"2024-04-26T12:53:52.491707+0000","last_active":"2024-04-26T12:53:52.491629+0000","last_peered":"2024-04-26T12:53:52.491629+0000","last_clean":"2024-04-26T12:53:52.491629+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:53:52.491629+0000","last_undegraded":"2024-04-26T12:53:52.491629+0000","last_fullsized":"2024-04-26T12:53:52.491629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.491439+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:11.972259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.155724+0000","last_change":"2024-04-26T12:53:36.155779+0000","last_active":"2024-04-26T12:53:36.155724+0000","last_peered":"2024-04-26T12:53:36.155724+0000","last_clean":"2024-04-26T12:53:36.155724+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:53:36.155724+0000","last_undegraded":"2024-04-26T12:53:36.155724+0000","last_fullsized":"2024-04-26T12:53:36.155724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.155541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:38.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.529021+0000","last_change":"2024-04-26T12:54:01.529079+0000","last_active":"2024-04-26T12:54:01.529021+0000","last_peered":"2024-04-26T12:54:01.529021+0000","last_clean":"2024-04-26T12:54:01.529021+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:54:01.529021+0000","last_undegraded":"2024-04-26T12:54:01.529021+0000","last_fullsized":"2024-04-26T12:54:01.529021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:01.528785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:01.528785+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.528785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:27.197092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.304021+0000","last_change":"2024-04-26T12:53:32.304100+0000","last_active":"2024-04-26T12:53:32.304021+0000","last_peered":"2024-04-26T12:53:32.304021+0000","last_clean":"2024-04-26T12:53:32.304021+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:32.304021+0000","last_undegraded":"2024-04-26T12:53:32.304021+0000","last_fullsized":"2024-04-26T12:53:32.304021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.303812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:44.406488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.340617+0000","last_change":"2024-04-26T12:54:07.340671+0000","last_active":"2024-04-26T12:54:07.340617+0000","last_peered":"2024-04-26T12:54:07.340617+0000","last_clean":"2024-04-26T12:54:07.340617+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:54:07.340617+0000","last_undegraded":"2024-04-26T12:54:07.340617+0000","last_fullsized":"2024-04-26T12:54:07.340617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:07.340430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:07.340430+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.340430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:48.000026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.917230+0000","last_change":"2024-04-26T12:53:39.917284+0000","last_active":"2024-04-26T12:53:39.917230+0000","last_peered":"2024-04-26T12:53:39.917230+0000","last_clean":"2024-04-26T12:53:39.917230+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:53:39.917230+0000","last_undegraded":"2024-04-26T12:53:39.917230+0000","last_fullsized":"2024-04-26T12:53:39.917230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.917036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:25.602021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.199626+0000","last_change":"2024-04-26T12:53:32.199626+0000","last_active":"2024-04-26T12:53:32.199626+0000","last_peered":"2024-04-26T12:53:32.199626+0000","last_clean":"2024-04-26T12:53:32.199626+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:53:32.199626+0000","last_undegraded":"2024-04-26T12:53:32.199626+0000","last_fullsized":"2024-04-26T12:53:32.199626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.199339+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:43.051403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.287181+0000","last_change":"2024-04-26T12:53:22.287181+0000","last_active":"2024-04-26T12:53:22.287181+0000","last_peered":"2024-04-26T12:53:22.287181+0000","last_clean":"2024-04-26T12:53:22.287181+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:53:22.287181+0000","last_undegraded":"2024-04-26T12:53:22.287181+0000","last_fullsized":"2024-04-26T12:53:22.287181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.286848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:37.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.563601+0000","last_change":"2024-04-26T12:54:13.563665+0000","last_active":"2024-04-26T12:54:13.563601+0000","last_peered":"2024-04-26T12:54:13.563601+0000","last_clean":"2024-04-26T12:54:13.563601+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:54:13.563601+0000","last_undegraded":"2024-04-26T12:54:13.563601+0000","last_fullsized":"2024-04-26T12:54:13.563601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:13.563410+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:13.563410+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.563410+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:47.974922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.153511+0000","last_change":"2024-04-26T12:53:55.153568+0000","last_active":"2024-04-26T12:53:55.153511+0000","last_peered":"2024-04-26T12:53:55.153511+0000","last_clean":"2024-04-26T12:53:55.153511+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:53:55.153511+0000","last_undegraded":"2024-04-26T12:53:55.153511+0000","last_fullsized":"2024-04-26T12:53:55.153511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.153308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:06.760317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969621+0000","last_change":"2024-04-26T12:49:54.253819+0000","last_active":"2024-04-26T12:52:27.969621+0000","last_peered":"2024-04-26T12:52:27.969621+0000","last_clean":"2024-04-26T12:52:27.969621+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:52:27.969621+0000","last_undegraded":"2024-04-26T12:52:27.969621+0000","last_fullsized":"2024-04-26T12:52:27.969621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.124744+0000","last_change":"2024-04-26T12:53:34.124797+0000","last_active":"2024-04-26T12:53:34.124744+0000","last_peered":"2024-04-26T12:53:34.124744+0000","last_clean":"2024-04-26T12:53:34.124744+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:53:34.124744+0000","last_undegraded":"2024-04-26T12:53:34.124744+0000","last_fullsized":"2024-04-26T12:53:34.124744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.124506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:09.569031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.385969+0000","last_change":"2024-04-26T12:53:47.385969+0000","last_active":"2024-04-26T12:53:47.385969+0000","last_peered":"2024-04-26T12:53:47.385969+0000","last_clean":"2024-04-26T12:53:47.385969+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:53:47.385969+0000","last_undegraded":"2024-04-26T12:53:47.385969+0000","last_fullsized":"2024-04-26T12:53:47.385969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.385688+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:42.214059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":431,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.832479+0000","last_change":"2024-04-26T12:53:32.832479+0000","last_active":"2024-04-26T12:53:32.832479+0000","last_peered":"2024-04-26T12:53:32.832479+0000","last_clean":"2024-04-26T12:53:32.832479+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:32.832479+0000","last_undegraded":"2024-04-26T12:53:32.832479+0000","last_fullsized":"2024-04-26T12:53:32.832479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.832206+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:19.156979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969244+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:52:27.969244+0000","last_peered":"2024-04-26T12:52:27.969244+0000","last_clean":"2024-04-26T12:52:27.969244+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:52:27.969244+0000","last_undegraded":"2024-04-26T12:52:27.969244+0000","last_fullsized":"2024-04-26T12:52:27.969244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'24","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.994253+0000","last_change":"2024-04-26T12:53:43.994314+0000","last_active":"2024-04-26T12:53:43.994253+0000","last_peered":"2024-04-26T12:53:43.994253+0000","last_clean":"2024-04-26T12:53:43.994253+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:43.994253+0000","last_undegraded":"2024-04-26T12:53:43.994253+0000","last_fullsized":"2024-04-26T12:53:43.994253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.994064+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:53.158642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.121700+0000","last_change":"2024-04-26T12:53:55.121759+0000","last_active":"2024-04-26T12:53:55.121700+0000","last_peered":"2024-04-26T12:53:55.121700+0000","last_clean":"2024-04-26T12:53:55.121700+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:53:55.121700+0000","last_undegraded":"2024-04-26T12:53:55.121700+0000","last_fullsized":"2024-04-26T12:53:55.121700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.121449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:23.400093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.121759+0000","last_change":"2024-04-26T12:53:33.121816+0000","last_active":"2024-04-26T12:53:33.121759+0000","last_peered":"2024-04-26T12:53:33.121759+0000","last_clean":"2024-04-26T12:53:33.121759+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:53:33.121759+0000","last_undegraded":"2024-04-26T12:53:33.121759+0000","last_fullsized":"2024-04-26T12:53:33.121759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.121556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:50.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.092152+0000","last_change":"2024-04-26T12:53:27.092239+0000","last_active":"2024-04-26T12:53:27.092152+0000","last_peered":"2024-04-26T12:53:27.092152+0000","last_clean":"2024-04-26T12:53:27.092152+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:53:27.092152+0000","last_undegraded":"2024-04-26T12:53:27.092152+0000","last_fullsized":"2024-04-26T12:53:27.092152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.091940+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:51.222988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.289177+0000","last_change":"2024-04-26T12:53:24.289294+0000","last_active":"2024-04-26T12:53:24.289177+0000","last_peered":"2024-04-26T12:53:24.289177+0000","last_clean":"2024-04-26T12:53:24.289177+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:53:24.289177+0000","last_undegraded":"2024-04-26T12:53:24.289177+0000","last_fullsized":"2024-04-26T12:53:24.289177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.288887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:44.523664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.358327+0000","last_change":"2024-04-26T12:54:16.358389+0000","last_active":"2024-04-26T12:54:16.358327+0000","last_peered":"2024-04-26T12:54:16.358327+0000","last_clean":"2024-04-26T12:54:16.358327+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:54:16.358327+0000","last_undegraded":"2024-04-26T12:54:16.358327+0000","last_fullsized":"2024-04-26T12:54:16.358327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:16.358132+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:16.358132+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.358132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:39.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.893739+0000","last_change":"2024-04-26T12:53:50.893805+0000","last_active":"2024-04-26T12:53:50.893739+0000","last_peered":"2024-04-26T12:53:50.893739+0000","last_clean":"2024-04-26T12:53:50.893739+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:53:50.893739+0000","last_undegraded":"2024-04-26T12:53:50.893739+0000","last_fullsized":"2024-04-26T12:53:50.893739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.893537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:00.221642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969824+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:52:27.969824+0000","last_peered":"2024-04-26T12:52:27.969824+0000","last_clean":"2024-04-26T12:52:27.969824+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:52:27.969824+0000","last_undegraded":"2024-04-26T12:52:27.969824+0000","last_fullsized":"2024-04-26T12:52:27.969824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.929195+0000","last_change":"2024-04-26T12:53:38.929256+0000","last_active":"2024-04-26T12:53:38.929195+0000","last_peered":"2024-04-26T12:53:38.929195+0000","last_clean":"2024-04-26T12:53:38.929195+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:53:38.929195+0000","last_undegraded":"2024-04-26T12:53:38.929195+0000","last_fullsized":"2024-04-26T12:53:38.929195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.928996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:29.134252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.240483+0000","last_change":"2024-04-26T12:53:31.240665+0000","last_active":"2024-04-26T12:53:31.240483+0000","last_peered":"2024-04-26T12:53:31.240483+0000","last_clean":"2024-04-26T12:53:31.240483+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:53:31.240483+0000","last_undegraded":"2024-04-26T12:53:31.240483+0000","last_fullsized":"2024-04-26T12:53:31.240483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.240229+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:11.099663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.435994+0000","last_change":"2024-04-26T12:53:49.436052+0000","last_active":"2024-04-26T12:53:49.435994+0000","last_peered":"2024-04-26T12:53:49.435994+0000","last_clean":"2024-04-26T12:53:49.435994+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:53:49.435994+0000","last_undegraded":"2024-04-26T12:53:49.435994+0000","last_fullsized":"2024-04-26T12:53:49.435994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.435800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.047458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971454+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:52:32.971454+0000","last_peered":"2024-04-26T12:52:32.971454+0000","last_clean":"2024-04-26T12:52:32.971454+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:52:32.971454+0000","last_undegraded":"2024-04-26T12:52:32.971454+0000","last_fullsized":"2024-04-26T12:52:32.971454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.482932+0000","last_change":"2024-04-26T12:54:08.483107+0000","last_active":"2024-04-26T12:54:08.482932+0000","last_peered":"2024-04-26T12:54:08.482932+0000","last_clean":"2024-04-26T12:54:08.482932+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:54:08.482932+0000","last_undegraded":"2024-04-26T12:54:08.482932+0000","last_fullsized":"2024-04-26T12:54:08.482932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:08.482670+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:08.482670+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.482670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:00.116592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.086364+0000","last_change":"2024-04-26T12:54:02.086394+0000","last_active":"2024-04-26T12:54:02.086364+0000","last_peered":"2024-04-26T12:54:02.086364+0000","last_clean":"2024-04-26T12:54:02.086364+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:54:02.086364+0000","last_undegraded":"2024-04-26T12:54:02.086364+0000","last_fullsized":"2024-04-26T12:54:02.086364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:02.086261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:02.086261+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.086261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:39.169507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.068318+0000","last_change":"2024-04-26T12:53:31.068439+0000","last_active":"2024-04-26T12:53:31.068318+0000","last_peered":"2024-04-26T12:53:31.068318+0000","last_clean":"2024-04-26T12:53:31.068318+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:53:31.068318+0000","last_undegraded":"2024-04-26T12:53:31.068318+0000","last_fullsized":"2024-04-26T12:53:31.068318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.068090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:16.753074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'32","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.452853+0000","last_change":"2024-04-26T12:53:51.452990+0000","last_active":"2024-04-26T12:53:51.452853+0000","last_peered":"2024-04-26T12:53:51.452853+0000","last_clean":"2024-04-26T12:53:51.452853+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:53:51.452853+0000","last_undegraded":"2024-04-26T12:53:51.452853+0000","last_fullsized":"2024-04-26T12:53:51.452853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'32","last_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_deep_scrub":"35'32","last_deep_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.452618+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.889839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.506938+0000","last_change":"2024-04-26T12:53:53.506996+0000","last_active":"2024-04-26T12:53:53.506938+0000","last_peered":"2024-04-26T12:53:53.506938+0000","last_clean":"2024-04-26T12:53:53.506938+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:53:53.506938+0000","last_undegraded":"2024-04-26T12:53:53.506938+0000","last_fullsized":"2024-04-26T12:53:53.506938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.506716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:38.844443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971345+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:32.971345+0000","last_peered":"2024-04-26T12:52:32.971345+0000","last_clean":"2024-04-26T12:52:32.971345+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:32.971345+0000","last_undegraded":"2024-04-26T12:52:32.971345+0000","last_fullsized":"2024-04-26T12:52:32.971345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.981002+0000","last_change":"2024-04-26T12:53:54.981135+0000","last_active":"2024-04-26T12:53:54.981002+0000","last_peered":"2024-04-26T12:53:54.981002+0000","last_clean":"2024-04-26T12:53:54.981002+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:53:54.981002+0000","last_undegraded":"2024-04-26T12:53:54.981002+0000","last_fullsized":"2024-04-26T12:53:54.981002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.980684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:23.450201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.283199+0000","last_change":"2024-04-26T12:54:01.283199+0000","last_active":"2024-04-26T12:54:01.283199+0000","last_peered":"2024-04-26T12:54:01.283199+0000","last_clean":"2024-04-26T12:54:01.283199+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:54:01.283199+0000","last_undegraded":"2024-04-26T12:54:01.283199+0000","last_fullsized":"2024-04-26T12:54:01.283199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:01.282930+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:01.282930+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.282930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:55.471622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.069160+0000","last_change":"2024-04-26T12:53:30.069291+0000","last_active":"2024-04-26T12:53:30.069160+0000","last_peered":"2024-04-26T12:53:30.069160+0000","last_clean":"2024-04-26T12:53:30.069160+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:53:30.069160+0000","last_undegraded":"2024-04-26T12:53:30.069160+0000","last_fullsized":"2024-04-26T12:53:30.069160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.068914+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:20.274170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.418105+0000","last_change":"2024-04-26T12:53:50.418159+0000","last_active":"2024-04-26T12:53:50.418105+0000","last_peered":"2024-04-26T12:53:50.418105+0000","last_clean":"2024-04-26T12:53:50.418105+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:50.418105+0000","last_undegraded":"2024-04-26T12:53:50.418105+0000","last_fullsized":"2024-04-26T12:53:50.418105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.417994+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:42.018459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.295415+0000","last_change":"2024-04-26T12:53:26.295546+0000","last_active":"2024-04-26T12:53:26.295415+0000","last_peered":"2024-04-26T12:53:26.295415+0000","last_clean":"2024-04-26T12:53:26.295415+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:53:26.295415+0000","last_undegraded":"2024-04-26T12:53:26.295415+0000","last_fullsized":"2024-04-26T12:53:26.295415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.295181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:21.587262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.514864+0000","last_change":"2024-04-26T12:54:09.514929+0000","last_active":"2024-04-26T12:54:09.514864+0000","last_peered":"2024-04-26T12:54:09.514864+0000","last_clean":"2024-04-26T12:54:09.514864+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:54:09.514864+0000","last_undegraded":"2024-04-26T12:54:09.514864+0000","last_fullsized":"2024-04-26T12:54:09.514864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:09.514660+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:09.514660+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.514660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:53.553405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.144167+0000","last_change":"2024-04-26T12:53:46.144167+0000","last_active":"2024-04-26T12:53:46.144167+0000","last_peered":"2024-04-26T12:53:46.144167+0000","last_clean":"2024-04-26T12:53:46.144167+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:46.144167+0000","last_undegraded":"2024-04-26T12:53:46.144167+0000","last_fullsized":"2024-04-26T12:53:46.144167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.143916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:10.720490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.939817+0000","last_change":"2024-04-26T12:53:51.939817+0000","last_active":"2024-04-26T12:53:51.939817+0000","last_peered":"2024-04-26T12:53:51.939817+0000","last_clean":"2024-04-26T12:53:51.939817+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:53:51.939817+0000","last_undegraded":"2024-04-26T12:53:51.939817+0000","last_fullsized":"2024-04-26T12:53:51.939817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.939533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:29.601591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.262502+0000","last_change":"2024-04-26T12:53:51.262502+0000","last_active":"2024-04-26T12:53:51.262502+0000","last_peered":"2024-04-26T12:53:51.262502+0000","last_clean":"2024-04-26T12:53:51.262502+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:51.262502+0000","last_undegraded":"2024-04-26T12:53:51.262502+0000","last_fullsized":"2024-04-26T12:53:51.262502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.262245+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.721553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.165739+0000","last_change":"2024-04-26T12:53:56.165739+0000","last_active":"2024-04-26T12:53:56.165739+0000","last_peered":"2024-04-26T12:53:56.165739+0000","last_clean":"2024-04-26T12:53:56.165739+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:53:56.165739+0000","last_undegraded":"2024-04-26T12:53:56.165739+0000","last_fullsized":"2024-04-26T12:53:56.165739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.165465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:33.355823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.418074+0000","last_change":"2024-04-26T12:54:06.418074+0000","last_active":"2024-04-26T12:54:06.418074+0000","last_peered":"2024-04-26T12:54:06.418074+0000","last_clean":"2024-04-26T12:54:06.418074+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:54:06.418074+0000","last_undegraded":"2024-04-26T12:54:06.418074+0000","last_fullsized":"2024-04-26T12:54:06.418074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:06.417830+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:06.417830+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.417830+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:00.383510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.819571+0000","last_change":"2024-04-26T12:49:54.236188+0000","last_active":"2024-04-26T12:53:20.819571+0000","last_peered":"2024-04-26T12:53:20.819571+0000","last_clean":"2024-04-26T12:53:20.819571+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:53:20.819571+0000","last_undegraded":"2024-04-26T12:53:20.819571+0000","last_fullsized":"2024-04-26T12:53:20.819571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.094315+0000","last_change":"2024-04-26T12:54:03.094315+0000","last_active":"2024-04-26T12:54:03.094315+0000","last_peered":"2024-04-26T12:54:03.094315+0000","last_clean":"2024-04-26T12:54:03.094315+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:54:03.094315+0000","last_undegraded":"2024-04-26T12:54:03.094315+0000","last_fullsized":"2024-04-26T12:54:03.094315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:03.094053+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:03.094053+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.094053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:04.790219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.178704+0000","last_change":"2024-04-26T12:54:09.178771+0000","last_active":"2024-04-26T12:54:09.178704+0000","last_peered":"2024-04-26T12:54:09.178704+0000","last_clean":"2024-04-26T12:54:09.178704+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:54:09.178704+0000","last_undegraded":"2024-04-26T12:54:09.178704+0000","last_fullsized":"2024-04-26T12:54:09.178704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:09.178495+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:09.178495+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.178495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:57.622469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.097598+0000","last_change":"2024-04-26T12:53:59.097598+0000","last_active":"2024-04-26T12:53:59.097598+0000","last_peered":"2024-04-26T12:53:59.097598+0000","last_clean":"2024-04-26T12:53:59.097598+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:53:59.097598+0000","last_undegraded":"2024-04-26T12:53:59.097598+0000","last_fullsized":"2024-04-26T12:53:59.097598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.097326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:47.866871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.202547+0000","last_change":"2024-04-26T12:53:54.202547+0000","last_active":"2024-04-26T12:53:54.202547+0000","last_peered":"2024-04-26T12:53:54.202547+0000","last_clean":"2024-04-26T12:53:54.202547+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:53:54.202547+0000","last_undegraded":"2024-04-26T12:53:54.202547+0000","last_fullsized":"2024-04-26T12:53:54.202547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.202278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:55.097855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.220338+0000","last_change":"2024-04-26T12:53:39.220338+0000","last_active":"2024-04-26T12:53:39.220338+0000","last_peered":"2024-04-26T12:53:39.220338+0000","last_clean":"2024-04-26T12:53:39.220338+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:39.220338+0000","last_undegraded":"2024-04-26T12:53:39.220338+0000","last_fullsized":"2024-04-26T12:53:39.220338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.220089+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:13.125940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.350324+0000","last_change":"2024-04-26T12:54:11.350324+0000","last_active":"2024-04-26T12:54:11.350324+0000","last_peered":"2024-04-26T12:54:11.350324+0000","last_clean":"2024-04-26T12:54:11.350324+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:54:11.350324+0000","last_undegraded":"2024-04-26T12:54:11.350324+0000","last_fullsized":"2024-04-26T12:54:11.350324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:11.350039+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:11.350039+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.350039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:29.715742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.022978+0000","last_change":"2024-04-26T12:54:15.023177+0000","last_active":"2024-04-26T12:54:15.022978+0000","last_peered":"2024-04-26T12:54:15.022978+0000","last_clean":"2024-04-26T12:54:15.022978+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:54:15.022978+0000","last_undegraded":"2024-04-26T12:54:15.022978+0000","last_fullsized":"2024-04-26T12:54:15.022978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:15.022751+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:15.022751+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.022751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:45.263486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.022822+0000","last_change":"2024-04-26T12:53:46.022822+0000","last_active":"2024-04-26T12:53:46.022822+0000","last_peered":"2024-04-26T12:53:46.022822+0000","last_clean":"2024-04-26T12:53:46.022822+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:53:46.022822+0000","last_undegraded":"2024-04-26T12:53:46.022822+0000","last_fullsized":"2024-04-26T12:53:46.022822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.022525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:48.747486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.313205+0000","last_change":"2024-04-26T12:54:02.313205+0000","last_active":"2024-04-26T12:54:02.313205+0000","last_peered":"2024-04-26T12:54:02.313205+0000","last_clean":"2024-04-26T12:54:02.313205+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:54:02.313205+0000","last_undegraded":"2024-04-26T12:54:02.313205+0000","last_fullsized":"2024-04-26T12:54:02.313205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:02.312870+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:02.312870+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.312870+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:37.400546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.141412+0000","last_change":"2024-04-26T12:54:10.141412+0000","last_active":"2024-04-26T12:54:10.141412+0000","last_peered":"2024-04-26T12:54:10.141412+0000","last_clean":"2024-04-26T12:54:10.141412+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:54:10.141412+0000","last_undegraded":"2024-04-26T12:54:10.141412+0000","last_fullsized":"2024-04-26T12:54:10.141412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:10.141147+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:10.141147+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.141147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:35.775459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'10","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.188694+0000","last_change":"2024-04-26T12:53:53.188767+0000","last_active":"2024-04-26T12:53:53.188694+0000","last_peered":"2024-04-26T12:53:53.188694+0000","last_clean":"2024-04-26T12:53:53.188694+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:53.188694+0000","last_undegraded":"2024-04-26T12:53:53.188694+0000","last_fullsized":"2024-04-26T12:53:53.188694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.188457+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.177200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.819752+0000","last_change":"2024-04-26T12:49:54.240647+0000","last_active":"2024-04-26T12:53:20.819752+0000","last_peered":"2024-04-26T12:53:20.819752+0000","last_clean":"2024-04-26T12:53:20.819752+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:53:20.819752+0000","last_undegraded":"2024-04-26T12:53:20.819752+0000","last_fullsized":"2024-04-26T12:53:20.819752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.458918+0000","last_change":"2024-04-26T12:53:58.458983+0000","last_active":"2024-04-26T12:53:58.458918+0000","last_peered":"2024-04-26T12:53:58.458918+0000","last_clean":"2024-04-26T12:53:58.458918+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:53:58.458918+0000","last_undegraded":"2024-04-26T12:53:58.458918+0000","last_fullsized":"2024-04-26T12:53:58.458918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:58.458701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:58.458701+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.458701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:23.882587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.111777+0000","last_change":"2024-04-26T12:54:06.111930+0000","last_active":"2024-04-26T12:54:06.111777+0000","last_peered":"2024-04-26T12:54:06.111777+0000","last_clean":"2024-04-26T12:54:06.111777+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:54:06.111777+0000","last_undegraded":"2024-04-26T12:54:06.111777+0000","last_fullsized":"2024-04-26T12:54:06.111777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:06.111515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:06.111515+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.111515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:15.407080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:15.165902+0000","last_change":"2024-04-26T12:50:34.312404+0000","last_active":"2024-04-26T12:52:15.165902+0000","last_peered":"2024-04-26T12:52:15.165902+0000","last_clean":"2024-04-26T12:52:15.165902+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:52:15.165902+0000","last_undegraded":"2024-04-26T12:52:15.165902+0000","last_fullsized":"2024-04-26T12:52:15.165902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:55.194191+0000","last_clean_scrub_stamp":"2024-04-26T12:49:55.194191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.347748+0000","last_change":"2024-04-26T12:54:10.347824+0000","last_active":"2024-04-26T12:54:10.347748+0000","last_peered":"2024-04-26T12:54:10.347748+0000","last_clean":"2024-04-26T12:54:10.347748+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:54:10.347748+0000","last_undegraded":"2024-04-26T12:54:10.347748+0000","last_fullsized":"2024-04-26T12:54:10.347748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:10.347555+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:10.347555+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.347555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:59.959213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.238813+0000","last_change":"2024-04-26T12:54:00.238882+0000","last_active":"2024-04-26T12:54:00.238813+0000","last_peered":"2024-04-26T12:54:00.238813+0000","last_clean":"2024-04-26T12:54:00.238813+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:54:00.238813+0000","last_undegraded":"2024-04-26T12:54:00.238813+0000","last_fullsized":"2024-04-26T12:54:00.238813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:00.238630+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:00.238630+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.238630+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.241644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.301025+0000","last_change":"2024-04-26T12:54:08.301091+0000","last_active":"2024-04-26T12:54:08.301025+0000","last_peered":"2024-04-26T12:54:08.301025+0000","last_clean":"2024-04-26T12:54:08.301025+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:54:08.301025+0000","last_undegraded":"2024-04-26T12:54:08.301025+0000","last_fullsized":"2024-04-26T12:54:08.301025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:08.300828+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:08.300828+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.300828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:04.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.211868+0000","last_change":"2024-04-26T12:53:41.211925+0000","last_active":"2024-04-26T12:53:41.211868+0000","last_peered":"2024-04-26T12:53:41.211868+0000","last_clean":"2024-04-26T12:53:41.211868+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:41.211868+0000","last_undegraded":"2024-04-26T12:53:41.211868+0000","last_fullsized":"2024-04-26T12:53:41.211868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.211668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:06.215290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965283+0000","last_change":"2024-04-26T12:49:54.252713+0000","last_active":"2024-04-26T12:52:12.965283+0000","last_peered":"2024-04-26T12:52:12.965283+0000","last_clean":"2024-04-26T12:52:12.965283+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:52:12.965283+0000","last_undegraded":"2024-04-26T12:52:12.965283+0000","last_fullsized":"2024-04-26T12:52:12.965283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.141249+0000","last_change":"2024-04-26T12:53:54.141316+0000","last_active":"2024-04-26T12:53:54.141249+0000","last_peered":"2024-04-26T12:53:54.141249+0000","last_clean":"2024-04-26T12:53:54.141249+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:54.141249+0000","last_undegraded":"2024-04-26T12:53:54.141249+0000","last_fullsized":"2024-04-26T12:53:54.141249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.141037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:28.129327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:12.965369+0000","last_change":"2024-04-26T12:49:54.258313+0000","last_active":"2024-04-26T12:52:12.965369+0000","last_peered":"2024-04-26T12:52:12.965369+0000","last_clean":"2024-04-26T12:52:12.965369+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:52:12.965369+0000","last_undegraded":"2024-04-26T12:52:12.965369+0000","last_fullsized":"2024-04-26T12:52:12.965369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.552052+0000","last_change":"2024-04-26T12:54:02.552115+0000","last_active":"2024-04-26T12:54:02.552052+0000","last_peered":"2024-04-26T12:54:02.552052+0000","last_clean":"2024-04-26T12:54:02.552052+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:54:02.552052+0000","last_undegraded":"2024-04-26T12:54:02.552052+0000","last_fullsized":"2024-04-26T12:54:02.552052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:54:02.551851+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:54:02.551851+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.551851+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:15.051310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.914000+0000","last_change":"2024-04-26T12:53:49.914055+0000","last_active":"2024-04-26T12:53:49.914000+0000","last_peered":"2024-04-26T12:53:49.914000+0000","last_clean":"2024-04-26T12:53:49.914000+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:53:49.914000+0000","last_undegraded":"2024-04-26T12:53:49.914000+0000","last_fullsized":"2024-04-26T12:53:49.914000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.913803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:16.913370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.350004+0000","last_change":"2024-04-26T12:54:04.350004+0000","last_active":"2024-04-26T12:54:04.350004+0000","last_peered":"2024-04-26T12:54:04.350004+0000","last_clean":"2024-04-26T12:54:04.350004+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:54:04.350004+0000","last_undegraded":"2024-04-26T12:54:04.350004+0000","last_fullsized":"2024-04-26T12:54:04.350004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:04.349733+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:04.349733+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.349733+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:19.125248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:16.259413+0000","last_change":"2024-04-26T12:49:54.258409+0000","last_active":"2024-04-26T12:53:16.259413+0000","last_peered":"2024-04-26T12:53:16.259413+0000","last_clean":"2024-04-26T12:53:16.259413+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:53:16.259413+0000","last_undegraded":"2024-04-26T12:53:16.259413+0000","last_fullsized":"2024-04-26T12:53:16.259413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:17.966444+0000","last_change":"2024-04-26T12:49:54.241113+0000","last_active":"2024-04-26T12:52:17.966444+0000","last_peered":"2024-04-26T12:52:17.966444+0000","last_clean":"2024-04-26T12:52:17.966444+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:52:17.966444+0000","last_undegraded":"2024-04-26T12:52:17.966444+0000","last_fullsized":"2024-04-26T12:52:17.966444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.297136+0000","last_change":"2024-04-26T12:53:47.297203+0000","last_active":"2024-04-26T12:53:47.297136+0000","last_peered":"2024-04-26T12:53:47.297136+0000","last_clean":"2024-04-26T12:53:47.297136+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:47.297136+0000","last_undegraded":"2024-04-26T12:53:47.297136+0000","last_fullsized":"2024-04-26T12:53:47.297136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.296913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:39.557010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.257485+0000","last_change":"2024-04-26T12:53:52.257555+0000","last_active":"2024-04-26T12:53:52.257485+0000","last_peered":"2024-04-26T12:53:52.257485+0000","last_clean":"2024-04-26T12:53:52.257485+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:53:52.257485+0000","last_undegraded":"2024-04-26T12:53:52.257485+0000","last_fullsized":"2024-04-26T12:53:52.257485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.257248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:36.650269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.154392+0000","last_change":"2024-04-26T12:53:47.154450+0000","last_active":"2024-04-26T12:53:47.154392+0000","last_peered":"2024-04-26T12:53:47.154392+0000","last_clean":"2024-04-26T12:53:47.154392+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:53:47.154392+0000","last_undegraded":"2024-04-26T12:53:47.154392+0000","last_fullsized":"2024-04-26T12:53:47.154392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.154181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:47.175281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":153627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640316,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1015808,"data_stored":740708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640316,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1040384,"data_stored":740685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":458752,"data_stored":152990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:54:22.475 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.475 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.475 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.475 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.475 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.476 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.476 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.476 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.476 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.477 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.477 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.477 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.477 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.477 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.477 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.478 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.478 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.478 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.478 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.478 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:49:43.942632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=43, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.478 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.479 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.479 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.479 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.479 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.480 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.480 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.480 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.480 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.480 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.481 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:49:55.194191+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=55, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.481 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.481 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.481 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.481 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:22.481 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:54:42.483 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:54:42.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.613+0000 7fdede1f8640 1 Processor -- start 2024-04-26T12:54:42.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.613+0000 7fdede1f8640 1 -- start start 2024-04-26T12:54:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fdede1f8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fded80939f0 0x7fded8093dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fdede1f8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded809d410 con 0x7fded8094cb0 2024-04-26T12:54:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fdede1f8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fded8093360 con 0x7fded80939f0 2024-04-26T12:54:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fded8094cb0 0x7fded812c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:59078/0 (socket says 172.21.15.29:59078) 2024-04-26T12:54:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded6ffd640 1 -- 172.21.15.29:0/3630621580 learned_addr learned my addr 172.21.15.29:0/3630621580 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:54:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fded80939f0 0x7fded8093dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded67fc640 1 -- 172.21.15.29:0/3630621580 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251709621 0 0) 0x7fded809d410 con 0x7fded8094cb0 2024-04-26T12:54:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded67fc640 1 -- 172.21.15.29:0/3630621580 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec4003530 con 0x7fded8094cb0 2024-04-26T12:54:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded77fe640 1 -- 172.21.15.29:0/3630621580 >> v1:172.21.15.29:6789/0 conn(0x7fded8094cb0 legacy=0x7fded812c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded77fe640 1 -- 172.21.15.29:0/3630621580 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded80969b0 con 0x7fded80939f0 2024-04-26T12:54:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded77fe640 1 --2- 172.21.15.29:0/3630621580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded8093dd0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009d90 tx=0x7fdec801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4456c346270290ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded67fc640 1 -- 172.21.15.29:0/3630621580 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec80b2070 con 0x7fded80939f0 2024-04-26T12:54:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded67fc640 1 -- 172.21.15.29:0/3630621580 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec80a5740 con 0x7fded80939f0 2024-04-26T12:54:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.617+0000 7fded67fc640 1 -- 172.21.15.29:0/3630621580 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec80a5a40 con 0x7fded80939f0 2024-04-26T12:54:42.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/3630621580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 msgr2=0x7fded8093dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:42.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 --2- 172.21.15.29:0/3630621580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded8093dd0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009d90 tx=0x7fdec801c8c0 comp rx=0 tx=0).stop 2024-04-26T12:54:42.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/3630621580 shutdown_connections 2024-04-26T12:54:42.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 --2- 172.21.15.29:0/3630621580 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded8093dd0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:42.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/3630621580 >> 172.21.15.29:0/3630621580 conn(0x7fded809a3f0 msgr2=0x7fded809a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:54:42.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/3630621580 shutdown_connections 2024-04-26T12:54:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/3630621580 wait complete. 2024-04-26T12:54:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 Processor -- start 2024-04-26T12:54:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- start start 2024-04-26T12:54:42.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded81c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:42.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fded8134e60 con 0x7fded80939f0 2024-04-26T12:54:42.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fded77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded81c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:42.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fded77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded81c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45100/0 (socket says 172.21.15.29:45100) 2024-04-26T12:54:42.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fded77fe640 1 -- 172.21.15.29:0/1410632065 learned_addr learned my addr 172.21.15.29:0/1410632065 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:54:42.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fded77fe640 1 -- 172.21.15.29:0/1410632065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded808b140 con 0x7fded80939f0 2024-04-26T12:54:42.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fded77fe640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded81c4010 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fdec801a4f0 tx=0x7fdec8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:42.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdecffff640 1 -- 172.21.15.29:0/1410632065 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec80bd020 con 0x7fded80939f0 2024-04-26T12:54:42.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdecffff640 1 -- 172.21.15.29:0/1410632065 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec80ad770 con 0x7fded80939f0 2024-04-26T12:54:42.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded8073140 con 0x7fded80939f0 2024-04-26T12:54:42.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdecffff640 1 -- 172.21.15.29:0/1410632065 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec80b2040 con 0x7fded80939f0 2024-04-26T12:54:42.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded808c100 con 0x7fded80939f0 2024-04-26T12:54:42.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdecffff640 1 -- 172.21.15.29:0/1410632065 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdec80c0020 con 0x7fded80939f0 2024-04-26T12:54:42.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded8062f80 con 0x7fded80939f0 2024-04-26T12:54:42.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.621+0000 7fdecffff640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fdeb8035db0 0x7fdeb8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:54:42.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.625+0000 7fdecffff640 1 -- 172.21.15.29:0/1410632065 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7fdec80e4370 con 0x7fded80939f0 2024-04-26T12:54:42.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.625+0000 7fded6ffd640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fdeb8035db0 0x7fdeb8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:54:42.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.625+0000 7fded6ffd640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fdeb8035db0 0x7fdeb8038270 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fd0 tx=0x7fded0007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:54:42.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.629+0000 7fdecffff640 1 -- 172.21.15.29:0/1410632065 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdec80c7030 con 0x7fded80939f0 2024-04-26T12:54:42.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.781+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fded8073890 con 0x7fdeb8035db0 2024-04-26T12:54:42.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.825+0000 7fdecffff640 1 -- 172.21.15.29:0/1410632065 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665694 (secure 0 0 0) 0x7fded8073890 con 0x7fdeb8035db0 2024-04-26T12:54:42.835 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:54:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:54:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fdeb8035db0 msgr2=0x7fdeb8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fdeb8035db0 0x7fdeb8038270 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fd0 tx=0x7fded0007980 comp rx=0 tx=0).stop 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 msgr2=0x7fded81c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded81c4010 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fdec801a4f0 tx=0x7fdec8019660 comp rx=0 tx=0).stop 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 shutdown_connections 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7fdeb8035db0 0x7fdeb8038270 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 --2- 172.21.15.29:0/1410632065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fded80939f0 0x7fded81c4010 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 >> 172.21.15.29:0/1410632065 conn(0x7fded809a3f0 msgr2=0x7fded8131360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 shutdown_connections 2024-04-26T12:54:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:54:42.833+0000 7fdede1f8640 1 -- 172.21.15.29:0/1410632065 wait complete. 2024-04-26T12:54:42.856 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-04-26T12:54:41.280009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4786,"ondisk_log_size":4786,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152600,"kb_used_data":2936,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334760,"statfs":{"total":386547056640,"available":386390794240,"internally_reserved":0,"allocated":3006464,"data_stored":1788010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":153216787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006846"},"pg_stats":[{"pgid":"3.3f","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.101579+0000","last_change":"2024-04-26T12:54:05.101579+0000","last_active":"2024-04-26T12:54:05.101579+0000","last_peered":"2024-04-26T12:54:05.101579+0000","last_clean":"2024-04-26T12:54:05.101579+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:54:05.101579+0000","last_undegraded":"2024-04-26T12:54:05.101579+0000","last_fullsized":"2024-04-26T12:54:05.101579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:05.101171+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:05.101171+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.101171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:33.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.180121+0000","last_change":"2024-04-26T12:53:50.180182+0000","last_active":"2024-04-26T12:53:50.180121+0000","last_peered":"2024-04-26T12:53:50.180121+0000","last_clean":"2024-04-26T12:53:50.180121+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:53:50.180121+0000","last_undegraded":"2024-04-26T12:53:50.180121+0000","last_fullsized":"2024-04-26T12:53:50.180121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.179924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:48.519706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.094761+0000","last_change":"2024-04-26T12:54:11.094820+0000","last_active":"2024-04-26T12:54:11.094761+0000","last_peered":"2024-04-26T12:54:11.094761+0000","last_clean":"2024-04-26T12:54:11.094761+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:54:11.094761+0000","last_undegraded":"2024-04-26T12:54:11.094761+0000","last_fullsized":"2024-04-26T12:54:11.094761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:11.094551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:11.094551+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.094551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:33.971975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.437987+0000","last_change":"2024-04-26T12:54:07.438155+0000","last_active":"2024-04-26T12:54:07.437987+0000","last_peered":"2024-04-26T12:54:07.437987+0000","last_clean":"2024-04-26T12:54:07.437987+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:54:07.437987+0000","last_undegraded":"2024-04-26T12:54:07.437987+0000","last_fullsized":"2024-04-26T12:54:07.437987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:07.437770+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:07.437770+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.437770+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:25.917131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.613235+0000","last_change":"2024-04-26T12:54:14.613301+0000","last_active":"2024-04-26T12:54:14.613235+0000","last_peered":"2024-04-26T12:54:14.613235+0000","last_clean":"2024-04-26T12:54:14.613235+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:54:14.613235+0000","last_undegraded":"2024-04-26T12:54:14.613235+0000","last_fullsized":"2024-04-26T12:54:14.613235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:14.613017+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:14.613017+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.613017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:01.524008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.501855+0000","last_change":"2024-04-26T12:53:55.501925+0000","last_active":"2024-04-26T12:53:55.501855+0000","last_peered":"2024-04-26T12:53:55.501855+0000","last_clean":"2024-04-26T12:53:55.501855+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:55.501855+0000","last_undegraded":"2024-04-26T12:53:55.501855+0000","last_fullsized":"2024-04-26T12:53:55.501855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.501661+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:47.218244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.030404+0000","last_change":"2024-04-26T12:53:58.030471+0000","last_active":"2024-04-26T12:53:58.030404+0000","last_peered":"2024-04-26T12:53:58.030404+0000","last_clean":"2024-04-26T12:53:58.030404+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:53:58.030404+0000","last_undegraded":"2024-04-26T12:53:58.030404+0000","last_fullsized":"2024-04-26T12:53:58.030404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:58.030190+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:58.030190+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.030190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:58.883912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.156618+0000","last_change":"2024-04-26T12:54:13.156680+0000","last_active":"2024-04-26T12:54:13.156618+0000","last_peered":"2024-04-26T12:54:13.156618+0000","last_clean":"2024-04-26T12:54:13.156618+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:54:13.156618+0000","last_undegraded":"2024-04-26T12:54:13.156618+0000","last_fullsized":"2024-04-26T12:54:13.156618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:54:13.156427+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:54:13.156427+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.156427+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:11.918711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:28.549089+0000","last_change":"2024-04-26T12:54:28.549235+0000","last_active":"2024-04-26T12:54:28.549089+0000","last_peered":"2024-04-26T12:54:28.549089+0000","last_clean":"2024-04-26T12:54:28.549089+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:54:28.549089+0000","last_undegraded":"2024-04-26T12:54:28.549089+0000","last_fullsized":"2024-04-26T12:54:28.549089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:28.548748+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:28.548748+0000","last_clean_scrub_stamp":"2024-04-26T12:54:28.548748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:00.030263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.425667+0000","last_change":"2024-04-26T12:54:14.425735+0000","last_active":"2024-04-26T12:54:14.425667+0000","last_peered":"2024-04-26T12:54:14.425667+0000","last_clean":"2024-04-26T12:54:14.425667+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:54:14.425667+0000","last_undegraded":"2024-04-26T12:54:14.425667+0000","last_fullsized":"2024-04-26T12:54:14.425667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:14.425453+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:14.425453+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.425453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:33.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.087640+0000","last_change":"2024-04-26T12:54:03.087785+0000","last_active":"2024-04-26T12:54:03.087640+0000","last_peered":"2024-04-26T12:54:03.087640+0000","last_clean":"2024-04-26T12:54:03.087640+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:54:03.087640+0000","last_undegraded":"2024-04-26T12:54:03.087640+0000","last_fullsized":"2024-04-26T12:54:03.087640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:03.087384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:03.087384+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.087384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:15.190060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.551347+0000","last_change":"2024-04-26T12:54:00.551347+0000","last_active":"2024-04-26T12:54:00.551347+0000","last_peered":"2024-04-26T12:54:00.551347+0000","last_clean":"2024-04-26T12:54:00.551347+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:54:00.551347+0000","last_undegraded":"2024-04-26T12:54:00.551347+0000","last_fullsized":"2024-04-26T12:54:00.551347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:00.551092+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:00.551092+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.551092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:09.956495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:24.498118+0000","last_change":"2024-04-26T12:54:24.498190+0000","last_active":"2024-04-26T12:54:24.498118+0000","last_peered":"2024-04-26T12:54:24.498118+0000","last_clean":"2024-04-26T12:54:24.498118+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:54:24.498118+0000","last_undegraded":"2024-04-26T12:54:24.498118+0000","last_fullsized":"2024-04-26T12:54:24.498118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:24.497863+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:24.497863+0000","last_clean_scrub_stamp":"2024-04-26T12:54:24.497863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:35.575426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.002599+0000","last_change":"2024-04-26T12:53:57.002599+0000","last_active":"2024-04-26T12:53:57.002599+0000","last_peered":"2024-04-26T12:53:57.002599+0000","last_clean":"2024-04-26T12:53:57.002599+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:57.002599+0000","last_undegraded":"2024-04-26T12:53:57.002599+0000","last_fullsized":"2024-04-26T12:53:57.002599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.002331+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:55.456014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.057740+0000","last_change":"2024-04-26T12:54:13.057862+0000","last_active":"2024-04-26T12:54:13.057740+0000","last_peered":"2024-04-26T12:54:13.057740+0000","last_clean":"2024-04-26T12:54:13.057740+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:54:13.057740+0000","last_undegraded":"2024-04-26T12:54:13.057740+0000","last_fullsized":"2024-04-26T12:54:13.057740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:13.057507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:13.057507+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.057507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:20.511598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.035799+0000","last_change":"2024-04-26T12:53:45.035799+0000","last_active":"2024-04-26T12:53:45.035799+0000","last_peered":"2024-04-26T12:53:45.035799+0000","last_clean":"2024-04-26T12:53:45.035799+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:53:45.035799+0000","last_undegraded":"2024-04-26T12:53:45.035799+0000","last_fullsized":"2024-04-26T12:53:45.035799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.035418+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:47.435437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.531865+0000","last_change":"2024-04-26T12:54:10.531865+0000","last_active":"2024-04-26T12:54:10.531865+0000","last_peered":"2024-04-26T12:54:10.531865+0000","last_clean":"2024-04-26T12:54:10.531865+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:54:10.531865+0000","last_undegraded":"2024-04-26T12:54:10.531865+0000","last_fullsized":"2024-04-26T12:54:10.531865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:10.531604+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:10.531604+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.531604+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:00.093217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.186182+0000","last_change":"2024-04-26T12:53:59.186243+0000","last_active":"2024-04-26T12:53:59.186182+0000","last_peered":"2024-04-26T12:53:59.186182+0000","last_clean":"2024-04-26T12:53:59.186182+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:53:59.186182+0000","last_undegraded":"2024-04-26T12:53:59.186182+0000","last_fullsized":"2024-04-26T12:53:59.186182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:59.185989+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:59.185989+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.185989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:01.086515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.168771+0000","last_change":"2024-04-26T12:53:51.168771+0000","last_active":"2024-04-26T12:53:51.168771+0000","last_peered":"2024-04-26T12:53:51.168771+0000","last_clean":"2024-04-26T12:53:51.168771+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:51.168771+0000","last_undegraded":"2024-04-26T12:53:51.168771+0000","last_fullsized":"2024-04-26T12:53:51.168771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.168499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:07.181751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.966465+0000","last_change":"2024-04-26T12:53:47.966602+0000","last_active":"2024-04-26T12:53:47.966465+0000","last_peered":"2024-04-26T12:53:47.966465+0000","last_clean":"2024-04-26T12:53:47.966465+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:53:47.966465+0000","last_undegraded":"2024-04-26T12:53:47.966465+0000","last_fullsized":"2024-04-26T12:53:47.966465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.966229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:14.686968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.162532+0000","last_change":"2024-04-26T12:53:52.162532+0000","last_active":"2024-04-26T12:53:52.162532+0000","last_peered":"2024-04-26T12:53:52.162532+0000","last_clean":"2024-04-26T12:53:52.162532+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:52.162532+0000","last_undegraded":"2024-04-26T12:53:52.162532+0000","last_fullsized":"2024-04-26T12:53:52.162532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.162284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:06.228081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.317985+0000","last_change":"2024-04-26T12:54:03.318049+0000","last_active":"2024-04-26T12:54:03.317985+0000","last_peered":"2024-04-26T12:54:03.317985+0000","last_clean":"2024-04-26T12:54:03.317985+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:54:03.317985+0000","last_undegraded":"2024-04-26T12:54:03.317985+0000","last_fullsized":"2024-04-26T12:54:03.317985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:03.317789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:03.317789+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.317789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:02.080072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.098851+0000","last_change":"2024-04-26T12:54:01.098985+0000","last_active":"2024-04-26T12:54:01.098851+0000","last_peered":"2024-04-26T12:54:01.098851+0000","last_clean":"2024-04-26T12:54:01.098851+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:54:01.098851+0000","last_undegraded":"2024-04-26T12:54:01.098851+0000","last_fullsized":"2024-04-26T12:54:01.098851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:01.098623+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:01.098623+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.098623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:43.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.171211+0000","last_change":"2024-04-26T12:53:57.171275+0000","last_active":"2024-04-26T12:53:57.171211+0000","last_peered":"2024-04-26T12:53:57.171211+0000","last_clean":"2024-04-26T12:53:57.171211+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:57.171211+0000","last_undegraded":"2024-04-26T12:53:57.171211+0000","last_fullsized":"2024-04-26T12:53:57.171211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.171024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:17.576384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.937879+0000","last_change":"2024-04-26T12:53:48.937942+0000","last_active":"2024-04-26T12:53:48.937879+0000","last_peered":"2024-04-26T12:53:48.937879+0000","last_clean":"2024-04-26T12:53:48.937879+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:53:48.937879+0000","last_undegraded":"2024-04-26T12:53:48.937879+0000","last_fullsized":"2024-04-26T12:53:48.937879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.937678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:30.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.050730+0000","last_change":"2024-04-26T12:54:12.050791+0000","last_active":"2024-04-26T12:54:12.050730+0000","last_peered":"2024-04-26T12:54:12.050730+0000","last_clean":"2024-04-26T12:54:12.050730+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:54:12.050730+0000","last_undegraded":"2024-04-26T12:54:12.050730+0000","last_fullsized":"2024-04-26T12:54:12.050730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.050528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.050528+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.050528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:40.968443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.155704+0000","last_change":"2024-04-26T12:53:58.155762+0000","last_active":"2024-04-26T12:53:58.155704+0000","last_peered":"2024-04-26T12:53:58.155704+0000","last_clean":"2024-04-26T12:53:58.155704+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:58.155704+0000","last_undegraded":"2024-04-26T12:53:58.155704+0000","last_fullsized":"2024-04-26T12:53:58.155704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:58.155520+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:58.155520+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.155520+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:26.909565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:36.524202+0000","last_change":"2024-04-26T12:54:36.524202+0000","last_active":"2024-04-26T12:54:36.524202+0000","last_peered":"2024-04-26T12:54:36.524202+0000","last_clean":"2024-04-26T12:54:36.524202+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:54:36.524202+0000","last_undegraded":"2024-04-26T12:54:36.524202+0000","last_fullsized":"2024-04-26T12:54:36.524202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:36.523926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:36.523926+0000","last_clean_scrub_stamp":"2024-04-26T12:54:36.523926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:26.991669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'36","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:18.420847+0000","last_change":"2024-04-26T12:54:18.420916+0000","last_active":"2024-04-26T12:54:18.420847+0000","last_peered":"2024-04-26T12:54:18.420847+0000","last_clean":"2024-04-26T12:54:18.420847+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:54:18.420847+0000","last_undegraded":"2024-04-26T12:54:18.420847+0000","last_fullsized":"2024-04-26T12:54:18.420847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:54:18.420643+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:54:18.420643+0000","last_clean_scrub_stamp":"2024-04-26T12:54:18.420643+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:51.430543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.415428+0000","last_change":"2024-04-26T12:53:39.415428+0000","last_active":"2024-04-26T12:53:39.415428+0000","last_peered":"2024-04-26T12:53:39.415428+0000","last_clean":"2024-04-26T12:53:39.415428+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:53:39.415428+0000","last_undegraded":"2024-04-26T12:53:39.415428+0000","last_fullsized":"2024-04-26T12:53:39.415428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.415162+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:24.418176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:25.519453+0000","last_change":"2024-04-26T12:54:25.519453+0000","last_active":"2024-04-26T12:54:25.519453+0000","last_peered":"2024-04-26T12:54:25.519453+0000","last_clean":"2024-04-26T12:54:25.519453+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:54:25.519453+0000","last_undegraded":"2024-04-26T12:54:25.519453+0000","last_fullsized":"2024-04-26T12:54:25.519453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:25.519096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:25.519096+0000","last_clean_scrub_stamp":"2024-04-26T12:54:25.519096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:27.622842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.392070+0000","last_change":"2024-04-26T12:53:23.392134+0000","last_active":"2024-04-26T12:53:23.392070+0000","last_peered":"2024-04-26T12:53:23.392070+0000","last_clean":"2024-04-26T12:53:23.392070+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:53:23.392070+0000","last_undegraded":"2024-04-26T12:53:23.392070+0000","last_fullsized":"2024-04-26T12:53:23.392070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.391874+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:06.575701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.391893+0000","last_change":"2024-04-26T12:53:37.391968+0000","last_active":"2024-04-26T12:53:37.391893+0000","last_peered":"2024-04-26T12:53:37.391893+0000","last_clean":"2024-04-26T12:53:37.391893+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:53:37.391893+0000","last_undegraded":"2024-04-26T12:53:37.391893+0000","last_fullsized":"2024-04-26T12:53:37.391893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.391713+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:06.145759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.193575+0000","last_change":"2024-04-26T12:53:40.193637+0000","last_active":"2024-04-26T12:53:40.193575+0000","last_peered":"2024-04-26T12:53:40.193575+0000","last_clean":"2024-04-26T12:53:40.193575+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:53:40.193575+0000","last_undegraded":"2024-04-26T12:53:40.193575+0000","last_fullsized":"2024-04-26T12:53:40.193575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.193370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:21.524309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.378848+0000","last_change":"2024-04-26T12:54:17.378906+0000","last_active":"2024-04-26T12:54:17.378848+0000","last_peered":"2024-04-26T12:54:17.378848+0000","last_clean":"2024-04-26T12:54:17.378848+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:54:17.378848+0000","last_undegraded":"2024-04-26T12:54:17.378848+0000","last_fullsized":"2024-04-26T12:54:17.378848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-04-26T12:54:17.378654+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-04-26T12:54:17.378654+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.378654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:43.119977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.384124+0000","last_change":"2024-04-26T12:53:36.384186+0000","last_active":"2024-04-26T12:53:36.384124+0000","last_peered":"2024-04-26T12:53:36.384124+0000","last_clean":"2024-04-26T12:53:36.384124+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:36.384124+0000","last_undegraded":"2024-04-26T12:53:36.384124+0000","last_fullsized":"2024-04-26T12:53:36.384124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.383922+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:56.789282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.087214+0000","last_change":"2024-04-26T12:54:02.087214+0000","last_active":"2024-04-26T12:54:02.087214+0000","last_peered":"2024-04-26T12:54:02.087214+0000","last_clean":"2024-04-26T12:54:02.087214+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:54:02.087214+0000","last_undegraded":"2024-04-26T12:54:02.087214+0000","last_fullsized":"2024-04-26T12:54:02.087214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:02.086942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:02.086942+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.086942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.033899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.280249+0000","last_change":"2024-04-26T12:53:44.280249+0000","last_active":"2024-04-26T12:53:44.280249+0000","last_peered":"2024-04-26T12:53:44.280249+0000","last_clean":"2024-04-26T12:53:44.280249+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:53:44.280249+0000","last_undegraded":"2024-04-26T12:53:44.280249+0000","last_fullsized":"2024-04-26T12:53:44.280249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.279907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:46.896122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.076724+0000","last_change":"2024-04-26T12:53:23.076800+0000","last_active":"2024-04-26T12:53:23.076724+0000","last_peered":"2024-04-26T12:53:23.076724+0000","last_clean":"2024-04-26T12:53:23.076724+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:53:23.076724+0000","last_undegraded":"2024-04-26T12:53:23.076724+0000","last_fullsized":"2024-04-26T12:53:23.076724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.076513+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:18.548345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.104710+0000","last_change":"2024-04-26T12:53:32.104841+0000","last_active":"2024-04-26T12:53:32.104710+0000","last_peered":"2024-04-26T12:53:32.104710+0000","last_clean":"2024-04-26T12:53:32.104710+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:53:32.104710+0000","last_undegraded":"2024-04-26T12:53:32.104710+0000","last_fullsized":"2024-04-26T12:53:32.104710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.104460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:40.209749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.037640+0000","last_change":"2024-04-26T12:54:16.037705+0000","last_active":"2024-04-26T12:54:16.037640+0000","last_peered":"2024-04-26T12:54:16.037640+0000","last_clean":"2024-04-26T12:54:16.037640+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:54:16.037640+0000","last_undegraded":"2024-04-26T12:54:16.037640+0000","last_fullsized":"2024-04-26T12:54:16.037640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:16.037432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:16.037432+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.037432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:31.763516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.411066+0000","last_change":"2024-04-26T12:53:42.411216+0000","last_active":"2024-04-26T12:53:42.411066+0000","last_peered":"2024-04-26T12:53:42.411066+0000","last_clean":"2024-04-26T12:53:42.411066+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:53:42.411066+0000","last_undegraded":"2024-04-26T12:53:42.411066+0000","last_fullsized":"2024-04-26T12:53:42.411066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.410832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:41.173115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:26.489340+0000","last_change":"2024-04-26T12:54:26.489340+0000","last_active":"2024-04-26T12:54:26.489340+0000","last_peered":"2024-04-26T12:54:26.489340+0000","last_clean":"2024-04-26T12:54:26.489340+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:54:26.489340+0000","last_undegraded":"2024-04-26T12:54:26.489340+0000","last_fullsized":"2024-04-26T12:54:26.489340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:26.489052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:26.489052+0000","last_clean_scrub_stamp":"2024-04-26T12:54:26.489052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:12.187052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.256223+0000","last_change":"2024-04-26T12:53:40.256277+0000","last_active":"2024-04-26T12:53:40.256223+0000","last_peered":"2024-04-26T12:53:40.256223+0000","last_clean":"2024-04-26T12:53:40.256223+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:53:40.256223+0000","last_undegraded":"2024-04-26T12:53:40.256223+0000","last_fullsized":"2024-04-26T12:53:40.256223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.256017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:51.409965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.735659+0000","last_change":"2024-04-26T12:53:25.735736+0000","last_active":"2024-04-26T12:53:25.735659+0000","last_peered":"2024-04-26T12:53:25.735659+0000","last_clean":"2024-04-26T12:53:25.735659+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:53:25.735659+0000","last_undegraded":"2024-04-26T12:53:25.735659+0000","last_fullsized":"2024-04-26T12:53:25.735659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.735419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.323105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":399,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.468422+0000","last_change":"2024-04-26T12:53:57.468486+0000","last_active":"2024-04-26T12:53:57.468422+0000","last_peered":"2024-04-26T12:53:57.468422+0000","last_clean":"2024-04-26T12:53:57.468422+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:57.468422+0000","last_undegraded":"2024-04-26T12:53:57.468422+0000","last_fullsized":"2024-04-26T12:53:57.468422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.468221+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:49.873023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.945880+0000","last_change":"2024-04-26T12:53:40.945988+0000","last_active":"2024-04-26T12:53:40.945880+0000","last_peered":"2024-04-26T12:53:40.945880+0000","last_clean":"2024-04-26T12:53:40.945880+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:53:40.945880+0000","last_undegraded":"2024-04-26T12:53:40.945880+0000","last_fullsized":"2024-04-26T12:53:40.945880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.945653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:49.050942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.286893+0000","last_change":"2024-04-26T12:53:48.286965+0000","last_active":"2024-04-26T12:53:48.286893+0000","last_peered":"2024-04-26T12:53:48.286893+0000","last_clean":"2024-04-26T12:53:48.286893+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:48.286893+0000","last_undegraded":"2024-04-26T12:53:48.286893+0000","last_fullsized":"2024-04-26T12:53:48.286893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.286688+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:28.578485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.318456+0000","last_change":"2024-04-26T12:54:09.318456+0000","last_active":"2024-04-26T12:54:09.318456+0000","last_peered":"2024-04-26T12:54:09.318456+0000","last_clean":"2024-04-26T12:54:09.318456+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:54:09.318456+0000","last_undegraded":"2024-04-26T12:54:09.318456+0000","last_fullsized":"2024-04-26T12:54:09.318456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:09.318195+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:09.318195+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.318195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:41.368120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.380805+0000","last_change":"2024-04-26T12:53:22.380865+0000","last_active":"2024-04-26T12:53:22.380805+0000","last_peered":"2024-04-26T12:53:22.380805+0000","last_clean":"2024-04-26T12:53:22.380805+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:53:22.380805+0000","last_undegraded":"2024-04-26T12:53:22.380805+0000","last_fullsized":"2024-04-26T12:53:22.380805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.380528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.319667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.752160+0000","last_change":"2024-04-26T12:53:26.752246+0000","last_active":"2024-04-26T12:53:26.752160+0000","last_peered":"2024-04-26T12:53:26.752160+0000","last_clean":"2024-04-26T12:53:26.752160+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:53:26.752160+0000","last_undegraded":"2024-04-26T12:53:26.752160+0000","last_fullsized":"2024-04-26T12:53:26.752160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.751972+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:59.415047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":414,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.264797+0000","last_change":"2024-04-26T12:53:27.264864+0000","last_active":"2024-04-26T12:53:27.264797+0000","last_peered":"2024-04-26T12:53:27.264797+0000","last_clean":"2024-04-26T12:53:27.264797+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:27.264797+0000","last_undegraded":"2024-04-26T12:53:27.264797+0000","last_fullsized":"2024-04-26T12:53:27.264797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.264595+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:14.426766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.474657+0000","last_change":"2024-04-26T12:54:04.474657+0000","last_active":"2024-04-26T12:54:04.474657+0000","last_peered":"2024-04-26T12:54:04.474657+0000","last_clean":"2024-04-26T12:54:04.474657+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:54:04.474657+0000","last_undegraded":"2024-04-26T12:54:04.474657+0000","last_fullsized":"2024-04-26T12:54:04.474657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:04.474241+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:04.474241+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.474241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:19.601202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.092120+0000","last_change":"2024-04-26T12:54:04.092120+0000","last_active":"2024-04-26T12:54:04.092120+0000","last_peered":"2024-04-26T12:54:04.092120+0000","last_clean":"2024-04-26T12:54:04.092120+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:54:04.092120+0000","last_undegraded":"2024-04-26T12:54:04.092120+0000","last_fullsized":"2024-04-26T12:54:04.092120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:04.091919+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:04.091919+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.091919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:38.080209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.034874+0000","last_change":"2024-04-26T12:53:29.034874+0000","last_active":"2024-04-26T12:53:29.034874+0000","last_peered":"2024-04-26T12:53:29.034874+0000","last_clean":"2024-04-26T12:53:29.034874+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:53:29.034874+0000","last_undegraded":"2024-04-26T12:53:29.034874+0000","last_fullsized":"2024-04-26T12:53:29.034874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.034638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:13.359122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.842323+0000","last_change":"2024-04-26T12:53:33.842323+0000","last_active":"2024-04-26T12:53:33.842323+0000","last_peered":"2024-04-26T12:53:33.842323+0000","last_clean":"2024-04-26T12:53:33.842323+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:53:33.842323+0000","last_undegraded":"2024-04-26T12:53:33.842323+0000","last_fullsized":"2024-04-26T12:53:33.842323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.842014+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.029425+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.367753+0000","last_change":"2024-04-26T12:53:20.367753+0000","last_active":"2024-04-26T12:53:20.367753+0000","last_peered":"2024-04-26T12:53:20.367753+0000","last_clean":"2024-04-26T12:53:20.367753+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:53:20.367753+0000","last_undegraded":"2024-04-26T12:53:20.367753+0000","last_fullsized":"2024-04-26T12:53:20.367753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.367584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:03.848633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.144579+0000","last_change":"2024-04-26T12:54:10.144579+0000","last_active":"2024-04-26T12:54:10.144579+0000","last_peered":"2024-04-26T12:54:10.144579+0000","last_clean":"2024-04-26T12:54:10.144579+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:54:10.144579+0000","last_undegraded":"2024-04-26T12:54:10.144579+0000","last_fullsized":"2024-04-26T12:54:10.144579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:54:10.144359+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:54:10.144359+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.144359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:01.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.125068+0000","last_change":"2024-04-26T12:53:56.125068+0000","last_active":"2024-04-26T12:53:56.125068+0000","last_peered":"2024-04-26T12:53:56.125068+0000","last_clean":"2024-04-26T12:53:56.125068+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:53:56.125068+0000","last_undegraded":"2024-04-26T12:53:56.125068+0000","last_fullsized":"2024-04-26T12:53:56.125068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.124818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:33.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.971631+0000","last_change":"2024-04-26T12:53:55.971631+0000","last_active":"2024-04-26T12:53:55.971631+0000","last_peered":"2024-04-26T12:53:55.971631+0000","last_clean":"2024-04-26T12:53:55.971631+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:53:55.971631+0000","last_undegraded":"2024-04-26T12:53:55.971631+0000","last_fullsized":"2024-04-26T12:53:55.971631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.971365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:55.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.210108+0000","last_change":"2024-04-26T12:53:39.210108+0000","last_active":"2024-04-26T12:53:39.210108+0000","last_peered":"2024-04-26T12:53:39.210108+0000","last_clean":"2024-04-26T12:53:39.210108+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:53:39.210108+0000","last_undegraded":"2024-04-26T12:53:39.210108+0000","last_fullsized":"2024-04-26T12:53:39.210108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.209817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:09.302793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.322771+0000","last_change":"2024-04-26T12:53:25.322771+0000","last_active":"2024-04-26T12:53:25.322771+0000","last_peered":"2024-04-26T12:53:25.322771+0000","last_clean":"2024-04-26T12:53:25.322771+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:53:25.322771+0000","last_undegraded":"2024-04-26T12:53:25.322771+0000","last_fullsized":"2024-04-26T12:53:25.322771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.322379+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:57.683471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.239150+0000","last_change":"2024-04-26T12:53:33.239150+0000","last_active":"2024-04-26T12:53:33.239150+0000","last_peered":"2024-04-26T12:53:33.239150+0000","last_clean":"2024-04-26T12:53:33.239150+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:53:33.239150+0000","last_undegraded":"2024-04-26T12:53:33.239150+0000","last_fullsized":"2024-04-26T12:53:33.239150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.238876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:14.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'6","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.164922+0000","last_change":"2024-04-26T12:53:48.164922+0000","last_active":"2024-04-26T12:53:48.164922+0000","last_peered":"2024-04-26T12:53:48.164922+0000","last_clean":"2024-04-26T12:53:48.164922+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:53:48.164922+0000","last_undegraded":"2024-04-26T12:53:48.164922+0000","last_fullsized":"2024-04-26T12:53:48.164922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.164674+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:57.350352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.954336+0000","last_change":"2024-04-26T12:53:52.954336+0000","last_active":"2024-04-26T12:53:52.954336+0000","last_peered":"2024-04-26T12:53:52.954336+0000","last_clean":"2024-04-26T12:53:52.954336+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:53:52.954336+0000","last_undegraded":"2024-04-26T12:53:52.954336+0000","last_fullsized":"2024-04-26T12:53:52.954336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.954084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:23.735894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.548671+0000","last_change":"2024-04-26T12:54:17.548671+0000","last_active":"2024-04-26T12:54:17.548671+0000","last_peered":"2024-04-26T12:54:17.548671+0000","last_clean":"2024-04-26T12:54:17.548671+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:54:17.548671+0000","last_undegraded":"2024-04-26T12:54:17.548671+0000","last_fullsized":"2024-04-26T12:54:17.548671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:17.548417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:17.548417+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.548417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:27.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.216552+0000","last_change":"2024-04-26T12:53:36.216552+0000","last_active":"2024-04-26T12:53:36.216552+0000","last_peered":"2024-04-26T12:53:36.216552+0000","last_clean":"2024-04-26T12:53:36.216552+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:53:36.216552+0000","last_undegraded":"2024-04-26T12:53:36.216552+0000","last_fullsized":"2024-04-26T12:53:36.216552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.216285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:41.525193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.550362+0000","last_change":"2024-04-26T12:53:54.550362+0000","last_active":"2024-04-26T12:53:54.550362+0000","last_peered":"2024-04-26T12:53:54.550362+0000","last_clean":"2024-04-26T12:53:54.550362+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:53:54.550362+0000","last_undegraded":"2024-04-26T12:53:54.550362+0000","last_fullsized":"2024-04-26T12:53:54.550362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.550077+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:28.913960+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":362,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.260340+0000","last_change":"2024-04-26T12:53:23.260340+0000","last_active":"2024-04-26T12:53:23.260340+0000","last_peered":"2024-04-26T12:53:23.260340+0000","last_clean":"2024-04-26T12:53:23.260340+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:23.260340+0000","last_undegraded":"2024-04-26T12:53:23.260340+0000","last_fullsized":"2024-04-26T12:53:23.260340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.260077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:08.869807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:19.050474+0000","last_change":"2024-04-26T12:54:19.050474+0000","last_active":"2024-04-26T12:54:19.050474+0000","last_peered":"2024-04-26T12:54:19.050474+0000","last_clean":"2024-04-26T12:54:19.050474+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:54:19.050474+0000","last_undegraded":"2024-04-26T12:54:19.050474+0000","last_fullsized":"2024-04-26T12:54:19.050474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:19.050217+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:19.050217+0000","last_clean_scrub_stamp":"2024-04-26T12:54:19.050217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.578291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.963004+0000","last_change":"2024-04-26T12:53:42.963004+0000","last_active":"2024-04-26T12:53:42.963004+0000","last_peered":"2024-04-26T12:53:42.963004+0000","last_clean":"2024-04-26T12:53:42.963004+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:42.963004+0000","last_undegraded":"2024-04-26T12:53:42.963004+0000","last_fullsized":"2024-04-26T12:53:42.963004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.962751+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:04.429485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.557788+0000","last_change":"2024-04-26T12:54:11.557788+0000","last_active":"2024-04-26T12:54:11.557788+0000","last_peered":"2024-04-26T12:54:11.557788+0000","last_clean":"2024-04-26T12:54:11.557788+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:54:11.557788+0000","last_undegraded":"2024-04-26T12:54:11.557788+0000","last_fullsized":"2024-04-26T12:54:11.557788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:11.557529+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:11.557529+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.557529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:03.013567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.116569+0000","last_change":"2024-04-26T12:54:12.116623+0000","last_active":"2024-04-26T12:54:12.116569+0000","last_peered":"2024-04-26T12:54:12.116569+0000","last_clean":"2024-04-26T12:54:12.116569+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:54:12.116569+0000","last_undegraded":"2024-04-26T12:54:12.116569+0000","last_fullsized":"2024-04-26T12:54:12.116569+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.116369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.116369+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.116369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:47.204045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'65","reported_seq":139,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.301331+0000","last_change":"2024-04-26T12:53:33.301331+0000","last_active":"2024-04-26T12:53:33.301331+0000","last_peered":"2024-04-26T12:53:33.301331+0000","last_clean":"2024-04-26T12:53:33.301331+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:53:33.301331+0000","last_undegraded":"2024-04-26T12:53:33.301331+0000","last_fullsized":"2024-04-26T12:53:33.301331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'65","last_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_deep_scrub":"35'65","last_deep_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.301040+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:07.289330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.319398+0000","last_change":"2024-04-26T12:53:25.319398+0000","last_active":"2024-04-26T12:53:25.319398+0000","last_peered":"2024-04-26T12:53:25.319398+0000","last_clean":"2024-04-26T12:53:25.319398+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:53:25.319398+0000","last_undegraded":"2024-04-26T12:53:25.319398+0000","last_fullsized":"2024-04-26T12:53:25.319398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.319148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:51.725423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'23","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:21.040845+0000","last_change":"2024-04-26T12:54:21.040845+0000","last_active":"2024-04-26T12:54:21.040845+0000","last_peered":"2024-04-26T12:54:21.040845+0000","last_clean":"2024-04-26T12:54:21.040845+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:54:21.040845+0000","last_undegraded":"2024-04-26T12:54:21.040845+0000","last_fullsized":"2024-04-26T12:54:21.040845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:54:21.040581+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:54:21.040581+0000","last_clean_scrub_stamp":"2024-04-26T12:54:21.040581+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:29.501389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.147271+0000","last_change":"2024-04-26T12:53:45.147271+0000","last_active":"2024-04-26T12:53:45.147271+0000","last_peered":"2024-04-26T12:53:45.147271+0000","last_clean":"2024-04-26T12:53:45.147271+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:53:45.147271+0000","last_undegraded":"2024-04-26T12:53:45.147271+0000","last_fullsized":"2024-04-26T12:53:45.147271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.147005+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.360231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.093921+0000","last_change":"2024-04-26T12:54:04.093921+0000","last_active":"2024-04-26T12:54:04.093921+0000","last_peered":"2024-04-26T12:54:04.093921+0000","last_clean":"2024-04-26T12:54:04.093921+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:54:04.093921+0000","last_undegraded":"2024-04-26T12:54:04.093921+0000","last_fullsized":"2024-04-26T12:54:04.093921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:04.093611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:04.093611+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.093611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:06.282666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.821321+0000","last_change":"2024-04-26T12:53:35.821321+0000","last_active":"2024-04-26T12:53:35.821321+0000","last_peered":"2024-04-26T12:53:35.821321+0000","last_clean":"2024-04-26T12:53:35.821321+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:53:35.821321+0000","last_undegraded":"2024-04-26T12:53:35.821321+0000","last_fullsized":"2024-04-26T12:53:35.821321+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.821050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:59.952098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.093504+0000","last_change":"2024-04-26T12:53:26.093504+0000","last_active":"2024-04-26T12:53:26.093504+0000","last_peered":"2024-04-26T12:53:26.093504+0000","last_clean":"2024-04-26T12:53:26.093504+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:53:26.093504+0000","last_undegraded":"2024-04-26T12:53:26.093504+0000","last_fullsized":"2024-04-26T12:53:26.093504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.093081+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:46.353316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.345823+0000","last_change":"2024-04-26T12:53:44.345823+0000","last_active":"2024-04-26T12:53:44.345823+0000","last_peered":"2024-04-26T12:53:44.345823+0000","last_clean":"2024-04-26T12:53:44.345823+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:53:44.345823+0000","last_undegraded":"2024-04-26T12:53:44.345823+0000","last_fullsized":"2024-04-26T12:53:44.345823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.345550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:44.028093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.822266+0000","last_change":"2024-04-26T12:50:04.305542+0000","last_active":"2024-04-26T12:53:20.822266+0000","last_peered":"2024-04-26T12:53:20.822266+0000","last_clean":"2024-04-26T12:53:20.822266+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:53:20.822266+0000","last_undegraded":"2024-04-26T12:53:20.822266+0000","last_fullsized":"2024-04-26T12:53:20.822266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.390424+0000","last_change":"2024-04-26T12:53:40.390424+0000","last_active":"2024-04-26T12:53:40.390424+0000","last_peered":"2024-04-26T12:53:40.390424+0000","last_clean":"2024-04-26T12:53:40.390424+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:40.390424+0000","last_undegraded":"2024-04-26T12:53:40.390424+0000","last_fullsized":"2024-04-26T12:53:40.390424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.390158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:34.578850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:37.498239+0000","last_change":"2024-04-26T12:54:37.498307+0000","last_active":"2024-04-26T12:54:37.498239+0000","last_peered":"2024-04-26T12:54:37.498239+0000","last_clean":"2024-04-26T12:54:37.498239+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:54:37.498239+0000","last_undegraded":"2024-04-26T12:54:37.498239+0000","last_fullsized":"2024-04-26T12:54:37.498239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:37.498037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:37.498037+0000","last_clean_scrub_stamp":"2024-04-26T12:54:37.498037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:39.688926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.184522+0000","last_change":"2024-04-26T12:53:38.184522+0000","last_active":"2024-04-26T12:53:38.184522+0000","last_peered":"2024-04-26T12:53:38.184522+0000","last_clean":"2024-04-26T12:53:38.184522+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:53:38.184522+0000","last_undegraded":"2024-04-26T12:53:38.184522+0000","last_fullsized":"2024-04-26T12:53:38.184522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.184269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:49.731527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.784129+0000","last_change":"2024-04-26T12:53:29.784129+0000","last_active":"2024-04-26T12:53:29.784129+0000","last_peered":"2024-04-26T12:53:29.784129+0000","last_clean":"2024-04-26T12:53:29.784129+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:53:29.784129+0000","last_undegraded":"2024-04-26T12:53:29.784129+0000","last_fullsized":"2024-04-26T12:53:29.784129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.783856+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:02.402474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.700292+0000","last_change":"2024-04-26T12:53:20.700292+0000","last_active":"2024-04-26T12:53:20.700292+0000","last_peered":"2024-04-26T12:53:20.700292+0000","last_clean":"2024-04-26T12:53:20.700292+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:20.700292+0000","last_undegraded":"2024-04-26T12:53:20.700292+0000","last_fullsized":"2024-04-26T12:53:20.700292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.700008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:02.748840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:20.063364+0000","last_change":"2024-04-26T12:54:20.063435+0000","last_active":"2024-04-26T12:54:20.063364+0000","last_peered":"2024-04-26T12:54:20.063364+0000","last_clean":"2024-04-26T12:54:20.063364+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:54:20.063364+0000","last_undegraded":"2024-04-26T12:54:20.063364+0000","last_fullsized":"2024-04-26T12:54:20.063364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:54:20.063162+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:54:20.063162+0000","last_clean_scrub_stamp":"2024-04-26T12:54:20.063162+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:53.641992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.164575+0000","last_change":"2024-04-26T12:54:07.164575+0000","last_active":"2024-04-26T12:54:07.164575+0000","last_peered":"2024-04-26T12:54:07.164575+0000","last_clean":"2024-04-26T12:54:07.164575+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:54:07.164575+0000","last_undegraded":"2024-04-26T12:54:07.164575+0000","last_fullsized":"2024-04-26T12:54:07.164575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:07.164157+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:07.164157+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.164157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:27.569518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:22.475913+0000","last_change":"2024-04-26T12:54:22.475975+0000","last_active":"2024-04-26T12:54:22.475913+0000","last_peered":"2024-04-26T12:54:22.475913+0000","last_clean":"2024-04-26T12:54:22.475913+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:54:22.475913+0000","last_undegraded":"2024-04-26T12:54:22.475913+0000","last_fullsized":"2024-04-26T12:54:22.475913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:22.475711+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:22.475711+0000","last_clean_scrub_stamp":"2024-04-26T12:54:22.475711+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:06.132626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":429,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.150051+0000","last_change":"2024-04-26T12:53:35.150051+0000","last_active":"2024-04-26T12:53:35.150051+0000","last_peered":"2024-04-26T12:53:35.150051+0000","last_clean":"2024-04-26T12:53:35.150051+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:53:35.150051+0000","last_undegraded":"2024-04-26T12:53:35.150051+0000","last_fullsized":"2024-04-26T12:53:35.150051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.149786+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:44.314364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.384877+0000","last_change":"2024-04-26T12:53:41.384877+0000","last_active":"2024-04-26T12:53:41.384877+0000","last_peered":"2024-04-26T12:53:41.384877+0000","last_clean":"2024-04-26T12:53:41.384877+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:53:41.384877+0000","last_undegraded":"2024-04-26T12:53:41.384877+0000","last_fullsized":"2024-04-26T12:53:41.384877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.384606+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:41.807107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":479,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.083502+0000","last_change":"2024-04-26T12:53:24.083502+0000","last_active":"2024-04-26T12:53:24.083502+0000","last_peered":"2024-04-26T12:53:24.083502+0000","last_clean":"2024-04-26T12:53:24.083502+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:24.083502+0000","last_undegraded":"2024-04-26T12:53:24.083502+0000","last_fullsized":"2024-04-26T12:53:24.083502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.083257+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:10.408030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.864780+0000","last_change":"2024-04-26T12:53:36.864780+0000","last_active":"2024-04-26T12:53:36.864780+0000","last_peered":"2024-04-26T12:53:36.864780+0000","last_clean":"2024-04-26T12:53:36.864780+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:53:36.864780+0000","last_undegraded":"2024-04-26T12:53:36.864780+0000","last_fullsized":"2024-04-26T12:53:36.864780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.864409+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:22.533038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.165833+0000","last_change":"2024-04-26T12:53:42.165833+0000","last_active":"2024-04-26T12:53:42.165833+0000","last_peered":"2024-04-26T12:53:42.165833+0000","last_clean":"2024-04-26T12:53:42.165833+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:42.165833+0000","last_undegraded":"2024-04-26T12:53:42.165833+0000","last_fullsized":"2024-04-26T12:53:42.165833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.165579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:29.622380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.573825+0000","last_change":"2024-04-26T12:54:15.573825+0000","last_active":"2024-04-26T12:54:15.573825+0000","last_peered":"2024-04-26T12:54:15.573825+0000","last_clean":"2024-04-26T12:54:15.573825+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:54:15.573825+0000","last_undegraded":"2024-04-26T12:54:15.573825+0000","last_fullsized":"2024-04-26T12:54:15.573825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:15.573560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:15.573560+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.573560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.318576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.364210+0000","last_change":"2024-04-26T12:53:26.364210+0000","last_active":"2024-04-26T12:53:26.364210+0000","last_peered":"2024-04-26T12:53:26.364210+0000","last_clean":"2024-04-26T12:53:26.364210+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:53:26.364210+0000","last_undegraded":"2024-04-26T12:53:26.364210+0000","last_fullsized":"2024-04-26T12:53:26.364210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.363915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.300166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.062459+0000","last_change":"2024-04-26T12:53:25.062459+0000","last_active":"2024-04-26T12:53:25.062459+0000","last_peered":"2024-04-26T12:53:25.062459+0000","last_clean":"2024-04-26T12:53:25.062459+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:53:25.062459+0000","last_undegraded":"2024-04-26T12:53:25.062459+0000","last_fullsized":"2024-04-26T12:53:25.062459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.062142+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:45.249553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.744541+0000","last_change":"2024-04-26T12:53:28.744541+0000","last_active":"2024-04-26T12:53:28.744541+0000","last_peered":"2024-04-26T12:53:28.744541+0000","last_clean":"2024-04-26T12:53:28.744541+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:53:28.744541+0000","last_undegraded":"2024-04-26T12:53:28.744541+0000","last_fullsized":"2024-04-26T12:53:28.744541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.744289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:22.796067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'9","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.133618+0000","last_change":"2024-04-26T12:53:44.133618+0000","last_active":"2024-04-26T12:53:44.133618+0000","last_peered":"2024-04-26T12:53:44.133618+0000","last_clean":"2024-04-26T12:53:44.133618+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:44.133618+0000","last_undegraded":"2024-04-26T12:53:44.133618+0000","last_fullsized":"2024-04-26T12:53:44.133618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.133322+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:14.915132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.385289+0000","last_change":"2024-04-26T12:53:38.385289+0000","last_active":"2024-04-26T12:53:38.385289+0000","last_peered":"2024-04-26T12:53:38.385289+0000","last_clean":"2024-04-26T12:53:38.385289+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:53:38.385289+0000","last_undegraded":"2024-04-26T12:53:38.385289+0000","last_fullsized":"2024-04-26T12:53:38.385289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.385015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:40.285540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":214,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.350672+0000","last_change":"2024-04-26T12:54:06.350748+0000","last_active":"2024-04-26T12:54:06.350672+0000","last_peered":"2024-04-26T12:54:06.350672+0000","last_clean":"2024-04-26T12:54:06.350672+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:54:06.350672+0000","last_undegraded":"2024-04-26T12:54:06.350672+0000","last_fullsized":"2024-04-26T12:54:06.350672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-04-26T12:54:06.350483+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-04-26T12:54:06.350483+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.350483+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:01.619377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:35.531811+0000","last_change":"2024-04-26T12:54:35.531868+0000","last_active":"2024-04-26T12:54:35.531811+0000","last_peered":"2024-04-26T12:54:35.531811+0000","last_clean":"2024-04-26T12:54:35.531811+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:54:35.531811+0000","last_undegraded":"2024-04-26T12:54:35.531811+0000","last_fullsized":"2024-04-26T12:54:35.531811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:35.531614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:35.531614+0000","last_clean_scrub_stamp":"2024-04-26T12:54:35.531614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:59.413602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.819107+0000","last_change":"2024-04-26T12:49:54.233844+0000","last_active":"2024-04-26T12:53:20.819107+0000","last_peered":"2024-04-26T12:53:20.819107+0000","last_clean":"2024-04-26T12:53:20.819107+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:53:20.819107+0000","last_undegraded":"2024-04-26T12:53:20.819107+0000","last_fullsized":"2024-04-26T12:53:20.819107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.223660+0000","last_change":"2024-04-26T12:53:38.223660+0000","last_active":"2024-04-26T12:53:38.223660+0000","last_peered":"2024-04-26T12:53:38.223660+0000","last_clean":"2024-04-26T12:53:38.223660+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:53:38.223660+0000","last_undegraded":"2024-04-26T12:53:38.223660+0000","last_fullsized":"2024-04-26T12:53:38.223660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.223416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:18.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'88","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.405993+0000","last_change":"2024-04-26T12:53:29.405993+0000","last_active":"2024-04-26T12:53:29.405993+0000","last_peered":"2024-04-26T12:53:29.405993+0000","last_clean":"2024-04-26T12:53:29.405993+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:53:29.405993+0000","last_undegraded":"2024-04-26T12:53:29.405993+0000","last_fullsized":"2024-04-26T12:53:29.405993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'88","last_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_deep_scrub":"35'88","last_deep_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.405693+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.745474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.224221+0000","last_change":"2024-04-26T12:53:41.224221+0000","last_active":"2024-04-26T12:53:41.224221+0000","last_peered":"2024-04-26T12:53:41.224221+0000","last_clean":"2024-04-26T12:53:41.224221+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:53:41.224221+0000","last_undegraded":"2024-04-26T12:53:41.224221+0000","last_fullsized":"2024-04-26T12:53:41.224221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.223941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:36.119504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.150023+0000","last_change":"2024-04-26T12:54:11.150023+0000","last_active":"2024-04-26T12:54:11.150023+0000","last_peered":"2024-04-26T12:54:11.150023+0000","last_clean":"2024-04-26T12:54:11.150023+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:54:11.150023+0000","last_undegraded":"2024-04-26T12:54:11.150023+0000","last_fullsized":"2024-04-26T12:54:11.150023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-04-26T12:54:11.149596+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-04-26T12:54:11.149596+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.149596+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:00.175753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.504046+0000","last_change":"2024-04-26T12:53:59.504046+0000","last_active":"2024-04-26T12:53:59.504046+0000","last_peered":"2024-04-26T12:53:59.504046+0000","last_clean":"2024-04-26T12:53:59.504046+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:53:59.504046+0000","last_undegraded":"2024-04-26T12:53:59.504046+0000","last_fullsized":"2024-04-26T12:53:59.504046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:59.503798+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:59.503798+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.503798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:31.598970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:32.564316+0000","last_change":"2024-04-26T12:54:32.564433+0000","last_active":"2024-04-26T12:54:32.564316+0000","last_peered":"2024-04-26T12:54:32.564316+0000","last_clean":"2024-04-26T12:54:32.564316+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:54:32.564316+0000","last_undegraded":"2024-04-26T12:54:32.564316+0000","last_fullsized":"2024-04-26T12:54:32.564316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:32.564048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:32.564048+0000","last_clean_scrub_stamp":"2024-04-26T12:54:32.564048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:43.967879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.115583+0000","last_change":"2024-04-26T12:53:58.115583+0000","last_active":"2024-04-26T12:53:58.115583+0000","last_peered":"2024-04-26T12:53:58.115583+0000","last_clean":"2024-04-26T12:53:58.115583+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:53:58.115583+0000","last_undegraded":"2024-04-26T12:53:58.115583+0000","last_fullsized":"2024-04-26T12:53:58.115583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.115321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:52.115400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.382731+0000","last_change":"2024-04-26T12:53:28.382731+0000","last_active":"2024-04-26T12:53:28.382731+0000","last_peered":"2024-04-26T12:53:28.382731+0000","last_clean":"2024-04-26T12:53:28.382731+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:53:28.382731+0000","last_undegraded":"2024-04-26T12:53:28.382731+0000","last_fullsized":"2024-04-26T12:53:28.382731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.382477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:09.281461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":517,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.070911+0000","last_change":"2024-04-26T12:53:22.070911+0000","last_active":"2024-04-26T12:53:22.070911+0000","last_peered":"2024-04-26T12:53:22.070911+0000","last_clean":"2024-04-26T12:53:22.070911+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:22.070911+0000","last_undegraded":"2024-04-26T12:53:22.070911+0000","last_fullsized":"2024-04-26T12:53:22.070911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.070631+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:58.378060+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.372693+0000","last_change":"2024-04-26T12:53:43.372693+0000","last_active":"2024-04-26T12:53:43.372693+0000","last_peered":"2024-04-26T12:53:43.372693+0000","last_clean":"2024-04-26T12:53:43.372693+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:53:43.372693+0000","last_undegraded":"2024-04-26T12:53:43.372693+0000","last_fullsized":"2024-04-26T12:53:43.372693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.372441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:12.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.400151+0000","last_change":"2024-04-26T12:54:15.400151+0000","last_active":"2024-04-26T12:54:15.400151+0000","last_peered":"2024-04-26T12:54:15.400151+0000","last_clean":"2024-04-26T12:54:15.400151+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:54:15.400151+0000","last_undegraded":"2024-04-26T12:54:15.400151+0000","last_fullsized":"2024-04-26T12:54:15.400151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:15.399681+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:15.399681+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.399681+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:34.871803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.276515+0000","last_change":"2024-04-26T12:53:50.276515+0000","last_active":"2024-04-26T12:53:50.276515+0000","last_peered":"2024-04-26T12:53:50.276515+0000","last_clean":"2024-04-26T12:53:50.276515+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:50.276515+0000","last_undegraded":"2024-04-26T12:53:50.276515+0000","last_fullsized":"2024-04-26T12:53:50.276515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.276254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:50.769163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.078510+0000","last_change":"2024-04-26T12:53:59.078562+0000","last_active":"2024-04-26T12:53:59.078510+0000","last_peered":"2024-04-26T12:53:59.078510+0000","last_clean":"2024-04-26T12:53:59.078510+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:53:59.078510+0000","last_undegraded":"2024-04-26T12:53:59.078510+0000","last_fullsized":"2024-04-26T12:53:59.078510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:59.078308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:59.078308+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.078308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:58.992648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.025034+0000","last_change":"2024-04-26T12:54:14.025122+0000","last_active":"2024-04-26T12:54:14.025034+0000","last_peered":"2024-04-26T12:54:14.025034+0000","last_clean":"2024-04-26T12:54:14.025034+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:54:14.025034+0000","last_undegraded":"2024-04-26T12:54:14.025034+0000","last_fullsized":"2024-04-26T12:54:14.025034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:14.024798+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:14.024798+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.024798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:50.094214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.141474+0000","last_change":"2024-04-26T12:54:14.141474+0000","last_active":"2024-04-26T12:54:14.141474+0000","last_peered":"2024-04-26T12:54:14.141474+0000","last_clean":"2024-04-26T12:54:14.141474+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:54:14.141474+0000","last_undegraded":"2024-04-26T12:54:14.141474+0000","last_fullsized":"2024-04-26T12:54:14.141474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:14.141184+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:14.141184+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.141184+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:28.916700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.771034+0000","last_change":"2024-04-26T12:53:30.771034+0000","last_active":"2024-04-26T12:53:30.771034+0000","last_peered":"2024-04-26T12:53:30.771034+0000","last_clean":"2024-04-26T12:53:30.771034+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:30.771034+0000","last_undegraded":"2024-04-26T12:53:30.771034+0000","last_fullsized":"2024-04-26T12:53:30.771034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.770734+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:16.557148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.218444+0000","last_change":"2024-04-26T12:53:37.218444+0000","last_active":"2024-04-26T12:53:37.218444+0000","last_peered":"2024-04-26T12:53:37.218444+0000","last_clean":"2024-04-26T12:53:37.218444+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:53:37.218444+0000","last_undegraded":"2024-04-26T12:53:37.218444+0000","last_fullsized":"2024-04-26T12:53:37.218444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.218195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:55.090465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.454748+0000","last_change":"2024-04-26T12:54:05.454748+0000","last_active":"2024-04-26T12:54:05.454748+0000","last_peered":"2024-04-26T12:54:05.454748+0000","last_clean":"2024-04-26T12:54:05.454748+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:54:05.454748+0000","last_undegraded":"2024-04-26T12:54:05.454748+0000","last_fullsized":"2024-04-26T12:54:05.454748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:05.454504+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:05.454504+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.454504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:45.412144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.225812+0000","last_change":"2024-04-26T12:53:53.225812+0000","last_active":"2024-04-26T12:53:53.225812+0000","last_peered":"2024-04-26T12:53:53.225812+0000","last_clean":"2024-04-26T12:53:53.225812+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:53:53.225812+0000","last_undegraded":"2024-04-26T12:53:53.225812+0000","last_fullsized":"2024-04-26T12:53:53.225812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.225550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:27.498113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:31.530255+0000","last_change":"2024-04-26T12:54:31.530310+0000","last_active":"2024-04-26T12:54:31.530255+0000","last_peered":"2024-04-26T12:54:31.530255+0000","last_clean":"2024-04-26T12:54:31.530255+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:54:31.530255+0000","last_undegraded":"2024-04-26T12:54:31.530255+0000","last_fullsized":"2024-04-26T12:54:31.530255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:31.530051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:31.530051+0000","last_clean_scrub_stamp":"2024-04-26T12:54:31.530051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:35:38.641788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.076416+0000","last_change":"2024-04-26T12:54:01.076416+0000","last_active":"2024-04-26T12:54:01.076416+0000","last_peered":"2024-04-26T12:54:01.076416+0000","last_clean":"2024-04-26T12:54:01.076416+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:54:01.076416+0000","last_undegraded":"2024-04-26T12:54:01.076416+0000","last_fullsized":"2024-04-26T12:54:01.076416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:01.076163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:01.076163+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.076163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:17.089416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.187723+0000","last_change":"2024-04-26T12:53:42.187723+0000","last_active":"2024-04-26T12:53:42.187723+0000","last_peered":"2024-04-26T12:53:42.187723+0000","last_clean":"2024-04-26T12:53:42.187723+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:53:42.187723+0000","last_undegraded":"2024-04-26T12:53:42.187723+0000","last_fullsized":"2024-04-26T12:53:42.187723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.187463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:46.572342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'21","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.345235+0000","last_change":"2024-04-26T12:53:27.345235+0000","last_active":"2024-04-26T12:53:27.345235+0000","last_peered":"2024-04-26T12:53:27.345235+0000","last_clean":"2024-04-26T12:53:27.345235+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:27.345235+0000","last_undegraded":"2024-04-26T12:53:27.345235+0000","last_fullsized":"2024-04-26T12:53:27.345235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.344956+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:36.530634+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.363447+0000","last_change":"2024-04-26T12:53:45.363447+0000","last_active":"2024-04-26T12:53:45.363447+0000","last_peered":"2024-04-26T12:53:45.363447+0000","last_clean":"2024-04-26T12:53:45.363447+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:53:45.363447+0000","last_undegraded":"2024-04-26T12:53:45.363447+0000","last_fullsized":"2024-04-26T12:53:45.363447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.363192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:54.085665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:19.428238+0000","last_change":"2024-04-26T12:54:19.428238+0000","last_active":"2024-04-26T12:54:19.428238+0000","last_peered":"2024-04-26T12:54:19.428238+0000","last_clean":"2024-04-26T12:54:19.428238+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:54:19.428238+0000","last_undegraded":"2024-04-26T12:54:19.428238+0000","last_fullsized":"2024-04-26T12:54:19.428238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:19.427970+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:19.427970+0000","last_clean_scrub_stamp":"2024-04-26T12:54:19.427970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:54.999011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":98,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.172388+0000","last_change":"2024-04-26T12:53:43.172388+0000","last_active":"2024-04-26T12:53:43.172388+0000","last_peered":"2024-04-26T12:53:43.172388+0000","last_clean":"2024-04-26T12:53:43.172388+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:43.172388+0000","last_undegraded":"2024-04-26T12:53:43.172388+0000","last_fullsized":"2024-04-26T12:53:43.172388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.172137+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:20.834194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.115672+0000","last_change":"2024-04-26T12:54:00.115672+0000","last_active":"2024-04-26T12:54:00.115672+0000","last_peered":"2024-04-26T12:54:00.115672+0000","last_clean":"2024-04-26T12:54:00.115672+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:54:00.115672+0000","last_undegraded":"2024-04-26T12:54:00.115672+0000","last_fullsized":"2024-04-26T12:54:00.115672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:00.115220+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:00.115220+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.115220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:59.052303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.159508+0000","last_change":"2024-04-26T12:54:08.159561+0000","last_active":"2024-04-26T12:54:08.159508+0000","last_peered":"2024-04-26T12:54:08.159508+0000","last_clean":"2024-04-26T12:54:08.159508+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:54:08.159508+0000","last_undegraded":"2024-04-26T12:54:08.159508+0000","last_fullsized":"2024-04-26T12:54:08.159508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:08.159306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:08.159306+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.159306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:40.086269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.271022+0000","last_change":"2024-04-26T12:53:46.271022+0000","last_active":"2024-04-26T12:53:46.271022+0000","last_peered":"2024-04-26T12:53:46.271022+0000","last_clean":"2024-04-26T12:53:46.271022+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:53:46.271022+0000","last_undegraded":"2024-04-26T12:53:46.271022+0000","last_fullsized":"2024-04-26T12:53:46.271022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.270733+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:53.862641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'73","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.205126+0000","last_change":"2024-04-26T12:53:30.205126+0000","last_active":"2024-04-26T12:53:30.205126+0000","last_peered":"2024-04-26T12:53:30.205126+0000","last_clean":"2024-04-26T12:53:30.205126+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:53:30.205126+0000","last_undegraded":"2024-04-26T12:53:30.205126+0000","last_fullsized":"2024-04-26T12:53:30.205126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.204804+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:53.044186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.761261+0000","last_change":"2024-04-26T12:53:22.761261+0000","last_active":"2024-04-26T12:53:22.761261+0000","last_peered":"2024-04-26T12:53:22.761261+0000","last_clean":"2024-04-26T12:53:22.761261+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:53:22.761261+0000","last_undegraded":"2024-04-26T12:53:22.761261+0000","last_fullsized":"2024-04-26T12:53:22.761261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.761001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:49.570682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.038968+0000","last_change":"2024-04-26T12:54:17.038968+0000","last_active":"2024-04-26T12:54:17.038968+0000","last_peered":"2024-04-26T12:54:17.038968+0000","last_clean":"2024-04-26T12:54:17.038968+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:54:17.038968+0000","last_undegraded":"2024-04-26T12:54:17.038968+0000","last_fullsized":"2024-04-26T12:54:17.038968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:54:17.038676+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:54:17.038676+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.038676+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:16.419398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.198011+0000","last_change":"2024-04-26T12:53:49.198011+0000","last_active":"2024-04-26T12:53:49.198011+0000","last_peered":"2024-04-26T12:53:49.198011+0000","last_clean":"2024-04-26T12:53:49.198011+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:49.198011+0000","last_undegraded":"2024-04-26T12:53:49.198011+0000","last_fullsized":"2024-04-26T12:53:49.198011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.197740+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:50.051462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.057310+0000","last_change":"2024-04-26T12:54:00.057310+0000","last_active":"2024-04-26T12:54:00.057310+0000","last_peered":"2024-04-26T12:54:00.057310+0000","last_clean":"2024-04-26T12:54:00.057310+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:54:00.057310+0000","last_undegraded":"2024-04-26T12:54:00.057310+0000","last_fullsized":"2024-04-26T12:54:00.057310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.057054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:25.513480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:33.555898+0000","last_change":"2024-04-26T12:54:33.555951+0000","last_active":"2024-04-26T12:54:33.555898+0000","last_peered":"2024-04-26T12:54:33.555898+0000","last_clean":"2024-04-26T12:54:33.555898+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:54:33.555898+0000","last_undegraded":"2024-04-26T12:54:33.555898+0000","last_fullsized":"2024-04-26T12:54:33.555898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:33.555698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:33.555698+0000","last_clean_scrub_stamp":"2024-04-26T12:54:33.555698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:33.423337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.364121+0000","last_change":"2024-04-26T12:53:30.364121+0000","last_active":"2024-04-26T12:53:30.364121+0000","last_peered":"2024-04-26T12:53:30.364121+0000","last_clean":"2024-04-26T12:53:30.364121+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:53:30.364121+0000","last_undegraded":"2024-04-26T12:53:30.364121+0000","last_fullsized":"2024-04-26T12:53:30.364121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.363860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:46.377113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'23","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.061000+0000","last_change":"2024-04-26T12:53:21.061000+0000","last_active":"2024-04-26T12:53:21.061000+0000","last_peered":"2024-04-26T12:53:21.061000+0000","last_clean":"2024-04-26T12:53:21.061000+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:53:21.061000+0000","last_undegraded":"2024-04-26T12:53:21.061000+0000","last_fullsized":"2024-04-26T12:53:21.061000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.060723+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:54.780796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":369,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.077560+0000","last_change":"2024-04-26T12:53:28.077560+0000","last_active":"2024-04-26T12:53:28.077560+0000","last_peered":"2024-04-26T12:53:28.077560+0000","last_clean":"2024-04-26T12:53:28.077560+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:28.077560+0000","last_undegraded":"2024-04-26T12:53:28.077560+0000","last_fullsized":"2024-04-26T12:53:28.077560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.077291+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:13.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.822409+0000","last_change":"2024-04-26T12:50:04.309067+0000","last_active":"2024-04-26T12:53:20.822409+0000","last_peered":"2024-04-26T12:53:20.822409+0000","last_clean":"2024-04-26T12:53:20.822409+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:53:20.822409+0000","last_undegraded":"2024-04-26T12:53:20.822409+0000","last_fullsized":"2024-04-26T12:53:20.822409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'10","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.517273+0000","last_change":"2024-04-26T12:54:03.517340+0000","last_active":"2024-04-26T12:54:03.517273+0000","last_peered":"2024-04-26T12:54:03.517273+0000","last_clean":"2024-04-26T12:54:03.517273+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:54:03.517273+0000","last_undegraded":"2024-04-26T12:54:03.517273+0000","last_fullsized":"2024-04-26T12:54:03.517273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:03.517090+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:03.517090+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.517090+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:05.628227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:21.493549+0000","last_change":"2024-04-26T12:54:21.493623+0000","last_active":"2024-04-26T12:54:21.493549+0000","last_peered":"2024-04-26T12:54:21.493549+0000","last_clean":"2024-04-26T12:54:21.493549+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:54:21.493549+0000","last_undegraded":"2024-04-26T12:54:21.493549+0000","last_fullsized":"2024-04-26T12:54:21.493549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:21.493290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:21.493290+0000","last_clean_scrub_stamp":"2024-04-26T12:54:21.493290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:28.436480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.123286+0000","last_change":"2024-04-26T12:54:07.123347+0000","last_active":"2024-04-26T12:54:07.123286+0000","last_peered":"2024-04-26T12:54:07.123286+0000","last_clean":"2024-04-26T12:54:07.123286+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:54:07.123286+0000","last_undegraded":"2024-04-26T12:54:07.123286+0000","last_fullsized":"2024-04-26T12:54:07.123286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:07.123085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:07.123085+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.123085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:47.764312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.421343+0000","last_change":"2024-04-26T12:53:21.421343+0000","last_active":"2024-04-26T12:53:21.421343+0000","last_peered":"2024-04-26T12:53:21.421343+0000","last_clean":"2024-04-26T12:53:21.421343+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:53:21.421343+0000","last_undegraded":"2024-04-26T12:53:21.421343+0000","last_fullsized":"2024-04-26T12:53:21.421343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.421080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:06.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'16","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.399644+0000","last_change":"2024-04-26T12:53:48.399644+0000","last_active":"2024-04-26T12:53:48.399644+0000","last_peered":"2024-04-26T12:53:48.399644+0000","last_clean":"2024-04-26T12:53:48.399644+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:53:48.399644+0000","last_undegraded":"2024-04-26T12:53:48.399644+0000","last_fullsized":"2024-04-26T12:53:48.399644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.399160+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:20.449086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.333981+0000","last_change":"2024-04-26T12:53:21.333981+0000","last_active":"2024-04-26T12:53:21.333981+0000","last_peered":"2024-04-26T12:53:21.333981+0000","last_clean":"2024-04-26T12:53:21.333981+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:21.333981+0000","last_undegraded":"2024-04-26T12:53:21.333981+0000","last_fullsized":"2024-04-26T12:53:21.333981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.333725+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:27.636643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:20.457599+0000","last_change":"2024-04-26T12:54:20.457599+0000","last_active":"2024-04-26T12:54:20.457599+0000","last_peered":"2024-04-26T12:54:20.457599+0000","last_clean":"2024-04-26T12:54:20.457599+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:54:20.457599+0000","last_undegraded":"2024-04-26T12:54:20.457599+0000","last_fullsized":"2024-04-26T12:54:20.457599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-04-26T12:54:20.457274+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-04-26T12:54:20.457274+0000","last_clean_scrub_stamp":"2024-04-26T12:54:20.457274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:51.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.991775+0000","last_change":"2024-04-26T12:53:46.991775+0000","last_active":"2024-04-26T12:53:46.991775+0000","last_peered":"2024-04-26T12:53:46.991775+0000","last_clean":"2024-04-26T12:53:46.991775+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:53:46.991775+0000","last_undegraded":"2024-04-26T12:53:46.991775+0000","last_fullsized":"2024-04-26T12:53:46.991775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.991502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:27.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.392770+0000","last_change":"2024-04-26T12:54:13.392770+0000","last_active":"2024-04-26T12:54:13.392770+0000","last_peered":"2024-04-26T12:54:13.392770+0000","last_clean":"2024-04-26T12:54:13.392770+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:54:13.392770+0000","last_undegraded":"2024-04-26T12:54:13.392770+0000","last_fullsized":"2024-04-26T12:54:13.392770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:13.392469+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:13.392469+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.392469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:35.832684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:34.553698+0000","last_change":"2024-04-26T12:54:34.553756+0000","last_active":"2024-04-26T12:54:34.553698+0000","last_peered":"2024-04-26T12:54:34.553698+0000","last_clean":"2024-04-26T12:54:34.553698+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:54:34.553698+0000","last_undegraded":"2024-04-26T12:54:34.553698+0000","last_fullsized":"2024-04-26T12:54:34.553698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:34.553473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:34.553473+0000","last_clean_scrub_stamp":"2024-04-26T12:54:34.553473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.847532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.334821+0000","last_change":"2024-04-26T12:53:31.334821+0000","last_active":"2024-04-26T12:53:31.334821+0000","last_peered":"2024-04-26T12:53:31.334821+0000","last_clean":"2024-04-26T12:53:31.334821+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:53:31.334821+0000","last_undegraded":"2024-04-26T12:53:31.334821+0000","last_fullsized":"2024-04-26T12:53:31.334821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.334536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:45.400333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'99","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.718800+0000","last_change":"2024-04-26T12:53:27.718800+0000","last_active":"2024-04-26T12:53:27.718800+0000","last_peered":"2024-04-26T12:53:27.718800+0000","last_clean":"2024-04-26T12:53:27.718800+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:53:27.718800+0000","last_undegraded":"2024-04-26T12:53:27.718800+0000","last_fullsized":"2024-04-26T12:53:27.718800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'99","last_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_deep_scrub":"35'99","last_deep_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.718504+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:03.589502+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.215348+0000","last_change":"2024-04-26T12:53:29.215348+0000","last_active":"2024-04-26T12:53:29.215348+0000","last_peered":"2024-04-26T12:53:29.215348+0000","last_clean":"2024-04-26T12:53:29.215348+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:53:29.215348+0000","last_undegraded":"2024-04-26T12:53:29.215348+0000","last_fullsized":"2024-04-26T12:53:29.215348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.215091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:55.609962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.118706+0000","last_change":"2024-04-26T12:54:08.118706+0000","last_active":"2024-04-26T12:54:08.118706+0000","last_peered":"2024-04-26T12:54:08.118706+0000","last_clean":"2024-04-26T12:54:08.118706+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:54:08.118706+0000","last_undegraded":"2024-04-26T12:54:08.118706+0000","last_fullsized":"2024-04-26T12:54:08.118706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:08.118446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:08.118446+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.118446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:36.872491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.122612+0000","last_change":"2024-04-26T12:54:09.122612+0000","last_active":"2024-04-26T12:54:09.122612+0000","last_peered":"2024-04-26T12:54:09.122612+0000","last_clean":"2024-04-26T12:54:09.122612+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:54:09.122612+0000","last_undegraded":"2024-04-26T12:54:09.122612+0000","last_fullsized":"2024-04-26T12:54:09.122612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:09.122366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:09.122366+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.122366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:10.237483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.929781+0000","last_change":"2024-04-26T12:53:41.929781+0000","last_active":"2024-04-26T12:53:41.929781+0000","last_peered":"2024-04-26T12:53:41.929781+0000","last_clean":"2024-04-26T12:53:41.929781+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:53:41.929781+0000","last_undegraded":"2024-04-26T12:53:41.929781+0000","last_fullsized":"2024-04-26T12:53:41.929781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.929472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:59.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.524587+0000","last_change":"2024-04-26T12:54:12.524587+0000","last_active":"2024-04-26T12:54:12.524587+0000","last_peered":"2024-04-26T12:54:12.524587+0000","last_clean":"2024-04-26T12:54:12.524587+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:54:12.524587+0000","last_undegraded":"2024-04-26T12:54:12.524587+0000","last_fullsized":"2024-04-26T12:54:12.524587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.524326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.524326+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.524326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:02.974028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.182402+0000","last_change":"2024-04-26T12:53:37.182402+0000","last_active":"2024-04-26T12:53:37.182402+0000","last_peered":"2024-04-26T12:53:37.182402+0000","last_clean":"2024-04-26T12:53:37.182402+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:53:37.182402+0000","last_undegraded":"2024-04-26T12:53:37.182402+0000","last_fullsized":"2024-04-26T12:53:37.182402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.182009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.668088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.379326+0000","last_change":"2024-04-26T12:53:35.379487+0000","last_active":"2024-04-26T12:53:35.379326+0000","last_peered":"2024-04-26T12:53:35.379326+0000","last_clean":"2024-04-26T12:53:35.379326+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:53:35.379326+0000","last_undegraded":"2024-04-26T12:53:35.379326+0000","last_fullsized":"2024-04-26T12:53:35.379326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.379029+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:12.600563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.355791+0000","last_change":"2024-04-26T12:53:46.355844+0000","last_active":"2024-04-26T12:53:46.355791+0000","last_peered":"2024-04-26T12:53:46.355791+0000","last_clean":"2024-04-26T12:53:46.355791+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:53:46.355791+0000","last_undegraded":"2024-04-26T12:53:46.355791+0000","last_fullsized":"2024-04-26T12:53:46.355791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.355590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:41.624485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:18.039190+0000","last_change":"2024-04-26T12:54:18.039252+0000","last_active":"2024-04-26T12:54:18.039190+0000","last_peered":"2024-04-26T12:54:18.039190+0000","last_clean":"2024-04-26T12:54:18.039190+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:54:18.039190+0000","last_undegraded":"2024-04-26T12:54:18.039190+0000","last_fullsized":"2024-04-26T12:54:18.039190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:54:18.038959+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:54:18.038959+0000","last_clean_scrub_stamp":"2024-04-26T12:54:18.038959+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:39.489918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:21.457312+0000","last_change":"2024-04-26T12:54:21.457312+0000","last_active":"2024-04-26T12:54:21.457312+0000","last_peered":"2024-04-26T12:54:21.457312+0000","last_clean":"2024-04-26T12:54:21.457312+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:54:21.457312+0000","last_undegraded":"2024-04-26T12:54:21.457312+0000","last_fullsized":"2024-04-26T12:54:21.457312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:21.456900+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:21.456900+0000","last_clean_scrub_stamp":"2024-04-26T12:54:21.456900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:34.211647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.115727+0000","last_change":"2024-04-26T12:54:06.115884+0000","last_active":"2024-04-26T12:54:06.115727+0000","last_peered":"2024-04-26T12:54:06.115727+0000","last_clean":"2024-04-26T12:54:06.115727+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:54:06.115727+0000","last_undegraded":"2024-04-26T12:54:06.115727+0000","last_fullsized":"2024-04-26T12:54:06.115727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:06.115455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:06.115455+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.115455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:28.333237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.821218+0000","last_change":"2024-04-26T12:50:34.326186+0000","last_active":"2024-04-26T12:53:20.821218+0000","last_peered":"2024-04-26T12:53:20.821218+0000","last_clean":"2024-04-26T12:53:20.821218+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:53:20.821218+0000","last_undegraded":"2024-04-26T12:53:20.821218+0000","last_fullsized":"2024-04-26T12:53:20.821218+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:57.198321+0000","last_clean_scrub_stamp":"2024-04-26T12:49:57.198321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.245501+0000","last_change":"2024-04-26T12:53:35.245501+0000","last_active":"2024-04-26T12:53:35.245501+0000","last_peered":"2024-04-26T12:53:35.245501+0000","last_clean":"2024-04-26T12:53:35.245501+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:35.245501+0000","last_undegraded":"2024-04-26T12:53:35.245501+0000","last_fullsized":"2024-04-26T12:53:35.245501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.245236+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:33.087428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.725793+0000","last_change":"2024-04-26T12:53:24.725849+0000","last_active":"2024-04-26T12:53:24.725793+0000","last_peered":"2024-04-26T12:53:24.725793+0000","last_clean":"2024-04-26T12:53:24.725793+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:53:24.725793+0000","last_undegraded":"2024-04-26T12:53:24.725793+0000","last_fullsized":"2024-04-26T12:53:24.725793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.725577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:57.154247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.302405+0000","last_change":"2024-04-26T12:53:45.302468+0000","last_active":"2024-04-26T12:53:45.302405+0000","last_peered":"2024-04-26T12:53:45.302405+0000","last_clean":"2024-04-26T12:53:45.302405+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:45.302405+0000","last_undegraded":"2024-04-26T12:53:45.302405+0000","last_fullsized":"2024-04-26T12:53:45.302405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.302211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.021522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'16","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.150181+0000","last_change":"2024-04-26T12:53:57.150181+0000","last_active":"2024-04-26T12:53:57.150181+0000","last_peered":"2024-04-26T12:53:57.150181+0000","last_clean":"2024-04-26T12:53:57.150181+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:57.150181+0000","last_undegraded":"2024-04-26T12:53:57.150181+0000","last_fullsized":"2024-04-26T12:53:57.150181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.149914+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:33.210100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.962337+0000","last_change":"2024-04-26T12:53:53.962501+0000","last_active":"2024-04-26T12:53:53.962337+0000","last_peered":"2024-04-26T12:53:53.962337+0000","last_clean":"2024-04-26T12:53:53.962337+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:53:53.962337+0000","last_undegraded":"2024-04-26T12:53:53.962337+0000","last_fullsized":"2024-04-26T12:53:53.962337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.962061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:05.175288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.837739+0000","last_change":"2024-04-26T12:53:34.837739+0000","last_active":"2024-04-26T12:53:34.837739+0000","last_peered":"2024-04-26T12:53:34.837739+0000","last_clean":"2024-04-26T12:53:34.837739+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:53:34.837739+0000","last_undegraded":"2024-04-26T12:53:34.837739+0000","last_fullsized":"2024-04-26T12:53:34.837739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.837461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:55.097696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.252332+0000","last_change":"2024-04-26T12:53:34.252332+0000","last_active":"2024-04-26T12:53:34.252332+0000","last_peered":"2024-04-26T12:53:34.252332+0000","last_clean":"2024-04-26T12:53:34.252332+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:34.252332+0000","last_undegraded":"2024-04-26T12:53:34.252332+0000","last_fullsized":"2024-04-26T12:53:34.252332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.252055+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:22.283776+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.049935+0000","last_change":"2024-04-26T12:53:20.049974+0000","last_active":"2024-04-26T12:53:20.049935+0000","last_peered":"2024-04-26T12:53:20.049935+0000","last_clean":"2024-04-26T12:53:20.049935+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:53:20.049935+0000","last_undegraded":"2024-04-26T12:53:20.049935+0000","last_fullsized":"2024-04-26T12:53:20.049935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.049783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:14.101561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:37.972599+0000","last_change":"2024-04-26T12:50:04.309031+0000","last_active":"2024-04-26T12:52:37.972599+0000","last_peered":"2024-04-26T12:52:37.972599+0000","last_clean":"2024-04-26T12:52:37.972599+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:52:37.972599+0000","last_undegraded":"2024-04-26T12:52:37.972599+0000","last_fullsized":"2024-04-26T12:52:37.972599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.504321+0000","last_change":"2024-04-26T12:53:56.504321+0000","last_active":"2024-04-26T12:53:56.504321+0000","last_peered":"2024-04-26T12:53:56.504321+0000","last_clean":"2024-04-26T12:53:56.504321+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:56.504321+0000","last_undegraded":"2024-04-26T12:53:56.504321+0000","last_fullsized":"2024-04-26T12:53:56.504321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.503910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.738314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.385811+0000","last_change":"2024-04-26T12:54:12.385867+0000","last_active":"2024-04-26T12:54:12.385811+0000","last_peered":"2024-04-26T12:54:12.385811+0000","last_clean":"2024-04-26T12:54:12.385811+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:54:12.385811+0000","last_undegraded":"2024-04-26T12:54:12.385811+0000","last_fullsized":"2024-04-26T12:54:12.385811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.385615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.385615+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.385615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:05.886586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.347602+0000","last_change":"2024-04-26T12:53:24.347602+0000","last_active":"2024-04-26T12:53:24.347602+0000","last_peered":"2024-04-26T12:53:24.347602+0000","last_clean":"2024-04-26T12:53:24.347602+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:53:24.347602+0000","last_undegraded":"2024-04-26T12:53:24.347602+0000","last_fullsized":"2024-04-26T12:53:24.347602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.347350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:48.923924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.801252+0000","last_change":"2024-04-26T12:53:31.801328+0000","last_active":"2024-04-26T12:53:31.801252+0000","last_peered":"2024-04-26T12:53:31.801252+0000","last_clean":"2024-04-26T12:53:31.801252+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:53:31.801252+0000","last_undegraded":"2024-04-26T12:53:31.801252+0000","last_fullsized":"2024-04-26T12:53:31.801252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.801011+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:27.272844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.740640+0000","last_change":"2024-04-26T12:53:23.740693+0000","last_active":"2024-04-26T12:53:23.740640+0000","last_peered":"2024-04-26T12:53:23.740640+0000","last_clean":"2024-04-26T12:53:23.740640+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:53:23.740640+0000","last_undegraded":"2024-04-26T12:53:23.740640+0000","last_fullsized":"2024-04-26T12:53:23.740640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.740437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:49.029310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.334631+0000","last_change":"2024-04-26T12:53:34.334631+0000","last_active":"2024-04-26T12:53:34.334631+0000","last_peered":"2024-04-26T12:53:34.334631+0000","last_clean":"2024-04-26T12:53:34.334631+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:34.334631+0000","last_undegraded":"2024-04-26T12:53:34.334631+0000","last_fullsized":"2024-04-26T12:53:34.334631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.334375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:02.613019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.584722+0000","last_change":"2024-04-26T12:54:16.584779+0000","last_active":"2024-04-26T12:54:16.584722+0000","last_peered":"2024-04-26T12:54:16.584722+0000","last_clean":"2024-04-26T12:54:16.584722+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:54:16.584722+0000","last_undegraded":"2024-04-26T12:54:16.584722+0000","last_fullsized":"2024-04-26T12:54:16.584722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:16.584498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:16.584498+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.584498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:20.594239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":239,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.234809+0000","last_change":"2024-04-26T12:53:43.234809+0000","last_active":"2024-04-26T12:53:43.234809+0000","last_peered":"2024-04-26T12:53:43.234809+0000","last_clean":"2024-04-26T12:53:43.234809+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:53:43.234809+0000","last_undegraded":"2024-04-26T12:53:43.234809+0000","last_fullsized":"2024-04-26T12:53:43.234809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.234542+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:14.014272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.227085+0000","last_change":"2024-04-26T12:53:28.227166+0000","last_active":"2024-04-26T12:53:28.227085+0000","last_peered":"2024-04-26T12:53:28.227085+0000","last_clean":"2024-04-26T12:53:28.227085+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:53:28.227085+0000","last_undegraded":"2024-04-26T12:53:28.227085+0000","last_fullsized":"2024-04-26T12:53:28.227085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.226873+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:23.499693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.736545+0000","last_change":"2024-04-26T12:53:21.736604+0000","last_active":"2024-04-26T12:53:21.736545+0000","last_peered":"2024-04-26T12:53:21.736545+0000","last_clean":"2024-04-26T12:53:21.736545+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:53:21.736545+0000","last_undegraded":"2024-04-26T12:53:21.736545+0000","last_fullsized":"2024-04-26T12:53:21.736545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.736352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:21.809175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.288231+0000","last_change":"2024-04-26T12:53:49.288385+0000","last_active":"2024-04-26T12:53:49.288231+0000","last_peered":"2024-04-26T12:53:49.288231+0000","last_clean":"2024-04-26T12:53:49.288231+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:53:49.288231+0000","last_undegraded":"2024-04-26T12:53:49.288231+0000","last_fullsized":"2024-04-26T12:53:49.288231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.288000+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:06.328966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.099538+0000","last_change":"2024-04-26T12:54:05.099599+0000","last_active":"2024-04-26T12:54:05.099538+0000","last_peered":"2024-04-26T12:54:05.099538+0000","last_clean":"2024-04-26T12:54:05.099538+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:54:05.099538+0000","last_undegraded":"2024-04-26T12:54:05.099538+0000","last_fullsized":"2024-04-26T12:54:05.099538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:05.099328+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:05.099328+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.099328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:13.229996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.304926+0000","last_change":"2024-04-26T12:54:05.304979+0000","last_active":"2024-04-26T12:54:05.304926+0000","last_peered":"2024-04-26T12:54:05.304926+0000","last_clean":"2024-04-26T12:54:05.304926+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:54:05.304926+0000","last_undegraded":"2024-04-26T12:54:05.304926+0000","last_fullsized":"2024-04-26T12:54:05.304926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:05.304733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:05.304733+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.304733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:48.470972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.904759+0000","last_change":"2024-04-26T12:53:37.904759+0000","last_active":"2024-04-26T12:53:37.904759+0000","last_peered":"2024-04-26T12:53:37.904759+0000","last_clean":"2024-04-26T12:53:37.904759+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:53:37.904759+0000","last_undegraded":"2024-04-26T12:53:37.904759+0000","last_fullsized":"2024-04-26T12:53:37.904759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.904494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:22.228978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'47","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.491629+0000","last_change":"2024-04-26T12:53:52.491707+0000","last_active":"2024-04-26T12:53:52.491629+0000","last_peered":"2024-04-26T12:53:52.491629+0000","last_clean":"2024-04-26T12:53:52.491629+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:53:52.491629+0000","last_undegraded":"2024-04-26T12:53:52.491629+0000","last_fullsized":"2024-04-26T12:53:52.491629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.491439+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:11.972259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.155724+0000","last_change":"2024-04-26T12:53:36.155779+0000","last_active":"2024-04-26T12:53:36.155724+0000","last_peered":"2024-04-26T12:53:36.155724+0000","last_clean":"2024-04-26T12:53:36.155724+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:53:36.155724+0000","last_undegraded":"2024-04-26T12:53:36.155724+0000","last_fullsized":"2024-04-26T12:53:36.155724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.155541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:38.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.529021+0000","last_change":"2024-04-26T12:54:01.529079+0000","last_active":"2024-04-26T12:54:01.529021+0000","last_peered":"2024-04-26T12:54:01.529021+0000","last_clean":"2024-04-26T12:54:01.529021+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:54:01.529021+0000","last_undegraded":"2024-04-26T12:54:01.529021+0000","last_fullsized":"2024-04-26T12:54:01.529021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:01.528785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:01.528785+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.528785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:27.197092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.304021+0000","last_change":"2024-04-26T12:53:32.304100+0000","last_active":"2024-04-26T12:53:32.304021+0000","last_peered":"2024-04-26T12:53:32.304021+0000","last_clean":"2024-04-26T12:53:32.304021+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:32.304021+0000","last_undegraded":"2024-04-26T12:53:32.304021+0000","last_fullsized":"2024-04-26T12:53:32.304021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.303812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:44.406488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.340617+0000","last_change":"2024-04-26T12:54:07.340671+0000","last_active":"2024-04-26T12:54:07.340617+0000","last_peered":"2024-04-26T12:54:07.340617+0000","last_clean":"2024-04-26T12:54:07.340617+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:54:07.340617+0000","last_undegraded":"2024-04-26T12:54:07.340617+0000","last_fullsized":"2024-04-26T12:54:07.340617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:07.340430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:07.340430+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.340430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:48.000026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.917230+0000","last_change":"2024-04-26T12:53:39.917284+0000","last_active":"2024-04-26T12:53:39.917230+0000","last_peered":"2024-04-26T12:53:39.917230+0000","last_clean":"2024-04-26T12:53:39.917230+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:53:39.917230+0000","last_undegraded":"2024-04-26T12:53:39.917230+0000","last_fullsized":"2024-04-26T12:53:39.917230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.917036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:25.602021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.199626+0000","last_change":"2024-04-26T12:53:32.199626+0000","last_active":"2024-04-26T12:53:32.199626+0000","last_peered":"2024-04-26T12:53:32.199626+0000","last_clean":"2024-04-26T12:53:32.199626+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:53:32.199626+0000","last_undegraded":"2024-04-26T12:53:32.199626+0000","last_fullsized":"2024-04-26T12:53:32.199626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.199339+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:43.051403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.287181+0000","last_change":"2024-04-26T12:53:22.287181+0000","last_active":"2024-04-26T12:53:22.287181+0000","last_peered":"2024-04-26T12:53:22.287181+0000","last_clean":"2024-04-26T12:53:22.287181+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:53:22.287181+0000","last_undegraded":"2024-04-26T12:53:22.287181+0000","last_fullsized":"2024-04-26T12:53:22.287181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.286848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:37.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.563601+0000","last_change":"2024-04-26T12:54:13.563665+0000","last_active":"2024-04-26T12:54:13.563601+0000","last_peered":"2024-04-26T12:54:13.563601+0000","last_clean":"2024-04-26T12:54:13.563601+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:54:13.563601+0000","last_undegraded":"2024-04-26T12:54:13.563601+0000","last_fullsized":"2024-04-26T12:54:13.563601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:13.563410+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:13.563410+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.563410+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:47.974922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.153511+0000","last_change":"2024-04-26T12:53:55.153568+0000","last_active":"2024-04-26T12:53:55.153511+0000","last_peered":"2024-04-26T12:53:55.153511+0000","last_clean":"2024-04-26T12:53:55.153511+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:53:55.153511+0000","last_undegraded":"2024-04-26T12:53:55.153511+0000","last_fullsized":"2024-04-26T12:53:55.153511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.153308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:06.760317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:23.470259+0000","last_change":"2024-04-26T12:54:23.470321+0000","last_active":"2024-04-26T12:54:23.470259+0000","last_peered":"2024-04-26T12:54:23.470259+0000","last_clean":"2024-04-26T12:54:23.470259+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:54:23.470259+0000","last_undegraded":"2024-04-26T12:54:23.470259+0000","last_fullsized":"2024-04-26T12:54:23.470259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:23.470029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:23.470029+0000","last_clean_scrub_stamp":"2024-04-26T12:54:23.470029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:14.937806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.124744+0000","last_change":"2024-04-26T12:53:34.124797+0000","last_active":"2024-04-26T12:53:34.124744+0000","last_peered":"2024-04-26T12:53:34.124744+0000","last_clean":"2024-04-26T12:53:34.124744+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:53:34.124744+0000","last_undegraded":"2024-04-26T12:53:34.124744+0000","last_fullsized":"2024-04-26T12:53:34.124744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.124506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:09.569031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.385969+0000","last_change":"2024-04-26T12:53:47.385969+0000","last_active":"2024-04-26T12:53:47.385969+0000","last_peered":"2024-04-26T12:53:47.385969+0000","last_clean":"2024-04-26T12:53:47.385969+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:53:47.385969+0000","last_undegraded":"2024-04-26T12:53:47.385969+0000","last_fullsized":"2024-04-26T12:53:47.385969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.385688+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:42.214059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":431,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.832479+0000","last_change":"2024-04-26T12:53:32.832479+0000","last_active":"2024-04-26T12:53:32.832479+0000","last_peered":"2024-04-26T12:53:32.832479+0000","last_clean":"2024-04-26T12:53:32.832479+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:32.832479+0000","last_undegraded":"2024-04-26T12:53:32.832479+0000","last_fullsized":"2024-04-26T12:53:32.832479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.832206+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:19.156979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969244+0000","last_change":"2024-04-26T12:50:04.303305+0000","last_active":"2024-04-26T12:52:27.969244+0000","last_peered":"2024-04-26T12:52:27.969244+0000","last_clean":"2024-04-26T12:52:27.969244+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:52:27.969244+0000","last_undegraded":"2024-04-26T12:52:27.969244+0000","last_fullsized":"2024-04-26T12:52:27.969244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'24","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.994253+0000","last_change":"2024-04-26T12:53:43.994314+0000","last_active":"2024-04-26T12:53:43.994253+0000","last_peered":"2024-04-26T12:53:43.994253+0000","last_clean":"2024-04-26T12:53:43.994253+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:43.994253+0000","last_undegraded":"2024-04-26T12:53:43.994253+0000","last_fullsized":"2024-04-26T12:53:43.994253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.994064+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:53.158642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.121700+0000","last_change":"2024-04-26T12:53:55.121759+0000","last_active":"2024-04-26T12:53:55.121700+0000","last_peered":"2024-04-26T12:53:55.121700+0000","last_clean":"2024-04-26T12:53:55.121700+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:53:55.121700+0000","last_undegraded":"2024-04-26T12:53:55.121700+0000","last_fullsized":"2024-04-26T12:53:55.121700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.121449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:23.400093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.121759+0000","last_change":"2024-04-26T12:53:33.121816+0000","last_active":"2024-04-26T12:53:33.121759+0000","last_peered":"2024-04-26T12:53:33.121759+0000","last_clean":"2024-04-26T12:53:33.121759+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:53:33.121759+0000","last_undegraded":"2024-04-26T12:53:33.121759+0000","last_fullsized":"2024-04-26T12:53:33.121759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.121556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:50.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.092152+0000","last_change":"2024-04-26T12:53:27.092239+0000","last_active":"2024-04-26T12:53:27.092152+0000","last_peered":"2024-04-26T12:53:27.092152+0000","last_clean":"2024-04-26T12:53:27.092152+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:53:27.092152+0000","last_undegraded":"2024-04-26T12:53:27.092152+0000","last_fullsized":"2024-04-26T12:53:27.092152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.091940+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:51.222988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.289177+0000","last_change":"2024-04-26T12:53:24.289294+0000","last_active":"2024-04-26T12:53:24.289177+0000","last_peered":"2024-04-26T12:53:24.289177+0000","last_clean":"2024-04-26T12:53:24.289177+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:53:24.289177+0000","last_undegraded":"2024-04-26T12:53:24.289177+0000","last_fullsized":"2024-04-26T12:53:24.289177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.288887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:44.523664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.358327+0000","last_change":"2024-04-26T12:54:16.358389+0000","last_active":"2024-04-26T12:54:16.358327+0000","last_peered":"2024-04-26T12:54:16.358327+0000","last_clean":"2024-04-26T12:54:16.358327+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:54:16.358327+0000","last_undegraded":"2024-04-26T12:54:16.358327+0000","last_fullsized":"2024-04-26T12:54:16.358327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:16.358132+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:16.358132+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.358132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:39.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.893739+0000","last_change":"2024-04-26T12:53:50.893805+0000","last_active":"2024-04-26T12:53:50.893739+0000","last_peered":"2024-04-26T12:53:50.893739+0000","last_clean":"2024-04-26T12:53:50.893739+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:53:50.893739+0000","last_undegraded":"2024-04-26T12:53:50.893739+0000","last_fullsized":"2024-04-26T12:53:50.893739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.893537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:00.221642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:27.969824+0000","last_change":"2024-04-26T12:49:54.259462+0000","last_active":"2024-04-26T12:52:27.969824+0000","last_peered":"2024-04-26T12:52:27.969824+0000","last_clean":"2024-04-26T12:52:27.969824+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:52:27.969824+0000","last_undegraded":"2024-04-26T12:52:27.969824+0000","last_fullsized":"2024-04-26T12:52:27.969824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:49:53.189928+0000","last_clean_scrub_stamp":"2024-04-26T12:49:53.189928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.929195+0000","last_change":"2024-04-26T12:53:38.929256+0000","last_active":"2024-04-26T12:53:38.929195+0000","last_peered":"2024-04-26T12:53:38.929195+0000","last_clean":"2024-04-26T12:53:38.929195+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:53:38.929195+0000","last_undegraded":"2024-04-26T12:53:38.929195+0000","last_fullsized":"2024-04-26T12:53:38.929195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.928996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:29.134252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.240483+0000","last_change":"2024-04-26T12:53:31.240665+0000","last_active":"2024-04-26T12:53:31.240483+0000","last_peered":"2024-04-26T12:53:31.240483+0000","last_clean":"2024-04-26T12:53:31.240483+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:53:31.240483+0000","last_undegraded":"2024-04-26T12:53:31.240483+0000","last_fullsized":"2024-04-26T12:53:31.240483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.240229+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:11.099663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.435994+0000","last_change":"2024-04-26T12:53:49.436052+0000","last_active":"2024-04-26T12:53:49.435994+0000","last_peered":"2024-04-26T12:53:49.435994+0000","last_clean":"2024-04-26T12:53:49.435994+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:53:49.435994+0000","last_undegraded":"2024-04-26T12:53:49.435994+0000","last_fullsized":"2024-04-26T12:53:49.435994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.435800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.047458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971454+0000","last_change":"2024-04-26T12:50:04.309834+0000","last_active":"2024-04-26T12:52:32.971454+0000","last_peered":"2024-04-26T12:52:32.971454+0000","last_clean":"2024-04-26T12:52:32.971454+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:52:32.971454+0000","last_undegraded":"2024-04-26T12:52:32.971454+0000","last_fullsized":"2024-04-26T12:52:32.971454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.482932+0000","last_change":"2024-04-26T12:54:08.483107+0000","last_active":"2024-04-26T12:54:08.482932+0000","last_peered":"2024-04-26T12:54:08.482932+0000","last_clean":"2024-04-26T12:54:08.482932+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:54:08.482932+0000","last_undegraded":"2024-04-26T12:54:08.482932+0000","last_fullsized":"2024-04-26T12:54:08.482932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:08.482670+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:08.482670+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.482670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:00.116592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.086364+0000","last_change":"2024-04-26T12:54:02.086394+0000","last_active":"2024-04-26T12:54:02.086364+0000","last_peered":"2024-04-26T12:54:02.086364+0000","last_clean":"2024-04-26T12:54:02.086364+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:54:02.086364+0000","last_undegraded":"2024-04-26T12:54:02.086364+0000","last_fullsized":"2024-04-26T12:54:02.086364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:02.086261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:02.086261+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.086261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:39.169507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.068318+0000","last_change":"2024-04-26T12:53:31.068439+0000","last_active":"2024-04-26T12:53:31.068318+0000","last_peered":"2024-04-26T12:53:31.068318+0000","last_clean":"2024-04-26T12:53:31.068318+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:53:31.068318+0000","last_undegraded":"2024-04-26T12:53:31.068318+0000","last_fullsized":"2024-04-26T12:53:31.068318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.068090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:16.753074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'32","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.452853+0000","last_change":"2024-04-26T12:53:51.452990+0000","last_active":"2024-04-26T12:53:51.452853+0000","last_peered":"2024-04-26T12:53:51.452853+0000","last_clean":"2024-04-26T12:53:51.452853+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:53:51.452853+0000","last_undegraded":"2024-04-26T12:53:51.452853+0000","last_fullsized":"2024-04-26T12:53:51.452853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'32","last_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_deep_scrub":"35'32","last_deep_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.452618+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.889839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.506938+0000","last_change":"2024-04-26T12:53:53.506996+0000","last_active":"2024-04-26T12:53:53.506938+0000","last_peered":"2024-04-26T12:53:53.506938+0000","last_clean":"2024-04-26T12:53:53.506938+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:53:53.506938+0000","last_undegraded":"2024-04-26T12:53:53.506938+0000","last_fullsized":"2024-04-26T12:53:53.506938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.506716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:38.844443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:52:32.971345+0000","last_change":"2024-04-26T12:50:04.309116+0000","last_active":"2024-04-26T12:52:32.971345+0000","last_peered":"2024-04-26T12:52:32.971345+0000","last_clean":"2024-04-26T12:52:32.971345+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:52:32.971345+0000","last_undegraded":"2024-04-26T12:52:32.971345+0000","last_fullsized":"2024-04-26T12:52:32.971345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:50:03.238474+0000","last_clean_scrub_stamp":"2024-04-26T12:50:03.238474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.981002+0000","last_change":"2024-04-26T12:53:54.981135+0000","last_active":"2024-04-26T12:53:54.981002+0000","last_peered":"2024-04-26T12:53:54.981002+0000","last_clean":"2024-04-26T12:53:54.981002+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:53:54.981002+0000","last_undegraded":"2024-04-26T12:53:54.981002+0000","last_fullsized":"2024-04-26T12:53:54.981002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.980684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:23.450201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.283199+0000","last_change":"2024-04-26T12:54:01.283199+0000","last_active":"2024-04-26T12:54:01.283199+0000","last_peered":"2024-04-26T12:54:01.283199+0000","last_clean":"2024-04-26T12:54:01.283199+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:54:01.283199+0000","last_undegraded":"2024-04-26T12:54:01.283199+0000","last_fullsized":"2024-04-26T12:54:01.283199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:01.282930+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:01.282930+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.282930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:55.471622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.069160+0000","last_change":"2024-04-26T12:53:30.069291+0000","last_active":"2024-04-26T12:53:30.069160+0000","last_peered":"2024-04-26T12:53:30.069160+0000","last_clean":"2024-04-26T12:53:30.069160+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:53:30.069160+0000","last_undegraded":"2024-04-26T12:53:30.069160+0000","last_fullsized":"2024-04-26T12:53:30.069160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.068914+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:20.274170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.418105+0000","last_change":"2024-04-26T12:53:50.418159+0000","last_active":"2024-04-26T12:53:50.418105+0000","last_peered":"2024-04-26T12:53:50.418105+0000","last_clean":"2024-04-26T12:53:50.418105+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:50.418105+0000","last_undegraded":"2024-04-26T12:53:50.418105+0000","last_fullsized":"2024-04-26T12:53:50.418105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.417994+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:42.018459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.295415+0000","last_change":"2024-04-26T12:53:26.295546+0000","last_active":"2024-04-26T12:53:26.295415+0000","last_peered":"2024-04-26T12:53:26.295415+0000","last_clean":"2024-04-26T12:53:26.295415+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:53:26.295415+0000","last_undegraded":"2024-04-26T12:53:26.295415+0000","last_fullsized":"2024-04-26T12:53:26.295415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.295181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:21.587262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.514864+0000","last_change":"2024-04-26T12:54:09.514929+0000","last_active":"2024-04-26T12:54:09.514864+0000","last_peered":"2024-04-26T12:54:09.514864+0000","last_clean":"2024-04-26T12:54:09.514864+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:54:09.514864+0000","last_undegraded":"2024-04-26T12:54:09.514864+0000","last_fullsized":"2024-04-26T12:54:09.514864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:09.514660+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:09.514660+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.514660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:53.553405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.144167+0000","last_change":"2024-04-26T12:53:46.144167+0000","last_active":"2024-04-26T12:53:46.144167+0000","last_peered":"2024-04-26T12:53:46.144167+0000","last_clean":"2024-04-26T12:53:46.144167+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:46.144167+0000","last_undegraded":"2024-04-26T12:53:46.144167+0000","last_fullsized":"2024-04-26T12:53:46.144167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.143916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:10.720490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.939817+0000","last_change":"2024-04-26T12:53:51.939817+0000","last_active":"2024-04-26T12:53:51.939817+0000","last_peered":"2024-04-26T12:53:51.939817+0000","last_clean":"2024-04-26T12:53:51.939817+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:53:51.939817+0000","last_undegraded":"2024-04-26T12:53:51.939817+0000","last_fullsized":"2024-04-26T12:53:51.939817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.939533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:29.601591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.262502+0000","last_change":"2024-04-26T12:53:51.262502+0000","last_active":"2024-04-26T12:53:51.262502+0000","last_peered":"2024-04-26T12:53:51.262502+0000","last_clean":"2024-04-26T12:53:51.262502+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:51.262502+0000","last_undegraded":"2024-04-26T12:53:51.262502+0000","last_fullsized":"2024-04-26T12:53:51.262502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.262245+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.721553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.165739+0000","last_change":"2024-04-26T12:53:56.165739+0000","last_active":"2024-04-26T12:53:56.165739+0000","last_peered":"2024-04-26T12:53:56.165739+0000","last_clean":"2024-04-26T12:53:56.165739+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:53:56.165739+0000","last_undegraded":"2024-04-26T12:53:56.165739+0000","last_fullsized":"2024-04-26T12:53:56.165739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.165465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:33.355823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.418074+0000","last_change":"2024-04-26T12:54:06.418074+0000","last_active":"2024-04-26T12:54:06.418074+0000","last_peered":"2024-04-26T12:54:06.418074+0000","last_clean":"2024-04-26T12:54:06.418074+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:54:06.418074+0000","last_undegraded":"2024-04-26T12:54:06.418074+0000","last_fullsized":"2024-04-26T12:54:06.418074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:06.417830+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:06.417830+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.417830+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:00.383510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:30.542647+0000","last_change":"2024-04-26T12:54:30.542721+0000","last_active":"2024-04-26T12:54:30.542647+0000","last_peered":"2024-04-26T12:54:30.542647+0000","last_clean":"2024-04-26T12:54:30.542647+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:54:30.542647+0000","last_undegraded":"2024-04-26T12:54:30.542647+0000","last_fullsized":"2024-04-26T12:54:30.542647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:30.542433+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:30.542433+0000","last_clean_scrub_stamp":"2024-04-26T12:54:30.542433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:37.075885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.094315+0000","last_change":"2024-04-26T12:54:03.094315+0000","last_active":"2024-04-26T12:54:03.094315+0000","last_peered":"2024-04-26T12:54:03.094315+0000","last_clean":"2024-04-26T12:54:03.094315+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:54:03.094315+0000","last_undegraded":"2024-04-26T12:54:03.094315+0000","last_fullsized":"2024-04-26T12:54:03.094315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:03.094053+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:03.094053+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.094053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:04.790219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.178704+0000","last_change":"2024-04-26T12:54:09.178771+0000","last_active":"2024-04-26T12:54:09.178704+0000","last_peered":"2024-04-26T12:54:09.178704+0000","last_clean":"2024-04-26T12:54:09.178704+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:54:09.178704+0000","last_undegraded":"2024-04-26T12:54:09.178704+0000","last_fullsized":"2024-04-26T12:54:09.178704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:09.178495+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:09.178495+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.178495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:57.622469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.097598+0000","last_change":"2024-04-26T12:53:59.097598+0000","last_active":"2024-04-26T12:53:59.097598+0000","last_peered":"2024-04-26T12:53:59.097598+0000","last_clean":"2024-04-26T12:53:59.097598+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:53:59.097598+0000","last_undegraded":"2024-04-26T12:53:59.097598+0000","last_fullsized":"2024-04-26T12:53:59.097598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.097326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:47.866871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.202547+0000","last_change":"2024-04-26T12:53:54.202547+0000","last_active":"2024-04-26T12:53:54.202547+0000","last_peered":"2024-04-26T12:53:54.202547+0000","last_clean":"2024-04-26T12:53:54.202547+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:53:54.202547+0000","last_undegraded":"2024-04-26T12:53:54.202547+0000","last_fullsized":"2024-04-26T12:53:54.202547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.202278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:55.097855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.220338+0000","last_change":"2024-04-26T12:53:39.220338+0000","last_active":"2024-04-26T12:53:39.220338+0000","last_peered":"2024-04-26T12:53:39.220338+0000","last_clean":"2024-04-26T12:53:39.220338+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:39.220338+0000","last_undegraded":"2024-04-26T12:53:39.220338+0000","last_fullsized":"2024-04-26T12:53:39.220338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.220089+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:13.125940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.350324+0000","last_change":"2024-04-26T12:54:11.350324+0000","last_active":"2024-04-26T12:54:11.350324+0000","last_peered":"2024-04-26T12:54:11.350324+0000","last_clean":"2024-04-26T12:54:11.350324+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:54:11.350324+0000","last_undegraded":"2024-04-26T12:54:11.350324+0000","last_fullsized":"2024-04-26T12:54:11.350324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:11.350039+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:11.350039+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.350039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:29.715742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.022978+0000","last_change":"2024-04-26T12:54:15.023177+0000","last_active":"2024-04-26T12:54:15.022978+0000","last_peered":"2024-04-26T12:54:15.022978+0000","last_clean":"2024-04-26T12:54:15.022978+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:54:15.022978+0000","last_undegraded":"2024-04-26T12:54:15.022978+0000","last_fullsized":"2024-04-26T12:54:15.022978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:15.022751+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:15.022751+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.022751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:45.263486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.022822+0000","last_change":"2024-04-26T12:53:46.022822+0000","last_active":"2024-04-26T12:53:46.022822+0000","last_peered":"2024-04-26T12:53:46.022822+0000","last_clean":"2024-04-26T12:53:46.022822+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:53:46.022822+0000","last_undegraded":"2024-04-26T12:53:46.022822+0000","last_fullsized":"2024-04-26T12:53:46.022822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.022525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:48.747486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.313205+0000","last_change":"2024-04-26T12:54:02.313205+0000","last_active":"2024-04-26T12:54:02.313205+0000","last_peered":"2024-04-26T12:54:02.313205+0000","last_clean":"2024-04-26T12:54:02.313205+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:54:02.313205+0000","last_undegraded":"2024-04-26T12:54:02.313205+0000","last_fullsized":"2024-04-26T12:54:02.313205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:02.312870+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:02.312870+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.312870+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:37.400546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.141412+0000","last_change":"2024-04-26T12:54:10.141412+0000","last_active":"2024-04-26T12:54:10.141412+0000","last_peered":"2024-04-26T12:54:10.141412+0000","last_clean":"2024-04-26T12:54:10.141412+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:54:10.141412+0000","last_undegraded":"2024-04-26T12:54:10.141412+0000","last_fullsized":"2024-04-26T12:54:10.141412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:10.141147+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:10.141147+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.141147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:35.775459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'10","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.188767+0000","last_change":"2024-04-26T12:53:53.188767+0000","last_active":"2024-04-26T12:53:53.188767+0000","last_peered":"2024-04-26T12:53:53.188767+0000","last_clean":"2024-04-26T12:53:53.188767+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:53.188767+0000","last_undegraded":"2024-04-26T12:53:53.188767+0000","last_fullsized":"2024-04-26T12:53:53.188767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.188457+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.177200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:20.511533+0000","last_change":"2024-04-26T12:54:20.511671+0000","last_active":"2024-04-26T12:54:20.511533+0000","last_peered":"2024-04-26T12:54:20.511533+0000","last_clean":"2024-04-26T12:54:20.511533+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:54:20.511533+0000","last_undegraded":"2024-04-26T12:54:20.511533+0000","last_fullsized":"2024-04-26T12:54:20.511533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:20.511200+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:20.511200+0000","last_clean_scrub_stamp":"2024-04-26T12:54:20.511200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:48.862437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.458983+0000","last_change":"2024-04-26T12:53:58.458983+0000","last_active":"2024-04-26T12:53:58.458983+0000","last_peered":"2024-04-26T12:53:58.458983+0000","last_clean":"2024-04-26T12:53:58.458983+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:53:58.458983+0000","last_undegraded":"2024-04-26T12:53:58.458983+0000","last_fullsized":"2024-04-26T12:53:58.458983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:58.458701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:58.458701+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.458701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:23.882587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.111930+0000","last_change":"2024-04-26T12:54:06.111930+0000","last_active":"2024-04-26T12:54:06.111930+0000","last_peered":"2024-04-26T12:54:06.111930+0000","last_clean":"2024-04-26T12:54:06.111930+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:54:06.111930+0000","last_undegraded":"2024-04-26T12:54:06.111930+0000","last_fullsized":"2024-04-26T12:54:06.111930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:06.111515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:06.111515+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.111515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:15.407080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:22.085537+0000","last_change":"2024-04-26T12:54:22.085537+0000","last_active":"2024-04-26T12:54:22.085537+0000","last_peered":"2024-04-26T12:54:22.085537+0000","last_clean":"2024-04-26T12:54:22.085537+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:54:22.085537+0000","last_undegraded":"2024-04-26T12:54:22.085537+0000","last_fullsized":"2024-04-26T12:54:22.085537+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:22.085123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:22.085123+0000","last_clean_scrub_stamp":"2024-04-26T12:54:22.085123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:12.082735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.347824+0000","last_change":"2024-04-26T12:54:10.347824+0000","last_active":"2024-04-26T12:54:10.347824+0000","last_peered":"2024-04-26T12:54:10.347824+0000","last_clean":"2024-04-26T12:54:10.347824+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:54:10.347824+0000","last_undegraded":"2024-04-26T12:54:10.347824+0000","last_fullsized":"2024-04-26T12:54:10.347824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:10.347555+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:10.347555+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.347555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:59.959213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.238882+0000","last_change":"2024-04-26T12:54:00.238882+0000","last_active":"2024-04-26T12:54:00.238882+0000","last_peered":"2024-04-26T12:54:00.238882+0000","last_clean":"2024-04-26T12:54:00.238882+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:54:00.238882+0000","last_undegraded":"2024-04-26T12:54:00.238882+0000","last_fullsized":"2024-04-26T12:54:00.238882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:00.238630+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:00.238630+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.238630+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.241644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.301091+0000","last_change":"2024-04-26T12:54:08.301091+0000","last_active":"2024-04-26T12:54:08.301091+0000","last_peered":"2024-04-26T12:54:08.301091+0000","last_clean":"2024-04-26T12:54:08.301091+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:54:08.301091+0000","last_undegraded":"2024-04-26T12:54:08.301091+0000","last_fullsized":"2024-04-26T12:54:08.301091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:08.300828+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:08.300828+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.300828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:04.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.211925+0000","last_change":"2024-04-26T12:53:41.211925+0000","last_active":"2024-04-26T12:53:41.211925+0000","last_peered":"2024-04-26T12:53:41.211925+0000","last_clean":"2024-04-26T12:53:41.211925+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:41.211925+0000","last_undegraded":"2024-04-26T12:53:41.211925+0000","last_fullsized":"2024-04-26T12:53:41.211925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.211668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:06.215290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:19.543470+0000","last_change":"2024-04-26T12:54:19.543470+0000","last_active":"2024-04-26T12:54:19.543470+0000","last_peered":"2024-04-26T12:54:19.543470+0000","last_clean":"2024-04-26T12:54:19.543470+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:54:19.543470+0000","last_undegraded":"2024-04-26T12:54:19.543470+0000","last_fullsized":"2024-04-26T12:54:19.543470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:19.543215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:19.543215+0000","last_clean_scrub_stamp":"2024-04-26T12:54:19.543215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:41.214610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.141316+0000","last_change":"2024-04-26T12:53:54.141316+0000","last_active":"2024-04-26T12:53:54.141316+0000","last_peered":"2024-04-26T12:53:54.141316+0000","last_clean":"2024-04-26T12:53:54.141316+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:54.141316+0000","last_undegraded":"2024-04-26T12:53:54.141316+0000","last_fullsized":"2024-04-26T12:53:54.141316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.141037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:28.129327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:27.533233+0000","last_change":"2024-04-26T12:54:27.533233+0000","last_active":"2024-04-26T12:54:27.533233+0000","last_peered":"2024-04-26T12:54:27.533233+0000","last_clean":"2024-04-26T12:54:27.533233+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:54:27.533233+0000","last_undegraded":"2024-04-26T12:54:27.533233+0000","last_fullsized":"2024-04-26T12:54:27.533233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:27.532972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:27.532972+0000","last_clean_scrub_stamp":"2024-04-26T12:54:27.532972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:45.178226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.552115+0000","last_change":"2024-04-26T12:54:02.552115+0000","last_active":"2024-04-26T12:54:02.552115+0000","last_peered":"2024-04-26T12:54:02.552115+0000","last_clean":"2024-04-26T12:54:02.552115+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:54:02.552115+0000","last_undegraded":"2024-04-26T12:54:02.552115+0000","last_fullsized":"2024-04-26T12:54:02.552115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:54:02.551851+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:54:02.551851+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.551851+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:15.051310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.914055+0000","last_change":"2024-04-26T12:53:49.914055+0000","last_active":"2024-04-26T12:53:49.914055+0000","last_peered":"2024-04-26T12:53:49.914055+0000","last_clean":"2024-04-26T12:53:49.914055+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:53:49.914055+0000","last_undegraded":"2024-04-26T12:53:49.914055+0000","last_fullsized":"2024-04-26T12:53:49.914055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.913803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:16.913370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.350004+0000","last_change":"2024-04-26T12:54:04.350004+0000","last_active":"2024-04-26T12:54:04.350004+0000","last_peered":"2024-04-26T12:54:04.350004+0000","last_clean":"2024-04-26T12:54:04.350004+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:54:04.350004+0000","last_undegraded":"2024-04-26T12:54:04.350004+0000","last_fullsized":"2024-04-26T12:54:04.350004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:04.349733+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:04.349733+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.349733+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:19.125248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:29.546708+0000","last_change":"2024-04-26T12:54:29.546708+0000","last_active":"2024-04-26T12:54:29.546708+0000","last_peered":"2024-04-26T12:54:29.546708+0000","last_clean":"2024-04-26T12:54:29.546708+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:54:29.546708+0000","last_undegraded":"2024-04-26T12:54:29.546708+0000","last_fullsized":"2024-04-26T12:54:29.546708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:29.546398+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:29.546398+0000","last_clean_scrub_stamp":"2024-04-26T12:54:29.546398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:41.994734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:18.522804+0000","last_change":"2024-04-26T12:54:18.522804+0000","last_active":"2024-04-26T12:54:18.522804+0000","last_peered":"2024-04-26T12:54:18.522804+0000","last_clean":"2024-04-26T12:54:18.522804+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:54:18.522804+0000","last_undegraded":"2024-04-26T12:54:18.522804+0000","last_fullsized":"2024-04-26T12:54:18.522804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:18.522391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:18.522391+0000","last_clean_scrub_stamp":"2024-04-26T12:54:18.522391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:12.022300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.297136+0000","last_change":"2024-04-26T12:53:47.297203+0000","last_active":"2024-04-26T12:53:47.297136+0000","last_peered":"2024-04-26T12:53:47.297136+0000","last_clean":"2024-04-26T12:53:47.297136+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:47.297136+0000","last_undegraded":"2024-04-26T12:53:47.297136+0000","last_fullsized":"2024-04-26T12:53:47.297136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.296913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:39.557010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.257555+0000","last_change":"2024-04-26T12:53:52.257555+0000","last_active":"2024-04-26T12:53:52.257555+0000","last_peered":"2024-04-26T12:53:52.257555+0000","last_clean":"2024-04-26T12:53:52.257555+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:53:52.257555+0000","last_undegraded":"2024-04-26T12:53:52.257555+0000","last_fullsized":"2024-04-26T12:53:52.257555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.257248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:36.650269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.154392+0000","last_change":"2024-04-26T12:53:47.154450+0000","last_active":"2024-04-26T12:53:47.154392+0000","last_peered":"2024-04-26T12:53:47.154392+0000","last_clean":"2024-04-26T12:53:47.154392+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:53:47.154392+0000","last_undegraded":"2024-04-26T12:53:47.154392+0000","last_fullsized":"2024-04-26T12:53:47.154392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.154181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:47.175281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":153627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640320,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1015808,"data_stored":740708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640320,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1040384,"data_stored":740685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":458752,"data_stored":152990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:54:42.867 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.867 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.868 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.868 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:49:57.198321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=57, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.868 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.869 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.869 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:49:53.189928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=49, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.869 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.869 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:50:03.238474+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=50, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=53, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:54:42.870 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:55:02.870 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:55:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dcb537640 1 Processor -- start 2024-04-26T12:55:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dcb537640 1 -- start start 2024-04-26T12:55:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dcb537640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1dc40939f0 0x7f1dc4093dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:55:03.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dcb537640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc409d410 con 0x7f1dc4094cb0 2024-04-26T12:55:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dcb537640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc4093360 con 0x7f1dc40939f0 2024-04-26T12:55:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dc92d3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1dc40939f0 0x7f1dc4093dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:55:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dc92d3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1dc40939f0 0x7f1dc4093dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51920/0 (socket says 172.21.15.29:51920) 2024-04-26T12:55:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dc92d3640 1 -- 172.21.15.29:0/1321043713 learned_addr learned my addr 172.21.15.29:0/1321043713 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:55:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dc92d3640 1 -- 172.21.15.29:0/1321043713 >> v1:172.21.15.29:6789/0 conn(0x7f1dc4094cb0 legacy=0x7f1dc412c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dc92d3640 1 -- 172.21.15.29:0/1321043713 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc40969b0 con 0x7f1dc40939f0 2024-04-26T12:55:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dc92d3640 1 --2- 172.21.15.29:0/1321043713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc4093dd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097f0 tx=0x7f1dc001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51f65c0cc27a1b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:55:03.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dbbfff640 1 -- 172.21.15.29:0/1321043713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc00b0070 con 0x7f1dc40939f0 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dbbfff640 1 -- 172.21.15.29:0/1321043713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc00ab530 con 0x7f1dc40939f0 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.005+0000 7f1dbbfff640 1 -- 172.21.15.29:0/1321043713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc00ab830 con 0x7f1dc40939f0 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1321043713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 msgr2=0x7f1dc4093dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 --2- 172.21.15.29:0/1321043713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc4093dd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097f0 tx=0x7f1dc001c430 comp rx=0 tx=0).stop 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1321043713 shutdown_connections 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 --2- 172.21.15.29:0/1321043713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc4093dd0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1321043713 >> 172.21.15.29:0/1321043713 conn(0x7f1dc409a3f0 msgr2=0x7f1dc409a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1321043713 shutdown_connections 2024-04-26T12:55:03.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1321043713 wait complete. 2024-04-26T12:55:03.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 Processor -- start 2024-04-26T12:55:03.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- start start 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc408e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc4134e60 con 0x7f1dc40939f0 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dc92d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc408e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dc92d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc408e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51932/0 (socket says 172.21.15.29:51932) 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dc92d3640 1 -- 172.21.15.29:0/1849962828 learned_addr learned my addr 172.21.15.29:0/1849962828 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dc92d3640 1 -- 172.21.15.29:0/1849962828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc4073510 con 0x7f1dc40939f0 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dc92d3640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc408e5e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00ae040 tx=0x7f1dc001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1db9ffb640 1 -- 172.21.15.29:0/1849962828 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc00ba020 con 0x7f1dc40939f0 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc4072330 con 0x7f1dc40939f0 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1db9ffb640 1 -- 172.21.15.29:0/1849962828 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc00aa5f0 con 0x7f1dc40939f0 2024-04-26T12:55:03.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc4072650 con 0x7f1dc40939f0 2024-04-26T12:55:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1db9ffb640 1 -- 172.21.15.29:0/1849962828 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dc00b0040 con 0x7f1dc40939f0 2024-04-26T12:55:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc4062f80 con 0x7f1dc40939f0 2024-04-26T12:55:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1db9ffb640 1 -- 172.21.15.29:0/1849962828 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1dc00bd020 con 0x7f1dc40939f0 2024-04-26T12:55:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1db9ffb640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1da8035d60 0x7f1da8038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:55:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.009+0000 7f1db9ffb640 1 -- 172.21.15.29:0/1849962828 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f1dc00e3960 con 0x7f1dc40939f0 2024-04-26T12:55:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.013+0000 7f1dc8ad2640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1da8035d60 0x7f1da8038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:55:03.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.013+0000 7f1dc8ad2640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1da8035d60 0x7f1da8038220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1db4001590 tx=0x7f1db4007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:55:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.017+0000 7f1db9ffb640 1 -- 172.21.15.29:0/1849962828 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1dc00c4030 con 0x7f1dc40939f0 2024-04-26T12:55:03.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.173+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 --> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1dc408f650 con 0x7f1da8035d60 2024-04-26T12:55:03.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.217+0000 7f1db9ffb640 1 -- 172.21.15.29:0/1849962828 <== mgr.4100 v2:172.21.15.72:6824/3729194001 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666035 (secure 0 0 0) 0x7f1db4005080 con 0x7f1da8035d60 2024-04-26T12:55:03.222 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T12:55:03.230 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T12:55:03.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1da8035d60 msgr2=0x7f1da8038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1da8035d60 0x7f1da8038220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1db4001590 tx=0x7f1db4007a60 comp rx=0 tx=0).stop 2024-04-26T12:55:03.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 msgr2=0x7f1dc408e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc408e5e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00ae040 tx=0x7f1dc001ac70 comp rx=0 tx=0).stop 2024-04-26T12:55:03.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 shutdown_connections 2024-04-26T12:55:03.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f1da8035d60 0x7f1da8038220 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:55:03.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 --2- 172.21.15.29:0/1849962828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc40939f0 0x7f1dc408e5e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:55:03.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 >> 172.21.15.29:0/1849962828 conn(0x7f1dc409a3f0 msgr2=0x7f1dc412f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:55:03.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 shutdown_connections 2024-04-26T12:55:03.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.225+0000 7f1dcb537640 1 -- 172.21.15.29:0/1849962828 wait complete. 2024-04-26T12:55:03.248 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-26T12:55:01.290688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152600,"kb_used_data":2936,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334760,"statfs":{"total":386547056640,"available":386390794240,"internally_reserved":0,"allocated":3006464,"data_stored":1788010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6381,"internal_metadata":153216787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006727"},"pg_stats":[{"pgid":"3.3f","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.101579+0000","last_change":"2024-04-26T12:54:05.101579+0000","last_active":"2024-04-26T12:54:05.101579+0000","last_peered":"2024-04-26T12:54:05.101579+0000","last_clean":"2024-04-26T12:54:05.101579+0000","last_became_active":"2024-04-26T12:49:54.242189+0000","last_became_peered":"2024-04-26T12:49:54.242189+0000","last_unstale":"2024-04-26T12:54:05.101579+0000","last_undegraded":"2024-04-26T12:54:05.101579+0000","last_fullsized":"2024-04-26T12:54:05.101579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:05.101171+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:05.101171+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.101171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:33.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.180182+0000","last_change":"2024-04-26T12:53:50.180182+0000","last_active":"2024-04-26T12:53:50.180182+0000","last_peered":"2024-04-26T12:53:50.180182+0000","last_clean":"2024-04-26T12:53:50.180182+0000","last_became_active":"2024-04-26T12:49:56.222285+0000","last_became_peered":"2024-04-26T12:49:56.222285+0000","last_unstale":"2024-04-26T12:53:50.180182+0000","last_undegraded":"2024-04-26T12:53:50.180182+0000","last_fullsized":"2024-04-26T12:53:50.180182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:50.179924+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.179924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:48.519706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.094761+0000","last_change":"2024-04-26T12:54:11.094820+0000","last_active":"2024-04-26T12:54:11.094761+0000","last_peered":"2024-04-26T12:54:11.094761+0000","last_clean":"2024-04-26T12:54:11.094761+0000","last_became_active":"2024-04-26T12:49:54.233419+0000","last_became_peered":"2024-04-26T12:49:54.233419+0000","last_unstale":"2024-04-26T12:54:11.094761+0000","last_undegraded":"2024-04-26T12:54:11.094761+0000","last_fullsized":"2024-04-26T12:54:11.094761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:11.094551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:11.094551+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.094551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:33.971975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.438155+0000","last_change":"2024-04-26T12:54:07.438155+0000","last_active":"2024-04-26T12:54:07.438155+0000","last_peered":"2024-04-26T12:54:07.438155+0000","last_clean":"2024-04-26T12:54:07.438155+0000","last_became_active":"2024-04-26T12:49:56.223224+0000","last_became_peered":"2024-04-26T12:49:56.223224+0000","last_unstale":"2024-04-26T12:54:07.438155+0000","last_undegraded":"2024-04-26T12:54:07.438155+0000","last_fullsized":"2024-04-26T12:54:07.438155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:07.437770+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:07.437770+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.437770+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:25.917131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.613235+0000","last_change":"2024-04-26T12:54:14.613301+0000","last_active":"2024-04-26T12:54:14.613235+0000","last_peered":"2024-04-26T12:54:14.613235+0000","last_clean":"2024-04-26T12:54:14.613235+0000","last_became_active":"2024-04-26T12:49:54.258223+0000","last_became_peered":"2024-04-26T12:49:54.258223+0000","last_unstale":"2024-04-26T12:54:14.613235+0000","last_undegraded":"2024-04-26T12:54:14.613235+0000","last_fullsized":"2024-04-26T12:54:14.613235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:14.613017+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:14.613017+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.613017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:01.524008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.501925+0000","last_change":"2024-04-26T12:53:55.501925+0000","last_active":"2024-04-26T12:53:55.501925+0000","last_peered":"2024-04-26T12:53:55.501925+0000","last_clean":"2024-04-26T12:53:55.501925+0000","last_became_active":"2024-04-26T12:49:56.228261+0000","last_became_peered":"2024-04-26T12:49:56.228261+0000","last_unstale":"2024-04-26T12:53:55.501925+0000","last_undegraded":"2024-04-26T12:53:55.501925+0000","last_fullsized":"2024-04-26T12:53:55.501925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:55.501661+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.501661+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:47.218244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.030404+0000","last_change":"2024-04-26T12:53:58.030471+0000","last_active":"2024-04-26T12:53:58.030404+0000","last_peered":"2024-04-26T12:53:58.030404+0000","last_clean":"2024-04-26T12:53:58.030404+0000","last_became_active":"2024-04-26T12:49:54.243034+0000","last_became_peered":"2024-04-26T12:49:54.243034+0000","last_unstale":"2024-04-26T12:53:58.030404+0000","last_undegraded":"2024-04-26T12:53:58.030404+0000","last_fullsized":"2024-04-26T12:53:58.030404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:58.030190+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:58.030190+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.030190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:58.883912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'14","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.156618+0000","last_change":"2024-04-26T12:54:13.156680+0000","last_active":"2024-04-26T12:54:13.156618+0000","last_peered":"2024-04-26T12:54:13.156618+0000","last_clean":"2024-04-26T12:54:13.156618+0000","last_became_active":"2024-04-26T12:50:34.311872+0000","last_became_peered":"2024-04-26T12:50:34.311872+0000","last_unstale":"2024-04-26T12:54:13.156618+0000","last_undegraded":"2024-04-26T12:54:13.156618+0000","last_fullsized":"2024-04-26T12:54:13.156618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:54:13.156427+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:54:13.156427+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.156427+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:11.918711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:28.549235+0000","last_change":"2024-04-26T12:54:28.549235+0000","last_active":"2024-04-26T12:54:28.549235+0000","last_peered":"2024-04-26T12:54:28.549235+0000","last_clean":"2024-04-26T12:54:28.549235+0000","last_became_active":"2024-04-26T12:49:54.236339+0000","last_became_peered":"2024-04-26T12:49:54.236339+0000","last_unstale":"2024-04-26T12:54:28.549235+0000","last_undegraded":"2024-04-26T12:54:28.549235+0000","last_fullsized":"2024-04-26T12:54:28.549235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:28.548748+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:28.548748+0000","last_clean_scrub_stamp":"2024-04-26T12:54:28.548748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:00.030263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.425667+0000","last_change":"2024-04-26T12:54:14.425735+0000","last_active":"2024-04-26T12:54:14.425667+0000","last_peered":"2024-04-26T12:54:14.425667+0000","last_clean":"2024-04-26T12:54:14.425667+0000","last_became_active":"2024-04-26T12:49:56.231352+0000","last_became_peered":"2024-04-26T12:49:56.231352+0000","last_unstale":"2024-04-26T12:54:14.425667+0000","last_undegraded":"2024-04-26T12:54:14.425667+0000","last_fullsized":"2024-04-26T12:54:14.425667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:14.425453+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:14.425453+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.425453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:33.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.087785+0000","last_change":"2024-04-26T12:54:03.087785+0000","last_active":"2024-04-26T12:54:03.087785+0000","last_peered":"2024-04-26T12:54:03.087785+0000","last_clean":"2024-04-26T12:54:03.087785+0000","last_became_active":"2024-04-26T12:49:54.242078+0000","last_became_peered":"2024-04-26T12:49:54.242078+0000","last_unstale":"2024-04-26T12:54:03.087785+0000","last_undegraded":"2024-04-26T12:54:03.087785+0000","last_fullsized":"2024-04-26T12:54:03.087785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:03.087384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:03.087384+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.087384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:15.190060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.551347+0000","last_change":"2024-04-26T12:54:00.551347+0000","last_active":"2024-04-26T12:54:00.551347+0000","last_peered":"2024-04-26T12:54:00.551347+0000","last_clean":"2024-04-26T12:54:00.551347+0000","last_became_active":"2024-04-26T12:49:56.226775+0000","last_became_peered":"2024-04-26T12:49:56.226775+0000","last_unstale":"2024-04-26T12:54:00.551347+0000","last_undegraded":"2024-04-26T12:54:00.551347+0000","last_fullsized":"2024-04-26T12:54:00.551347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:00.551092+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:00.551092+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.551092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:09.956495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:24.498190+0000","last_change":"2024-04-26T12:54:24.498190+0000","last_active":"2024-04-26T12:54:24.498190+0000","last_peered":"2024-04-26T12:54:24.498190+0000","last_clean":"2024-04-26T12:54:24.498190+0000","last_became_active":"2024-04-26T12:49:54.235525+0000","last_became_peered":"2024-04-26T12:49:54.235525+0000","last_unstale":"2024-04-26T12:54:24.498190+0000","last_undegraded":"2024-04-26T12:54:24.498190+0000","last_fullsized":"2024-04-26T12:54:24.498190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:24.497863+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:24.497863+0000","last_clean_scrub_stamp":"2024-04-26T12:54:24.497863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:35.575426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.002599+0000","last_change":"2024-04-26T12:53:57.002599+0000","last_active":"2024-04-26T12:53:57.002599+0000","last_peered":"2024-04-26T12:53:57.002599+0000","last_clean":"2024-04-26T12:53:57.002599+0000","last_became_active":"2024-04-26T12:49:56.218951+0000","last_became_peered":"2024-04-26T12:49:56.218951+0000","last_unstale":"2024-04-26T12:53:57.002599+0000","last_undegraded":"2024-04-26T12:53:57.002599+0000","last_fullsized":"2024-04-26T12:53:57.002599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:57.002331+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.002331+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:55.456014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.057862+0000","last_change":"2024-04-26T12:54:13.057862+0000","last_active":"2024-04-26T12:54:13.057862+0000","last_peered":"2024-04-26T12:54:13.057862+0000","last_clean":"2024-04-26T12:54:13.057862+0000","last_became_active":"2024-04-26T12:49:54.237230+0000","last_became_peered":"2024-04-26T12:49:54.237230+0000","last_unstale":"2024-04-26T12:54:13.057862+0000","last_undegraded":"2024-04-26T12:54:13.057862+0000","last_fullsized":"2024-04-26T12:54:13.057862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:13.057507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:13.057507+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.057507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:20.511598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'16","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.035799+0000","last_change":"2024-04-26T12:53:45.035799+0000","last_active":"2024-04-26T12:53:45.035799+0000","last_peered":"2024-04-26T12:53:45.035799+0000","last_clean":"2024-04-26T12:53:45.035799+0000","last_became_active":"2024-04-26T12:49:56.213748+0000","last_became_peered":"2024-04-26T12:49:56.213748+0000","last_unstale":"2024-04-26T12:53:45.035799+0000","last_undegraded":"2024-04-26T12:53:45.035799+0000","last_fullsized":"2024-04-26T12:53:45.035799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:45.035418+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.035418+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:47.435437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":39,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'10","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.531865+0000","last_change":"2024-04-26T12:54:10.531865+0000","last_active":"2024-04-26T12:54:10.531865+0000","last_peered":"2024-04-26T12:54:10.531865+0000","last_clean":"2024-04-26T12:54:10.531865+0000","last_became_active":"2024-04-26T12:49:56.220182+0000","last_became_peered":"2024-04-26T12:49:56.220182+0000","last_unstale":"2024-04-26T12:54:10.531865+0000","last_undegraded":"2024-04-26T12:54:10.531865+0000","last_fullsized":"2024-04-26T12:54:10.531865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:10.531604+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:10.531604+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.531604+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:00.093217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'4","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.186243+0000","last_change":"2024-04-26T12:53:59.186243+0000","last_active":"2024-04-26T12:53:59.186243+0000","last_peered":"2024-04-26T12:53:59.186243+0000","last_clean":"2024-04-26T12:53:59.186243+0000","last_became_active":"2024-04-26T12:49:54.245157+0000","last_became_peered":"2024-04-26T12:49:54.245157+0000","last_unstale":"2024-04-26T12:53:59.186243+0000","last_undegraded":"2024-04-26T12:53:59.186243+0000","last_fullsized":"2024-04-26T12:53:59.186243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:59.185989+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:59.185989+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.185989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:01.086515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.168771+0000","last_change":"2024-04-26T12:53:51.168771+0000","last_active":"2024-04-26T12:53:51.168771+0000","last_peered":"2024-04-26T12:53:51.168771+0000","last_clean":"2024-04-26T12:53:51.168771+0000","last_became_active":"2024-04-26T12:49:56.217716+0000","last_became_peered":"2024-04-26T12:49:56.217716+0000","last_unstale":"2024-04-26T12:53:51.168771+0000","last_undegraded":"2024-04-26T12:53:51.168771+0000","last_fullsized":"2024-04-26T12:53:51.168771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:51.168499+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.168499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:07.181751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.966602+0000","last_change":"2024-04-26T12:53:47.966602+0000","last_active":"2024-04-26T12:53:47.966602+0000","last_peered":"2024-04-26T12:53:47.966602+0000","last_clean":"2024-04-26T12:53:47.966602+0000","last_became_active":"2024-04-26T12:49:54.249401+0000","last_became_peered":"2024-04-26T12:49:54.249401+0000","last_unstale":"2024-04-26T12:53:47.966602+0000","last_undegraded":"2024-04-26T12:53:47.966602+0000","last_fullsized":"2024-04-26T12:53:47.966602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:47.966229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.966229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:14.686968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.162532+0000","last_change":"2024-04-26T12:53:52.162532+0000","last_active":"2024-04-26T12:53:52.162532+0000","last_peered":"2024-04-26T12:53:52.162532+0000","last_clean":"2024-04-26T12:53:52.162532+0000","last_became_active":"2024-04-26T12:49:56.222277+0000","last_became_peered":"2024-04-26T12:49:56.222277+0000","last_unstale":"2024-04-26T12:53:52.162532+0000","last_undegraded":"2024-04-26T12:53:52.162532+0000","last_fullsized":"2024-04-26T12:53:52.162532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:52.162284+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.162284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:06.228081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.318049+0000","last_change":"2024-04-26T12:54:03.318049+0000","last_active":"2024-04-26T12:54:03.318049+0000","last_peered":"2024-04-26T12:54:03.318049+0000","last_clean":"2024-04-26T12:54:03.318049+0000","last_became_active":"2024-04-26T12:49:54.244035+0000","last_became_peered":"2024-04-26T12:49:54.244035+0000","last_unstale":"2024-04-26T12:54:03.318049+0000","last_undegraded":"2024-04-26T12:54:03.318049+0000","last_fullsized":"2024-04-26T12:54:03.318049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:03.317789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:03.317789+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.317789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:02.080072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'8","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.098985+0000","last_change":"2024-04-26T12:54:01.098985+0000","last_active":"2024-04-26T12:54:01.098985+0000","last_peered":"2024-04-26T12:54:01.098985+0000","last_clean":"2024-04-26T12:54:01.098985+0000","last_became_active":"2024-04-26T12:49:56.220590+0000","last_became_peered":"2024-04-26T12:49:56.220590+0000","last_unstale":"2024-04-26T12:54:01.098985+0000","last_undegraded":"2024-04-26T12:54:01.098985+0000","last_fullsized":"2024-04-26T12:54:01.098985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:01.098623+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:01.098623+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.098623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:43.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.171275+0000","last_change":"2024-04-26T12:53:57.171275+0000","last_active":"2024-04-26T12:53:57.171275+0000","last_peered":"2024-04-26T12:53:57.171275+0000","last_clean":"2024-04-26T12:53:57.171275+0000","last_became_active":"2024-04-26T12:49:54.245921+0000","last_became_peered":"2024-04-26T12:49:54.245921+0000","last_unstale":"2024-04-26T12:53:57.171275+0000","last_undegraded":"2024-04-26T12:53:57.171275+0000","last_fullsized":"2024-04-26T12:53:57.171275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:57.171024+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.171024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:17.576384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.937942+0000","last_change":"2024-04-26T12:53:48.937942+0000","last_active":"2024-04-26T12:53:48.937942+0000","last_peered":"2024-04-26T12:53:48.937942+0000","last_clean":"2024-04-26T12:53:48.937942+0000","last_became_active":"2024-04-26T12:49:56.214526+0000","last_became_peered":"2024-04-26T12:49:56.214526+0000","last_unstale":"2024-04-26T12:53:48.937942+0000","last_undegraded":"2024-04-26T12:53:48.937942+0000","last_fullsized":"2024-04-26T12:53:48.937942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:48.937678+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.937678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:30.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.050791+0000","last_change":"2024-04-26T12:54:12.050791+0000","last_active":"2024-04-26T12:54:12.050791+0000","last_peered":"2024-04-26T12:54:12.050791+0000","last_clean":"2024-04-26T12:54:12.050791+0000","last_became_active":"2024-04-26T12:49:54.235076+0000","last_became_peered":"2024-04-26T12:49:54.235076+0000","last_unstale":"2024-04-26T12:54:12.050791+0000","last_undegraded":"2024-04-26T12:54:12.050791+0000","last_fullsized":"2024-04-26T12:54:12.050791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.050528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.050528+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.050528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:40.968443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'18","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.155762+0000","last_change":"2024-04-26T12:53:58.155762+0000","last_active":"2024-04-26T12:53:58.155762+0000","last_peered":"2024-04-26T12:53:58.155762+0000","last_clean":"2024-04-26T12:53:58.155762+0000","last_became_active":"2024-04-26T12:49:56.230230+0000","last_became_peered":"2024-04-26T12:49:56.230230+0000","last_unstale":"2024-04-26T12:53:58.155762+0000","last_undegraded":"2024-04-26T12:53:58.155762+0000","last_fullsized":"2024-04-26T12:53:58.155762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:58.155520+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:58.155520+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.155520+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:26.909565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:36.524202+0000","last_change":"2024-04-26T12:54:36.524202+0000","last_active":"2024-04-26T12:54:36.524202+0000","last_peered":"2024-04-26T12:54:36.524202+0000","last_clean":"2024-04-26T12:54:36.524202+0000","last_became_active":"2024-04-26T12:49:54.230379+0000","last_became_peered":"2024-04-26T12:49:54.230379+0000","last_unstale":"2024-04-26T12:54:36.524202+0000","last_undegraded":"2024-04-26T12:54:36.524202+0000","last_fullsized":"2024-04-26T12:54:36.524202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:36.523926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:36.523926+0000","last_clean_scrub_stamp":"2024-04-26T12:54:36.523926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:26.991669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'36","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:18.420916+0000","last_change":"2024-04-26T12:54:18.420916+0000","last_active":"2024-04-26T12:54:18.420916+0000","last_peered":"2024-04-26T12:54:18.420916+0000","last_clean":"2024-04-26T12:54:18.420916+0000","last_became_active":"2024-04-26T12:50:04.289055+0000","last_became_peered":"2024-04-26T12:50:04.289055+0000","last_unstale":"2024-04-26T12:54:18.420916+0000","last_undegraded":"2024-04-26T12:54:18.420916+0000","last_fullsized":"2024-04-26T12:54:18.420916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:54:18.420643+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:54:18.420643+0000","last_clean_scrub_stamp":"2024-04-26T12:54:18.420643+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:51.430543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'3","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.415428+0000","last_change":"2024-04-26T12:53:39.415428+0000","last_active":"2024-04-26T12:53:39.415428+0000","last_peered":"2024-04-26T12:53:39.415428+0000","last_clean":"2024-04-26T12:53:39.415428+0000","last_became_active":"2024-04-26T12:49:56.229337+0000","last_became_peered":"2024-04-26T12:49:56.229337+0000","last_unstale":"2024-04-26T12:53:39.415428+0000","last_undegraded":"2024-04-26T12:53:39.415428+0000","last_fullsized":"2024-04-26T12:53:39.415428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:39.415162+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.415162+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:24.418176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:25.519453+0000","last_change":"2024-04-26T12:54:25.519453+0000","last_active":"2024-04-26T12:54:25.519453+0000","last_peered":"2024-04-26T12:54:25.519453+0000","last_clean":"2024-04-26T12:54:25.519453+0000","last_became_active":"2024-04-26T12:49:54.254280+0000","last_became_peered":"2024-04-26T12:49:54.254280+0000","last_unstale":"2024-04-26T12:54:25.519453+0000","last_undegraded":"2024-04-26T12:54:25.519453+0000","last_fullsized":"2024-04-26T12:54:25.519453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:25.519096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:25.519096+0000","last_clean_scrub_stamp":"2024-04-26T12:54:25.519096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:27.622842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"35'2","reported_seq":231,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.392134+0000","last_change":"2024-04-26T12:53:23.392134+0000","last_active":"2024-04-26T12:53:23.392134+0000","last_peered":"2024-04-26T12:53:23.392134+0000","last_clean":"2024-04-26T12:53:23.392134+0000","last_became_active":"2024-04-26T12:49:58.244596+0000","last_became_peered":"2024-04-26T12:49:58.244596+0000","last_unstale":"2024-04-26T12:53:23.392134+0000","last_undegraded":"2024-04-26T12:53:23.392134+0000","last_fullsized":"2024-04-26T12:53:23.392134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:23.391874+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.391874+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:06.575701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.391968+0000","last_change":"2024-04-26T12:53:37.391968+0000","last_active":"2024-04-26T12:53:37.391968+0000","last_peered":"2024-04-26T12:53:37.391968+0000","last_clean":"2024-04-26T12:53:37.391968+0000","last_became_active":"2024-04-26T12:50:00.266404+0000","last_became_peered":"2024-04-26T12:50:00.266404+0000","last_unstale":"2024-04-26T12:53:37.391968+0000","last_undegraded":"2024-04-26T12:53:37.391968+0000","last_fullsized":"2024-04-26T12:53:37.391968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:37.391713+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.391713+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:06.145759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.193637+0000","last_change":"2024-04-26T12:53:40.193637+0000","last_active":"2024-04-26T12:53:40.193637+0000","last_peered":"2024-04-26T12:53:40.193637+0000","last_clean":"2024-04-26T12:53:40.193637+0000","last_became_active":"2024-04-26T12:50:02.285163+0000","last_became_peered":"2024-04-26T12:50:02.285163+0000","last_unstale":"2024-04-26T12:53:40.193637+0000","last_undegraded":"2024-04-26T12:53:40.193637+0000","last_fullsized":"2024-04-26T12:53:40.193637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.193370+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.193370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:21.524309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'7","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.378906+0000","last_change":"2024-04-26T12:54:17.378906+0000","last_active":"2024-04-26T12:54:17.378906+0000","last_peered":"2024-04-26T12:54:17.378906+0000","last_clean":"2024-04-26T12:54:17.378906+0000","last_became_active":"2024-04-26T12:50:04.288959+0000","last_became_peered":"2024-04-26T12:50:04.288959+0000","last_unstale":"2024-04-26T12:54:17.378906+0000","last_undegraded":"2024-04-26T12:54:17.378906+0000","last_fullsized":"2024-04-26T12:54:17.378906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-04-26T12:54:17.378654+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-04-26T12:54:17.378654+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.378654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:43.119977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'10","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.384186+0000","last_change":"2024-04-26T12:53:36.384186+0000","last_active":"2024-04-26T12:53:36.384186+0000","last_peered":"2024-04-26T12:53:36.384186+0000","last_clean":"2024-04-26T12:53:36.384186+0000","last_became_active":"2024-04-26T12:49:56.230241+0000","last_became_peered":"2024-04-26T12:49:56.230241+0000","last_unstale":"2024-04-26T12:53:36.384186+0000","last_undegraded":"2024-04-26T12:53:36.384186+0000","last_fullsized":"2024-04-26T12:53:36.384186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:36.383922+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.383922+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:56.789282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.087214+0000","last_change":"2024-04-26T12:54:02.087214+0000","last_active":"2024-04-26T12:54:02.087214+0000","last_peered":"2024-04-26T12:54:02.087214+0000","last_clean":"2024-04-26T12:54:02.087214+0000","last_became_active":"2024-04-26T12:49:54.239597+0000","last_became_peered":"2024-04-26T12:49:54.239597+0000","last_unstale":"2024-04-26T12:54:02.087214+0000","last_undegraded":"2024-04-26T12:54:02.087214+0000","last_fullsized":"2024-04-26T12:54:02.087214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:02.086942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:02.086942+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.086942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:56.033899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.280249+0000","last_change":"2024-04-26T12:53:44.280249+0000","last_active":"2024-04-26T12:53:44.280249+0000","last_peered":"2024-04-26T12:53:44.280249+0000","last_clean":"2024-04-26T12:53:44.280249+0000","last_became_active":"2024-04-26T12:49:58.222021+0000","last_became_peered":"2024-04-26T12:49:58.222021+0000","last_unstale":"2024-04-26T12:53:44.280249+0000","last_undegraded":"2024-04-26T12:53:44.280249+0000","last_fullsized":"2024-04-26T12:53:44.280249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.279907+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.279907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:46.896122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.076800+0000","last_change":"2024-04-26T12:53:23.076800+0000","last_active":"2024-04-26T12:53:23.076800+0000","last_peered":"2024-04-26T12:53:23.076800+0000","last_clean":"2024-04-26T12:53:23.076800+0000","last_became_active":"2024-04-26T12:50:00.236557+0000","last_became_peered":"2024-04-26T12:50:00.236557+0000","last_unstale":"2024-04-26T12:53:23.076800+0000","last_undegraded":"2024-04-26T12:53:23.076800+0000","last_fullsized":"2024-04-26T12:53:23.076800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:23.076513+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.076513+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:18.548345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.104841+0000","last_change":"2024-04-26T12:53:32.104841+0000","last_active":"2024-04-26T12:53:32.104841+0000","last_peered":"2024-04-26T12:53:32.104841+0000","last_clean":"2024-04-26T12:53:32.104841+0000","last_became_active":"2024-04-26T12:50:02.278327+0000","last_became_peered":"2024-04-26T12:50:02.278327+0000","last_unstale":"2024-04-26T12:53:32.104841+0000","last_undegraded":"2024-04-26T12:53:32.104841+0000","last_fullsized":"2024-04-26T12:53:32.104841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:32.104460+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.104460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:40.209749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.037640+0000","last_change":"2024-04-26T12:54:16.037705+0000","last_active":"2024-04-26T12:54:16.037640+0000","last_peered":"2024-04-26T12:54:16.037640+0000","last_clean":"2024-04-26T12:54:16.037640+0000","last_became_active":"2024-04-26T12:50:04.280803+0000","last_became_peered":"2024-04-26T12:50:04.280803+0000","last_unstale":"2024-04-26T12:54:16.037640+0000","last_undegraded":"2024-04-26T12:54:16.037640+0000","last_fullsized":"2024-04-26T12:54:16.037640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:16.037432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:16.037432+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.037432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:31.763516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.411216+0000","last_change":"2024-04-26T12:53:42.411216+0000","last_active":"2024-04-26T12:53:42.411216+0000","last_peered":"2024-04-26T12:53:42.411216+0000","last_clean":"2024-04-26T12:53:42.411216+0000","last_became_active":"2024-04-26T12:49:56.229874+0000","last_became_peered":"2024-04-26T12:49:56.229874+0000","last_unstale":"2024-04-26T12:53:42.411216+0000","last_undegraded":"2024-04-26T12:53:42.411216+0000","last_fullsized":"2024-04-26T12:53:42.411216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:42.410832+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.410832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:41.173115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:26.489340+0000","last_change":"2024-04-26T12:54:26.489340+0000","last_active":"2024-04-26T12:54:26.489340+0000","last_peered":"2024-04-26T12:54:26.489340+0000","last_clean":"2024-04-26T12:54:26.489340+0000","last_became_active":"2024-04-26T12:49:54.235853+0000","last_became_peered":"2024-04-26T12:49:54.235853+0000","last_unstale":"2024-04-26T12:54:26.489340+0000","last_undegraded":"2024-04-26T12:54:26.489340+0000","last_fullsized":"2024-04-26T12:54:26.489340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:26.489052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:26.489052+0000","last_clean_scrub_stamp":"2024-04-26T12:54:26.489052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:12.187052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.256277+0000","last_change":"2024-04-26T12:53:40.256277+0000","last_active":"2024-04-26T12:53:40.256277+0000","last_peered":"2024-04-26T12:53:40.256277+0000","last_clean":"2024-04-26T12:53:40.256277+0000","last_became_active":"2024-04-26T12:49:58.226367+0000","last_became_peered":"2024-04-26T12:49:58.226367+0000","last_unstale":"2024-04-26T12:53:40.256277+0000","last_undegraded":"2024-04-26T12:53:40.256277+0000","last_fullsized":"2024-04-26T12:53:40.256277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.256017+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.256017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:51.409965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.735736+0000","last_change":"2024-04-26T12:53:25.735736+0000","last_active":"2024-04-26T12:53:25.735736+0000","last_peered":"2024-04-26T12:53:25.735736+0000","last_clean":"2024-04-26T12:53:25.735736+0000","last_became_active":"2024-04-26T12:50:00.264558+0000","last_became_peered":"2024-04-26T12:50:00.264558+0000","last_unstale":"2024-04-26T12:53:25.735736+0000","last_undegraded":"2024-04-26T12:53:25.735736+0000","last_fullsized":"2024-04-26T12:53:25.735736+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:25.735419+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.735419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.323105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":400,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.468486+0000","last_change":"2024-04-26T12:53:57.468486+0000","last_active":"2024-04-26T12:53:57.468486+0000","last_peered":"2024-04-26T12:53:57.468486+0000","last_clean":"2024-04-26T12:53:57.468486+0000","last_became_active":"2024-04-26T12:50:02.293441+0000","last_became_peered":"2024-04-26T12:50:02.293441+0000","last_unstale":"2024-04-26T12:53:57.468486+0000","last_undegraded":"2024-04-26T12:53:57.468486+0000","last_fullsized":"2024-04-26T12:53:57.468486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-04-26T12:53:57.468221+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.468221+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:49.873023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.945880+0000","last_change":"2024-04-26T12:53:40.945988+0000","last_active":"2024-04-26T12:53:40.945880+0000","last_peered":"2024-04-26T12:53:40.945880+0000","last_clean":"2024-04-26T12:53:40.945880+0000","last_became_active":"2024-04-26T12:50:04.281970+0000","last_became_peered":"2024-04-26T12:50:04.281970+0000","last_unstale":"2024-04-26T12:53:40.945880+0000","last_undegraded":"2024-04-26T12:53:40.945880+0000","last_fullsized":"2024-04-26T12:53:40.945880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:40.945653+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.945653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:49.050942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'14","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.286965+0000","last_change":"2024-04-26T12:53:48.286965+0000","last_active":"2024-04-26T12:53:48.286965+0000","last_peered":"2024-04-26T12:53:48.286965+0000","last_clean":"2024-04-26T12:53:48.286965+0000","last_became_active":"2024-04-26T12:49:56.225119+0000","last_became_peered":"2024-04-26T12:49:56.225119+0000","last_unstale":"2024-04-26T12:53:48.286965+0000","last_undegraded":"2024-04-26T12:53:48.286965+0000","last_fullsized":"2024-04-26T12:53:48.286965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:48.286688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.286688+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:28.578485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.318456+0000","last_change":"2024-04-26T12:54:09.318456+0000","last_active":"2024-04-26T12:54:09.318456+0000","last_peered":"2024-04-26T12:54:09.318456+0000","last_clean":"2024-04-26T12:54:09.318456+0000","last_became_active":"2024-04-26T12:49:54.235247+0000","last_became_peered":"2024-04-26T12:49:54.235247+0000","last_unstale":"2024-04-26T12:54:09.318456+0000","last_undegraded":"2024-04-26T12:54:09.318456+0000","last_fullsized":"2024-04-26T12:54:09.318456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:09.318195+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:09.318195+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.318195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:41.368120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.380865+0000","last_change":"2024-04-26T12:53:22.380865+0000","last_active":"2024-04-26T12:53:22.380865+0000","last_peered":"2024-04-26T12:53:22.380865+0000","last_clean":"2024-04-26T12:53:22.380865+0000","last_became_active":"2024-04-26T12:49:58.245002+0000","last_became_peered":"2024-04-26T12:49:58.245002+0000","last_unstale":"2024-04-26T12:53:22.380865+0000","last_undegraded":"2024-04-26T12:53:22.380865+0000","last_fullsized":"2024-04-26T12:53:22.380865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.380528+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.380528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.319667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.752246+0000","last_change":"2024-04-26T12:53:26.752246+0000","last_active":"2024-04-26T12:53:26.752246+0000","last_peered":"2024-04-26T12:53:26.752246+0000","last_clean":"2024-04-26T12:53:26.752246+0000","last_became_active":"2024-04-26T12:50:00.264679+0000","last_became_peered":"2024-04-26T12:50:00.264679+0000","last_unstale":"2024-04-26T12:53:26.752246+0000","last_undegraded":"2024-04-26T12:53:26.752246+0000","last_fullsized":"2024-04-26T12:53:26.752246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:26.751972+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.751972+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:59.415047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":415,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.264864+0000","last_change":"2024-04-26T12:53:27.264864+0000","last_active":"2024-04-26T12:53:27.264864+0000","last_peered":"2024-04-26T12:53:27.264864+0000","last_clean":"2024-04-26T12:53:27.264864+0000","last_became_active":"2024-04-26T12:50:02.264169+0000","last_became_peered":"2024-04-26T12:50:02.264169+0000","last_unstale":"2024-04-26T12:53:27.264864+0000","last_undegraded":"2024-04-26T12:53:27.264864+0000","last_fullsized":"2024-04-26T12:53:27.264864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:27.264595+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.264595+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:14.426766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'6","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.474657+0000","last_change":"2024-04-26T12:54:04.474657+0000","last_active":"2024-04-26T12:54:04.474657+0000","last_peered":"2024-04-26T12:54:04.474657+0000","last_clean":"2024-04-26T12:54:04.474657+0000","last_became_active":"2024-04-26T12:49:56.225564+0000","last_became_peered":"2024-04-26T12:49:56.225564+0000","last_unstale":"2024-04-26T12:54:04.474657+0000","last_undegraded":"2024-04-26T12:54:04.474657+0000","last_fullsized":"2024-04-26T12:54:04.474657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:04.474241+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:04.474241+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.474241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:19.601202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.092120+0000","last_change":"2024-04-26T12:54:04.092120+0000","last_active":"2024-04-26T12:54:04.092120+0000","last_peered":"2024-04-26T12:54:04.092120+0000","last_clean":"2024-04-26T12:54:04.092120+0000","last_became_active":"2024-04-26T12:49:54.240681+0000","last_became_peered":"2024-04-26T12:49:54.240681+0000","last_unstale":"2024-04-26T12:54:04.092120+0000","last_undegraded":"2024-04-26T12:54:04.092120+0000","last_fullsized":"2024-04-26T12:54:04.092120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:04.091919+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:04.091919+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.091919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:38.080209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.034874+0000","last_change":"2024-04-26T12:53:29.034874+0000","last_active":"2024-04-26T12:53:29.034874+0000","last_peered":"2024-04-26T12:53:29.034874+0000","last_clean":"2024-04-26T12:53:29.034874+0000","last_became_active":"2024-04-26T12:49:58.241280+0000","last_became_peered":"2024-04-26T12:49:58.241280+0000","last_unstale":"2024-04-26T12:53:29.034874+0000","last_undegraded":"2024-04-26T12:53:29.034874+0000","last_fullsized":"2024-04-26T12:53:29.034874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.034638+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.034638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:13.359122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.842323+0000","last_change":"2024-04-26T12:53:33.842323+0000","last_active":"2024-04-26T12:53:33.842323+0000","last_peered":"2024-04-26T12:53:33.842323+0000","last_clean":"2024-04-26T12:53:33.842323+0000","last_became_active":"2024-04-26T12:50:00.234346+0000","last_became_peered":"2024-04-26T12:50:00.234346+0000","last_unstale":"2024-04-26T12:53:33.842323+0000","last_undegraded":"2024-04-26T12:53:33.842323+0000","last_fullsized":"2024-04-26T12:53:33.842323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-04-26T12:53:33.842014+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.842014+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.029425+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.367753+0000","last_change":"2024-04-26T12:53:20.367753+0000","last_active":"2024-04-26T12:53:20.367753+0000","last_peered":"2024-04-26T12:53:20.367753+0000","last_clean":"2024-04-26T12:53:20.367753+0000","last_became_active":"2024-04-26T12:50:02.272726+0000","last_became_peered":"2024-04-26T12:50:02.272726+0000","last_unstale":"2024-04-26T12:53:20.367753+0000","last_undegraded":"2024-04-26T12:53:20.367753+0000","last_fullsized":"2024-04-26T12:53:20.367753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.367584+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.367584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:03.848633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.144579+0000","last_change":"2024-04-26T12:54:10.144579+0000","last_active":"2024-04-26T12:54:10.144579+0000","last_peered":"2024-04-26T12:54:10.144579+0000","last_clean":"2024-04-26T12:54:10.144579+0000","last_became_active":"2024-04-26T12:50:04.290635+0000","last_became_peered":"2024-04-26T12:50:04.290635+0000","last_unstale":"2024-04-26T12:54:10.144579+0000","last_undegraded":"2024-04-26T12:54:10.144579+0000","last_fullsized":"2024-04-26T12:54:10.144579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:54:10.144359+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:54:10.144359+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.144359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:01.981136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.125068+0000","last_change":"2024-04-26T12:53:56.125068+0000","last_active":"2024-04-26T12:53:56.125068+0000","last_peered":"2024-04-26T12:53:56.125068+0000","last_clean":"2024-04-26T12:53:56.125068+0000","last_became_active":"2024-04-26T12:49:56.227648+0000","last_became_peered":"2024-04-26T12:49:56.227648+0000","last_unstale":"2024-04-26T12:53:56.125068+0000","last_undegraded":"2024-04-26T12:53:56.125068+0000","last_fullsized":"2024-04-26T12:53:56.125068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:56.124818+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.124818+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:33.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.971631+0000","last_change":"2024-04-26T12:53:55.971631+0000","last_active":"2024-04-26T12:53:55.971631+0000","last_peered":"2024-04-26T12:53:55.971631+0000","last_clean":"2024-04-26T12:53:55.971631+0000","last_became_active":"2024-04-26T12:49:54.245129+0000","last_became_peered":"2024-04-26T12:49:54.245129+0000","last_unstale":"2024-04-26T12:53:55.971631+0000","last_undegraded":"2024-04-26T12:53:55.971631+0000","last_fullsized":"2024-04-26T12:53:55.971631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:55.971365+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.971365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:55.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.210108+0000","last_change":"2024-04-26T12:53:39.210108+0000","last_active":"2024-04-26T12:53:39.210108+0000","last_peered":"2024-04-26T12:53:39.210108+0000","last_clean":"2024-04-26T12:53:39.210108+0000","last_became_active":"2024-04-26T12:49:58.226835+0000","last_became_peered":"2024-04-26T12:49:58.226835+0000","last_unstale":"2024-04-26T12:53:39.210108+0000","last_undegraded":"2024-04-26T12:53:39.210108+0000","last_fullsized":"2024-04-26T12:53:39.210108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.209817+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.209817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:09.302793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.322771+0000","last_change":"2024-04-26T12:53:25.322771+0000","last_active":"2024-04-26T12:53:25.322771+0000","last_peered":"2024-04-26T12:53:25.322771+0000","last_clean":"2024-04-26T12:53:25.322771+0000","last_became_active":"2024-04-26T12:50:00.252875+0000","last_became_peered":"2024-04-26T12:50:00.252875+0000","last_unstale":"2024-04-26T12:53:25.322771+0000","last_undegraded":"2024-04-26T12:53:25.322771+0000","last_fullsized":"2024-04-26T12:53:25.322771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:25.322379+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.322379+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:57.683471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.239150+0000","last_change":"2024-04-26T12:53:33.239150+0000","last_active":"2024-04-26T12:53:33.239150+0000","last_peered":"2024-04-26T12:53:33.239150+0000","last_clean":"2024-04-26T12:53:33.239150+0000","last_became_active":"2024-04-26T12:50:02.277762+0000","last_became_peered":"2024-04-26T12:50:02.277762+0000","last_unstale":"2024-04-26T12:53:33.239150+0000","last_undegraded":"2024-04-26T12:53:33.239150+0000","last_fullsized":"2024-04-26T12:53:33.239150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.238876+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.238876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:14.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'6","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.164922+0000","last_change":"2024-04-26T12:53:48.164922+0000","last_active":"2024-04-26T12:53:48.164922+0000","last_peered":"2024-04-26T12:53:48.164922+0000","last_clean":"2024-04-26T12:53:48.164922+0000","last_became_active":"2024-04-26T12:50:04.276156+0000","last_became_peered":"2024-04-26T12:50:04.276156+0000","last_unstale":"2024-04-26T12:53:48.164922+0000","last_undegraded":"2024-04-26T12:53:48.164922+0000","last_fullsized":"2024-04-26T12:53:48.164922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:48.164674+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.164674+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:57.350352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.954336+0000","last_change":"2024-04-26T12:53:52.954336+0000","last_active":"2024-04-26T12:53:52.954336+0000","last_peered":"2024-04-26T12:53:52.954336+0000","last_clean":"2024-04-26T12:53:52.954336+0000","last_became_active":"2024-04-26T12:49:56.216438+0000","last_became_peered":"2024-04-26T12:49:56.216438+0000","last_unstale":"2024-04-26T12:53:52.954336+0000","last_undegraded":"2024-04-26T12:53:52.954336+0000","last_fullsized":"2024-04-26T12:53:52.954336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:52.954084+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.954084+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:23.735894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.548671+0000","last_change":"2024-04-26T12:54:17.548671+0000","last_active":"2024-04-26T12:54:17.548671+0000","last_peered":"2024-04-26T12:54:17.548671+0000","last_clean":"2024-04-26T12:54:17.548671+0000","last_became_active":"2024-04-26T12:49:54.252108+0000","last_became_peered":"2024-04-26T12:49:54.252108+0000","last_unstale":"2024-04-26T12:54:17.548671+0000","last_undegraded":"2024-04-26T12:54:17.548671+0000","last_fullsized":"2024-04-26T12:54:17.548671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:17.548417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:17.548417+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.548417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:27.047344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.216552+0000","last_change":"2024-04-26T12:53:36.216552+0000","last_active":"2024-04-26T12:53:36.216552+0000","last_peered":"2024-04-26T12:53:36.216552+0000","last_clean":"2024-04-26T12:53:36.216552+0000","last_became_active":"2024-04-26T12:49:58.229952+0000","last_became_peered":"2024-04-26T12:49:58.229952+0000","last_unstale":"2024-04-26T12:53:36.216552+0000","last_undegraded":"2024-04-26T12:53:36.216552+0000","last_fullsized":"2024-04-26T12:53:36.216552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.216285+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.216285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:41.525193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.550362+0000","last_change":"2024-04-26T12:53:54.550362+0000","last_active":"2024-04-26T12:53:54.550362+0000","last_peered":"2024-04-26T12:53:54.550362+0000","last_clean":"2024-04-26T12:53:54.550362+0000","last_became_active":"2024-04-26T12:50:00.268024+0000","last_became_peered":"2024-04-26T12:50:00.268024+0000","last_unstale":"2024-04-26T12:53:54.550362+0000","last_undegraded":"2024-04-26T12:53:54.550362+0000","last_fullsized":"2024-04-26T12:53:54.550362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:54.550077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.550077+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:28.913960+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":362,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.260340+0000","last_change":"2024-04-26T12:53:23.260340+0000","last_active":"2024-04-26T12:53:23.260340+0000","last_peered":"2024-04-26T12:53:23.260340+0000","last_clean":"2024-04-26T12:53:23.260340+0000","last_became_active":"2024-04-26T12:50:02.270974+0000","last_became_peered":"2024-04-26T12:50:02.270974+0000","last_unstale":"2024-04-26T12:53:23.260340+0000","last_undegraded":"2024-04-26T12:53:23.260340+0000","last_fullsized":"2024-04-26T12:53:23.260340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:23.260077+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.260077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:08.869807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:19.050474+0000","last_change":"2024-04-26T12:54:19.050474+0000","last_active":"2024-04-26T12:54:19.050474+0000","last_peered":"2024-04-26T12:54:19.050474+0000","last_clean":"2024-04-26T12:54:19.050474+0000","last_became_active":"2024-04-26T12:50:04.294848+0000","last_became_peered":"2024-04-26T12:50:04.294848+0000","last_unstale":"2024-04-26T12:54:19.050474+0000","last_undegraded":"2024-04-26T12:54:19.050474+0000","last_fullsized":"2024-04-26T12:54:19.050474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:19.050217+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:19.050217+0000","last_clean_scrub_stamp":"2024-04-26T12:54:19.050217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.578291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.963004+0000","last_change":"2024-04-26T12:53:42.963004+0000","last_active":"2024-04-26T12:53:42.963004+0000","last_peered":"2024-04-26T12:53:42.963004+0000","last_clean":"2024-04-26T12:53:42.963004+0000","last_became_active":"2024-04-26T12:49:56.213084+0000","last_became_peered":"2024-04-26T12:49:56.213084+0000","last_unstale":"2024-04-26T12:53:42.963004+0000","last_undegraded":"2024-04-26T12:53:42.963004+0000","last_fullsized":"2024-04-26T12:53:42.963004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:42.962751+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.962751+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:04.429485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.557788+0000","last_change":"2024-04-26T12:54:11.557788+0000","last_active":"2024-04-26T12:54:11.557788+0000","last_peered":"2024-04-26T12:54:11.557788+0000","last_clean":"2024-04-26T12:54:11.557788+0000","last_became_active":"2024-04-26T12:49:54.256437+0000","last_became_peered":"2024-04-26T12:49:54.256437+0000","last_unstale":"2024-04-26T12:54:11.557788+0000","last_undegraded":"2024-04-26T12:54:11.557788+0000","last_fullsized":"2024-04-26T12:54:11.557788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:11.557529+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:11.557529+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.557529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:03.013567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.116623+0000","last_change":"2024-04-26T12:54:12.116623+0000","last_active":"2024-04-26T12:54:12.116623+0000","last_peered":"2024-04-26T12:54:12.116623+0000","last_clean":"2024-04-26T12:54:12.116623+0000","last_became_active":"2024-04-26T12:50:34.304859+0000","last_became_peered":"2024-04-26T12:50:34.304859+0000","last_unstale":"2024-04-26T12:54:12.116623+0000","last_undegraded":"2024-04-26T12:54:12.116623+0000","last_fullsized":"2024-04-26T12:54:12.116623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.116369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.116369+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.116369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:47.204045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'65","reported_seq":139,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.301331+0000","last_change":"2024-04-26T12:53:33.301331+0000","last_active":"2024-04-26T12:53:33.301331+0000","last_peered":"2024-04-26T12:53:33.301331+0000","last_clean":"2024-04-26T12:53:33.301331+0000","last_became_active":"2024-04-26T12:50:00.265724+0000","last_became_peered":"2024-04-26T12:50:00.265724+0000","last_unstale":"2024-04-26T12:53:33.301331+0000","last_undegraded":"2024-04-26T12:53:33.301331+0000","last_fullsized":"2024-04-26T12:53:33.301331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'65","last_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_deep_scrub":"35'65","last_deep_scrub_stamp":"2024-04-26T12:53:33.301040+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.301040+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:07.289330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.319398+0000","last_change":"2024-04-26T12:53:25.319398+0000","last_active":"2024-04-26T12:53:25.319398+0000","last_peered":"2024-04-26T12:53:25.319398+0000","last_clean":"2024-04-26T12:53:25.319398+0000","last_became_active":"2024-04-26T12:50:02.275663+0000","last_became_peered":"2024-04-26T12:50:02.275663+0000","last_unstale":"2024-04-26T12:53:25.319398+0000","last_undegraded":"2024-04-26T12:53:25.319398+0000","last_fullsized":"2024-04-26T12:53:25.319398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:25.319148+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.319148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:51.725423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'23","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:21.040845+0000","last_change":"2024-04-26T12:54:21.040845+0000","last_active":"2024-04-26T12:54:21.040845+0000","last_peered":"2024-04-26T12:54:21.040845+0000","last_clean":"2024-04-26T12:54:21.040845+0000","last_became_active":"2024-04-26T12:50:04.302782+0000","last_became_peered":"2024-04-26T12:50:04.302782+0000","last_unstale":"2024-04-26T12:54:21.040845+0000","last_undegraded":"2024-04-26T12:54:21.040845+0000","last_fullsized":"2024-04-26T12:54:21.040845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:54:21.040581+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:54:21.040581+0000","last_clean_scrub_stamp":"2024-04-26T12:54:21.040581+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:29.501389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'18","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.147271+0000","last_change":"2024-04-26T12:53:45.147271+0000","last_active":"2024-04-26T12:53:45.147271+0000","last_peered":"2024-04-26T12:53:45.147271+0000","last_clean":"2024-04-26T12:53:45.147271+0000","last_became_active":"2024-04-26T12:49:56.234294+0000","last_became_peered":"2024-04-26T12:49:56.234294+0000","last_unstale":"2024-04-26T12:53:45.147271+0000","last_undegraded":"2024-04-26T12:53:45.147271+0000","last_fullsized":"2024-04-26T12:53:45.147271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:45.147005+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.147005+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.360231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.093921+0000","last_change":"2024-04-26T12:54:04.093921+0000","last_active":"2024-04-26T12:54:04.093921+0000","last_peered":"2024-04-26T12:54:04.093921+0000","last_clean":"2024-04-26T12:54:04.093921+0000","last_became_active":"2024-04-26T12:49:54.236908+0000","last_became_peered":"2024-04-26T12:49:54.236908+0000","last_unstale":"2024-04-26T12:54:04.093921+0000","last_undegraded":"2024-04-26T12:54:04.093921+0000","last_fullsized":"2024-04-26T12:54:04.093921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:04.093611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:04.093611+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.093611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:06.282666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.821321+0000","last_change":"2024-04-26T12:53:35.821321+0000","last_active":"2024-04-26T12:53:35.821321+0000","last_peered":"2024-04-26T12:53:35.821321+0000","last_clean":"2024-04-26T12:53:35.821321+0000","last_became_active":"2024-04-26T12:49:58.225668+0000","last_became_peered":"2024-04-26T12:49:58.225668+0000","last_unstale":"2024-04-26T12:53:35.821321+0000","last_undegraded":"2024-04-26T12:53:35.821321+0000","last_fullsized":"2024-04-26T12:53:35.821321+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:35.821050+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.821050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:59.952098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.093504+0000","last_change":"2024-04-26T12:53:26.093504+0000","last_active":"2024-04-26T12:53:26.093504+0000","last_peered":"2024-04-26T12:53:26.093504+0000","last_clean":"2024-04-26T12:53:26.093504+0000","last_became_active":"2024-04-26T12:50:00.234394+0000","last_became_peered":"2024-04-26T12:50:00.234394+0000","last_unstale":"2024-04-26T12:53:26.093504+0000","last_undegraded":"2024-04-26T12:53:26.093504+0000","last_fullsized":"2024-04-26T12:53:26.093504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:26.093081+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.093081+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:46.353316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.345823+0000","last_change":"2024-04-26T12:53:44.345823+0000","last_active":"2024-04-26T12:53:44.345823+0000","last_peered":"2024-04-26T12:53:44.345823+0000","last_clean":"2024-04-26T12:53:44.345823+0000","last_became_active":"2024-04-26T12:50:02.282422+0000","last_became_peered":"2024-04-26T12:50:02.282422+0000","last_unstale":"2024-04-26T12:53:44.345823+0000","last_undegraded":"2024-04-26T12:53:44.345823+0000","last_fullsized":"2024-04-26T12:53:44.345823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:44.345550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.345550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:44.028093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:41.379340+0000","last_change":"2024-04-26T12:54:41.379413+0000","last_active":"2024-04-26T12:54:41.379340+0000","last_peered":"2024-04-26T12:54:41.379340+0000","last_clean":"2024-04-26T12:54:41.379340+0000","last_became_active":"2024-04-26T12:50:04.304163+0000","last_became_peered":"2024-04-26T12:50:04.304163+0000","last_unstale":"2024-04-26T12:54:41.379340+0000","last_undegraded":"2024-04-26T12:54:41.379340+0000","last_fullsized":"2024-04-26T12:54:41.379340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:41.379122+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:41.379122+0000","last_clean_scrub_stamp":"2024-04-26T12:54:41.379122+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:47.678504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:40.390424+0000","last_change":"2024-04-26T12:53:40.390424+0000","last_active":"2024-04-26T12:53:40.390424+0000","last_peered":"2024-04-26T12:53:40.390424+0000","last_clean":"2024-04-26T12:53:40.390424+0000","last_became_active":"2024-04-26T12:49:56.228982+0000","last_became_peered":"2024-04-26T12:49:56.228982+0000","last_unstale":"2024-04-26T12:53:40.390424+0000","last_undegraded":"2024-04-26T12:53:40.390424+0000","last_fullsized":"2024-04-26T12:53:40.390424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:40.390158+0000","last_clean_scrub_stamp":"2024-04-26T12:53:40.390158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:34.578850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:37.498239+0000","last_change":"2024-04-26T12:54:37.498307+0000","last_active":"2024-04-26T12:54:37.498239+0000","last_peered":"2024-04-26T12:54:37.498239+0000","last_clean":"2024-04-26T12:54:37.498239+0000","last_became_active":"2024-04-26T12:49:54.231113+0000","last_became_peered":"2024-04-26T12:49:54.231113+0000","last_unstale":"2024-04-26T12:54:37.498239+0000","last_undegraded":"2024-04-26T12:54:37.498239+0000","last_fullsized":"2024-04-26T12:54:37.498239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:37.498037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:37.498037+0000","last_clean_scrub_stamp":"2024-04-26T12:54:37.498037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:39.688926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.184522+0000","last_change":"2024-04-26T12:53:38.184522+0000","last_active":"2024-04-26T12:53:38.184522+0000","last_peered":"2024-04-26T12:53:38.184522+0000","last_clean":"2024-04-26T12:53:38.184522+0000","last_became_active":"2024-04-26T12:49:58.229972+0000","last_became_peered":"2024-04-26T12:49:58.229972+0000","last_unstale":"2024-04-26T12:53:38.184522+0000","last_undegraded":"2024-04-26T12:53:38.184522+0000","last_fullsized":"2024-04-26T12:53:38.184522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.184269+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.184269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:49.731527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.784129+0000","last_change":"2024-04-26T12:53:29.784129+0000","last_active":"2024-04-26T12:53:29.784129+0000","last_peered":"2024-04-26T12:53:29.784129+0000","last_clean":"2024-04-26T12:53:29.784129+0000","last_became_active":"2024-04-26T12:50:00.248580+0000","last_became_peered":"2024-04-26T12:50:00.248580+0000","last_unstale":"2024-04-26T12:53:29.784129+0000","last_undegraded":"2024-04-26T12:53:29.784129+0000","last_fullsized":"2024-04-26T12:53:29.784129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-04-26T12:53:29.783856+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.783856+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:02.402474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.700292+0000","last_change":"2024-04-26T12:53:20.700292+0000","last_active":"2024-04-26T12:53:20.700292+0000","last_peered":"2024-04-26T12:53:20.700292+0000","last_clean":"2024-04-26T12:53:20.700292+0000","last_became_active":"2024-04-26T12:50:02.273884+0000","last_became_peered":"2024-04-26T12:50:02.273884+0000","last_unstale":"2024-04-26T12:53:20.700292+0000","last_undegraded":"2024-04-26T12:53:20.700292+0000","last_fullsized":"2024-04-26T12:53:20.700292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:20.700008+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.700008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:02.748840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:20.063364+0000","last_change":"2024-04-26T12:54:20.063435+0000","last_active":"2024-04-26T12:54:20.063364+0000","last_peered":"2024-04-26T12:54:20.063364+0000","last_clean":"2024-04-26T12:54:20.063364+0000","last_became_active":"2024-04-26T12:50:04.295811+0000","last_became_peered":"2024-04-26T12:50:04.295811+0000","last_unstale":"2024-04-26T12:54:20.063364+0000","last_undegraded":"2024-04-26T12:54:20.063364+0000","last_fullsized":"2024-04-26T12:54:20.063364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:54:20.063162+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:54:20.063162+0000","last_clean_scrub_stamp":"2024-04-26T12:54:20.063162+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:53.641992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.164575+0000","last_change":"2024-04-26T12:54:07.164575+0000","last_active":"2024-04-26T12:54:07.164575+0000","last_peered":"2024-04-26T12:54:07.164575+0000","last_clean":"2024-04-26T12:54:07.164575+0000","last_became_active":"2024-04-26T12:49:56.221042+0000","last_became_peered":"2024-04-26T12:49:56.221042+0000","last_unstale":"2024-04-26T12:54:07.164575+0000","last_undegraded":"2024-04-26T12:54:07.164575+0000","last_fullsized":"2024-04-26T12:54:07.164575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:07.164157+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:07.164157+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.164157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:27.569518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'3","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:22.475913+0000","last_change":"2024-04-26T12:54:22.475975+0000","last_active":"2024-04-26T12:54:22.475913+0000","last_peered":"2024-04-26T12:54:22.475913+0000","last_clean":"2024-04-26T12:54:22.475913+0000","last_became_active":"2024-04-26T12:49:54.234886+0000","last_became_peered":"2024-04-26T12:49:54.234886+0000","last_unstale":"2024-04-26T12:54:22.475913+0000","last_undegraded":"2024-04-26T12:54:22.475913+0000","last_fullsized":"2024-04-26T12:54:22.475913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:22.475711+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:22.475711+0000","last_clean_scrub_stamp":"2024-04-26T12:54:22.475711+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:06.132626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":429,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.150051+0000","last_change":"2024-04-26T12:53:35.150051+0000","last_active":"2024-04-26T12:53:35.150051+0000","last_peered":"2024-04-26T12:53:35.150051+0000","last_clean":"2024-04-26T12:53:35.150051+0000","last_became_active":"2024-04-26T12:49:58.226259+0000","last_became_peered":"2024-04-26T12:49:58.226259+0000","last_unstale":"2024-04-26T12:53:35.150051+0000","last_undegraded":"2024-04-26T12:53:35.150051+0000","last_fullsized":"2024-04-26T12:53:35.150051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:35.149786+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.149786+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:44.314364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.384877+0000","last_change":"2024-04-26T12:53:41.384877+0000","last_active":"2024-04-26T12:53:41.384877+0000","last_peered":"2024-04-26T12:53:41.384877+0000","last_clean":"2024-04-26T12:53:41.384877+0000","last_became_active":"2024-04-26T12:50:00.266294+0000","last_became_peered":"2024-04-26T12:50:00.266294+0000","last_unstale":"2024-04-26T12:53:41.384877+0000","last_undegraded":"2024-04-26T12:53:41.384877+0000","last_fullsized":"2024-04-26T12:53:41.384877+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:41.384606+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.384606+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:41.807107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":479,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.083502+0000","last_change":"2024-04-26T12:53:24.083502+0000","last_active":"2024-04-26T12:53:24.083502+0000","last_peered":"2024-04-26T12:53:24.083502+0000","last_clean":"2024-04-26T12:53:24.083502+0000","last_became_active":"2024-04-26T12:50:02.271437+0000","last_became_peered":"2024-04-26T12:50:02.271437+0000","last_unstale":"2024-04-26T12:53:24.083502+0000","last_undegraded":"2024-04-26T12:53:24.083502+0000","last_fullsized":"2024-04-26T12:53:24.083502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:24.083257+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.083257+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:10.408030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.864780+0000","last_change":"2024-04-26T12:53:36.864780+0000","last_active":"2024-04-26T12:53:36.864780+0000","last_peered":"2024-04-26T12:53:36.864780+0000","last_clean":"2024-04-26T12:53:36.864780+0000","last_became_active":"2024-04-26T12:50:04.273987+0000","last_became_peered":"2024-04-26T12:50:04.273987+0000","last_unstale":"2024-04-26T12:53:36.864780+0000","last_undegraded":"2024-04-26T12:53:36.864780+0000","last_fullsized":"2024-04-26T12:53:36.864780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:36.864409+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.864409+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:22.533038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.165833+0000","last_change":"2024-04-26T12:53:42.165833+0000","last_active":"2024-04-26T12:53:42.165833+0000","last_peered":"2024-04-26T12:53:42.165833+0000","last_clean":"2024-04-26T12:53:42.165833+0000","last_became_active":"2024-04-26T12:49:56.234153+0000","last_became_peered":"2024-04-26T12:49:56.234153+0000","last_unstale":"2024-04-26T12:53:42.165833+0000","last_undegraded":"2024-04-26T12:53:42.165833+0000","last_fullsized":"2024-04-26T12:53:42.165833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:42.165579+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.165579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:29.622380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.573825+0000","last_change":"2024-04-26T12:54:15.573825+0000","last_active":"2024-04-26T12:54:15.573825+0000","last_peered":"2024-04-26T12:54:15.573825+0000","last_clean":"2024-04-26T12:54:15.573825+0000","last_became_active":"2024-04-26T12:49:54.241229+0000","last_became_peered":"2024-04-26T12:49:54.241229+0000","last_unstale":"2024-04-26T12:54:15.573825+0000","last_undegraded":"2024-04-26T12:54:15.573825+0000","last_fullsized":"2024-04-26T12:54:15.573825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:15.573560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:15.573560+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.573560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:45.318576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.364210+0000","last_change":"2024-04-26T12:53:26.364210+0000","last_active":"2024-04-26T12:53:26.364210+0000","last_peered":"2024-04-26T12:53:26.364210+0000","last_clean":"2024-04-26T12:53:26.364210+0000","last_became_active":"2024-04-26T12:49:58.242752+0000","last_became_peered":"2024-04-26T12:49:58.242752+0000","last_unstale":"2024-04-26T12:53:26.364210+0000","last_undegraded":"2024-04-26T12:53:26.364210+0000","last_fullsized":"2024-04-26T12:53:26.364210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.363915+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.363915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:16.300166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'49","reported_seq":109,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:25.062459+0000","last_change":"2024-04-26T12:53:25.062459+0000","last_active":"2024-04-26T12:53:25.062459+0000","last_peered":"2024-04-26T12:53:25.062459+0000","last_clean":"2024-04-26T12:53:25.062459+0000","last_became_active":"2024-04-26T12:50:00.233053+0000","last_became_peered":"2024-04-26T12:50:00.233053+0000","last_unstale":"2024-04-26T12:53:25.062459+0000","last_undegraded":"2024-04-26T12:53:25.062459+0000","last_fullsized":"2024-04-26T12:53:25.062459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-04-26T12:53:25.062142+0000","last_clean_scrub_stamp":"2024-04-26T12:53:25.062142+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:45.249553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.744541+0000","last_change":"2024-04-26T12:53:28.744541+0000","last_active":"2024-04-26T12:53:28.744541+0000","last_peered":"2024-04-26T12:53:28.744541+0000","last_clean":"2024-04-26T12:53:28.744541+0000","last_became_active":"2024-04-26T12:50:02.289010+0000","last_became_peered":"2024-04-26T12:50:02.289010+0000","last_unstale":"2024-04-26T12:53:28.744541+0000","last_undegraded":"2024-04-26T12:53:28.744541+0000","last_fullsized":"2024-04-26T12:53:28.744541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.744289+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.744289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:22.796067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'9","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:44.133618+0000","last_change":"2024-04-26T12:53:44.133618+0000","last_active":"2024-04-26T12:53:44.133618+0000","last_peered":"2024-04-26T12:53:44.133618+0000","last_clean":"2024-04-26T12:53:44.133618+0000","last_became_active":"2024-04-26T12:50:04.271281+0000","last_became_peered":"2024-04-26T12:50:04.271281+0000","last_unstale":"2024-04-26T12:53:44.133618+0000","last_undegraded":"2024-04-26T12:53:44.133618+0000","last_fullsized":"2024-04-26T12:53:44.133618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:53:44.133322+0000","last_clean_scrub_stamp":"2024-04-26T12:53:44.133322+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:14.915132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.385289+0000","last_change":"2024-04-26T12:53:38.385289+0000","last_active":"2024-04-26T12:53:38.385289+0000","last_peered":"2024-04-26T12:53:38.385289+0000","last_clean":"2024-04-26T12:53:38.385289+0000","last_became_active":"2024-04-26T12:49:56.230553+0000","last_became_peered":"2024-04-26T12:49:56.230553+0000","last_unstale":"2024-04-26T12:53:38.385289+0000","last_undegraded":"2024-04-26T12:53:38.385289+0000","last_fullsized":"2024-04-26T12:53:38.385289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:38.385015+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.385015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:40.285540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":214,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.350672+0000","last_change":"2024-04-26T12:54:06.350748+0000","last_active":"2024-04-26T12:54:06.350672+0000","last_peered":"2024-04-26T12:54:06.350672+0000","last_clean":"2024-04-26T12:54:06.350672+0000","last_became_active":"2024-04-26T12:49:41.037726+0000","last_became_peered":"2024-04-26T12:49:41.037726+0000","last_unstale":"2024-04-26T12:54:06.350672+0000","last_undegraded":"2024-04-26T12:54:06.350672+0000","last_fullsized":"2024-04-26T12:54:06.350672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-04-26T12:54:06.350483+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-04-26T12:54:06.350483+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.350483+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:01.619377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:35.531811+0000","last_change":"2024-04-26T12:54:35.531868+0000","last_active":"2024-04-26T12:54:35.531811+0000","last_peered":"2024-04-26T12:54:35.531811+0000","last_clean":"2024-04-26T12:54:35.531811+0000","last_became_active":"2024-04-26T12:49:44.968795+0000","last_became_peered":"2024-04-26T12:49:44.968795+0000","last_unstale":"2024-04-26T12:54:35.531811+0000","last_undegraded":"2024-04-26T12:54:35.531811+0000","last_fullsized":"2024-04-26T12:54:35.531811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:35.531614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:35.531614+0000","last_clean_scrub_stamp":"2024-04-26T12:54:35.531614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:59.413602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:38.451739+0000","last_change":"2024-04-26T12:54:38.451821+0000","last_active":"2024-04-26T12:54:38.451739+0000","last_peered":"2024-04-26T12:54:38.451739+0000","last_clean":"2024-04-26T12:54:38.451739+0000","last_became_active":"2024-04-26T12:49:54.233439+0000","last_became_peered":"2024-04-26T12:49:54.233439+0000","last_unstale":"2024-04-26T12:54:38.451739+0000","last_undegraded":"2024-04-26T12:54:38.451739+0000","last_fullsized":"2024-04-26T12:54:38.451739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:38.451534+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:38.451534+0000","last_clean_scrub_stamp":"2024-04-26T12:54:38.451534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:51.719965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.223660+0000","last_change":"2024-04-26T12:53:38.223660+0000","last_active":"2024-04-26T12:53:38.223660+0000","last_peered":"2024-04-26T12:53:38.223660+0000","last_clean":"2024-04-26T12:53:38.223660+0000","last_became_active":"2024-04-26T12:49:58.226058+0000","last_became_peered":"2024-04-26T12:49:58.226058+0000","last_unstale":"2024-04-26T12:53:38.223660+0000","last_undegraded":"2024-04-26T12:53:38.223660+0000","last_fullsized":"2024-04-26T12:53:38.223660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.223416+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.223416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:18.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'88","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.405993+0000","last_change":"2024-04-26T12:53:29.405993+0000","last_active":"2024-04-26T12:53:29.405993+0000","last_peered":"2024-04-26T12:53:29.405993+0000","last_clean":"2024-04-26T12:53:29.405993+0000","last_became_active":"2024-04-26T12:50:00.263781+0000","last_became_peered":"2024-04-26T12:50:00.263781+0000","last_unstale":"2024-04-26T12:53:29.405993+0000","last_undegraded":"2024-04-26T12:53:29.405993+0000","last_fullsized":"2024-04-26T12:53:29.405993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'88","last_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_deep_scrub":"35'88","last_deep_scrub_stamp":"2024-04-26T12:53:29.405693+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.405693+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.745474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.224221+0000","last_change":"2024-04-26T12:53:41.224221+0000","last_active":"2024-04-26T12:53:41.224221+0000","last_peered":"2024-04-26T12:53:41.224221+0000","last_clean":"2024-04-26T12:53:41.224221+0000","last_became_active":"2024-04-26T12:50:02.282913+0000","last_became_peered":"2024-04-26T12:50:02.282913+0000","last_unstale":"2024-04-26T12:53:41.224221+0000","last_undegraded":"2024-04-26T12:53:41.224221+0000","last_fullsized":"2024-04-26T12:53:41.224221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:41.223941+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.223941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:36.119504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'94","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.150023+0000","last_change":"2024-04-26T12:54:11.150023+0000","last_active":"2024-04-26T12:54:11.150023+0000","last_peered":"2024-04-26T12:54:11.150023+0000","last_clean":"2024-04-26T12:54:11.150023+0000","last_became_active":"2024-04-26T12:50:04.294679+0000","last_became_peered":"2024-04-26T12:50:04.294679+0000","last_unstale":"2024-04-26T12:54:11.150023+0000","last_undegraded":"2024-04-26T12:54:11.150023+0000","last_fullsized":"2024-04-26T12:54:11.150023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'94","last_scrub_stamp":"2024-04-26T12:54:11.149596+0000","last_deep_scrub":"35'94","last_deep_scrub_stamp":"2024-04-26T12:54:11.149596+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.149596+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:00.175753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":284,"num_write":194,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.504046+0000","last_change":"2024-04-26T12:53:59.504046+0000","last_active":"2024-04-26T12:53:59.504046+0000","last_peered":"2024-04-26T12:53:59.504046+0000","last_clean":"2024-04-26T12:53:59.504046+0000","last_became_active":"2024-04-26T12:49:56.228986+0000","last_became_peered":"2024-04-26T12:49:56.228986+0000","last_unstale":"2024-04-26T12:53:59.504046+0000","last_undegraded":"2024-04-26T12:53:59.504046+0000","last_fullsized":"2024-04-26T12:53:59.504046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:59.503798+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:59.503798+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.503798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:31.598970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:32.564316+0000","last_change":"2024-04-26T12:54:32.564433+0000","last_active":"2024-04-26T12:54:32.564316+0000","last_peered":"2024-04-26T12:54:32.564316+0000","last_clean":"2024-04-26T12:54:32.564316+0000","last_became_active":"2024-04-26T12:49:44.964437+0000","last_became_peered":"2024-04-26T12:49:44.964437+0000","last_unstale":"2024-04-26T12:54:32.564316+0000","last_undegraded":"2024-04-26T12:54:32.564316+0000","last_fullsized":"2024-04-26T12:54:32.564316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:32.564048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:32.564048+0000","last_clean_scrub_stamp":"2024-04-26T12:54:32.564048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:43.967879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.115583+0000","last_change":"2024-04-26T12:53:58.115583+0000","last_active":"2024-04-26T12:53:58.115583+0000","last_peered":"2024-04-26T12:53:58.115583+0000","last_clean":"2024-04-26T12:53:58.115583+0000","last_became_active":"2024-04-26T12:49:54.240298+0000","last_became_peered":"2024-04-26T12:49:54.240298+0000","last_unstale":"2024-04-26T12:53:58.115583+0000","last_undegraded":"2024-04-26T12:53:58.115583+0000","last_fullsized":"2024-04-26T12:53:58.115583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:58.115321+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.115321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:52.115400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.382731+0000","last_change":"2024-04-26T12:53:28.382731+0000","last_active":"2024-04-26T12:53:28.382731+0000","last_peered":"2024-04-26T12:53:28.382731+0000","last_clean":"2024-04-26T12:53:28.382731+0000","last_became_active":"2024-04-26T12:49:58.242559+0000","last_became_peered":"2024-04-26T12:49:58.242559+0000","last_unstale":"2024-04-26T12:53:28.382731+0000","last_undegraded":"2024-04-26T12:53:28.382731+0000","last_fullsized":"2024-04-26T12:53:28.382731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:28.382477+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.382477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:09.281461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'290","reported_seq":517,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.070911+0000","last_change":"2024-04-26T12:53:22.070911+0000","last_active":"2024-04-26T12:53:22.070911+0000","last_peered":"2024-04-26T12:53:22.070911+0000","last_clean":"2024-04-26T12:53:22.070911+0000","last_became_active":"2024-04-26T12:50:00.248521+0000","last_became_peered":"2024-04-26T12:50:00.248521+0000","last_unstale":"2024-04-26T12:53:22.070911+0000","last_undegraded":"2024-04-26T12:53:22.070911+0000","last_fullsized":"2024-04-26T12:53:22.070911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'290","last_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_deep_scrub":"35'290","last_deep_scrub_stamp":"2024-04-26T12:53:22.070631+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.070631+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:58.378060+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.372693+0000","last_change":"2024-04-26T12:53:43.372693+0000","last_active":"2024-04-26T12:53:43.372693+0000","last_peered":"2024-04-26T12:53:43.372693+0000","last_clean":"2024-04-26T12:53:43.372693+0000","last_became_active":"2024-04-26T12:50:02.282478+0000","last_became_peered":"2024-04-26T12:50:02.282478+0000","last_unstale":"2024-04-26T12:53:43.372693+0000","last_undegraded":"2024-04-26T12:53:43.372693+0000","last_fullsized":"2024-04-26T12:53:43.372693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:43.372441+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.372441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:12.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'3","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.400151+0000","last_change":"2024-04-26T12:54:15.400151+0000","last_active":"2024-04-26T12:54:15.400151+0000","last_peered":"2024-04-26T12:54:15.400151+0000","last_clean":"2024-04-26T12:54:15.400151+0000","last_became_active":"2024-04-26T12:50:04.281798+0000","last_became_peered":"2024-04-26T12:50:04.281798+0000","last_unstale":"2024-04-26T12:54:15.400151+0000","last_undegraded":"2024-04-26T12:54:15.400151+0000","last_fullsized":"2024-04-26T12:54:15.400151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:15.399681+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:15.399681+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.399681+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:34.871803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'4","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.276515+0000","last_change":"2024-04-26T12:53:50.276515+0000","last_active":"2024-04-26T12:53:50.276515+0000","last_peered":"2024-04-26T12:53:50.276515+0000","last_clean":"2024-04-26T12:53:50.276515+0000","last_became_active":"2024-04-26T12:49:56.224915+0000","last_became_peered":"2024-04-26T12:49:56.224915+0000","last_unstale":"2024-04-26T12:53:50.276515+0000","last_undegraded":"2024-04-26T12:53:50.276515+0000","last_fullsized":"2024-04-26T12:53:50.276515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:50.276254+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.276254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:50.769163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.078510+0000","last_change":"2024-04-26T12:53:59.078562+0000","last_active":"2024-04-26T12:53:59.078510+0000","last_peered":"2024-04-26T12:53:59.078510+0000","last_clean":"2024-04-26T12:53:59.078510+0000","last_became_active":"2024-04-26T12:49:44.964112+0000","last_became_peered":"2024-04-26T12:49:44.964112+0000","last_unstale":"2024-04-26T12:53:59.078510+0000","last_undegraded":"2024-04-26T12:53:59.078510+0000","last_fullsized":"2024-04-26T12:53:59.078510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:59.078308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:59.078308+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.078308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:58.992648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'6","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.025034+0000","last_change":"2024-04-26T12:54:14.025122+0000","last_active":"2024-04-26T12:54:14.025034+0000","last_peered":"2024-04-26T12:54:14.025034+0000","last_clean":"2024-04-26T12:54:14.025034+0000","last_became_active":"2024-04-26T12:49:54.234301+0000","last_became_peered":"2024-04-26T12:49:54.234301+0000","last_unstale":"2024-04-26T12:54:14.025034+0000","last_undegraded":"2024-04-26T12:54:14.025034+0000","last_fullsized":"2024-04-26T12:54:14.025034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:14.024798+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:14.024798+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.024798+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:50.094214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:14.141474+0000","last_change":"2024-04-26T12:54:14.141474+0000","last_active":"2024-04-26T12:54:14.141474+0000","last_peered":"2024-04-26T12:54:14.141474+0000","last_clean":"2024-04-26T12:54:14.141474+0000","last_became_active":"2024-04-26T12:50:34.316636+0000","last_became_peered":"2024-04-26T12:50:34.316636+0000","last_unstale":"2024-04-26T12:54:14.141474+0000","last_undegraded":"2024-04-26T12:54:14.141474+0000","last_fullsized":"2024-04-26T12:54:14.141474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:14.141184+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:14.141184+0000","last_clean_scrub_stamp":"2024-04-26T12:54:14.141184+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:28.916700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'23","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.771034+0000","last_change":"2024-04-26T12:53:30.771034+0000","last_active":"2024-04-26T12:53:30.771034+0000","last_peered":"2024-04-26T12:53:30.771034+0000","last_clean":"2024-04-26T12:53:30.771034+0000","last_became_active":"2024-04-26T12:50:00.246662+0000","last_became_peered":"2024-04-26T12:50:00.246662+0000","last_unstale":"2024-04-26T12:53:30.771034+0000","last_undegraded":"2024-04-26T12:53:30.771034+0000","last_fullsized":"2024-04-26T12:53:30.771034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:30.770734+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.770734+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:16.557148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.218444+0000","last_change":"2024-04-26T12:53:37.218444+0000","last_active":"2024-04-26T12:53:37.218444+0000","last_peered":"2024-04-26T12:53:37.218444+0000","last_clean":"2024-04-26T12:53:37.218444+0000","last_became_active":"2024-04-26T12:50:02.278435+0000","last_became_peered":"2024-04-26T12:50:02.278435+0000","last_unstale":"2024-04-26T12:53:37.218444+0000","last_undegraded":"2024-04-26T12:53:37.218444+0000","last_fullsized":"2024-04-26T12:53:37.218444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.218195+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.218195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:55.090465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.454748+0000","last_change":"2024-04-26T12:54:05.454748+0000","last_active":"2024-04-26T12:54:05.454748+0000","last_peered":"2024-04-26T12:54:05.454748+0000","last_clean":"2024-04-26T12:54:05.454748+0000","last_became_active":"2024-04-26T12:50:04.301371+0000","last_became_peered":"2024-04-26T12:50:04.301371+0000","last_unstale":"2024-04-26T12:54:05.454748+0000","last_undegraded":"2024-04-26T12:54:05.454748+0000","last_fullsized":"2024-04-26T12:54:05.454748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:05.454504+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:05.454504+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.454504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:45.412144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.225812+0000","last_change":"2024-04-26T12:53:53.225812+0000","last_active":"2024-04-26T12:53:53.225812+0000","last_peered":"2024-04-26T12:53:53.225812+0000","last_clean":"2024-04-26T12:53:53.225812+0000","last_became_active":"2024-04-26T12:49:56.217639+0000","last_became_peered":"2024-04-26T12:49:56.217639+0000","last_unstale":"2024-04-26T12:53:53.225812+0000","last_undegraded":"2024-04-26T12:53:53.225812+0000","last_fullsized":"2024-04-26T12:53:53.225812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:53.225550+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.225550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:27.498113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:31.530255+0000","last_change":"2024-04-26T12:54:31.530310+0000","last_active":"2024-04-26T12:54:31.530255+0000","last_peered":"2024-04-26T12:54:31.530255+0000","last_clean":"2024-04-26T12:54:31.530255+0000","last_became_active":"2024-04-26T12:49:44.964013+0000","last_became_peered":"2024-04-26T12:49:44.964013+0000","last_unstale":"2024-04-26T12:54:31.530255+0000","last_undegraded":"2024-04-26T12:54:31.530255+0000","last_fullsized":"2024-04-26T12:54:31.530255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:31.530051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:31.530051+0000","last_clean_scrub_stamp":"2024-04-26T12:54:31.530051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:35:38.641788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.076416+0000","last_change":"2024-04-26T12:54:01.076416+0000","last_active":"2024-04-26T12:54:01.076416+0000","last_peered":"2024-04-26T12:54:01.076416+0000","last_clean":"2024-04-26T12:54:01.076416+0000","last_became_active":"2024-04-26T12:49:54.228158+0000","last_became_peered":"2024-04-26T12:49:54.228158+0000","last_unstale":"2024-04-26T12:54:01.076416+0000","last_undegraded":"2024-04-26T12:54:01.076416+0000","last_fullsized":"2024-04-26T12:54:01.076416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:01.076163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:01.076163+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.076163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:17.089416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:42.187723+0000","last_change":"2024-04-26T12:53:42.187723+0000","last_active":"2024-04-26T12:53:42.187723+0000","last_peered":"2024-04-26T12:53:42.187723+0000","last_clean":"2024-04-26T12:53:42.187723+0000","last_became_active":"2024-04-26T12:49:58.225433+0000","last_became_peered":"2024-04-26T12:49:58.225433+0000","last_unstale":"2024-04-26T12:53:42.187723+0000","last_undegraded":"2024-04-26T12:53:42.187723+0000","last_fullsized":"2024-04-26T12:53:42.187723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:42.187463+0000","last_clean_scrub_stamp":"2024-04-26T12:53:42.187463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:46.572342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'21","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.345235+0000","last_change":"2024-04-26T12:53:27.345235+0000","last_active":"2024-04-26T12:53:27.345235+0000","last_peered":"2024-04-26T12:53:27.345235+0000","last_clean":"2024-04-26T12:53:27.345235+0000","last_became_active":"2024-04-26T12:50:00.261571+0000","last_became_peered":"2024-04-26T12:50:00.261571+0000","last_unstale":"2024-04-26T12:53:27.345235+0000","last_undegraded":"2024-04-26T12:53:27.345235+0000","last_fullsized":"2024-04-26T12:53:27.345235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-04-26T12:53:27.344956+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.344956+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:36.530634+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.363447+0000","last_change":"2024-04-26T12:53:45.363447+0000","last_active":"2024-04-26T12:53:45.363447+0000","last_peered":"2024-04-26T12:53:45.363447+0000","last_clean":"2024-04-26T12:53:45.363447+0000","last_became_active":"2024-04-26T12:50:02.283844+0000","last_became_peered":"2024-04-26T12:50:02.283844+0000","last_unstale":"2024-04-26T12:53:45.363447+0000","last_undegraded":"2024-04-26T12:53:45.363447+0000","last_fullsized":"2024-04-26T12:53:45.363447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:45.363192+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.363192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:54.085665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:19.428238+0000","last_change":"2024-04-26T12:54:19.428238+0000","last_active":"2024-04-26T12:54:19.428238+0000","last_peered":"2024-04-26T12:54:19.428238+0000","last_clean":"2024-04-26T12:54:19.428238+0000","last_became_active":"2024-04-26T12:50:04.290038+0000","last_became_peered":"2024-04-26T12:50:04.290038+0000","last_unstale":"2024-04-26T12:54:19.428238+0000","last_undegraded":"2024-04-26T12:54:19.428238+0000","last_fullsized":"2024-04-26T12:54:19.428238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:19.427970+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:19.427970+0000","last_clean_scrub_stamp":"2024-04-26T12:54:19.427970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:54.999011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'14","reported_seq":98,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.172388+0000","last_change":"2024-04-26T12:53:43.172388+0000","last_active":"2024-04-26T12:53:43.172388+0000","last_peered":"2024-04-26T12:53:43.172388+0000","last_clean":"2024-04-26T12:53:43.172388+0000","last_became_active":"2024-04-26T12:49:56.234303+0000","last_became_peered":"2024-04-26T12:49:56.234303+0000","last_unstale":"2024-04-26T12:53:43.172388+0000","last_undegraded":"2024-04-26T12:53:43.172388+0000","last_fullsized":"2024-04-26T12:53:43.172388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:43.172137+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.172137+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:20.834194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.115672+0000","last_change":"2024-04-26T12:54:00.115672+0000","last_active":"2024-04-26T12:54:00.115672+0000","last_peered":"2024-04-26T12:54:00.115672+0000","last_clean":"2024-04-26T12:54:00.115672+0000","last_became_active":"2024-04-26T12:49:54.226999+0000","last_became_peered":"2024-04-26T12:49:54.226999+0000","last_unstale":"2024-04-26T12:54:00.115672+0000","last_undegraded":"2024-04-26T12:54:00.115672+0000","last_fullsized":"2024-04-26T12:54:00.115672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:00.115220+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:00.115220+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.115220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:59.052303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.159508+0000","last_change":"2024-04-26T12:54:08.159561+0000","last_active":"2024-04-26T12:54:08.159508+0000","last_peered":"2024-04-26T12:54:08.159508+0000","last_clean":"2024-04-26T12:54:08.159508+0000","last_became_active":"2024-04-26T12:49:44.966052+0000","last_became_peered":"2024-04-26T12:49:44.966052+0000","last_unstale":"2024-04-26T12:54:08.159508+0000","last_undegraded":"2024-04-26T12:54:08.159508+0000","last_fullsized":"2024-04-26T12:54:08.159508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:08.159306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:08.159306+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.159306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:40.086269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.271022+0000","last_change":"2024-04-26T12:53:46.271022+0000","last_active":"2024-04-26T12:53:46.271022+0000","last_peered":"2024-04-26T12:53:46.271022+0000","last_clean":"2024-04-26T12:53:46.271022+0000","last_became_active":"2024-04-26T12:49:58.217526+0000","last_became_peered":"2024-04-26T12:49:58.217526+0000","last_unstale":"2024-04-26T12:53:46.271022+0000","last_undegraded":"2024-04-26T12:53:46.271022+0000","last_fullsized":"2024-04-26T12:53:46.271022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.270733+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.270733+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:53.862641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'73","reported_seq":150,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.205126+0000","last_change":"2024-04-26T12:53:30.205126+0000","last_active":"2024-04-26T12:53:30.205126+0000","last_peered":"2024-04-26T12:53:30.205126+0000","last_clean":"2024-04-26T12:53:30.205126+0000","last_became_active":"2024-04-26T12:50:00.239201+0000","last_became_peered":"2024-04-26T12:50:00.239201+0000","last_unstale":"2024-04-26T12:53:30.205126+0000","last_undegraded":"2024-04-26T12:53:30.205126+0000","last_fullsized":"2024-04-26T12:53:30.205126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'73","last_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_deep_scrub":"35'73","last_deep_scrub_stamp":"2024-04-26T12:53:30.204804+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.204804+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:53.044186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.761261+0000","last_change":"2024-04-26T12:53:22.761261+0000","last_active":"2024-04-26T12:53:22.761261+0000","last_peered":"2024-04-26T12:53:22.761261+0000","last_clean":"2024-04-26T12:53:22.761261+0000","last_became_active":"2024-04-26T12:50:02.267005+0000","last_became_peered":"2024-04-26T12:50:02.267005+0000","last_unstale":"2024-04-26T12:53:22.761261+0000","last_undegraded":"2024-04-26T12:53:22.761261+0000","last_fullsized":"2024-04-26T12:53:22.761261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.761001+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.761001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:49.570682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'9","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:17.038968+0000","last_change":"2024-04-26T12:54:17.038968+0000","last_active":"2024-04-26T12:54:17.038968+0000","last_peered":"2024-04-26T12:54:17.038968+0000","last_clean":"2024-04-26T12:54:17.038968+0000","last_became_active":"2024-04-26T12:50:04.281916+0000","last_became_peered":"2024-04-26T12:50:04.281916+0000","last_unstale":"2024-04-26T12:54:17.038968+0000","last_undegraded":"2024-04-26T12:54:17.038968+0000","last_fullsized":"2024-04-26T12:54:17.038968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-04-26T12:54:17.038676+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-04-26T12:54:17.038676+0000","last_clean_scrub_stamp":"2024-04-26T12:54:17.038676+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:16.419398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.198011+0000","last_change":"2024-04-26T12:53:49.198011+0000","last_active":"2024-04-26T12:53:49.198011+0000","last_peered":"2024-04-26T12:53:49.198011+0000","last_clean":"2024-04-26T12:53:49.198011+0000","last_became_active":"2024-04-26T12:49:56.231534+0000","last_became_peered":"2024-04-26T12:49:56.231534+0000","last_unstale":"2024-04-26T12:53:49.198011+0000","last_undegraded":"2024-04-26T12:53:49.198011+0000","last_fullsized":"2024-04-26T12:53:49.198011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:49.197740+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.197740+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:50.051462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.057310+0000","last_change":"2024-04-26T12:54:00.057310+0000","last_active":"2024-04-26T12:54:00.057310+0000","last_peered":"2024-04-26T12:54:00.057310+0000","last_clean":"2024-04-26T12:54:00.057310+0000","last_became_active":"2024-04-26T12:49:54.240417+0000","last_became_peered":"2024-04-26T12:49:54.240417+0000","last_unstale":"2024-04-26T12:54:00.057310+0000","last_undegraded":"2024-04-26T12:54:00.057310+0000","last_fullsized":"2024-04-26T12:54:00.057310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:00.057054+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.057054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:03:25.513480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:33.555898+0000","last_change":"2024-04-26T12:54:33.555951+0000","last_active":"2024-04-26T12:54:33.555898+0000","last_peered":"2024-04-26T12:54:33.555898+0000","last_clean":"2024-04-26T12:54:33.555898+0000","last_became_active":"2024-04-26T12:49:44.966451+0000","last_became_peered":"2024-04-26T12:49:44.966451+0000","last_unstale":"2024-04-26T12:54:33.555898+0000","last_undegraded":"2024-04-26T12:54:33.555898+0000","last_fullsized":"2024-04-26T12:54:33.555898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:33.555698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:33.555698+0000","last_clean_scrub_stamp":"2024-04-26T12:54:33.555698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:33.423337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.364121+0000","last_change":"2024-04-26T12:53:30.364121+0000","last_active":"2024-04-26T12:53:30.364121+0000","last_peered":"2024-04-26T12:53:30.364121+0000","last_clean":"2024-04-26T12:53:30.364121+0000","last_became_active":"2024-04-26T12:49:58.241184+0000","last_became_peered":"2024-04-26T12:49:58.241184+0000","last_unstale":"2024-04-26T12:53:30.364121+0000","last_undegraded":"2024-04-26T12:53:30.364121+0000","last_fullsized":"2024-04-26T12:53:30.364121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:30.363860+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.363860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:46.377113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'23","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.061000+0000","last_change":"2024-04-26T12:53:21.061000+0000","last_active":"2024-04-26T12:53:21.061000+0000","last_peered":"2024-04-26T12:53:21.061000+0000","last_clean":"2024-04-26T12:53:21.061000+0000","last_became_active":"2024-04-26T12:50:00.248421+0000","last_became_peered":"2024-04-26T12:50:00.248421+0000","last_unstale":"2024-04-26T12:53:21.061000+0000","last_undegraded":"2024-04-26T12:53:21.061000+0000","last_fullsized":"2024-04-26T12:53:21.061000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'23","last_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_deep_scrub":"35'23","last_deep_scrub_stamp":"2024-04-26T12:53:21.060723+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.060723+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:54.780796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":369,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.077560+0000","last_change":"2024-04-26T12:53:28.077560+0000","last_active":"2024-04-26T12:53:28.077560+0000","last_peered":"2024-04-26T12:53:28.077560+0000","last_clean":"2024-04-26T12:53:28.077560+0000","last_became_active":"2024-04-26T12:50:02.273352+0000","last_became_peered":"2024-04-26T12:50:02.273352+0000","last_unstale":"2024-04-26T12:53:28.077560+0000","last_undegraded":"2024-04-26T12:53:28.077560+0000","last_fullsized":"2024-04-26T12:53:28.077560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:28.077291+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.077291+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:13.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:44.313936+0000","last_change":"2024-04-26T12:54:44.313991+0000","last_active":"2024-04-26T12:54:44.313936+0000","last_peered":"2024-04-26T12:54:44.313936+0000","last_clean":"2024-04-26T12:54:44.313936+0000","last_became_active":"2024-04-26T12:50:04.308439+0000","last_became_peered":"2024-04-26T12:50:04.308439+0000","last_unstale":"2024-04-26T12:54:44.313936+0000","last_undegraded":"2024-04-26T12:54:44.313936+0000","last_fullsized":"2024-04-26T12:54:44.313936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:44.313706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:44.313706+0000","last_clean_scrub_stamp":"2024-04-26T12:54:44.313706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:15.968812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'10","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.517273+0000","last_change":"2024-04-26T12:54:03.517340+0000","last_active":"2024-04-26T12:54:03.517273+0000","last_peered":"2024-04-26T12:54:03.517273+0000","last_clean":"2024-04-26T12:54:03.517273+0000","last_became_active":"2024-04-26T12:49:56.225939+0000","last_became_peered":"2024-04-26T12:49:56.225939+0000","last_unstale":"2024-04-26T12:54:03.517273+0000","last_undegraded":"2024-04-26T12:54:03.517273+0000","last_fullsized":"2024-04-26T12:54:03.517273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:03.517090+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:03.517090+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.517090+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:05.628227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:21.493549+0000","last_change":"2024-04-26T12:54:21.493623+0000","last_active":"2024-04-26T12:54:21.493549+0000","last_peered":"2024-04-26T12:54:21.493549+0000","last_clean":"2024-04-26T12:54:21.493549+0000","last_became_active":"2024-04-26T12:49:54.252875+0000","last_became_peered":"2024-04-26T12:49:54.252875+0000","last_unstale":"2024-04-26T12:54:21.493549+0000","last_undegraded":"2024-04-26T12:54:21.493549+0000","last_fullsized":"2024-04-26T12:54:21.493549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:21.493290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:21.493290+0000","last_clean_scrub_stamp":"2024-04-26T12:54:21.493290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:28.436480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.123286+0000","last_change":"2024-04-26T12:54:07.123347+0000","last_active":"2024-04-26T12:54:07.123286+0000","last_peered":"2024-04-26T12:54:07.123286+0000","last_clean":"2024-04-26T12:54:07.123286+0000","last_became_active":"2024-04-26T12:49:44.965705+0000","last_became_peered":"2024-04-26T12:49:44.965705+0000","last_unstale":"2024-04-26T12:54:07.123286+0000","last_undegraded":"2024-04-26T12:54:07.123286+0000","last_fullsized":"2024-04-26T12:54:07.123286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:07.123085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:07.123085+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.123085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:47.764312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.421343+0000","last_change":"2024-04-26T12:53:21.421343+0000","last_active":"2024-04-26T12:53:21.421343+0000","last_peered":"2024-04-26T12:53:21.421343+0000","last_clean":"2024-04-26T12:53:21.421343+0000","last_became_active":"2024-04-26T12:49:58.245408+0000","last_became_peered":"2024-04-26T12:49:58.245408+0000","last_unstale":"2024-04-26T12:53:21.421343+0000","last_undegraded":"2024-04-26T12:53:21.421343+0000","last_fullsized":"2024-04-26T12:53:21.421343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.421080+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.421080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:06.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'16","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:48.399644+0000","last_change":"2024-04-26T12:53:48.399644+0000","last_active":"2024-04-26T12:53:48.399644+0000","last_peered":"2024-04-26T12:53:48.399644+0000","last_clean":"2024-04-26T12:53:48.399644+0000","last_became_active":"2024-04-26T12:50:00.271411+0000","last_became_peered":"2024-04-26T12:50:00.271411+0000","last_unstale":"2024-04-26T12:53:48.399644+0000","last_undegraded":"2024-04-26T12:53:48.399644+0000","last_fullsized":"2024-04-26T12:53:48.399644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:48.399160+0000","last_clean_scrub_stamp":"2024-04-26T12:53:48.399160+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:20.449086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.333981+0000","last_change":"2024-04-26T12:53:21.333981+0000","last_active":"2024-04-26T12:53:21.333981+0000","last_peered":"2024-04-26T12:53:21.333981+0000","last_clean":"2024-04-26T12:53:21.333981+0000","last_became_active":"2024-04-26T12:50:02.272766+0000","last_became_peered":"2024-04-26T12:50:02.272766+0000","last_unstale":"2024-04-26T12:53:21.333981+0000","last_undegraded":"2024-04-26T12:53:21.333981+0000","last_fullsized":"2024-04-26T12:53:21.333981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:21.333725+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.333725+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:27.636643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:20.457599+0000","last_change":"2024-04-26T12:54:20.457599+0000","last_active":"2024-04-26T12:54:20.457599+0000","last_peered":"2024-04-26T12:54:20.457599+0000","last_clean":"2024-04-26T12:54:20.457599+0000","last_became_active":"2024-04-26T12:50:04.300673+0000","last_became_peered":"2024-04-26T12:50:04.300673+0000","last_unstale":"2024-04-26T12:54:20.457599+0000","last_undegraded":"2024-04-26T12:54:20.457599+0000","last_fullsized":"2024-04-26T12:54:20.457599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-04-26T12:54:20.457274+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-04-26T12:54:20.457274+0000","last_clean_scrub_stamp":"2024-04-26T12:54:20.457274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:51.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.991775+0000","last_change":"2024-04-26T12:53:46.991775+0000","last_active":"2024-04-26T12:53:46.991775+0000","last_peered":"2024-04-26T12:53:46.991775+0000","last_clean":"2024-04-26T12:53:46.991775+0000","last_became_active":"2024-04-26T12:49:56.214941+0000","last_became_peered":"2024-04-26T12:49:56.214941+0000","last_unstale":"2024-04-26T12:53:46.991775+0000","last_undegraded":"2024-04-26T12:53:46.991775+0000","last_fullsized":"2024-04-26T12:53:46.991775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:46.991502+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.991502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:27.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.392770+0000","last_change":"2024-04-26T12:54:13.392770+0000","last_active":"2024-04-26T12:54:13.392770+0000","last_peered":"2024-04-26T12:54:13.392770+0000","last_clean":"2024-04-26T12:54:13.392770+0000","last_became_active":"2024-04-26T12:49:54.238798+0000","last_became_peered":"2024-04-26T12:49:54.238798+0000","last_unstale":"2024-04-26T12:54:13.392770+0000","last_undegraded":"2024-04-26T12:54:13.392770+0000","last_fullsized":"2024-04-26T12:54:13.392770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:13.392469+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:13.392469+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.392469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:35.832684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:34.553698+0000","last_change":"2024-04-26T12:54:34.553756+0000","last_active":"2024-04-26T12:54:34.553698+0000","last_peered":"2024-04-26T12:54:34.553698+0000","last_clean":"2024-04-26T12:54:34.553698+0000","last_became_active":"2024-04-26T12:49:44.966631+0000","last_became_peered":"2024-04-26T12:49:44.966631+0000","last_unstale":"2024-04-26T12:54:34.553698+0000","last_undegraded":"2024-04-26T12:54:34.553698+0000","last_fullsized":"2024-04-26T12:54:34.553698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:34.553473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:34.553473+0000","last_clean_scrub_stamp":"2024-04-26T12:54:34.553473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.847532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.334821+0000","last_change":"2024-04-26T12:53:31.334821+0000","last_active":"2024-04-26T12:53:31.334821+0000","last_peered":"2024-04-26T12:53:31.334821+0000","last_clean":"2024-04-26T12:53:31.334821+0000","last_became_active":"2024-04-26T12:49:58.231055+0000","last_became_peered":"2024-04-26T12:49:58.231055+0000","last_unstale":"2024-04-26T12:53:31.334821+0000","last_undegraded":"2024-04-26T12:53:31.334821+0000","last_fullsized":"2024-04-26T12:53:31.334821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.334536+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.334536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:45.400333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'99","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.718800+0000","last_change":"2024-04-26T12:53:27.718800+0000","last_active":"2024-04-26T12:53:27.718800+0000","last_peered":"2024-04-26T12:53:27.718800+0000","last_clean":"2024-04-26T12:53:27.718800+0000","last_became_active":"2024-04-26T12:50:00.260709+0000","last_became_peered":"2024-04-26T12:50:00.260709+0000","last_unstale":"2024-04-26T12:53:27.718800+0000","last_undegraded":"2024-04-26T12:53:27.718800+0000","last_fullsized":"2024-04-26T12:53:27.718800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'99","last_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_deep_scrub":"35'99","last_deep_scrub_stamp":"2024-04-26T12:53:27.718504+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.718504+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:03.589502+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:29.215348+0000","last_change":"2024-04-26T12:53:29.215348+0000","last_active":"2024-04-26T12:53:29.215348+0000","last_peered":"2024-04-26T12:53:29.215348+0000","last_clean":"2024-04-26T12:53:29.215348+0000","last_became_active":"2024-04-26T12:50:02.276042+0000","last_became_peered":"2024-04-26T12:50:02.276042+0000","last_unstale":"2024-04-26T12:53:29.215348+0000","last_undegraded":"2024-04-26T12:53:29.215348+0000","last_fullsized":"2024-04-26T12:53:29.215348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:29.215091+0000","last_clean_scrub_stamp":"2024-04-26T12:53:29.215091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:55.609962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.118706+0000","last_change":"2024-04-26T12:54:08.118706+0000","last_active":"2024-04-26T12:54:08.118706+0000","last_peered":"2024-04-26T12:54:08.118706+0000","last_clean":"2024-04-26T12:54:08.118706+0000","last_became_active":"2024-04-26T12:50:04.279821+0000","last_became_peered":"2024-04-26T12:50:04.279821+0000","last_unstale":"2024-04-26T12:54:08.118706+0000","last_undegraded":"2024-04-26T12:54:08.118706+0000","last_fullsized":"2024-04-26T12:54:08.118706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:08.118446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:08.118446+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.118446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:36.872491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.122612+0000","last_change":"2024-04-26T12:54:09.122612+0000","last_active":"2024-04-26T12:54:09.122612+0000","last_peered":"2024-04-26T12:54:09.122612+0000","last_clean":"2024-04-26T12:54:09.122612+0000","last_became_active":"2024-04-26T12:50:04.282553+0000","last_became_peered":"2024-04-26T12:50:04.282553+0000","last_unstale":"2024-04-26T12:54:09.122612+0000","last_undegraded":"2024-04-26T12:54:09.122612+0000","last_fullsized":"2024-04-26T12:54:09.122612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:09.122366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:09.122366+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.122366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:10.237483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'6","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.929781+0000","last_change":"2024-04-26T12:53:41.929781+0000","last_active":"2024-04-26T12:53:41.929781+0000","last_peered":"2024-04-26T12:53:41.929781+0000","last_clean":"2024-04-26T12:53:41.929781+0000","last_became_active":"2024-04-26T12:49:56.224277+0000","last_became_peered":"2024-04-26T12:49:56.224277+0000","last_unstale":"2024-04-26T12:53:41.929781+0000","last_undegraded":"2024-04-26T12:53:41.929781+0000","last_fullsized":"2024-04-26T12:53:41.929781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:53:41.929472+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.929472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:59.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.524587+0000","last_change":"2024-04-26T12:54:12.524587+0000","last_active":"2024-04-26T12:54:12.524587+0000","last_peered":"2024-04-26T12:54:12.524587+0000","last_clean":"2024-04-26T12:54:12.524587+0000","last_became_active":"2024-04-26T12:49:54.257921+0000","last_became_peered":"2024-04-26T12:49:54.257921+0000","last_unstale":"2024-04-26T12:54:12.524587+0000","last_undegraded":"2024-04-26T12:54:12.524587+0000","last_fullsized":"2024-04-26T12:54:12.524587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.524326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.524326+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.524326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:02.974028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.182402+0000","last_change":"2024-04-26T12:53:37.182402+0000","last_active":"2024-04-26T12:53:37.182402+0000","last_peered":"2024-04-26T12:53:37.182402+0000","last_clean":"2024-04-26T12:53:37.182402+0000","last_became_active":"2024-04-26T12:49:58.226416+0000","last_became_peered":"2024-04-26T12:49:58.226416+0000","last_unstale":"2024-04-26T12:53:37.182402+0000","last_undegraded":"2024-04-26T12:53:37.182402+0000","last_fullsized":"2024-04-26T12:53:37.182402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.182009+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.182009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.668088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.379487+0000","last_change":"2024-04-26T12:53:35.379487+0000","last_active":"2024-04-26T12:53:35.379487+0000","last_peered":"2024-04-26T12:53:35.379487+0000","last_clean":"2024-04-26T12:53:35.379487+0000","last_became_active":"2024-04-26T12:50:00.265667+0000","last_became_peered":"2024-04-26T12:50:00.265667+0000","last_unstale":"2024-04-26T12:53:35.379487+0000","last_undegraded":"2024-04-26T12:53:35.379487+0000","last_fullsized":"2024-04-26T12:53:35.379487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:35.379029+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.379029+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:12.600563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.355844+0000","last_change":"2024-04-26T12:53:46.355844+0000","last_active":"2024-04-26T12:53:46.355844+0000","last_peered":"2024-04-26T12:53:46.355844+0000","last_clean":"2024-04-26T12:53:46.355844+0000","last_became_active":"2024-04-26T12:50:02.282221+0000","last_became_peered":"2024-04-26T12:50:02.282221+0000","last_unstale":"2024-04-26T12:53:46.355844+0000","last_undegraded":"2024-04-26T12:53:46.355844+0000","last_fullsized":"2024-04-26T12:53:46.355844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.355590+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.355590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:41.624485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:18.039190+0000","last_change":"2024-04-26T12:54:18.039252+0000","last_active":"2024-04-26T12:54:18.039190+0000","last_peered":"2024-04-26T12:54:18.039190+0000","last_clean":"2024-04-26T12:54:18.039190+0000","last_became_active":"2024-04-26T12:50:04.285562+0000","last_became_peered":"2024-04-26T12:50:04.285562+0000","last_unstale":"2024-04-26T12:54:18.039190+0000","last_undegraded":"2024-04-26T12:54:18.039190+0000","last_fullsized":"2024-04-26T12:54:18.039190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:54:18.038959+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:54:18.038959+0000","last_clean_scrub_stamp":"2024-04-26T12:54:18.038959+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:39.489918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'8","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:21.457312+0000","last_change":"2024-04-26T12:54:21.457312+0000","last_active":"2024-04-26T12:54:21.457312+0000","last_peered":"2024-04-26T12:54:21.457312+0000","last_clean":"2024-04-26T12:54:21.457312+0000","last_became_active":"2024-04-26T12:50:34.320586+0000","last_became_peered":"2024-04-26T12:50:34.320586+0000","last_unstale":"2024-04-26T12:54:21.457312+0000","last_undegraded":"2024-04-26T12:54:21.457312+0000","last_fullsized":"2024-04-26T12:54:21.457312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:21.456900+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:21.456900+0000","last_clean_scrub_stamp":"2024-04-26T12:54:21.456900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:34.211647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.115884+0000","last_change":"2024-04-26T12:54:06.115884+0000","last_active":"2024-04-26T12:54:06.115884+0000","last_peered":"2024-04-26T12:54:06.115884+0000","last_clean":"2024-04-26T12:54:06.115884+0000","last_became_active":"2024-04-26T12:49:54.242435+0000","last_became_peered":"2024-04-26T12:49:54.242435+0000","last_unstale":"2024-04-26T12:54:06.115884+0000","last_undegraded":"2024-04-26T12:54:06.115884+0000","last_fullsized":"2024-04-26T12:54:06.115884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:06.115455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:06.115455+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.115455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:28.333237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:46.278562+0000","last_change":"2024-04-26T12:54:46.278740+0000","last_active":"2024-04-26T12:54:46.278562+0000","last_peered":"2024-04-26T12:54:46.278562+0000","last_clean":"2024-04-26T12:54:46.278562+0000","last_became_active":"2024-04-26T12:50:34.323925+0000","last_became_peered":"2024-04-26T12:50:34.323925+0000","last_unstale":"2024-04-26T12:54:46.278562+0000","last_undegraded":"2024-04-26T12:54:46.278562+0000","last_fullsized":"2024-04-26T12:54:46.278562+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:46.278336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:46.278336+0000","last_clean_scrub_stamp":"2024-04-26T12:54:46.278336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:01.586864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:35.245501+0000","last_change":"2024-04-26T12:53:35.245501+0000","last_active":"2024-04-26T12:53:35.245501+0000","last_peered":"2024-04-26T12:53:35.245501+0000","last_clean":"2024-04-26T12:53:35.245501+0000","last_became_active":"2024-04-26T12:50:00.231537+0000","last_became_peered":"2024-04-26T12:50:00.231537+0000","last_unstale":"2024-04-26T12:53:35.245501+0000","last_undegraded":"2024-04-26T12:53:35.245501+0000","last_fullsized":"2024-04-26T12:53:35.245501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:35.245236+0000","last_clean_scrub_stamp":"2024-04-26T12:53:35.245236+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:33.087428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.725849+0000","last_change":"2024-04-26T12:53:24.725849+0000","last_active":"2024-04-26T12:53:24.725849+0000","last_peered":"2024-04-26T12:53:24.725849+0000","last_clean":"2024-04-26T12:53:24.725849+0000","last_became_active":"2024-04-26T12:50:02.284169+0000","last_became_peered":"2024-04-26T12:50:02.284169+0000","last_unstale":"2024-04-26T12:53:24.725849+0000","last_undegraded":"2024-04-26T12:53:24.725849+0000","last_fullsized":"2024-04-26T12:53:24.725849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.725577+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.725577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:57.154247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'10","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:45.302405+0000","last_change":"2024-04-26T12:53:45.302468+0000","last_active":"2024-04-26T12:53:45.302405+0000","last_peered":"2024-04-26T12:53:45.302405+0000","last_clean":"2024-04-26T12:53:45.302405+0000","last_became_active":"2024-04-26T12:50:04.280922+0000","last_became_peered":"2024-04-26T12:50:04.280922+0000","last_unstale":"2024-04-26T12:53:45.302405+0000","last_undegraded":"2024-04-26T12:53:45.302405+0000","last_fullsized":"2024-04-26T12:53:45.302405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:45.302211+0000","last_clean_scrub_stamp":"2024-04-26T12:53:45.302211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.021522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'16","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:57.150181+0000","last_change":"2024-04-26T12:53:57.150181+0000","last_active":"2024-04-26T12:53:57.150181+0000","last_peered":"2024-04-26T12:53:57.150181+0000","last_clean":"2024-04-26T12:53:57.150181+0000","last_became_active":"2024-04-26T12:49:56.220537+0000","last_became_peered":"2024-04-26T12:49:56.220537+0000","last_unstale":"2024-04-26T12:53:57.150181+0000","last_undegraded":"2024-04-26T12:53:57.150181+0000","last_fullsized":"2024-04-26T12:53:57.150181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-04-26T12:53:57.149914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:57.149914+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:33.210100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.962501+0000","last_change":"2024-04-26T12:53:53.962501+0000","last_active":"2024-04-26T12:53:53.962501+0000","last_peered":"2024-04-26T12:53:53.962501+0000","last_clean":"2024-04-26T12:53:53.962501+0000","last_became_active":"2024-04-26T12:49:54.245581+0000","last_became_peered":"2024-04-26T12:49:54.245581+0000","last_unstale":"2024-04-26T12:53:53.962501+0000","last_undegraded":"2024-04-26T12:53:53.962501+0000","last_fullsized":"2024-04-26T12:53:53.962501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:53.962061+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.962061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:05.175288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.837739+0000","last_change":"2024-04-26T12:53:34.837739+0000","last_active":"2024-04-26T12:53:34.837739+0000","last_peered":"2024-04-26T12:53:34.837739+0000","last_clean":"2024-04-26T12:53:34.837739+0000","last_became_active":"2024-04-26T12:49:58.226649+0000","last_became_peered":"2024-04-26T12:49:58.226649+0000","last_unstale":"2024-04-26T12:53:34.837739+0000","last_undegraded":"2024-04-26T12:53:34.837739+0000","last_fullsized":"2024-04-26T12:53:34.837739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.837461+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.837461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:55.097696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'47","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.252332+0000","last_change":"2024-04-26T12:53:34.252332+0000","last_active":"2024-04-26T12:53:34.252332+0000","last_peered":"2024-04-26T12:53:34.252332+0000","last_clean":"2024-04-26T12:53:34.252332+0000","last_became_active":"2024-04-26T12:50:00.232706+0000","last_became_peered":"2024-04-26T12:50:00.232706+0000","last_unstale":"2024-04-26T12:53:34.252332+0000","last_undegraded":"2024-04-26T12:53:34.252332+0000","last_fullsized":"2024-04-26T12:53:34.252332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:34.252055+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.252055+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:22.283776+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:20.049974+0000","last_change":"2024-04-26T12:53:20.049974+0000","last_active":"2024-04-26T12:53:20.049974+0000","last_peered":"2024-04-26T12:53:20.049974+0000","last_clean":"2024-04-26T12:53:20.049974+0000","last_became_active":"2024-04-26T12:50:02.271878+0000","last_became_peered":"2024-04-26T12:50:02.271878+0000","last_unstale":"2024-04-26T12:53:20.049974+0000","last_undegraded":"2024-04-26T12:53:20.049974+0000","last_fullsized":"2024-04-26T12:53:20.049974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:20.049783+0000","last_clean_scrub_stamp":"2024-04-26T12:53:20.049783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:14.101561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'4","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:42.344945+0000","last_change":"2024-04-26T12:54:42.345011+0000","last_active":"2024-04-26T12:54:42.344945+0000","last_peered":"2024-04-26T12:54:42.344945+0000","last_clean":"2024-04-26T12:54:42.344945+0000","last_became_active":"2024-04-26T12:50:04.308250+0000","last_became_peered":"2024-04-26T12:50:04.308250+0000","last_unstale":"2024-04-26T12:54:42.344945+0000","last_undegraded":"2024-04-26T12:54:42.344945+0000","last_fullsized":"2024-04-26T12:54:42.344945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:42.344739+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:42.344739+0000","last_clean_scrub_stamp":"2024-04-26T12:54:42.344739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:10.305616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'10","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.504321+0000","last_change":"2024-04-26T12:53:56.504321+0000","last_active":"2024-04-26T12:53:56.504321+0000","last_peered":"2024-04-26T12:53:56.504321+0000","last_clean":"2024-04-26T12:53:56.504321+0000","last_became_active":"2024-04-26T12:49:56.226554+0000","last_became_peered":"2024-04-26T12:49:56.226554+0000","last_unstale":"2024-04-26T12:53:56.504321+0000","last_undegraded":"2024-04-26T12:53:56.504321+0000","last_fullsized":"2024-04-26T12:53:56.504321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:56.503910+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.503910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.738314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:12.385867+0000","last_change":"2024-04-26T12:54:12.385867+0000","last_active":"2024-04-26T12:54:12.385867+0000","last_peered":"2024-04-26T12:54:12.385867+0000","last_clean":"2024-04-26T12:54:12.385867+0000","last_became_active":"2024-04-26T12:49:54.237896+0000","last_became_peered":"2024-04-26T12:49:54.237896+0000","last_unstale":"2024-04-26T12:54:12.385867+0000","last_undegraded":"2024-04-26T12:54:12.385867+0000","last_fullsized":"2024-04-26T12:54:12.385867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:12.385615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:12.385615+0000","last_clean_scrub_stamp":"2024-04-26T12:54:12.385615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:05.886586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.347602+0000","last_change":"2024-04-26T12:53:24.347602+0000","last_active":"2024-04-26T12:53:24.347602+0000","last_peered":"2024-04-26T12:53:24.347602+0000","last_clean":"2024-04-26T12:53:24.347602+0000","last_became_active":"2024-04-26T12:49:58.244184+0000","last_became_peered":"2024-04-26T12:49:58.244184+0000","last_unstale":"2024-04-26T12:53:24.347602+0000","last_undegraded":"2024-04-26T12:53:24.347602+0000","last_fullsized":"2024-04-26T12:53:24.347602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.347350+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.347350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:48.923924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.801328+0000","last_change":"2024-04-26T12:53:31.801328+0000","last_active":"2024-04-26T12:53:31.801328+0000","last_peered":"2024-04-26T12:53:31.801328+0000","last_clean":"2024-04-26T12:53:31.801328+0000","last_became_active":"2024-04-26T12:50:00.239390+0000","last_became_peered":"2024-04-26T12:50:00.239390+0000","last_unstale":"2024-04-26T12:53:31.801328+0000","last_undegraded":"2024-04-26T12:53:31.801328+0000","last_fullsized":"2024-04-26T12:53:31.801328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-04-26T12:53:31.801011+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.801011+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:27.272844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:23.740693+0000","last_change":"2024-04-26T12:53:23.740693+0000","last_active":"2024-04-26T12:53:23.740693+0000","last_peered":"2024-04-26T12:53:23.740693+0000","last_clean":"2024-04-26T12:53:23.740693+0000","last_became_active":"2024-04-26T12:50:02.263409+0000","last_became_peered":"2024-04-26T12:50:02.263409+0000","last_unstale":"2024-04-26T12:53:23.740693+0000","last_undegraded":"2024-04-26T12:53:23.740693+0000","last_fullsized":"2024-04-26T12:53:23.740693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:23.740437+0000","last_clean_scrub_stamp":"2024-04-26T12:53:23.740437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:49.029310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.334631+0000","last_change":"2024-04-26T12:53:34.334631+0000","last_active":"2024-04-26T12:53:34.334631+0000","last_peered":"2024-04-26T12:53:34.334631+0000","last_clean":"2024-04-26T12:53:34.334631+0000","last_became_active":"2024-04-26T12:49:56.229847+0000","last_became_peered":"2024-04-26T12:49:56.229847+0000","last_unstale":"2024-04-26T12:53:34.334631+0000","last_undegraded":"2024-04-26T12:53:34.334631+0000","last_fullsized":"2024-04-26T12:53:34.334631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:34.334375+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.334375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:02.613019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.584779+0000","last_change":"2024-04-26T12:54:16.584779+0000","last_active":"2024-04-26T12:54:16.584779+0000","last_peered":"2024-04-26T12:54:16.584779+0000","last_clean":"2024-04-26T12:54:16.584779+0000","last_became_active":"2024-04-26T12:49:54.239730+0000","last_became_peered":"2024-04-26T12:49:54.239730+0000","last_unstale":"2024-04-26T12:54:16.584779+0000","last_undegraded":"2024-04-26T12:54:16.584779+0000","last_fullsized":"2024-04-26T12:54:16.584779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:16.584498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:16.584498+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.584498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:20.594239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":239,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.234809+0000","last_change":"2024-04-26T12:53:43.234809+0000","last_active":"2024-04-26T12:53:43.234809+0000","last_peered":"2024-04-26T12:53:43.234809+0000","last_clean":"2024-04-26T12:53:43.234809+0000","last_became_active":"2024-04-26T12:49:58.223858+0000","last_became_peered":"2024-04-26T12:49:58.223858+0000","last_unstale":"2024-04-26T12:53:43.234809+0000","last_undegraded":"2024-04-26T12:53:43.234809+0000","last_fullsized":"2024-04-26T12:53:43.234809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-04-26T12:53:43.234542+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.234542+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:14.014272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":137,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:28.227166+0000","last_change":"2024-04-26T12:53:28.227166+0000","last_active":"2024-04-26T12:53:28.227166+0000","last_peered":"2024-04-26T12:53:28.227166+0000","last_clean":"2024-04-26T12:53:28.227166+0000","last_became_active":"2024-04-26T12:50:00.241717+0000","last_became_peered":"2024-04-26T12:50:00.241717+0000","last_unstale":"2024-04-26T12:53:28.227166+0000","last_undegraded":"2024-04-26T12:53:28.227166+0000","last_fullsized":"2024-04-26T12:53:28.227166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-04-26T12:53:28.226873+0000","last_clean_scrub_stamp":"2024-04-26T12:53:28.226873+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:23.499693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:21.736545+0000","last_change":"2024-04-26T12:53:21.736604+0000","last_active":"2024-04-26T12:53:21.736545+0000","last_peered":"2024-04-26T12:53:21.736545+0000","last_clean":"2024-04-26T12:53:21.736545+0000","last_became_active":"2024-04-26T12:50:02.271283+0000","last_became_peered":"2024-04-26T12:50:02.271283+0000","last_unstale":"2024-04-26T12:53:21.736545+0000","last_undegraded":"2024-04-26T12:53:21.736545+0000","last_fullsized":"2024-04-26T12:53:21.736545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:21.736352+0000","last_clean_scrub_stamp":"2024-04-26T12:53:21.736352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:21.809175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.288385+0000","last_change":"2024-04-26T12:53:49.288385+0000","last_active":"2024-04-26T12:53:49.288385+0000","last_peered":"2024-04-26T12:53:49.288385+0000","last_clean":"2024-04-26T12:53:49.288385+0000","last_became_active":"2024-04-26T12:50:04.281140+0000","last_became_peered":"2024-04-26T12:50:04.281140+0000","last_unstale":"2024-04-26T12:53:49.288385+0000","last_undegraded":"2024-04-26T12:53:49.288385+0000","last_fullsized":"2024-04-26T12:53:49.288385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-04-26T12:53:49.288000+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.288000+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:06.328966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.099538+0000","last_change":"2024-04-26T12:54:05.099599+0000","last_active":"2024-04-26T12:54:05.099538+0000","last_peered":"2024-04-26T12:54:05.099538+0000","last_clean":"2024-04-26T12:54:05.099538+0000","last_became_active":"2024-04-26T12:49:56.224228+0000","last_became_peered":"2024-04-26T12:49:56.224228+0000","last_unstale":"2024-04-26T12:54:05.099538+0000","last_undegraded":"2024-04-26T12:54:05.099538+0000","last_fullsized":"2024-04-26T12:54:05.099538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:54:05.099328+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:54:05.099328+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.099328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:13.229996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:05.304979+0000","last_change":"2024-04-26T12:54:05.304979+0000","last_active":"2024-04-26T12:54:05.304979+0000","last_peered":"2024-04-26T12:54:05.304979+0000","last_clean":"2024-04-26T12:54:05.304979+0000","last_became_active":"2024-04-26T12:49:54.243116+0000","last_became_peered":"2024-04-26T12:49:54.243116+0000","last_unstale":"2024-04-26T12:54:05.304979+0000","last_undegraded":"2024-04-26T12:54:05.304979+0000","last_fullsized":"2024-04-26T12:54:05.304979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:05.304733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:05.304733+0000","last_clean_scrub_stamp":"2024-04-26T12:54:05.304733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:48.470972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:37.904759+0000","last_change":"2024-04-26T12:53:37.904759+0000","last_active":"2024-04-26T12:53:37.904759+0000","last_peered":"2024-04-26T12:53:37.904759+0000","last_clean":"2024-04-26T12:53:37.904759+0000","last_became_active":"2024-04-26T12:49:58.219891+0000","last_became_peered":"2024-04-26T12:49:58.219891+0000","last_unstale":"2024-04-26T12:53:37.904759+0000","last_undegraded":"2024-04-26T12:53:37.904759+0000","last_fullsized":"2024-04-26T12:53:37.904759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:37.904494+0000","last_clean_scrub_stamp":"2024-04-26T12:53:37.904494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:22.228978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'47","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.491629+0000","last_change":"2024-04-26T12:53:52.491707+0000","last_active":"2024-04-26T12:53:52.491629+0000","last_peered":"2024-04-26T12:53:52.491629+0000","last_clean":"2024-04-26T12:53:52.491629+0000","last_became_active":"2024-04-26T12:50:00.269563+0000","last_became_peered":"2024-04-26T12:50:00.269563+0000","last_unstale":"2024-04-26T12:53:52.491629+0000","last_undegraded":"2024-04-26T12:53:52.491629+0000","last_fullsized":"2024-04-26T12:53:52.491629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'47","last_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_deep_scrub":"35'47","last_deep_scrub_stamp":"2024-04-26T12:53:52.491439+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.491439+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:11.972259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:36.155724+0000","last_change":"2024-04-26T12:53:36.155779+0000","last_active":"2024-04-26T12:53:36.155724+0000","last_peered":"2024-04-26T12:53:36.155724+0000","last_clean":"2024-04-26T12:53:36.155724+0000","last_became_active":"2024-04-26T12:50:02.285350+0000","last_became_peered":"2024-04-26T12:50:02.285350+0000","last_unstale":"2024-04-26T12:53:36.155724+0000","last_undegraded":"2024-04-26T12:53:36.155724+0000","last_fullsized":"2024-04-26T12:53:36.155724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:36.155541+0000","last_clean_scrub_stamp":"2024-04-26T12:53:36.155541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:38.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.529079+0000","last_change":"2024-04-26T12:54:01.529079+0000","last_active":"2024-04-26T12:54:01.529079+0000","last_peered":"2024-04-26T12:54:01.529079+0000","last_clean":"2024-04-26T12:54:01.529079+0000","last_became_active":"2024-04-26T12:50:04.301271+0000","last_became_peered":"2024-04-26T12:50:04.301271+0000","last_unstale":"2024-04-26T12:54:01.529079+0000","last_undegraded":"2024-04-26T12:54:01.529079+0000","last_fullsized":"2024-04-26T12:54:01.529079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:01.528785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:01.528785+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.528785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:27.197092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.304100+0000","last_change":"2024-04-26T12:53:32.304100+0000","last_active":"2024-04-26T12:53:32.304100+0000","last_peered":"2024-04-26T12:53:32.304100+0000","last_clean":"2024-04-26T12:53:32.304100+0000","last_became_active":"2024-04-26T12:49:56.232307+0000","last_became_peered":"2024-04-26T12:49:56.232307+0000","last_unstale":"2024-04-26T12:53:32.304100+0000","last_undegraded":"2024-04-26T12:53:32.304100+0000","last_fullsized":"2024-04-26T12:53:32.304100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:32.303812+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.303812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:44.406488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:07.340671+0000","last_change":"2024-04-26T12:54:07.340671+0000","last_active":"2024-04-26T12:54:07.340671+0000","last_peered":"2024-04-26T12:54:07.340671+0000","last_clean":"2024-04-26T12:54:07.340671+0000","last_became_active":"2024-04-26T12:49:54.229227+0000","last_became_peered":"2024-04-26T12:49:54.229227+0000","last_unstale":"2024-04-26T12:54:07.340671+0000","last_undegraded":"2024-04-26T12:54:07.340671+0000","last_fullsized":"2024-04-26T12:54:07.340671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:07.340430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:07.340430+0000","last_clean_scrub_stamp":"2024-04-26T12:54:07.340430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:48.000026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.917284+0000","last_change":"2024-04-26T12:53:39.917284+0000","last_active":"2024-04-26T12:53:39.917284+0000","last_peered":"2024-04-26T12:53:39.917284+0000","last_clean":"2024-04-26T12:53:39.917284+0000","last_became_active":"2024-04-26T12:49:58.218563+0000","last_became_peered":"2024-04-26T12:49:58.218563+0000","last_unstale":"2024-04-26T12:53:39.917284+0000","last_undegraded":"2024-04-26T12:53:39.917284+0000","last_fullsized":"2024-04-26T12:53:39.917284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:39.917036+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.917036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:25.602021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.199626+0000","last_change":"2024-04-26T12:53:32.199626+0000","last_active":"2024-04-26T12:53:32.199626+0000","last_peered":"2024-04-26T12:53:32.199626+0000","last_clean":"2024-04-26T12:53:32.199626+0000","last_became_active":"2024-04-26T12:50:00.238947+0000","last_became_peered":"2024-04-26T12:50:00.238947+0000","last_unstale":"2024-04-26T12:53:32.199626+0000","last_undegraded":"2024-04-26T12:53:32.199626+0000","last_fullsized":"2024-04-26T12:53:32.199626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-04-26T12:53:32.199339+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.199339+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:43.051403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:22.287181+0000","last_change":"2024-04-26T12:53:22.287181+0000","last_active":"2024-04-26T12:53:22.287181+0000","last_peered":"2024-04-26T12:53:22.287181+0000","last_clean":"2024-04-26T12:53:22.287181+0000","last_became_active":"2024-04-26T12:50:02.273020+0000","last_became_peered":"2024-04-26T12:50:02.273020+0000","last_unstale":"2024-04-26T12:53:22.287181+0000","last_undegraded":"2024-04-26T12:53:22.287181+0000","last_fullsized":"2024-04-26T12:53:22.287181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:22.286848+0000","last_clean_scrub_stamp":"2024-04-26T12:53:22.286848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:37.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'3","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:13.563665+0000","last_change":"2024-04-26T12:54:13.563665+0000","last_active":"2024-04-26T12:54:13.563665+0000","last_peered":"2024-04-26T12:54:13.563665+0000","last_clean":"2024-04-26T12:54:13.563665+0000","last_became_active":"2024-04-26T12:50:04.301917+0000","last_became_peered":"2024-04-26T12:50:04.301917+0000","last_unstale":"2024-04-26T12:54:13.563665+0000","last_undegraded":"2024-04-26T12:54:13.563665+0000","last_fullsized":"2024-04-26T12:54:13.563665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:54:13.563410+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:54:13.563410+0000","last_clean_scrub_stamp":"2024-04-26T12:54:13.563410+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:47.974922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.153568+0000","last_change":"2024-04-26T12:53:55.153568+0000","last_active":"2024-04-26T12:53:55.153568+0000","last_peered":"2024-04-26T12:53:55.153568+0000","last_clean":"2024-04-26T12:53:55.153568+0000","last_became_active":"2024-04-26T12:49:56.217858+0000","last_became_peered":"2024-04-26T12:49:56.217858+0000","last_unstale":"2024-04-26T12:53:55.153568+0000","last_undegraded":"2024-04-26T12:53:55.153568+0000","last_fullsized":"2024-04-26T12:53:55.153568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.153308+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.153308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:06.760317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:23.470321+0000","last_change":"2024-04-26T12:54:23.470321+0000","last_active":"2024-04-26T12:54:23.470321+0000","last_peered":"2024-04-26T12:54:23.470321+0000","last_clean":"2024-04-26T12:54:23.470321+0000","last_became_active":"2024-04-26T12:49:54.253420+0000","last_became_peered":"2024-04-26T12:49:54.253420+0000","last_unstale":"2024-04-26T12:54:23.470321+0000","last_undegraded":"2024-04-26T12:54:23.470321+0000","last_fullsized":"2024-04-26T12:54:23.470321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:23.470029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:23.470029+0000","last_clean_scrub_stamp":"2024-04-26T12:54:23.470029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:14.937806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:34.124797+0000","last_change":"2024-04-26T12:53:34.124797+0000","last_active":"2024-04-26T12:53:34.124797+0000","last_peered":"2024-04-26T12:53:34.124797+0000","last_clean":"2024-04-26T12:53:34.124797+0000","last_became_active":"2024-04-26T12:49:58.226221+0000","last_became_peered":"2024-04-26T12:49:58.226221+0000","last_unstale":"2024-04-26T12:53:34.124797+0000","last_undegraded":"2024-04-26T12:53:34.124797+0000","last_fullsized":"2024-04-26T12:53:34.124797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:34.124506+0000","last_clean_scrub_stamp":"2024-04-26T12:53:34.124506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:09.569031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.385969+0000","last_change":"2024-04-26T12:53:47.385969+0000","last_active":"2024-04-26T12:53:47.385969+0000","last_peered":"2024-04-26T12:53:47.385969+0000","last_clean":"2024-04-26T12:53:47.385969+0000","last_became_active":"2024-04-26T12:50:00.270063+0000","last_became_peered":"2024-04-26T12:50:00.270063+0000","last_unstale":"2024-04-26T12:53:47.385969+0000","last_undegraded":"2024-04-26T12:53:47.385969+0000","last_fullsized":"2024-04-26T12:53:47.385969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-04-26T12:53:47.385688+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.385688+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:42.214059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":431,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:32.832479+0000","last_change":"2024-04-26T12:53:32.832479+0000","last_active":"2024-04-26T12:53:32.832479+0000","last_peered":"2024-04-26T12:53:32.832479+0000","last_clean":"2024-04-26T12:53:32.832479+0000","last_became_active":"2024-04-26T12:50:02.294061+0000","last_became_peered":"2024-04-26T12:50:02.294061+0000","last_unstale":"2024-04-26T12:53:32.832479+0000","last_undegraded":"2024-04-26T12:53:32.832479+0000","last_fullsized":"2024-04-26T12:53:32.832479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-04-26T12:53:32.832206+0000","last_clean_scrub_stamp":"2024-04-26T12:53:32.832206+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:19.156979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:40.386105+0000","last_change":"2024-04-26T12:54:40.386105+0000","last_active":"2024-04-26T12:54:40.386105+0000","last_peered":"2024-04-26T12:54:40.386105+0000","last_clean":"2024-04-26T12:54:40.386105+0000","last_became_active":"2024-04-26T12:50:04.301765+0000","last_became_peered":"2024-04-26T12:50:04.301765+0000","last_unstale":"2024-04-26T12:54:40.386105+0000","last_undegraded":"2024-04-26T12:54:40.386105+0000","last_fullsized":"2024-04-26T12:54:40.386105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:40.385815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:40.385815+0000","last_clean_scrub_stamp":"2024-04-26T12:54:40.385815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:14.219154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'24","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:43.994314+0000","last_change":"2024-04-26T12:53:43.994314+0000","last_active":"2024-04-26T12:53:43.994314+0000","last_peered":"2024-04-26T12:53:43.994314+0000","last_clean":"2024-04-26T12:53:43.994314+0000","last_became_active":"2024-04-26T12:49:56.212723+0000","last_became_peered":"2024-04-26T12:49:56.212723+0000","last_unstale":"2024-04-26T12:53:43.994314+0000","last_undegraded":"2024-04-26T12:53:43.994314+0000","last_fullsized":"2024-04-26T12:53:43.994314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-04-26T12:53:43.994064+0000","last_clean_scrub_stamp":"2024-04-26T12:53:43.994064+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:53.158642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":29,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:55.121759+0000","last_change":"2024-04-26T12:53:55.121759+0000","last_active":"2024-04-26T12:53:55.121759+0000","last_peered":"2024-04-26T12:53:55.121759+0000","last_clean":"2024-04-26T12:53:55.121759+0000","last_became_active":"2024-04-26T12:49:54.246778+0000","last_became_peered":"2024-04-26T12:49:54.246778+0000","last_unstale":"2024-04-26T12:53:55.121759+0000","last_undegraded":"2024-04-26T12:53:55.121759+0000","last_fullsized":"2024-04-26T12:53:55.121759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:55.121449+0000","last_clean_scrub_stamp":"2024-04-26T12:53:55.121449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:23.400093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:33.121816+0000","last_change":"2024-04-26T12:53:33.121816+0000","last_active":"2024-04-26T12:53:33.121816+0000","last_peered":"2024-04-26T12:53:33.121816+0000","last_clean":"2024-04-26T12:53:33.121816+0000","last_became_active":"2024-04-26T12:49:58.226700+0000","last_became_peered":"2024-04-26T12:49:58.226700+0000","last_unstale":"2024-04-26T12:53:33.121816+0000","last_undegraded":"2024-04-26T12:53:33.121816+0000","last_fullsized":"2024-04-26T12:53:33.121816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:33.121556+0000","last_clean_scrub_stamp":"2024-04-26T12:53:33.121556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:50.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:27.092239+0000","last_change":"2024-04-26T12:53:27.092239+0000","last_active":"2024-04-26T12:53:27.092239+0000","last_peered":"2024-04-26T12:53:27.092239+0000","last_clean":"2024-04-26T12:53:27.092239+0000","last_became_active":"2024-04-26T12:50:00.232966+0000","last_became_peered":"2024-04-26T12:50:00.232966+0000","last_unstale":"2024-04-26T12:53:27.092239+0000","last_undegraded":"2024-04-26T12:53:27.092239+0000","last_fullsized":"2024-04-26T12:53:27.092239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-04-26T12:53:27.091940+0000","last_clean_scrub_stamp":"2024-04-26T12:53:27.091940+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:51.222988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:24.289294+0000","last_change":"2024-04-26T12:53:24.289294+0000","last_active":"2024-04-26T12:53:24.289294+0000","last_peered":"2024-04-26T12:53:24.289294+0000","last_clean":"2024-04-26T12:53:24.289294+0000","last_became_active":"2024-04-26T12:50:02.270984+0000","last_became_peered":"2024-04-26T12:50:02.270984+0000","last_unstale":"2024-04-26T12:53:24.289294+0000","last_undegraded":"2024-04-26T12:53:24.289294+0000","last_fullsized":"2024-04-26T12:53:24.289294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:24.288887+0000","last_clean_scrub_stamp":"2024-04-26T12:53:24.288887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:44.523664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:16.358389+0000","last_change":"2024-04-26T12:54:16.358389+0000","last_active":"2024-04-26T12:54:16.358389+0000","last_peered":"2024-04-26T12:54:16.358389+0000","last_clean":"2024-04-26T12:54:16.358389+0000","last_became_active":"2024-04-26T12:50:04.281700+0000","last_became_peered":"2024-04-26T12:50:04.281700+0000","last_unstale":"2024-04-26T12:54:16.358389+0000","last_undegraded":"2024-04-26T12:54:16.358389+0000","last_fullsized":"2024-04-26T12:54:16.358389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:16.358132+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:16.358132+0000","last_clean_scrub_stamp":"2024-04-26T12:54:16.358132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:39.662491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.893805+0000","last_change":"2024-04-26T12:53:50.893805+0000","last_active":"2024-04-26T12:53:50.893805+0000","last_peered":"2024-04-26T12:53:50.893805+0000","last_clean":"2024-04-26T12:53:50.893805+0000","last_became_active":"2024-04-26T12:49:56.214069+0000","last_became_peered":"2024-04-26T12:49:56.214069+0000","last_unstale":"2024-04-26T12:53:50.893805+0000","last_undegraded":"2024-04-26T12:53:50.893805+0000","last_fullsized":"2024-04-26T12:53:50.893805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:50.893537+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.893537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:00.221642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:39.429829+0000","last_change":"2024-04-26T12:54:39.429829+0000","last_active":"2024-04-26T12:54:39.429829+0000","last_peered":"2024-04-26T12:54:39.429829+0000","last_clean":"2024-04-26T12:54:39.429829+0000","last_became_active":"2024-04-26T12:49:54.256430+0000","last_became_peered":"2024-04-26T12:49:54.256430+0000","last_unstale":"2024-04-26T12:54:39.429829+0000","last_undegraded":"2024-04-26T12:54:39.429829+0000","last_fullsized":"2024-04-26T12:54:39.429829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:39.429535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:39.429535+0000","last_clean_scrub_stamp":"2024-04-26T12:54:39.429535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:36.747637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:38.929256+0000","last_change":"2024-04-26T12:53:38.929256+0000","last_active":"2024-04-26T12:53:38.929256+0000","last_peered":"2024-04-26T12:53:38.929256+0000","last_clean":"2024-04-26T12:53:38.929256+0000","last_became_active":"2024-04-26T12:49:58.218477+0000","last_became_peered":"2024-04-26T12:49:58.218477+0000","last_unstale":"2024-04-26T12:53:38.929256+0000","last_undegraded":"2024-04-26T12:53:38.929256+0000","last_fullsized":"2024-04-26T12:53:38.929256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:38.928996+0000","last_clean_scrub_stamp":"2024-04-26T12:53:38.928996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:29.134252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.240665+0000","last_change":"2024-04-26T12:53:31.240665+0000","last_active":"2024-04-26T12:53:31.240665+0000","last_peered":"2024-04-26T12:53:31.240665+0000","last_clean":"2024-04-26T12:53:31.240665+0000","last_became_active":"2024-04-26T12:50:00.239084+0000","last_became_peered":"2024-04-26T12:50:00.239084+0000","last_unstale":"2024-04-26T12:53:31.240665+0000","last_undegraded":"2024-04-26T12:53:31.240665+0000","last_fullsized":"2024-04-26T12:53:31.240665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-04-26T12:53:31.240229+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.240229+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:11.099663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.436052+0000","last_change":"2024-04-26T12:53:49.436052+0000","last_active":"2024-04-26T12:53:49.436052+0000","last_peered":"2024-04-26T12:53:49.436052+0000","last_clean":"2024-04-26T12:53:49.436052+0000","last_became_active":"2024-04-26T12:50:02.282337+0000","last_became_peered":"2024-04-26T12:50:02.282337+0000","last_unstale":"2024-04-26T12:53:49.436052+0000","last_undegraded":"2024-04-26T12:53:49.436052+0000","last_fullsized":"2024-04-26T12:53:49.436052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.435800+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.435800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.047458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:45.306113+0000","last_change":"2024-04-26T12:54:45.306113+0000","last_active":"2024-04-26T12:54:45.306113+0000","last_peered":"2024-04-26T12:54:45.306113+0000","last_clean":"2024-04-26T12:54:45.306113+0000","last_became_active":"2024-04-26T12:50:04.308504+0000","last_became_peered":"2024-04-26T12:50:04.308504+0000","last_unstale":"2024-04-26T12:54:45.306113+0000","last_undegraded":"2024-04-26T12:54:45.306113+0000","last_fullsized":"2024-04-26T12:54:45.306113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:45.305854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:45.305854+0000","last_clean_scrub_stamp":"2024-04-26T12:54:45.305854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:19.833544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.483107+0000","last_change":"2024-04-26T12:54:08.483107+0000","last_active":"2024-04-26T12:54:08.483107+0000","last_peered":"2024-04-26T12:54:08.483107+0000","last_clean":"2024-04-26T12:54:08.483107+0000","last_became_active":"2024-04-26T12:49:56.222905+0000","last_became_peered":"2024-04-26T12:49:56.222905+0000","last_unstale":"2024-04-26T12:54:08.483107+0000","last_undegraded":"2024-04-26T12:54:08.483107+0000","last_fullsized":"2024-04-26T12:54:08.483107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:08.482670+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:08.482670+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.482670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:00.116592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.086364+0000","last_change":"2024-04-26T12:54:02.086394+0000","last_active":"2024-04-26T12:54:02.086364+0000","last_peered":"2024-04-26T12:54:02.086364+0000","last_clean":"2024-04-26T12:54:02.086364+0000","last_became_active":"2024-04-26T12:49:54.237817+0000","last_became_peered":"2024-04-26T12:49:54.237817+0000","last_unstale":"2024-04-26T12:54:02.086364+0000","last_undegraded":"2024-04-26T12:54:02.086364+0000","last_fullsized":"2024-04-26T12:54:02.086364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:02.086261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:02.086261+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.086261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:39.169507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:31.068439+0000","last_change":"2024-04-26T12:53:31.068439+0000","last_active":"2024-04-26T12:53:31.068439+0000","last_peered":"2024-04-26T12:53:31.068439+0000","last_clean":"2024-04-26T12:53:31.068439+0000","last_became_active":"2024-04-26T12:49:58.240887+0000","last_became_peered":"2024-04-26T12:49:58.240887+0000","last_unstale":"2024-04-26T12:53:31.068439+0000","last_undegraded":"2024-04-26T12:53:31.068439+0000","last_fullsized":"2024-04-26T12:53:31.068439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:31.068090+0000","last_clean_scrub_stamp":"2024-04-26T12:53:31.068090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:16.753074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'32","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.452853+0000","last_change":"2024-04-26T12:53:51.452990+0000","last_active":"2024-04-26T12:53:51.452853+0000","last_peered":"2024-04-26T12:53:51.452853+0000","last_clean":"2024-04-26T12:53:51.452853+0000","last_became_active":"2024-04-26T12:50:00.270075+0000","last_became_peered":"2024-04-26T12:50:00.270075+0000","last_unstale":"2024-04-26T12:53:51.452853+0000","last_undegraded":"2024-04-26T12:53:51.452853+0000","last_fullsized":"2024-04-26T12:53:51.452853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'32","last_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_deep_scrub":"35'32","last_deep_scrub_stamp":"2024-04-26T12:53:51.452618+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.452618+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.889839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.506938+0000","last_change":"2024-04-26T12:53:53.506996+0000","last_active":"2024-04-26T12:53:53.506938+0000","last_peered":"2024-04-26T12:53:53.506938+0000","last_clean":"2024-04-26T12:53:53.506938+0000","last_became_active":"2024-04-26T12:50:02.287876+0000","last_became_peered":"2024-04-26T12:50:02.287876+0000","last_unstale":"2024-04-26T12:53:53.506938+0000","last_undegraded":"2024-04-26T12:53:53.506938+0000","last_fullsized":"2024-04-26T12:53:53.506938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:53.506716+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.506716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:38.844443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'8","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:43.347321+0000","last_change":"2024-04-26T12:54:43.347321+0000","last_active":"2024-04-26T12:54:43.347321+0000","last_peered":"2024-04-26T12:54:43.347321+0000","last_clean":"2024-04-26T12:54:43.347321+0000","last_became_active":"2024-04-26T12:50:04.308313+0000","last_became_peered":"2024-04-26T12:50:04.308313+0000","last_unstale":"2024-04-26T12:54:43.347321+0000","last_undegraded":"2024-04-26T12:54:43.347321+0000","last_fullsized":"2024-04-26T12:54:43.347321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:43.347065+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:43.347065+0000","last_clean_scrub_stamp":"2024-04-26T12:54:43.347065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:22.760765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'4","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.981135+0000","last_change":"2024-04-26T12:53:54.981135+0000","last_active":"2024-04-26T12:53:54.981135+0000","last_peered":"2024-04-26T12:53:54.981135+0000","last_clean":"2024-04-26T12:53:54.981135+0000","last_became_active":"2024-04-26T12:49:56.215243+0000","last_became_peered":"2024-04-26T12:49:56.215243+0000","last_unstale":"2024-04-26T12:53:54.981135+0000","last_undegraded":"2024-04-26T12:53:54.981135+0000","last_fullsized":"2024-04-26T12:53:54.981135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:54.980684+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.980684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:23.450201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:01.283199+0000","last_change":"2024-04-26T12:54:01.283199+0000","last_active":"2024-04-26T12:54:01.283199+0000","last_peered":"2024-04-26T12:54:01.283199+0000","last_clean":"2024-04-26T12:54:01.283199+0000","last_became_active":"2024-04-26T12:49:54.245016+0000","last_became_peered":"2024-04-26T12:49:54.245016+0000","last_unstale":"2024-04-26T12:54:01.283199+0000","last_undegraded":"2024-04-26T12:54:01.283199+0000","last_fullsized":"2024-04-26T12:54:01.283199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:01.282930+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:01.282930+0000","last_clean_scrub_stamp":"2024-04-26T12:54:01.282930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:55.471622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:30.069291+0000","last_change":"2024-04-26T12:53:30.069291+0000","last_active":"2024-04-26T12:53:30.069291+0000","last_peered":"2024-04-26T12:53:30.069291+0000","last_clean":"2024-04-26T12:53:30.069291+0000","last_became_active":"2024-04-26T12:49:58.241065+0000","last_became_peered":"2024-04-26T12:49:58.241065+0000","last_unstale":"2024-04-26T12:53:30.069291+0000","last_undegraded":"2024-04-26T12:53:30.069291+0000","last_fullsized":"2024-04-26T12:53:30.069291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-04-26T12:53:30.068914+0000","last_clean_scrub_stamp":"2024-04-26T12:53:30.068914+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:20.274170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'40","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:50.418105+0000","last_change":"2024-04-26T12:53:50.418159+0000","last_active":"2024-04-26T12:53:50.418105+0000","last_peered":"2024-04-26T12:53:50.418105+0000","last_clean":"2024-04-26T12:53:50.418105+0000","last_became_active":"2024-04-26T12:50:00.271333+0000","last_became_peered":"2024-04-26T12:50:00.271333+0000","last_unstale":"2024-04-26T12:53:50.418105+0000","last_undegraded":"2024-04-26T12:53:50.418105+0000","last_fullsized":"2024-04-26T12:53:50.418105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-04-26T12:53:50.417994+0000","last_clean_scrub_stamp":"2024-04-26T12:53:50.417994+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:42.018459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:26.295415+0000","last_change":"2024-04-26T12:53:26.295546+0000","last_active":"2024-04-26T12:53:26.295415+0000","last_peered":"2024-04-26T12:53:26.295415+0000","last_clean":"2024-04-26T12:53:26.295415+0000","last_became_active":"2024-04-26T12:50:02.270665+0000","last_became_peered":"2024-04-26T12:50:02.270665+0000","last_unstale":"2024-04-26T12:53:26.295415+0000","last_undegraded":"2024-04-26T12:53:26.295415+0000","last_fullsized":"2024-04-26T12:53:26.295415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:26.295181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:26.295181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:21.587262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.514929+0000","last_change":"2024-04-26T12:54:09.514929+0000","last_active":"2024-04-26T12:54:09.514929+0000","last_peered":"2024-04-26T12:54:09.514929+0000","last_clean":"2024-04-26T12:54:09.514929+0000","last_became_active":"2024-04-26T12:50:04.301445+0000","last_became_peered":"2024-04-26T12:50:04.301445+0000","last_unstale":"2024-04-26T12:54:09.514929+0000","last_undegraded":"2024-04-26T12:54:09.514929+0000","last_fullsized":"2024-04-26T12:54:09.514929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:09.514660+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:09.514660+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.514660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:53.553405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.144167+0000","last_change":"2024-04-26T12:53:46.144167+0000","last_active":"2024-04-26T12:53:46.144167+0000","last_peered":"2024-04-26T12:53:46.144167+0000","last_clean":"2024-04-26T12:53:46.144167+0000","last_became_active":"2024-04-26T12:49:56.233832+0000","last_became_peered":"2024-04-26T12:49:56.233832+0000","last_unstale":"2024-04-26T12:53:46.144167+0000","last_undegraded":"2024-04-26T12:53:46.144167+0000","last_fullsized":"2024-04-26T12:53:46.144167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:53:46.143916+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.143916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:10.720490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.939817+0000","last_change":"2024-04-26T12:53:51.939817+0000","last_active":"2024-04-26T12:53:51.939817+0000","last_peered":"2024-04-26T12:53:51.939817+0000","last_clean":"2024-04-26T12:53:51.939817+0000","last_became_active":"2024-04-26T12:49:54.245839+0000","last_became_peered":"2024-04-26T12:49:54.245839+0000","last_unstale":"2024-04-26T12:53:51.939817+0000","last_undegraded":"2024-04-26T12:53:51.939817+0000","last_fullsized":"2024-04-26T12:53:51.939817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:51.939533+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.939533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:29.601591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:51.262502+0000","last_change":"2024-04-26T12:53:51.262502+0000","last_active":"2024-04-26T12:53:51.262502+0000","last_peered":"2024-04-26T12:53:51.262502+0000","last_clean":"2024-04-26T12:53:51.262502+0000","last_became_active":"2024-04-26T12:49:56.214585+0000","last_became_peered":"2024-04-26T12:49:56.214585+0000","last_unstale":"2024-04-26T12:53:51.262502+0000","last_undegraded":"2024-04-26T12:53:51.262502+0000","last_fullsized":"2024-04-26T12:53:51.262502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:51.262245+0000","last_clean_scrub_stamp":"2024-04-26T12:53:51.262245+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.721553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:56.165739+0000","last_change":"2024-04-26T12:53:56.165739+0000","last_active":"2024-04-26T12:53:56.165739+0000","last_peered":"2024-04-26T12:53:56.165739+0000","last_clean":"2024-04-26T12:53:56.165739+0000","last_became_active":"2024-04-26T12:49:54.240501+0000","last_became_peered":"2024-04-26T12:49:54.240501+0000","last_unstale":"2024-04-26T12:53:56.165739+0000","last_undegraded":"2024-04-26T12:53:56.165739+0000","last_fullsized":"2024-04-26T12:53:56.165739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:56.165465+0000","last_clean_scrub_stamp":"2024-04-26T12:53:56.165465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:33.355823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'6","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.418074+0000","last_change":"2024-04-26T12:54:06.418074+0000","last_active":"2024-04-26T12:54:06.418074+0000","last_peered":"2024-04-26T12:54:06.418074+0000","last_clean":"2024-04-26T12:54:06.418074+0000","last_became_active":"2024-04-26T12:49:56.225388+0000","last_became_peered":"2024-04-26T12:49:56.225388+0000","last_unstale":"2024-04-26T12:54:06.418074+0000","last_undegraded":"2024-04-26T12:54:06.418074+0000","last_fullsized":"2024-04-26T12:54:06.418074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-04-26T12:54:06.417830+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-04-26T12:54:06.417830+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.417830+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:00.383510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:30.542647+0000","last_change":"2024-04-26T12:54:30.542721+0000","last_active":"2024-04-26T12:54:30.542647+0000","last_peered":"2024-04-26T12:54:30.542647+0000","last_clean":"2024-04-26T12:54:30.542647+0000","last_became_active":"2024-04-26T12:49:54.235734+0000","last_became_peered":"2024-04-26T12:49:54.235734+0000","last_unstale":"2024-04-26T12:54:30.542647+0000","last_undegraded":"2024-04-26T12:54:30.542647+0000","last_fullsized":"2024-04-26T12:54:30.542647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:30.542433+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:30.542433+0000","last_clean_scrub_stamp":"2024-04-26T12:54:30.542433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:37.075885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:03.094315+0000","last_change":"2024-04-26T12:54:03.094315+0000","last_active":"2024-04-26T12:54:03.094315+0000","last_peered":"2024-04-26T12:54:03.094315+0000","last_clean":"2024-04-26T12:54:03.094315+0000","last_became_active":"2024-04-26T12:49:56.222291+0000","last_became_peered":"2024-04-26T12:49:56.222291+0000","last_unstale":"2024-04-26T12:54:03.094315+0000","last_undegraded":"2024-04-26T12:54:03.094315+0000","last_fullsized":"2024-04-26T12:54:03.094315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:03.094053+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:03.094053+0000","last_clean_scrub_stamp":"2024-04-26T12:54:03.094053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:04.790219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:09.178704+0000","last_change":"2024-04-26T12:54:09.178771+0000","last_active":"2024-04-26T12:54:09.178704+0000","last_peered":"2024-04-26T12:54:09.178704+0000","last_clean":"2024-04-26T12:54:09.178704+0000","last_became_active":"2024-04-26T12:49:54.225332+0000","last_became_peered":"2024-04-26T12:49:54.225332+0000","last_unstale":"2024-04-26T12:54:09.178704+0000","last_undegraded":"2024-04-26T12:54:09.178704+0000","last_fullsized":"2024-04-26T12:54:09.178704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:09.178495+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:09.178495+0000","last_clean_scrub_stamp":"2024-04-26T12:54:09.178495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:57.622469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:59.097598+0000","last_change":"2024-04-26T12:53:59.097598+0000","last_active":"2024-04-26T12:53:59.097598+0000","last_peered":"2024-04-26T12:53:59.097598+0000","last_clean":"2024-04-26T12:53:59.097598+0000","last_became_active":"2024-04-26T12:49:56.220583+0000","last_became_peered":"2024-04-26T12:49:56.220583+0000","last_unstale":"2024-04-26T12:53:59.097598+0000","last_undegraded":"2024-04-26T12:53:59.097598+0000","last_fullsized":"2024-04-26T12:53:59.097598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:53:59.097326+0000","last_clean_scrub_stamp":"2024-04-26T12:53:59.097326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:47.866871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.202547+0000","last_change":"2024-04-26T12:53:54.202547+0000","last_active":"2024-04-26T12:53:54.202547+0000","last_peered":"2024-04-26T12:53:54.202547+0000","last_clean":"2024-04-26T12:53:54.202547+0000","last_became_active":"2024-04-26T12:49:54.241824+0000","last_became_peered":"2024-04-26T12:49:54.241824+0000","last_unstale":"2024-04-26T12:53:54.202547+0000","last_undegraded":"2024-04-26T12:53:54.202547+0000","last_fullsized":"2024-04-26T12:53:54.202547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:54.202278+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.202278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:55.097855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'18","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:39.220338+0000","last_change":"2024-04-26T12:53:39.220338+0000","last_active":"2024-04-26T12:53:39.220338+0000","last_peered":"2024-04-26T12:53:39.220338+0000","last_clean":"2024-04-26T12:53:39.220338+0000","last_became_active":"2024-04-26T12:49:56.235033+0000","last_became_peered":"2024-04-26T12:49:56.235033+0000","last_unstale":"2024-04-26T12:53:39.220338+0000","last_undegraded":"2024-04-26T12:53:39.220338+0000","last_fullsized":"2024-04-26T12:53:39.220338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-04-26T12:53:39.220089+0000","last_clean_scrub_stamp":"2024-04-26T12:53:39.220089+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:13.125940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":78,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:11.350324+0000","last_change":"2024-04-26T12:54:11.350324+0000","last_active":"2024-04-26T12:54:11.350324+0000","last_peered":"2024-04-26T12:54:11.350324+0000","last_clean":"2024-04-26T12:54:11.350324+0000","last_became_active":"2024-04-26T12:49:54.238004+0000","last_became_peered":"2024-04-26T12:49:54.238004+0000","last_unstale":"2024-04-26T12:54:11.350324+0000","last_undegraded":"2024-04-26T12:54:11.350324+0000","last_fullsized":"2024-04-26T12:54:11.350324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-04-26T12:54:11.350039+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-04-26T12:54:11.350039+0000","last_clean_scrub_stamp":"2024-04-26T12:54:11.350039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:29.715742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:15.022978+0000","last_change":"2024-04-26T12:54:15.023177+0000","last_active":"2024-04-26T12:54:15.022978+0000","last_peered":"2024-04-26T12:54:15.022978+0000","last_clean":"2024-04-26T12:54:15.022978+0000","last_became_active":"2024-04-26T12:49:56.224151+0000","last_became_peered":"2024-04-26T12:49:56.224151+0000","last_unstale":"2024-04-26T12:54:15.022978+0000","last_undegraded":"2024-04-26T12:54:15.022978+0000","last_fullsized":"2024-04-26T12:54:15.022978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:15.022751+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:15.022751+0000","last_clean_scrub_stamp":"2024-04-26T12:54:15.022751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:45.263486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:46.022822+0000","last_change":"2024-04-26T12:53:46.022822+0000","last_active":"2024-04-26T12:53:46.022822+0000","last_peered":"2024-04-26T12:53:46.022822+0000","last_clean":"2024-04-26T12:53:46.022822+0000","last_became_active":"2024-04-26T12:49:54.246398+0000","last_became_peered":"2024-04-26T12:49:54.246398+0000","last_unstale":"2024-04-26T12:53:46.022822+0000","last_undegraded":"2024-04-26T12:53:46.022822+0000","last_fullsized":"2024-04-26T12:53:46.022822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:46.022525+0000","last_clean_scrub_stamp":"2024-04-26T12:53:46.022525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:48.747486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.313205+0000","last_change":"2024-04-26T12:54:02.313205+0000","last_active":"2024-04-26T12:54:02.313205+0000","last_peered":"2024-04-26T12:54:02.313205+0000","last_clean":"2024-04-26T12:54:02.313205+0000","last_became_active":"2024-04-26T12:49:56.231093+0000","last_became_peered":"2024-04-26T12:49:56.231093+0000","last_unstale":"2024-04-26T12:54:02.313205+0000","last_undegraded":"2024-04-26T12:54:02.313205+0000","last_fullsized":"2024-04-26T12:54:02.313205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:02.312870+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:02.312870+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.312870+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:37.400546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.141412+0000","last_change":"2024-04-26T12:54:10.141412+0000","last_active":"2024-04-26T12:54:10.141412+0000","last_peered":"2024-04-26T12:54:10.141412+0000","last_clean":"2024-04-26T12:54:10.141412+0000","last_became_active":"2024-04-26T12:49:54.229133+0000","last_became_peered":"2024-04-26T12:49:54.229133+0000","last_unstale":"2024-04-26T12:54:10.141412+0000","last_undegraded":"2024-04-26T12:54:10.141412+0000","last_fullsized":"2024-04-26T12:54:10.141412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:10.141147+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:10.141147+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.141147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:35.775459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'10","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:53.188767+0000","last_change":"2024-04-26T12:53:53.188767+0000","last_active":"2024-04-26T12:53:53.188767+0000","last_peered":"2024-04-26T12:53:53.188767+0000","last_clean":"2024-04-26T12:53:53.188767+0000","last_became_active":"2024-04-26T12:49:56.217967+0000","last_became_peered":"2024-04-26T12:49:56.217967+0000","last_unstale":"2024-04-26T12:53:53.188767+0000","last_undegraded":"2024-04-26T12:53:53.188767+0000","last_fullsized":"2024-04-26T12:53:53.188767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-04-26T12:53:53.188457+0000","last_clean_scrub_stamp":"2024-04-26T12:53:53.188457+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.177200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:20.511533+0000","last_change":"2024-04-26T12:54:20.511671+0000","last_active":"2024-04-26T12:54:20.511533+0000","last_peered":"2024-04-26T12:54:20.511533+0000","last_clean":"2024-04-26T12:54:20.511533+0000","last_became_active":"2024-04-26T12:49:54.237942+0000","last_became_peered":"2024-04-26T12:49:54.237942+0000","last_unstale":"2024-04-26T12:54:20.511533+0000","last_undegraded":"2024-04-26T12:54:20.511533+0000","last_fullsized":"2024-04-26T12:54:20.511533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:20.511200+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:20.511200+0000","last_clean_scrub_stamp":"2024-04-26T12:54:20.511200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:48.862437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:58.458983+0000","last_change":"2024-04-26T12:53:58.458983+0000","last_active":"2024-04-26T12:53:58.458983+0000","last_peered":"2024-04-26T12:53:58.458983+0000","last_clean":"2024-04-26T12:53:58.458983+0000","last_became_active":"2024-04-26T12:49:56.229379+0000","last_became_peered":"2024-04-26T12:49:56.229379+0000","last_unstale":"2024-04-26T12:53:58.458983+0000","last_undegraded":"2024-04-26T12:53:58.458983+0000","last_fullsized":"2024-04-26T12:53:58.458983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:58.458701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:58.458701+0000","last_clean_scrub_stamp":"2024-04-26T12:53:58.458701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:23.882587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:06.111930+0000","last_change":"2024-04-26T12:54:06.111930+0000","last_active":"2024-04-26T12:54:06.111930+0000","last_peered":"2024-04-26T12:54:06.111930+0000","last_clean":"2024-04-26T12:54:06.111930+0000","last_became_active":"2024-04-26T12:49:54.233630+0000","last_became_peered":"2024-04-26T12:49:54.233630+0000","last_unstale":"2024-04-26T12:54:06.111930+0000","last_undegraded":"2024-04-26T12:54:06.111930+0000","last_fullsized":"2024-04-26T12:54:06.111930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:06.111515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:06.111515+0000","last_clean_scrub_stamp":"2024-04-26T12:54:06.111515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:15.407080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:22.085537+0000","last_change":"2024-04-26T12:54:22.085537+0000","last_active":"2024-04-26T12:54:22.085537+0000","last_peered":"2024-04-26T12:54:22.085537+0000","last_clean":"2024-04-26T12:54:22.085537+0000","last_became_active":"2024-04-26T12:50:34.311539+0000","last_became_peered":"2024-04-26T12:50:34.311539+0000","last_unstale":"2024-04-26T12:54:22.085537+0000","last_undegraded":"2024-04-26T12:54:22.085537+0000","last_fullsized":"2024-04-26T12:54:22.085537+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:22.085123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:22.085123+0000","last_clean_scrub_stamp":"2024-04-26T12:54:22.085123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:12.082735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:10.347824+0000","last_change":"2024-04-26T12:54:10.347824+0000","last_active":"2024-04-26T12:54:10.347824+0000","last_peered":"2024-04-26T12:54:10.347824+0000","last_clean":"2024-04-26T12:54:10.347824+0000","last_became_active":"2024-04-26T12:49:54.236337+0000","last_became_peered":"2024-04-26T12:49:54.236337+0000","last_unstale":"2024-04-26T12:54:10.347824+0000","last_undegraded":"2024-04-26T12:54:10.347824+0000","last_fullsized":"2024-04-26T12:54:10.347824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:10.347555+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:10.347555+0000","last_clean_scrub_stamp":"2024-04-26T12:54:10.347555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:59.959213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:00.238882+0000","last_change":"2024-04-26T12:54:00.238882+0000","last_active":"2024-04-26T12:54:00.238882+0000","last_peered":"2024-04-26T12:54:00.238882+0000","last_clean":"2024-04-26T12:54:00.238882+0000","last_became_active":"2024-04-26T12:49:56.230646+0000","last_became_peered":"2024-04-26T12:49:56.230646+0000","last_unstale":"2024-04-26T12:54:00.238882+0000","last_undegraded":"2024-04-26T12:54:00.238882+0000","last_fullsized":"2024-04-26T12:54:00.238882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:00.238630+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:00.238630+0000","last_clean_scrub_stamp":"2024-04-26T12:54:00.238630+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.241644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:08.301091+0000","last_change":"2024-04-26T12:54:08.301091+0000","last_active":"2024-04-26T12:54:08.301091+0000","last_peered":"2024-04-26T12:54:08.301091+0000","last_clean":"2024-04-26T12:54:08.301091+0000","last_became_active":"2024-04-26T12:49:54.233003+0000","last_became_peered":"2024-04-26T12:49:54.233003+0000","last_unstale":"2024-04-26T12:54:08.301091+0000","last_undegraded":"2024-04-26T12:54:08.301091+0000","last_fullsized":"2024-04-26T12:54:08.301091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-04-26T12:54:08.300828+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-04-26T12:54:08.300828+0000","last_clean_scrub_stamp":"2024-04-26T12:54:08.300828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:04.252503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'8","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:41.211925+0000","last_change":"2024-04-26T12:53:41.211925+0000","last_active":"2024-04-26T12:53:41.211925+0000","last_peered":"2024-04-26T12:53:41.211925+0000","last_clean":"2024-04-26T12:53:41.211925+0000","last_became_active":"2024-04-26T12:49:56.234462+0000","last_became_peered":"2024-04-26T12:49:56.234462+0000","last_unstale":"2024-04-26T12:53:41.211925+0000","last_undegraded":"2024-04-26T12:53:41.211925+0000","last_fullsized":"2024-04-26T12:53:41.211925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:41.211668+0000","last_clean_scrub_stamp":"2024-04-26T12:53:41.211668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:06.215290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:19.543470+0000","last_change":"2024-04-26T12:54:19.543470+0000","last_active":"2024-04-26T12:54:19.543470+0000","last_peered":"2024-04-26T12:54:19.543470+0000","last_clean":"2024-04-26T12:54:19.543470+0000","last_became_active":"2024-04-26T12:49:54.252048+0000","last_became_peered":"2024-04-26T12:49:54.252048+0000","last_unstale":"2024-04-26T12:54:19.543470+0000","last_undegraded":"2024-04-26T12:54:19.543470+0000","last_fullsized":"2024-04-26T12:54:19.543470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:19.543215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:19.543215+0000","last_clean_scrub_stamp":"2024-04-26T12:54:19.543215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:41.214610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'12","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:54.141316+0000","last_change":"2024-04-26T12:53:54.141316+0000","last_active":"2024-04-26T12:53:54.141316+0000","last_peered":"2024-04-26T12:53:54.141316+0000","last_clean":"2024-04-26T12:53:54.141316+0000","last_became_active":"2024-04-26T12:49:56.223148+0000","last_became_peered":"2024-04-26T12:49:56.223148+0000","last_unstale":"2024-04-26T12:53:54.141316+0000","last_undegraded":"2024-04-26T12:53:54.141316+0000","last_fullsized":"2024-04-26T12:53:54.141316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:53:54.141037+0000","last_clean_scrub_stamp":"2024-04-26T12:53:54.141037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:28.129327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:27.533233+0000","last_change":"2024-04-26T12:54:27.533233+0000","last_active":"2024-04-26T12:54:27.533233+0000","last_peered":"2024-04-26T12:54:27.533233+0000","last_clean":"2024-04-26T12:54:27.533233+0000","last_became_active":"2024-04-26T12:49:54.256000+0000","last_became_peered":"2024-04-26T12:49:54.256000+0000","last_unstale":"2024-04-26T12:54:27.533233+0000","last_undegraded":"2024-04-26T12:54:27.533233+0000","last_fullsized":"2024-04-26T12:54:27.533233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:27.532972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:27.532972+0000","last_clean_scrub_stamp":"2024-04-26T12:54:27.532972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:45.178226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'12","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:02.552115+0000","last_change":"2024-04-26T12:54:02.552115+0000","last_active":"2024-04-26T12:54:02.552115+0000","last_peered":"2024-04-26T12:54:02.552115+0000","last_clean":"2024-04-26T12:54:02.552115+0000","last_became_active":"2024-04-26T12:49:56.228288+0000","last_became_peered":"2024-04-26T12:49:56.228288+0000","last_unstale":"2024-04-26T12:54:02.552115+0000","last_undegraded":"2024-04-26T12:54:02.552115+0000","last_fullsized":"2024-04-26T12:54:02.552115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-04-26T12:54:02.551851+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-04-26T12:54:02.551851+0000","last_clean_scrub_stamp":"2024-04-26T12:54:02.551851+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:15.051310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:49.914055+0000","last_change":"2024-04-26T12:53:49.914055+0000","last_active":"2024-04-26T12:53:49.914055+0000","last_peered":"2024-04-26T12:53:49.914055+0000","last_clean":"2024-04-26T12:53:49.914055+0000","last_became_active":"2024-04-26T12:49:54.246168+0000","last_became_peered":"2024-04-26T12:49:54.246168+0000","last_unstale":"2024-04-26T12:53:49.914055+0000","last_undegraded":"2024-04-26T12:53:49.914055+0000","last_fullsized":"2024-04-26T12:53:49.914055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:53:49.913803+0000","last_clean_scrub_stamp":"2024-04-26T12:53:49.913803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:16.913370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:04.350004+0000","last_change":"2024-04-26T12:54:04.350004+0000","last_active":"2024-04-26T12:54:04.350004+0000","last_peered":"2024-04-26T12:54:04.350004+0000","last_clean":"2024-04-26T12:54:04.350004+0000","last_became_active":"2024-04-26T12:49:56.231144+0000","last_became_peered":"2024-04-26T12:49:56.231144+0000","last_unstale":"2024-04-26T12:54:04.350004+0000","last_undegraded":"2024-04-26T12:54:04.350004+0000","last_fullsized":"2024-04-26T12:54:04.350004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:54:04.349733+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:54:04.349733+0000","last_clean_scrub_stamp":"2024-04-26T12:54:04.349733+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:19.125248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"35'2","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:29.546708+0000","last_change":"2024-04-26T12:54:29.546708+0000","last_active":"2024-04-26T12:54:29.546708+0000","last_peered":"2024-04-26T12:54:29.546708+0000","last_clean":"2024-04-26T12:54:29.546708+0000","last_became_active":"2024-04-26T12:49:54.258003+0000","last_became_peered":"2024-04-26T12:49:54.258003+0000","last_unstale":"2024-04-26T12:54:29.546708+0000","last_undegraded":"2024-04-26T12:54:29.546708+0000","last_fullsized":"2024-04-26T12:54:29.546708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:54:29.546398+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:54:29.546398+0000","last_clean_scrub_stamp":"2024-04-26T12:54:29.546398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:41.994734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:54:18.522804+0000","last_change":"2024-04-26T12:54:18.522804+0000","last_active":"2024-04-26T12:54:18.522804+0000","last_peered":"2024-04-26T12:54:18.522804+0000","last_clean":"2024-04-26T12:54:18.522804+0000","last_became_active":"2024-04-26T12:49:54.238872+0000","last_became_peered":"2024-04-26T12:49:54.238872+0000","last_unstale":"2024-04-26T12:54:18.522804+0000","last_undegraded":"2024-04-26T12:54:18.522804+0000","last_fullsized":"2024-04-26T12:54:18.522804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:54:18.522391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:54:18.522391+0000","last_clean_scrub_stamp":"2024-04-26T12:54:18.522391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:12.022300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.297203+0000","last_change":"2024-04-26T12:53:47.297203+0000","last_active":"2024-04-26T12:53:47.297203+0000","last_peered":"2024-04-26T12:53:47.297203+0000","last_clean":"2024-04-26T12:53:47.297203+0000","last_became_active":"2024-04-26T12:49:56.225971+0000","last_became_peered":"2024-04-26T12:49:56.225971+0000","last_unstale":"2024-04-26T12:53:47.297203+0000","last_undegraded":"2024-04-26T12:53:47.297203+0000","last_fullsized":"2024-04-26T12:53:47.297203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-04-26T12:53:47.296913+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.296913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:39.557010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:52.257555+0000","last_change":"2024-04-26T12:53:52.257555+0000","last_active":"2024-04-26T12:53:52.257555+0000","last_peered":"2024-04-26T12:53:52.257555+0000","last_clean":"2024-04-26T12:53:52.257555+0000","last_became_active":"2024-04-26T12:49:54.244025+0000","last_became_peered":"2024-04-26T12:49:54.244025+0000","last_unstale":"2024-04-26T12:53:52.257555+0000","last_undegraded":"2024-04-26T12:53:52.257555+0000","last_fullsized":"2024-04-26T12:53:52.257555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:52.257248+0000","last_clean_scrub_stamp":"2024-04-26T12:53:52.257248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:36.650269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T12:53:47.154450+0000","last_change":"2024-04-26T12:53:47.154450+0000","last_active":"2024-04-26T12:53:47.154450+0000","last_peered":"2024-04-26T12:53:47.154450+0000","last_clean":"2024-04-26T12:53:47.154450+0000","last_became_active":"2024-04-26T12:49:56.232549+0000","last_became_peered":"2024-04-26T12:49:56.232549+0000","last_unstale":"2024-04-26T12:53:47.154450+0000","last_undegraded":"2024-04-26T12:53:47.154450+0000","last_fullsized":"2024-04-26T12:53:47.154450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-04-26T12:53:47.154181+0000","last_clean_scrub_stamp":"2024-04-26T12:53:47.154181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:47.175281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":153627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640324,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1015808,"data_stored":740708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640324,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1040384,"data_stored":740685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":458752,"data_stored":152990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:55:03.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:55:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.413+0000 7f5a8d00d640 1 Processor -- start 2024-04-26T12:55:03.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.413+0000 7f5a8d00d640 1 -- start start 2024-04-26T12:55:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a8d00d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a88099270 0x7f5a88099650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:55:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a8d00d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8808d110 con 0x7f5a88099b90 2024-04-26T12:55:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a8d00d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5a8808eb90 con 0x7f5a88099270 2024-04-26T12:55:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a86d9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a88099270 0x7f5a88099650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:55:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a8659c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5a88099b90 0x7f5a8806d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56424/0 (socket says 172.21.15.29:56424) 2024-04-26T12:55:03.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a8659c640 1 -- 172.21.15.29:0/3300046208 learned_addr learned my addr 172.21.15.29:0/3300046208 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-26T12:55:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a85d9b640 1 -- 172.21.15.29:0/3300046208 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458520188 0 0) 0x7f5a8808d110 con 0x7f5a88099b90 2024-04-26T12:55:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a85d9b640 1 -- 172.21.15.29:0/3300046208 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a70003530 con 0x7f5a88099b90 2024-04-26T12:55:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a86d9d640 1 -- 172.21.15.29:0/3300046208 >> v1:172.21.15.29:6789/0 conn(0x7f5a88099b90 legacy=0x7f5a8806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a86d9d640 1 -- 172.21.15.29:0/3300046208 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8806f1b0 con 0x7f5a88099270 2024-04-26T12:55:03.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a86d9d640 1 --2- 172.21.15.29:0/3300046208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a88099650 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009740 tx=0x7f5a7801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d8bac74c3b74e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:55:03.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a85d9b640 1 -- 172.21.15.29:0/3300046208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a780b1070 con 0x7f5a88099270 2024-04-26T12:55:03.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a85d9b640 1 -- 172.21.15.29:0/3300046208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a780ac520 con 0x7f5a88099270 2024-04-26T12:55:03.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a85d9b640 1 -- 172.21.15.29:0/3300046208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a780ac800 con 0x7f5a88099270 2024-04-26T12:55:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a8d00d640 1 -- 172.21.15.29:0/3300046208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 msgr2=0x7f5a88099650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.417+0000 7f5a8d00d640 1 --2- 172.21.15.29:0/3300046208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a88099650 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009740 tx=0x7f5a7801c370 comp rx=0 tx=0).stop 2024-04-26T12:55:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- 172.21.15.29:0/3300046208 shutdown_connections 2024-04-26T12:55:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 --2- 172.21.15.29:0/3300046208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a88099650 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:55:03.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- 172.21.15.29:0/3300046208 >> 172.21.15.29:0/3300046208 conn(0x7f5a8809c490 msgr2=0x7f5a8809c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:55:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- 172.21.15.29:0/3300046208 shutdown_connections 2024-04-26T12:55:03.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- 172.21.15.29:0/3300046208 wait complete. 2024-04-26T12:55:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 Processor -- start 2024-04-26T12:55:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- start start 2024-04-26T12:55:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a881325d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:55:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5a88131950 con 0x7f5a88099270 2024-04-26T12:55:03.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a86d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a881325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a86d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a881325d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51956/0 (socket says 172.21.15.29:51956) 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a86d9d640 1 -- 172.21.15.29:0/2120686643 learned_addr learned my addr 172.21.15.29:0/2120686643 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a86d9d640 1 -- 172.21.15.29:0/2120686643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a88131370 con 0x7f5a88099270 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a86d9d640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a881325d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5a78019fa0 tx=0x7f5a78019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a780b9020 con 0x7f5a88099270 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a780ac800 con 0x7f5a88099270 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a780b1040 con 0x7f5a88099270 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a88130860 con 0x7f5a88099270 2024-04-26T12:55:03.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a88133ae0 con 0x7f5a88099270 2024-04-26T12:55:03.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5a780bc020 con 0x7f5a88099270 2024-04-26T12:55:03.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a88062f80 con 0x7f5a88099270 2024-04-26T12:55:03.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a6f7fe640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a74035db0 0x7f5a74038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:55:03.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6284+0+0 (secure 0 0 0) 0x7f5a780e2cf0 con 0x7f5a88099270 2024-04-26T12:55:03.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.421+0000 7f5a8659c640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a74035db0 0x7f5a74038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:55:03.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.425+0000 7f5a8659c640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a74035db0 0x7f5a74038270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c000f70 tx=0x7f5a7c0010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:55:03.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.429+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5a780e9080 con 0x7f5a88099270 2024-04-26T12:55:03.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.589+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5a8806c2f0 con 0x7f5a88099270 2024-04-26T12:55:03.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f5a780c3030 con 0x7f5a88099270 2024-04-26T12:55:03.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a6f7fe640 1 -- 172.21.15.29:0/2120686643 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5a780ac4f0 con 0x7f5a88099270 2024-04-26T12:55:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a74035db0 msgr2=0x7f5a74038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a74035db0 0x7f5a74038270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c000f70 tx=0x7f5a7c0010b0 comp rx=0 tx=0).stop 2024-04-26T12:55:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 msgr2=0x7f5a881325d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:55:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a881325d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5a78019fa0 tx=0x7f5a78019110 comp rx=0 tx=0).stop 2024-04-26T12:55:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 shutdown_connections 2024-04-26T12:55:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.72:6824/3729194001,v1:172.21.15.72:6825/3729194001] conn(0x7f5a74035db0 0x7f5a74038270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:55:03.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 --2- 172.21.15.29:0/2120686643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a88099270 0x7f5a881325d0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:55:03.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.593+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 >> 172.21.15.29:0/2120686643 conn(0x7f5a8809c490 msgr2=0x7f5a88098250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:55:03.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.597+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 shutdown_connections 2024-04-26T12:55:03.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T12:55:03.597+0000 7f5a8d00d640 1 -- 172.21.15.29:0/2120686643 wait complete. 2024-04-26T12:55:03.613 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:55:03.613 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:55:03.614 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:55:03.614 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:55:03.695 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:55:03.695 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:55:03.695 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:55:03.788 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:55:03.788 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:55:03.788 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:55:08.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-26T12:55:09.890 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:55:09.891 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T12:55:09.891 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:55:09.967 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T12:55:09.967 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:55:09.968 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:55:09.968 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:55:09.998 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:55:09.998 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:55:09.998 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:55:09.998 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:55:10.017 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:55:10.017 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:55:10.018 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-26T12:55:10.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T12:55:10.076 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:55:10.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:55:10.405 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:55:10.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:55:10.715 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:55:10.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:55:10.902 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T12:55:11.077 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:55:11.079 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/data/mon.a.tgz 2024-04-26T12:55:11.079 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T12:55:11.085 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.jsIRMuJKXp 2024-04-26T12:55:11.085 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jsIRMuJKXp 2024-04-26T12:55:11.218 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.jsIRMuJKXp 2024-04-26T12:55:11.281 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.jsIRMuJKXp is 280KB 2024-04-26T12:55:11.343 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.jsIRMuJKXp 2024-04-26T12:55:11.348 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:55:11.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:55:11.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:55:11.454 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T12:55:11.460 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T12:55:11.460 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:55:11.461 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/remote/smithi029/crash 2024-04-26T12:55:11.462 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:55:11.510 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/remote/smithi072/crash 2024-04-26T12:55:11.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:55:11.524 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:55:11.524 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T12:55:11.554 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T12:55:11.582 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20176.log 2024-04-26T12:55:11.583 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23508.log 2024-04-26T12:55:11.584 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22664.log 2024-04-26T12:55:11.585 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.tmp-client.admin.20176.log: gzip/var/log/ceph/ceph-client.admin.23508.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22876.log 2024-04-26T12:55:11.585 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20176.log.gz 2024-04-26T12:55:11.585 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22664.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23508.log.gz 2024-04-26T12:55:11.585 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23210.log 2024-04-26T12:55:11.585 INFO:teuthology.orchestra.run.smithi029.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.22664.log.gz 2024-04-26T12:55:11.587 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23750.log 2024-04-26T12:55:11.587 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23210.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22876.log.gz 2024-04-26T12:55:11.587 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23430.log 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23210.log.gz 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23750.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23750.log.gz 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22883.log 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23430.log.gz 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21545.log 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23456.log 2024-04-26T12:55:11.588 INFO:teuthology.orchestra.run.smithi029.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.22883.log.gz 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23696.log 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.21545.log: /var/log/ceph/ceph-client.admin.23456.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.21545.log.gz 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23456.log.gz 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23640.log 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23696.log.gz 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22638.log 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.23640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23236.log 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21502.log 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23640.log.gz 2024-04-26T12:55:11.591 INFO:teuthology.orchestra.run.smithi029.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.22638.log.gz 2024-04-26T12:55:11.592 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23300.log 2024-04-26T12:55:11.592 INFO:teuthology.orchestra.run.smithi029.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23236.log.gz 2024-04-26T12:55:11.592 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.21502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22779.log 2024-04-26T12:55:11.592 INFO:teuthology.orchestra.run.smithi029.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.21502.log.gz 2024-04-26T12:55:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41448.log 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23586.log 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23300.log.gz 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22778.log 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.22779.log.gz 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22875.log 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23586.log.gz 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22716.log 2024-04-26T12:55:11.611 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22778.log: /var/log/ceph/ceph-client.admin.22875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23326.log 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22875.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.22778.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23668.log 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22716.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22976.log 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23326.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22742.log 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23668.log: /var/log/ceph/ceph-client.admin.22976.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23668.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23534.log 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.22976.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22690.log 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.22742.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23184.log 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23534.log.gz 2024-04-26T12:55:11.612 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22984.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22690.log: /var/log/ceph/ceph-client.admin.23184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23091.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.22690.log.gz 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.23184.log.gz 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22984.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22984.log.gz 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23092.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23091.log.gz 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose --/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.23352.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23084.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23092.log.gz 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23008.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23352.log.gz 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21432.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23084.log.gz 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23008.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T12:55:11.613 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23008.log.gz 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.21432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22980.log 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.21432.log.gz 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23726.log 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-client.admin.22980.log: 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22575.log 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.22980.log.gz 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23274.log 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23726.log: /var/log/ceph/ceph-client.admin.22575.log: 86.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.23726.log.gz 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23080.log 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22575.log.gz 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22884.log 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23274.log.gz 2024-04-26T12:55:11.614 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23482.log 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23080.log.gz 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22613.log 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22884.log: /var/log/ceph/ceph-client.admin.23482.log: gzip -5 --verbose -- 86.3% /var/log/ceph/ceph-client.admin.23612.log 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22884.log.gz 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22613.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23482.log.gz 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23378.log 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.22613.log.gz 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23560.log 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23612.log.gz 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23404.log 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23378.log: /var/log/ceph/ceph-client.admin.23560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22772.log 2024-04-26T12:55:11.615 INFO:teuthology.orchestra.run.smithi029.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23378.log.gz 2024-04-26T12:55:11.616 INFO:teuthology.orchestra.run.smithi029.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23560.log.gz 2024-04-26T12:55:11.616 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.23404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22780.log 2024-04-26T12:55:11.616 INFO:teuthology.orchestra.run.smithi029.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.23404.log.gz 2024-04-26T12:55:11.616 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.22772.log: /var/log/ceph/ceph-client.admin.22780.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.22772.log.gz 2024-04-26T12:55:11.616 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.22780.log.gz 2024-04-26T12:55:11.632 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74488.log 2024-04-26T12:55:11.632 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.41448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32014.log 2024-04-26T12:55:11.632 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.74488.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-26T12:55:11.632 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28348.log 2024-04-26T12:55:11.632 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41448.log.gz 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.32014.log: /var/log/ceph/rgw.ceph.client.0.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74488.log.gz 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52658.log 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.28348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86848.log 85.7% 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28348.log.gz 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.32014.log.gz 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.52658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52068.log 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.86848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43218.log 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.52068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34368.log 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52658.log.gz 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:gzip 91.3% -5 -- replaced with /var/log/ceph/ceph-client.0.86848.log.gz --verbose 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr: -- /var/log/ceph/ceph-client.admin.23849.log 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.43218.log: /var/log/ceph/ceph-client.0.34368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66818.log 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.23849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23873.log 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23849.log.gz 2024-04-26T12:55:11.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.66818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59148.log 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.23873.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.34368.log.gz 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66228.log 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23873.log.gz 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.52068.log.gz 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.59148.log: 91.3%gzip -- replaced with /var/log/ceph/ceph-client.0.43218.log.gz -5 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28396.log 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.66228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70358.log 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66818.log.gz 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.28396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23921.log 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.70358.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28396.log.gz 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66228.log.gz 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67408.log 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59148.log.gz 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.23921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46758.log 2024-04-26T12:55:11.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.67408.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.23921.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67998.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.70358.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.46758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37318.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.67408.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.67998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55018.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.37318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77426.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.55018.log: 92.2% -- replaced with /var/log/ceph/ceph-client.0.46758.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53838.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.77426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56788.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.67998.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.53838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38498.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77426.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37318.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.56788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78010.log 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.55018.log.gz 2024-04-26T12:55:11.635 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.38498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80358.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.78010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23897.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.80358.log: gzip 91.4% -- replaced with /var/log/ceph/ceph-client.0.53838.log.gz -5 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78010.log.gz 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56788.log.gz 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.23897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39088.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.23897.log.gz 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38498.log.gz 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83308.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.2.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80358.log.gz 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.39088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65638.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68588.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.83308.log: /var/log/ceph/ceph-client.0.65638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28324.log 2024-04-26T12:55:11.636 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.39088.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.68588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44988.log 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.28324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64458.log 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.44988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59738.log 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83308.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28324.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65638.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.64458.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68588.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.44988.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64458.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78594.log 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.59738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60918.log 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.78594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75078.log 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.60918.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78594.log.gz 2024-04-26T12:55:11.637 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32598.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49118.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.75078.log: /var/log/ceph/ceph-client.0.32598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53248.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.59738.log.gz 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.49118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71538.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69768.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.53248.log: /var/log/ceph/ceph-client.0.71538.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.32598.log.gz 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.49118.log.gz 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75078.log.gz 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53248.log.gz 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.60918.log.gz 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71538.log.gz 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76842.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.69768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51478.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.76842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60328.log 2024-04-26T12:55:11.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.51478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37908.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76842.log.gz 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.60328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82718.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69768.log.gz 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.37908.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.82718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46168.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.3.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51478.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.63278.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.46168.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37908.log.gz 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82718.log.gz 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.60328.log.gz 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46168.log.gz 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47348.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.63278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44398.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.47348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87444.log 2024-04-26T12:55:11.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.44398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73308.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.87444.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63278.log.gz 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28300.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62688.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47348.log.gz 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.28300.log: /var/log/ceph/ceph-client.0.73308.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44398.log.gz 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28300.log.gz 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62098.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.62688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31424.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.62098.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.31424.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62688.log.gz 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73308.log.gz 93.4% -- replaced with /var/log/ceph/ceph-client.0.87444.log.gz 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48528.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49708.log 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.0.62098.log.gz 2024-04-26T12:55:11.640 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.31424.log.gz 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.48528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63868.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.49708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36728.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.63868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33188.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.36728.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48528.log.gz 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49708.log.gz 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72128.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.33188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83898.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.72128.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36728.log.gz 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.63868.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.50298.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.33188.log.gz 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.83898.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72128.log.gz 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76258.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80948.log 2024-04-26T12:55:11.641 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.50298.log: /var/log/ceph/ceph-client.0.76258.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T12:55:11.642 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.80948.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83898.log.gz 2024-04-26T12:55:11.642 INFO:teuthology.orchestra.run.smithi072.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.76258.log.gz 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.50298.log.gz 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.80948.log.gz 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29654.log 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84488.log 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.29654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34958.log 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.84488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70948.log 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.34958.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.29654.log.gz 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84488.log.gz 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40858.log 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.0.34958.log.gz 2024-04-26T12:55:11.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.70948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55608.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45578.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.40858.log: /var/log/ceph/ceph-client.0.55608.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.40858.log.gz 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.70948.log.gz 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55608.log.gz 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81538.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54428.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.45578.log: /var/log/ceph/ceph-client.0.81538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42038.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.54428.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45578.log.gz 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81538.log.gz 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65048.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.54428.log.gz 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35548.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.42038.log: /var/log/ceph/ceph-client.0.65048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29064.log 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.35548.log: 91.3% 91.3% -- replaced with /var/log/ceph/ceph-client.0.65048.log.gz 2024-04-26T12:55:11.650 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.0.42038.log.gz 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79768.log 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.29064.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3%/var/log/ceph/ceph-client.0.79768.log: -- replaced with /var/log/ceph/ceph-client.0.35548.log.gz 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.29064.log.gz 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61508.log 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.79768.log.gz 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39678.log 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79178.log 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.61508.log: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.39678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43808.log 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.79178.log: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-26T12:55:11.651 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85668.log 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.43808.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39678.log.gz 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% 92.7% -- replaced with /var/log/ceph/ceph-client.0.79178.log.gz 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.0.61508.log.gz 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:gzip 91.2% -- replaced with /var/log/ceph/ceph-client.0.43808.log.gz -5 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr: --verbose -- /var/log/ceph/ceph-client.0.85078.log 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.85668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30834.log 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.85078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57968.log 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28372.log 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.30834.log: /var/log/ceph/ceph-client.0.57968.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85668.log.gz 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.85078.log.gz 2024-04-26T12:55:11.655 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72718.log 2024-04-26T12:55:11.656 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40268.log 2024-04-26T12:55:11.656 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.28372.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30834.log.gz/var/log/ceph/ceph-client.0.72718.log: 2024-04-26T12:55:11.656 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.57968.log.gz 2024-04-26T12:55:11.656 INFO:teuthology.orchestra.run.smithi072.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28372.log.gz 2024-04-26T12:55:11.656 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58558.log 2024-04-26T12:55:11.656 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.40268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36138.log 2024-04-26T12:55:11.656 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.58558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56198.log 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.36138.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.72718.log.gz 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40268.log.gz 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86258.log 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.56198.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.58558.log.gz 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42628.log 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36138.log.gz 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.86258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47938.log 2024-04-26T12:55:11.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73898.log 2024-04-26T12:55:11.660 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.47938.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.86258.log.gz 2024-04-26T12:55:11.660 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.56198.log.gz 2024-04-26T12:55:11.660 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75668.log 2024-04-26T12:55:11.660 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42628.log.gz 2024-04-26T12:55:11.660 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50888.log 2024-04-26T12:55:11.660 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.73898.log: /var/log/ceph/ceph-client.0.75668.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.47938.log.gz 2024-04-26T12:55:11.661 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75668.log.gz 2024-04-26T12:55:11.661 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3%gzip -- replaced with /var/log/ceph/ceph-client.0.73898.log.gz 2024-04-26T12:55:11.661 INFO:teuthology.orchestra.run.smithi072.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.30244.log 2024-04-26T12:55:11.661 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.50888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82128.log 2024-04-26T12:55:11.661 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.30244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69178.log 2024-04-26T12:55:11.662 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.82128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33778.log 2024-04-26T12:55:11.662 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4%/var/log/ceph/ceph-client.0.69178.log: -- replaced with /var/log/ceph/ceph-client.0.50888.log.gz 2024-04-26T12:55:11.663 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57378.log 2024-04-26T12:55:11.663 INFO:teuthology.orchestra.run.smithi072.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30244.log.gz 2024-04-26T12:55:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.33778.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82128.log.gz 2024-04-26T12:55:11.665 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69178.log.gz 2024-04-26T12:55:11.665 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.57378.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.33778.log.gz 2024-04-26T12:55:11.666 INFO:teuthology.orchestra.run.smithi072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57378.log.gz 2024-04-26T12:55:11.687 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T12:55:11.801 INFO:teuthology.orchestra.run.smithi029.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T12:55:12.469 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T12:55:12.622 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T12:55:12.692 INFO:teuthology.orchestra.run.smithi029.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T12:55:12.695 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-26T12:55:12.695 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m1.138s 2024-04-26T12:55:12.695 INFO:teuthology.orchestra.run.smithi029.stderr:user 0m1.315s 2024-04-26T12:55:12.695 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m0.090s 2024-04-26T12:55:12.696 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T12:55:12.697 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-04-26T12:55:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m1.123s 2024-04-26T12:55:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m3.129s 2024-04-26T12:55:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m0.191s 2024-04-26T12:55:12.697 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:55:12.697 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/remote/smithi029/log 2024-04-26T12:55:12.699 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:55:12.949 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/remote/smithi072/log 2024-04-26T12:55:12.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:55:13.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-26T12:55:13.447 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:55:13.459 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:55:13.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:55:13.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:55:13.522 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:55:13.532 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:55:13.532 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:55:13.534 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:55:13.543 INFO:teuthology.orchestra.run.smithi029.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:55:13.544 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================== 2024-04-26T12:55:13.544 INFO:teuthology.orchestra.run.smithi029.stdout:+hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.080 -2.588 0.841 2024-04-26T12:55:13.544 INFO:teuthology.orchestra.run.smithi029.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 377 0.068 -0.038 0.775 2024-04-26T12:55:13.544 INFO:teuthology.orchestra.run.smithi029.stdout:*hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.062 -1.254 1.286 2024-04-26T12:55:13.544 INFO:teuthology.orchestra.run.smithi029.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:55:13.546 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:55:13.547 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-04-26T12:55:13.547 INFO:teuthology.orchestra.run.smithi072.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.064 -2.095 1.097 2024-04-26T12:55:13.547 INFO:teuthology.orchestra.run.smithi072.stdout:*hv02.front.sepi 63.231.80.2 3 u 31 64 377 0.084 -2.156 1.866 2024-04-26T12:55:13.547 INFO:teuthology.orchestra.run.smithi072.stdout:+hv03.front.sepi 74.6.168.72 3 u 28 64 377 0.064 -2.240 1.715 2024-04-26T12:55:13.547 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:55:13.548 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:55:13.557 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:55:13.558 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:55:13.578 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:55:13.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:55:13.596 INFO:teuthology.task.internal:Duration was 936.765056 seconds 2024-04-26T12:55:13.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:55:13.606 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:55:13.606 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:55:13.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:55:13.645 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:55:13.646 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T12:55:13.646 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:55:13.698 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T12:55:13.698 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:55:13.708 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:55:13.708 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:55:13.746 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:55:13.779 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:55:13.779 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:55:13.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:55:13.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:55:13.886 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:55:13.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:55:13.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:55:13.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:55:13.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:55:13.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:55:13.949 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-04-26T12:55:13.960 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-04-26T12:55:13.984 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:55:14.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:55:14.008 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:55:14.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:55:14.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:55:14.042 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:55:14.043 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/remote/smithi029 2024-04-26T12:55:14.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:55:14.073 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674722/remote/smithi072 2024-04-26T12:55:14.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:55:14.095 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:55:14.095 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:55:14.114 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:55:14.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:55:14.151 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:55:14.152 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:55:14.162 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:55:14.162 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:55:14.165 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:55:14.168 INFO:teuthology.orchestra.run.smithi029.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:55 /home/ubuntu/cephtest 2024-04-26T12:55:14.188 INFO:teuthology.orchestra.run.smithi072.stdout: 658643 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:55 /home/ubuntu/cephtest 2024-04-26T12:55:14.189 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:55:14.200 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:55:14.224 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} duration: 936.7650563716888 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-04-26T12:55:14.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:55:14.316 INFO:teuthology.run:pass